-- Logs begin at Tue 2022-07-26 17:30:15 UTC, end at Tue 2022-07-26 19:19:00 UTC. -- Jul 26 18:19:46.410331 dv-cinder-825492-31-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 18:19:46.419545 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 18:19:46.421623 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 18:19:46 2022] *** Jul 26 18:19:46.421623 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 18:19:46.421623 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 18:19:46.421623 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: nodename: dv-cinder-825492-31-iscsi Jul 26 18:19:46.421623 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: machine: x86_64 Jul 26 18:19:46.421623 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: clock source: unix Jul 26 18:19:46.421623 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: pcre jit disabled Jul 26 18:19:46.421623 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: detected number of CPU cores: 4 Jul 26 18:19:46.421623 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: current working directory: / Jul 26 18:19:46.421623 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: detected binary path: /usr/bin/uwsgi-core Jul 26 18:19:46.421623 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: your processes number limit is 47680 Jul 26 18:19:46.421623 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: your memory page size is 4096 bytes Jul 26 18:19:46.422338 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: detected max file descriptor number: 2048 Jul 26 18:19:46.422338 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: lock engine: pthread robust mutexes Jul 26 18:19:46.422338 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: thunder lock: enabled Jul 26 18:19:46.422338 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 18:19:46.422338 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 18:19:46.460378 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: Python main interpreter initialized at 0x557ef720d9c0 Jul 26 18:19:46.460378 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: python threads support enabled Jul 26 18:19:46.460378 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: your server socket listen backlog is limited to 100 connections Jul 26 18:19:46.460378 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: your mercy for graceful operations on workers is 90 seconds Jul 26 18:19:46.460811 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 18:19:46.460811 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: *** Operational MODE: preforking *** Jul 26 18:19:46.461108 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: *** uWSGI is running in multiple interpreter mode *** Jul 26 18:19:46.461108 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: spawned uWSGI master process (pid: 103265) Jul 26 18:19:46.461505 dv-cinder-825492-31-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 18:19:46.461929 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: spawned uWSGI worker 1 (pid: 103266, cores: 1) Jul 26 18:19:46.463127 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: spawned uWSGI worker 2 (pid: 103267, cores: 1) Jul 26 18:19:46.463127 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 18:19:47.119261 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 18:19:47.121542 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 18:19:48.201251 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 18:19:48.201251 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: from cryptography.utils import int_from_bytes Jul 26 18:19:48.201872 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 18:19:48.201872 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: from cryptography.utils import int_from_bytes Jul 26 18:19:48.203282 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 18:19:48.203282 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: from cryptography.utils import int_from_bytes Jul 26 18:19:48.203753 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 18:19:48.203753 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: from cryptography.utils import int_from_bytes Jul 26 18:19:50.671766 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 18:19:50.672500 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 18:19:50.672836 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 18:19:50.672915 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 18:19:50.672993 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 18:19:50.673072 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 18:19:50.673145 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 18:19:50.673222 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 18:19:50.673302 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 18:19:50.673374 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 18:19:50.673596 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.673696 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.673942 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.674073 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.674214 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.674318 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.674555 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.674697 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.674849 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.674945 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.675213 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.675392 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.675536 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.675671 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.675803 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.675893 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.676131 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.676263 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.676346 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.676455 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.676679 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.676813 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.676969 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-31-iscsi {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.677091 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-31-iscsi {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.677278 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.677372 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.677593 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.677693 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.677893 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.677991 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.678210 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.678306 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.678507 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.678614 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.678845 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.678946 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.679206 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.679309 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.679686 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.679804 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.680094 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.681113 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.681113 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.681298 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.681383 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.681462 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.681530 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.681600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.681675 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.681740 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.681817 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.681884 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.681948 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.682011 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.682174 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.682270 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.682475 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.682603 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.682793 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.682923 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.683190 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-31-iscsi {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.683342 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-31-iscsi {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.683500 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.683627 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.683778 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.683928 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.684112 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.684239 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.684491 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.684667 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.684821 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.684938 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.685102 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.685230 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.685400 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.685548 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.685730 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.685855 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.686016 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.686119 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.686330 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.686452 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.686643 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.686729 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.686957 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.687097 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.687296 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.687391 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.687638 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.687744 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.687889 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.687977 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.688189 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.688287 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.688496 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.688584 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.688793 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.688917 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.689091 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.689183 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.689334 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.689428 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.689637 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.689740 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.689947 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.690033 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.690261 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.690361 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.690575 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.690671 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.690820 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.690908 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.691088 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.691192 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.691403 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.691533 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.691721 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.691814 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.692021 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.692114 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.692318 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.692403 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.692617 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.692709 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.692914 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.693001 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.693212 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.693304 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.693508 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.693606 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.693805 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.693891 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.694101 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.694193 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.694488 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.694589 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.694806 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.694892 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.695141 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.695229 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.695446 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.695548 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.695760 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.695856 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.696149 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.696243 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.696394 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.696491 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.696693 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.696780 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.697023 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.697109 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.697333 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.697430 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.697637 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.697745 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.697950 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.698047 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.698260 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.698347 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.698558 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.698645 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.698858 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.698957 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.699182 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.699270 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.699495 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.699582 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.699824 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.699929 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.700120 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.700217 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.700364 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.700450 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.700659 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.700828 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.700957 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.701045 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.701271 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.701356 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.701568 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.701667 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.701871 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.701966 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.702169 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.702259 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.702462 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.702561 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.702762 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.702847 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.703084 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.703184 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.703384 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.703481 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.704296 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.704410 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.704488 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.704576 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.704657 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.704749 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.704828 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.704905 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.705030 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.705192 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.705282 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.705365 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.705442 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.705525 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.705715 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.705801 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.706012 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.706099 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.706310 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.706394 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.706606 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.706703 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.706905 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.706999 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.707249 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.707338 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.707547 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.707639 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.707844 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.707952 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.708159 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.708262 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.708456 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.708545 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.708753 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.708839 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.709062 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.709160 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.709362 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.709456 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.709738 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.709862 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.710016 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.710113 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.710287 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.710382 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.710587 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.710679 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.710900 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.710985 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.711222 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.711310 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.711523 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.711610 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.711824 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.711909 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.712118 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.712211 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.712415 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.712502 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.712713 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.712814 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.713010 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.713107 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.713304 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.713403 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.713597 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.713691 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.714363 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.714482 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.714564 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.714643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.714728 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.714807 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.714883 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.714971 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.715086 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.715249 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.715462 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.715550 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:19:50.715810 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.716002 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.716136 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.716229 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.716471 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.716553 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.716780 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.716866 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.717106 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.717202 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.717432 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.717517 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.717744 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.717830 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.718049 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.718157 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.718357 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.718462 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.718672 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.718758 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.718978 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.719093 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.719375 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.719488 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.719610 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.719700 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.719919 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.720005 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.720234 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.720360 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.720551 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.720643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.720858 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.720944 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.721168 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.721341 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.721478 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.721564 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.721789 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.721916 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.722096 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.722258 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.722412 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.722594 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.722725 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.723085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.723181 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.723385 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.723474 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.723722 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.723814 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.724025 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.724132 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.724341 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.724507 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.724656 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.724864 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.724957 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.725237 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.725331 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.725557 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.725676 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.725955 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.726042 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.726272 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.726359 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.726586 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.726679 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.726895 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.726980 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.727224 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.727319 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.727529 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.727615 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.727835 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.727921 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.728138 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.728225 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.728443 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.728540 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.728752 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.728847 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.729065 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.729157 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.729376 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.729469 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.729681 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.729780 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.729992 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.730077 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.730302 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.730407 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.730607 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.730703 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.730910 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.730996 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.731230 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.731339 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.731526 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.731620 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.731828 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.731920 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.732133 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.732220 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.732432 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.732531 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.732740 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.732824 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.733043 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.733135 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.733345 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.733438 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.733669 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.733761 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.733966 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.734052 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.734268 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.734367 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.734572 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.734665 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.734878 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.734963 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.735205 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.735306 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.735511 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.735597 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.735815 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.735900 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.736109 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.736195 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.736423 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.736513 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.736723 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.736816 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.737021 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.737108 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.737336 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.737422 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.737635 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.737733 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.737930 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.738022 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.738234 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.738327 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.738536 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.738640 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.738838 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.738923 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.739167 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.739255 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.739479 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.739565 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.739790 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.739881 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.740094 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.740180 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.740403 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.740501 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.740714 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.740801 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.741450 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.741530 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.741530 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.741667 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.741733 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.741799 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.741970 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.742048 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.742277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.742355 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.742575 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.742650 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.742880 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.742966 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.743205 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.743294 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.743503 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.743579 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.743800 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.743886 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.744102 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.744179 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.744397 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.744472 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.744693 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.744778 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.744992 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.745088 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.745287 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.745363 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.745581 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.745666 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.746021 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.746110 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.746178 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.746250 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.746479 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.746583 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.746760 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.746848 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.747077 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.747180 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.747380 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.747465 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.747682 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.747768 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.748022 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.748116 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.748325 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.748411 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.748648 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.748750 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.748962 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.749056 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.749268 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.749355 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.749576 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.749670 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.749880 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.750058 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.750208 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.750300 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.750515 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.750629 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.750779 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.750873 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.751146 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.751296 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.751758 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.751864 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.752053 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.752185 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.752315 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.752453 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.752582 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.752738 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.752836 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.752949 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.753082 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.753243 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.753334 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.753465 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.753608 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.753742 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.753912 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.754077 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.754218 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.754362 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.754504 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.754637 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.754773 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.754907 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.755116 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.755259 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.755394 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.755528 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.755615 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.755768 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.755895 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.756084 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.756196 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.756395 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.756481 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.756703 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.756818 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.757095 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.757183 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.757409 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.757494 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.757727 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.757812 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.758038 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.758125 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.758355 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.758449 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.758662 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.758761 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.758955 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.759066 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.759289 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.759391 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.759610 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.759706 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.759910 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.759995 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.760223 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.760308 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.760529 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.760647 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.760844 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.760982 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.761144 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.761231 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.761445 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.761542 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.761827 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.761926 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.762056 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.762179 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.762355 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.762443 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.762658 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.762744 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.762962 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.763122 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.763289 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.763377 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.763593 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.763696 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.763891 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.763985 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.764196 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.764289 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.764495 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.764579 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.764792 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.764877 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.765087 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.765170 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.765386 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.765475 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.765689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.765790 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.765988 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.766074 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.766293 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.766379 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.766602 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.766708 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.766898 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.766983 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.767224 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.767327 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.767542 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.767636 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.767847 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.767934 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.768146 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.768230 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.768445 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.768540 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.768742 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.768829 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.769044 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.769128 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.769350 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.769444 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.769647 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.769733 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.769956 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.770042 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.770271 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.770358 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.770573 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.770665 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.770912 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.771048 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.771204 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.771294 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.771509 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.771596 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.771820 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.771918 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.772133 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.772229 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.772449 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.772538 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.772755 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.772841 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.773057 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.773144 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.773358 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.773444 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.773660 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.773755 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.773967 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.774053 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.774266 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.774395 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.774569 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.774715 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.774871 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.775056 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.775195 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.775372 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.775479 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.775684 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.775797 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.775993 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.776656 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.776748 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.776967 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.777062 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.777289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.777375 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.777653 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.777870 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.777965 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.778207 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.778293 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.778523 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.778609 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.778845 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.779011 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.779197 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.779286 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.779506 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.779601 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.779811 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.779898 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.780110 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.780205 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.780407 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.780501 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.780710 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.780806 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.781400 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.781506 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.781578 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.781646 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.781711 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.781776 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.781880 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.781966 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.782209 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.782298 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.782471 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.782549 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.782769 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.782855 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.783091 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.783174 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.783402 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.783493 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.783702 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.783788 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.786114 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.786240 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.786328 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.786409 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.786538 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.786631 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.786713 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.786792 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.786870 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.786948 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.787105 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.787202 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.787283 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.787362 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.787440 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.787523 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.787610 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.787697 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.787776 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.787864 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.787864 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.788006 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.788006 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.788229 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.788309 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.788386 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.788464 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.788550 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.788630 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.788697 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.788761 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.788826 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.788910 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.788992 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.789142 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.789285 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.789442 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.789598 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.789749 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.789945 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.790015 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.790168 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.790316 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.790472 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.790615 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.790786 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.790917 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.791116 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.791241 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.791419 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.791537 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.791730 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.791829 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.792035 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.792122 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.792346 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.792458 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.792651 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.792747 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.792952 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.793038 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.793246 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.793342 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.793545 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.793632 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.794329 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.794435 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.794527 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.794616 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.794696 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.794781 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.794870 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.794939 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.795060 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.795144 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.795302 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.795401 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.795601 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.795696 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.795894 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.795990 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.796196 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.796282 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.796496 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.796592 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.796788 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.796884 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.797085 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.797171 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.797387 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.797482 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.797681 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.797773 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.797975 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.798061 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.798272 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.798379 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.798563 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.798649 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.798856 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.798943 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.799180 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.799284 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.799494 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.799580 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.799797 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.799882 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.800090 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.800193 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.800386 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.800473 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.800681 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.800766 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.800975 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.801062 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.801268 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.801361 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.801575 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.801663 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.801909 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.802009 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.802156 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.802242 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.802444 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.802543 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.802736 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.802832 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.803073 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.803163 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.803348 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.803434 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.803680 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.803797 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.804012 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.804146 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.804329 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.804438 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.804613 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.804708 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.804936 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.805030 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.805234 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.805338 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.805532 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.805613 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.805836 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.805940 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.806136 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.806232 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.806453 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.806538 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.806755 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.806841 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.807076 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.807180 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.807383 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.807477 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.807678 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.807765 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.807985 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.808081 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.808285 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.808378 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.808587 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.808675 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.808883 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.808970 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.809177 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.809265 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.809489 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.809582 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.809790 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.809878 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.810089 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.810176 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.810397 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.810481 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.810699 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.810785 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.811012 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.811113 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.811328 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.811416 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.811635 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.811736 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.811936 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.812035 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.812238 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.812350 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.812546 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.812643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.812828 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.812916 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.813128 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.813229 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.813429 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.813518 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.813740 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.813827 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.814039 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.814133 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.814338 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.814440 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.814637 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.814731 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.814937 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.815065 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.815262 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.815349 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.815558 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.815657 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.815866 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.815958 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.816164 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.816252 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.816458 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.816543 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.816775 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.816870 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.817056 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.817150 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.817358 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.817444 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.817652 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.817740 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.817955 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.818086 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.818264 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.818387 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.818568 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.818687 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.818878 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.818971 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.819208 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.819336 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.819621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.819712 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.819981 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.820081 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.820334 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.820451 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.820546 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.820735 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.820831 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.820912 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.821162 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.821284 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.821445 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.821539 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.821795 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.821908 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.822059 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.822156 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.822353 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.822474 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.822649 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.822783 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.822957 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.823113 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.823285 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.823423 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.823586 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.823796 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.823908 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.824095 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.824182 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.824403 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.824498 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.824726 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.824831 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.825029 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.825152 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.825332 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.825456 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.825635 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.825753 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.825954 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.826162 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.826249 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.826466 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.826561 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.826770 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.826963 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.827125 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.827363 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.827475 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.827620 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.827743 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.827999 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.828087 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.828310 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.828397 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.828617 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.828705 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.828929 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.829036 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.829244 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.829331 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.829546 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.829633 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.829851 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.829939 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.830145 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.830232 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.830454 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.830555 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.830762 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.830849 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.831087 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.831182 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.831402 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.831507 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.831714 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.831800 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.832019 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.832106 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.832341 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.832452 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.832662 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.832772 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.832974 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.833072 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.833282 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.833389 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.833577 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.833692 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.833878 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.834014 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.834175 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.834325 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.834471 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.834647 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.834788 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.835038 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.835176 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.835351 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.835482 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.835698 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.835785 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.836013 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.836112 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.836356 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.836442 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.836652 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.836755 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.836966 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.837071 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.837261 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.837348 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.837572 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.837659 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.837878 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.837972 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.838187 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.838273 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.838492 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.838587 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.838787 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.838873 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.839125 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.839216 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.839427 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.839513 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.839722 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.839808 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.840019 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.840105 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.840315 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.840466 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.840648 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.840890 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.840985 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.841246 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.841332 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.841569 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.841664 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.841893 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.841980 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.842196 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.842308 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.842522 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.842610 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.842844 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.842941 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.843176 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.843273 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.843487 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.843576 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.843803 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.843889 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.844100 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.844195 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.844397 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.844506 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.844699 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.844847 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.844996 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.845151 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.845295 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.845480 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.845575 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.845797 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.845883 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.846118 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.846205 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.846441 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.846527 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.846737 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.846825 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.847058 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.847150 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.847358 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.847452 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.847673 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.847761 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.847975 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.848072 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.848271 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.848366 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.848568 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.848654 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.848862 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.848949 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.849185 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.849272 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.849480 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.849574 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.849800 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.849886 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.850103 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.850190 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.850416 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.850530 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.850751 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.850836 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.851081 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.851180 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.851391 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.851486 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.851694 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.851789 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.852002 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.852088 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.852325 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.852437 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.852616 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.852721 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.852922 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.853021 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.853223 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.853328 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.853525 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.853611 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.853826 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.853912 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.854131 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.854232 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.854436 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.854524 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.854742 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.854836 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.855088 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.855326 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.855414 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.855649 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.855741 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.855956 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.856053 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.856260 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.856354 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.856564 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.856651 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.856868 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.856962 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.857173 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.857260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.857476 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.857562 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.857783 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.858032 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.858120 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.858363 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.858458 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.858678 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.858778 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.858991 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.859100 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.859325 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.859414 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.859640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.859731 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.859944 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.860029 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.860251 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.860339 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.860559 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.860641 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.860882 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.861222 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.861222 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.861393 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.861488 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.861569 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.861843 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.861944 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.862090 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.862186 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.862399 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.862495 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.862715 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.862824 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.863011 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.863186 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.863346 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.863445 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.863638 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.863729 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.863944 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.864032 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.864251 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.864350 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.864548 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.864636 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.864856 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.864971 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.865184 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.865280 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.865501 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.865598 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.865825 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.865913 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.866152 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.866273 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.866505 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.866610 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.866820 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.866916 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.867151 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.867240 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.867463 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.867662 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.867776 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.867973 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.868091 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.868296 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.868415 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.868614 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.868748 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.868931 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.869075 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.869243 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.869390 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.869558 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.869704 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.869882 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.870018 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.870186 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.870481 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.870568 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.870785 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.870872 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.871111 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.871199 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.871411 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.871498 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.871731 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.871819 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.872034 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.872129 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.872331 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.872426 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.872643 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.872738 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.872943 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.873053 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.873319 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.873490 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.873627 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.873807 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.873934 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.874120 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.874234 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.874445 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.874541 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.874764 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.874858 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.875097 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.875278 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.875401 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.875607 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.875723 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.875919 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.876019 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.876308 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.876451 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.876617 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.876800 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.876919 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.877121 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.877209 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.877447 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.877533 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.877772 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.877867 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.878076 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.878170 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.878372 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.878458 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.878673 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.878773 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.878969 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.879067 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.879315 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.879413 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.879618 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.879721 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.879917 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.880012 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.880216 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.880303 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.880519 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.880606 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.880815 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.880903 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.881112 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.881199 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.881421 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.881521 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.881705 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.881810 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.882035 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.882122 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.882331 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.882419 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.882633 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.882728 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.882928 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.883015 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.883320 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.883420 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.883602 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.883700 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.883849 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.884014 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.884147 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.884233 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.884452 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.884540 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.884753 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.884847 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.885072 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.885169 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.885371 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.885465 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.885677 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.885772 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.885976 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.886078 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.886284 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.886370 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.886586 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.886689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.886890 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.886975 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.887247 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.887334 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.887586 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.887768 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.887892 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.888142 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.888243 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.888412 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.888513 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.888739 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.888826 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.889062 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.889148 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.889363 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.889463 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.889662 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.889749 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.889958 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.890051 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.891922 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.892095 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.892298 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.892384 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.892464 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.892464 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.892624 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.892706 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.892785 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.892870 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.892950 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.893028 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.893115 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.893195 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.893274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.893376 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.893458 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.893541 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.893629 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.893870 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.893951 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.894030 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.894109 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.894197 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.894278 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.894357 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.894435 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.894512 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.894591 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.894682 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.894814 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.894984 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.895165 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.895318 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.895476 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.895631 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.895786 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.895940 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.896094 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.896245 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.896404 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.896550 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.896712 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.896855 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.897020 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.897161 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.897327 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.897565 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.897698 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.897893 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.898039 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.898203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.898360 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.898505 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.898686 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.898927 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.899049 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.899260 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.899363 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.899576 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.899674 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.899889 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.899988 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.900195 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.900299 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.900509 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.900598 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.900821 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.900916 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.901502 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.901654 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.901812 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.901902 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.902119 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.902216 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.902438 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.902537 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.902771 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.902860 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.903130 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.903239 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.903449 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.903555 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.903750 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.903835 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.904047 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.904139 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.904347 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.904432 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.904653 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.904772 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.904962 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.905059 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.905263 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.905348 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.905556 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.905651 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.905851 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.905941 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.906152 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.906323 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.906439 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.906643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.906742 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.906951 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.907054 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.907282 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.907370 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.907591 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.907697 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.907884 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.907971 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.908178 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.908265 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.908474 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.908561 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.908765 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.908854 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.909060 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.909148 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.909354 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.909443 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.909655 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.909750 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.909949 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.910044 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.910245 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.910341 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.910538 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.910634 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.910833 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.910920 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.911148 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.911241 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.911451 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.911564 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.911761 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.911909 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.912059 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.912148 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.912365 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.912469 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.912664 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.912835 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.912974 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.913084 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.913300 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.913387 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.913603 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.913701 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.913905 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.913994 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.914210 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.914298 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.914512 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.914611 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.914844 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.914976 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.915168 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.915248 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.915476 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.915618 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.915779 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.915869 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.916082 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.916169 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.916387 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.916527 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.916692 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.916781 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.917030 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.917124 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.917327 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.917415 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.917625 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.917713 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.917931 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.918018 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.918240 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.918332 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.918557 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.918644 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.918863 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.918959 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.919202 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.919291 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.919518 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.919616 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.919819 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.919916 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.920128 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.920229 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.920434 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.920522 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.920740 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.920840 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.921066 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.921152 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.921361 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.921449 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.921670 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.921759 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.922039 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.922145 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.922286 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.922377 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.922594 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.922698 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.922915 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.923002 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.923248 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.923337 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.923554 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.923648 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.923860 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.923947 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.924170 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.924267 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.924479 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.924574 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.924795 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.924883 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.925105 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.925201 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.925416 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.925504 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.925732 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.925821 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.926035 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.926130 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.926335 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.926425 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.926574 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 18:19:50.926669 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.926968 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.927319 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.927644 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.927989 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.928301 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.928668 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.929030 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.929346 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.929658 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.929965 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:19:50.930209 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 18:19:51.082839 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO dbcounter [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] Registered counter for database nova_api Jul 26 18:19:51.085662 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO dbcounter [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Registered counter for database nova_api Jul 26 18:19:51.106387 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_db.sqlalchemy.engines [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:19:51.108228 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG oslo_db.sqlalchemy.engines [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:19:51.113941 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writer thread running {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:19:51.114921 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writer thread running {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:19:51.169568 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.context [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed53b5a3-56b8-4096-ad1b-6bf0519db1d4(cell1) {{(pid=103266) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 18:19:51.170134 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.context [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed53b5a3-56b8-4096-ad1b-6bf0519db1d4(cell1) {{(pid=103267) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 18:19:51.173678 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:19:51.174152 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG oslo_concurrency.lockutils [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:19:51.175221 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:19:51.175734 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG oslo_concurrency.lockutils [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:19:51.176006 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:19:51.176531 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG oslo_concurrency.lockutils [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:19:51.178038 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:19:51.178489 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG oslo_concurrency.lockutils [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:19:51.180223 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO dbcounter [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Registered counter for database nova_cell0 Jul 26 18:19:51.180530 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO dbcounter [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] Registered counter for database nova_cell0 Jul 26 18:19:51.186060 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO dbcounter [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Registered counter for database nova_cell1 Jul 26 18:19:51.186236 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO dbcounter [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] Registered counter for database nova_cell1 Jul 26 18:19:51.193309 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_db.sqlalchemy.engines [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:19:51.195653 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_db.sqlalchemy.engines [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:19:51.199299 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG oslo_db.sqlalchemy.engines [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:19:51.200333 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writer thread running {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:19:51.200676 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG oslo_db.sqlalchemy.engines [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:19:51.203132 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writer thread running {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:19:51.207254 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writer thread running {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:19:51.209030 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writer thread running {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:19:51.346158 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO dbcounter [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Registered counter for database nova_cell0 Jul 26 18:19:51.349618 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO dbcounter [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] Registered counter for database nova_cell0 Jul 26 18:19:51.355691 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_db.sqlalchemy.engines [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:19:51.357973 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG oslo_db.sqlalchemy.engines [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:19:51.361049 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writer thread running {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:19:51.363084 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writer thread running {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:19:51.695659 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: WARNING keystonemiddleware.auth_token [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 18:19:51.697528 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: WARNING keystonemiddleware.auth_token [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 18:19:51.702962 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: WARNING keystonemiddleware.auth_token [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 18:19:51.704923 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: WARNING keystonemiddleware.auth_token [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 18:19:52.047994 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: WARNING keystonemiddleware.auth_token [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 18:19:52.054086 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: WARNING keystonemiddleware.auth_token [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 18:19:52.055154 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: WARNING keystonemiddleware.auth_token [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 18:19:52.059429 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ef720d9c0 pid: 103266 (default app) Jul 26 18:19:52.061095 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: WARNING keystonemiddleware.auth_token [None req-d08f0b21-8030-4a00-884d-a1821968b630 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 18:19:52.061545 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:19:52.062763 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001776 Jul 26 18:19:52.063207 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Tue Jul 26 18:19:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:19:52.066389 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ef720d9c0 pid: 103267 (default app) Jul 26 18:21:09.425936 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:09.426974 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 26 18:21:09.427370 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:21:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:21:09.439469 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writing DB stats nova_api:SELECT=3 {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:21:09.440612 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writing DB stats nova_cell1:SELECT=3 {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:21:09.441431 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writing DB stats nova_cell0:SELECT=3 {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:21:09.442771 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:21:10.304432 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-d0281dae-0cfd-486b-a65f-bded20dd91f2 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:10.337684 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-d0281dae-0cfd-486b-a65f-bded20dd91f2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.903262 Jul 26 18:21:10.338543 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1291 bytes} [Tue Jul 26 18:21:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:21:12.556793 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:12.557828 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-699d4edd-5788-49b9-980a-bf14373c400a None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 26 18:21:12.558517 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:21:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:21:13.169352 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c55596d4-83a3-4481-9155-01e6f2a88820 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "disk": 1}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:13.189625 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 18:21:13.189625 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: warnings.warn(msg) Jul 26 18:21:13.220394 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c55596d4-83a3-4481-9155-01e6f2a88820 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.655490 Jul 26 18:21:13.221434 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1282 bytes} [Tue Jul 26 18:21:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:21:13.235618 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=3 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:21:13.236584 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_cell1:SELECT=3 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:21:13.237585 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_cell0:SELECT=3 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:21:13.238798 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:21:13.444717 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-c0ab065d-ff76-4f45-8574-94bdd0cdf0e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:13.449292 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 18:21:13.449292 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 26 18:21:13.510998 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-c0ab065d-ff76-4f45-8574-94bdd0cdf0e3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281479 Jul 26 18:21:13.511617 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1335 bytes} [Tue Jul 26 18:21:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:21:15.811165 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c55596d4-83a3-4481-9155-01e6f2a88820 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:15.813621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c55596d4-83a3-4481-9155-01e6f2a88820 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002951 Jul 26 18:21:15.815179 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:21:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:21:16.496632 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-cdce8dff-80ac-47cf-98be-5a6866faf131 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:16.515707 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 18:21:16.515707 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 26 18:21:16.536727 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-cdce8dff-80ac-47cf-98be-5a6866faf131 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.716011 Jul 26 18:21:16.537832 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1282 bytes} [Tue Jul 26 18:21:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:21:16.550061 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-aaad34a5-032b-4052-9a40-e97b4067a158 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:16.553468 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 18:21:16.553468 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: warnings.warn(msg) Jul 26 18:21:16.589491 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-aaad34a5-032b-4052-9a40-e97b4067a158 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043277 Jul 26 18:21:16.590381 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1335 bytes} [Tue Jul 26 18:21:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:21:18.815962 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-cdce8dff-80ac-47cf-98be-5a6866faf131 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:18.817061 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-cdce8dff-80ac-47cf-98be-5a6866faf131 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jul 26 18:21:18.817371 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:21:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:21:19.225226 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-39b57dc1-003e-41a2-8023-902716caa32e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "swap": 0}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:19.245749 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-39b57dc1-003e-41a2-8023-902716caa32e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.421974 Jul 26 18:21:19.246231 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1282 bytes} [Tue Jul 26 18:21:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 18:21:19.258454 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-a46bee2d-f81b-4e10-8bcd-294193a36847 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:19.284040 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-a46bee2d-f81b-4e10-8bcd-294193a36847 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029380 Jul 26 18:21:19.284684 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1335 bytes} [Tue Jul 26 18:21:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:21:21.485112 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-39b57dc1-003e-41a2-8023-902716caa32e admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:21.486166 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-39b57dc1-003e-41a2-8023-902716caa32e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jul 26 18:21:21.486577 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:21:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:21:21.949960 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-2ca8c2fc-309d-44e8-bd1a-ef479e703b0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "disk": 10, "ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:21.971200 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-2ca8c2fc-309d-44e8-bd1a-ef479e703b0b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478377 Jul 26 18:21:21.971917 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1282 bytes} [Tue Jul 26 18:21:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:21:21.984263 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-7428a1eb-9b80-4e5d-b804-c7e6ad7251e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:22.010595 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-7428a1eb-9b80-4e5d-b804-c7e6ad7251e9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030192 Jul 26 18:21:22.011390 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1335 bytes} [Tue Jul 26 18:21:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:21:24.290932 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-2ca8c2fc-309d-44e8-bd1a-ef479e703b0b admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:24.292159 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-2ca8c2fc-309d-44e8-bd1a-ef479e703b0b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Jul 26 18:21:24.292712 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:21:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:21:24.770284 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-9554f614-f3ea-4040-8d67-34ff8fdadf93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:24.794279 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-9554f614-f3ea-4040-8d67-34ff8fdadf93 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.494581 Jul 26 18:21:24.799159 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1282 bytes} [Tue Jul 26 18:21:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:21:24.807136 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-d075d092-61f6-4fd5-97c6-0f6692a7cc63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:24.832980 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-d075d092-61f6-4fd5-97c6-0f6692a7cc63 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029590 Jul 26 18:21:24.835424 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1335 bytes} [Tue Jul 26 18:21:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:21:27.062543 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-9554f614-f3ea-4040-8d67-34ff8fdadf93 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:27.063638 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-9554f614-f3ea-4040-8d67-34ff8fdadf93 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Jul 26 18:21:27.064039 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:21:27.520760 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-92d05b92-160f-4059-81fd-bd96612acfe0 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:27.546082 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-92d05b92-160f-4059-81fd-bd96612acfe0 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.475633 Jul 26 18:21:27.546636 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1291 bytes} [Tue Jul 26 18:21:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:21:30.428447 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-9554f614-f3ea-4040-8d67-34ff8fdadf93 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:30.429527 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-9554f614-f3ea-4040-8d67-34ff8fdadf93 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jul 26 18:21:30.429950 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:21:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:21:30.860273 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-f4f8e27f-77c8-4571-8f85-719f101cf699 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "id": "1", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:30.881369 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-f4f8e27f-77c8-4571-8f85-719f101cf699 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.445147 Jul 26 18:21:30.881938 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1282 bytes} [Tue Jul 26 18:21:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:21:30.894645 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-06932350-f9e9-4ce1-8f3f-53c3e4bc1106 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:30.921850 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-06932350-f9e9-4ce1-8f3f-53c3e4bc1106 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030994 Jul 26 18:21:30.922464 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1332 bytes} [Tue Jul 26 18:21:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:21:33.207799 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-f4f8e27f-77c8-4571-8f85-719f101cf699 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:33.208817 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-f4f8e27f-77c8-4571-8f85-719f101cf699 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 26 18:21:33.209191 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:21:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:21:33.615008 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-dce9fdd1-10cc-4bcf-9aef-d55c669d331b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:33.634516 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-dce9fdd1-10cc-4bcf-9aef-d55c669d331b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.419088 Jul 26 18:21:33.635238 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1282 bytes} [Tue Jul 26 18:21:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 18:21:33.648725 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-92dd033d-dbb3-467d-a21e-3e4cb2ae841c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:33.673744 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-92dd033d-dbb3-467d-a21e-3e4cb2ae841c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030248 Jul 26 18:21:33.674312 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1332 bytes} [Tue Jul 26 18:21:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:21:35.913638 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-dce9fdd1-10cc-4bcf-9aef-d55c669d331b admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:35.915415 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-dce9fdd1-10cc-4bcf-9aef-d55c669d331b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002354 Jul 26 18:21:35.915811 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:21:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:21:36.357998 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-d0733869-a425-486c-8593-79c3332ca80d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:36.381378 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-d0733869-a425-486c-8593-79c3332ca80d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.459595 Jul 26 18:21:36.382084 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1282 bytes} [Tue Jul 26 18:21:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:21:36.394371 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-0c80b130-2d7e-4b6b-a0a5-1f3cbf53a890 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:36.421187 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-0c80b130-2d7e-4b6b-a0a5-1f3cbf53a890 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030517 Jul 26 18:21:36.422095 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1332 bytes} [Tue Jul 26 18:21:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:21:38.664013 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-d0733869-a425-486c-8593-79c3332ca80d admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:38.665016 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-d0733869-a425-486c-8593-79c3332ca80d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Jul 26 18:21:38.665649 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:21:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:21:39.107443 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-931b261c-28b2-4bb7-bc9a-a85a35687f85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:39.128123 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-931b261c-28b2-4bb7-bc9a-a85a35687f85 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456119 Jul 26 18:21:39.128959 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1282 bytes} [Tue Jul 26 18:21:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:21:39.140993 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-1f7b533a-4d78-493d-8214-8a0b234a049c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:39.168060 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-1f7b533a-4d78-493d-8214-8a0b234a049c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030728 Jul 26 18:21:39.168842 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1332 bytes} [Tue Jul 26 18:21:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:21:41.374803 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-931b261c-28b2-4bb7-bc9a-a85a35687f85 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:21:41.375827 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-931b261c-28b2-4bb7-bc9a-a85a35687f85 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jul 26 18:21:41.376229 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:21:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:21:41.817681 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-32c59433-5bcf-4fd8-9fbe-154ef6078881 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "swap": 0}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:41.838582 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-32c59433-5bcf-4fd8-9fbe-154ef6078881 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.456161 Jul 26 18:21:41.839568 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1282 bytes} [Tue Jul 26 18:21:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:21:41.852339 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-e0e9de46-6d38-4434-bdf5-1b7a3c4b64d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:21:41.857250 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:21:41.884796 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-e0e9de46-6d38-4434-bdf5-1b7a3c4b64d4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037060 Jul 26 18:21:41.886018 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1332 bytes} [Tue Jul 26 18:21:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:22:01.080418 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-32c59433-5bcf-4fd8-9fbe-154ef6078881 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:01.081440 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-32c59433-5bcf-4fd8-9fbe-154ef6078881 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 26 18:22:01.081817 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:22:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:22:01.509179 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-5eb85037-895f-403e-806b-317737948ae9 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:01.528782 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-5eb85037-895f-403e-806b-317737948ae9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.440502 Jul 26 18:22:01.529334 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1291 bytes} [Tue Jul 26 18:22:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:22:02.631800 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-32c59433-5bcf-4fd8-9fbe-154ef6078881 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:02.632858 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-32c59433-5bcf-4fd8-9fbe-154ef6078881 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 26 18:22:02.633259 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Jul 26 18:22:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:22:03.218509 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-9d1d0cc7-15ee-4543-ae74-91532fb0f71d admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:03.224218 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.wsgi [None req-9d1d0cc7-15ee-4543-ae74-91532fb0f71d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-9d1d0cc7-15ee-4543-ae74-91532fb0f71d admin admin] Request method failure captured: Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Accept: application/json Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Accept-Encoding: gzip, deflate Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Connection: keep-alive Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Content-Length: 0 Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Host: 10.222.0.27 Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Openstack-Api-Version: compute 2.90 Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Openstack-System-Scope: None Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: User-Agent: python-novaclient Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Auth-Token: gAAAAABi4DDKvbQyld6oN8B6cNd89N5Ngf6jUYeuuqYMI9AtsT0F2IGUtHxyNbiGA9JvvKC_iMOCPzvGCJfgugWuJJRArU2X4y6pjnTAenwZ1DIXo6CkOPyw--s8QA3bWLF58lKSgRZ9cj8tRYKy8wv902l6pleQu0JtzqWrQ_Axm18d6Mz9gCk Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Domain-Id: None Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Domain-Name: None Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Identity-Status: Confirmed Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Is-Admin-Project: True Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Project-Domain-Id: default Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Project-Domain-Name: Default Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Project-Id: 054ace9b241147df81d052613939294e Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Project-Name: admin Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Role: admin,member,reader Jul 26 18:22:03.227621 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Roles: admin,member,reader Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/054ace9b241147df81d052613939294e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_054ace9b241147df81d052613939294e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/054ace9b241147df81d052613939294e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/054ace9b241147df81d052613939294e"}]}] Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Tenant: admin Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Tenant-Id: 054ace9b241147df81d052613939294e Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Tenant-Name: admin Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User: admin Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User-Domain-Id: default Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User-Domain-Name: Default Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User-Id: 06e6297ddefa4f0c8614872306ae2ddc Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User-Name: admin Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: method: > Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: exception: Flavor 42 could not be found. Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: action_args: {'id': '42'} Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:22:03.229277 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:22:03.230203 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:03.231417 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-9d1d0cc7-15ee-4543-ae74-91532fb0f71d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:22:03.232736 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-9d1d0cc7-15ee-4543-ae74-91532fb0f71d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.453747 Jul 26 18:22:03.232736 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Jul 26 18:22:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 455 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 18:22:03.236319 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:22:03.240091 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-2c74cb08-6fec-41d4-81b3-2fc49dd6aa20 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:03.262512 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-2c74cb08-6fec-41d4-81b3-2fc49dd6aa20 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027190 Jul 26 18:22:03.263070 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Jul 26 18:22:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:22:03.273336 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-55fa0de3-b4bd-4e98-a03b-a50623b624dd admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:03.299285 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-55fa0de3-b4bd-4e98-a03b-a50623b624dd admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029627 Jul 26 18:22:03.299872 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Jul 26 18:22:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:22:03.309805 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-de6daa36-9e15-418f-9224-626c24b7d556 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:03.316491 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.wsgi [None req-de6daa36-9e15-418f-9224-626c24b7d556 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-de6daa36-9e15-418f-9224-626c24b7d556 admin admin] Request method failure captured: Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Accept: application/json Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Accept-Encoding: gzip, deflate Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Connection: keep-alive Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Content-Length: 0 Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Host: 10.222.0.27 Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Openstack-Api-Version: compute 2.90 Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Openstack-System-Scope: None Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: User-Agent: python-novaclient Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Auth-Token: gAAAAABi4DDKvbQyld6oN8B6cNd89N5Ngf6jUYeuuqYMI9AtsT0F2IGUtHxyNbiGA9JvvKC_iMOCPzvGCJfgugWuJJRArU2X4y6pjnTAenwZ1DIXo6CkOPyw--s8QA3bWLF58lKSgRZ9cj8tRYKy8wv902l6pleQu0JtzqWrQ_Axm18d6Mz9gCk Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Domain-Id: None Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Domain-Name: None Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Identity-Status: Confirmed Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Is-Admin-Project: True Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Project-Domain-Id: default Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Project-Domain-Name: Default Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Project-Id: 054ace9b241147df81d052613939294e Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Project-Name: admin Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Role: admin,member,reader Jul 26 18:22:03.319823 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Roles: admin,member,reader Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/054ace9b241147df81d052613939294e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_054ace9b241147df81d052613939294e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/054ace9b241147df81d052613939294e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/054ace9b241147df81d052613939294e"}]}] Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Tenant: admin Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Tenant-Id: 054ace9b241147df81d052613939294e Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Tenant-Name: admin Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User: admin Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User-Domain-Id: default Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User-Domain-Name: Default Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User-Id: 06e6297ddefa4f0c8614872306ae2ddc Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User-Name: admin Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: method: > Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: exception: Flavor 42 could not be found. Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: action_args: {'id': '42'} Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:22:03.321260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:22:03.322096 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:03.323274 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-de6daa36-9e15-418f-9224-626c24b7d556 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:22:03.324331 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-de6daa36-9e15-418f-9224-626c24b7d556 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015391 Jul 26 18:22:03.324331 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Jul 26 18:22:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 26 18:22:04.302857 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-55fa0de3-b4bd-4e98-a03b-a50623b624dd admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:04.303914 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-55fa0de3-b4bd-4e98-a03b-a50623b624dd admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 26 18:22:04.304566 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Jul 26 18:22:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:22:04.849568 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-416b3d67-849a-49e5-ad04-db01a427de96 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:04.855149 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.wsgi [None req-416b3d67-849a-49e5-ad04-db01a427de96 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-416b3d67-849a-49e5-ad04-db01a427de96 admin admin] Request method failure captured: Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Accept: application/json Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Accept-Encoding: gzip, deflate Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Connection: keep-alive Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Content-Length: 0 Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Host: 10.222.0.27 Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Openstack-Api-Version: compute 2.90 Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Openstack-System-Scope: None Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: User-Agent: python-novaclient Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Auth-Token: gAAAAABi4DDM1D9sh2t2gO4rxCKn8k-g2e9VZlpqgBl0kV6Vja3IzUfyUvXd39y4jS1y4m1XS8Oree3p96-Qz-IWmi9NK3-M7jGqfW8n0yOTzx3KOinQpcr74lpDaCLYoK_pDpRfp1QvM4HZ5JSWqjs8yynh9mvLlIqZH_FGoWcKA_BsvPXs8iM Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Domain-Id: None Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Domain-Name: None Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Identity-Status: Confirmed Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Is-Admin-Project: True Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Project-Domain-Id: default Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Project-Domain-Name: Default Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Project-Id: 054ace9b241147df81d052613939294e Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Project-Name: admin Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Role: admin,member,reader Jul 26 18:22:04.856643 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Roles: admin,member,reader Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/054ace9b241147df81d052613939294e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_054ace9b241147df81d052613939294e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/054ace9b241147df81d052613939294e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/054ace9b241147df81d052613939294e"}]}] Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Tenant: admin Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Tenant-Id: 054ace9b241147df81d052613939294e Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Tenant-Name: admin Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User: admin Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User-Domain-Id: default Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User-Domain-Name: Default Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User-Id: 06e6297ddefa4f0c8614872306ae2ddc Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User-Name: admin Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: method: > Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: exception: Flavor 84 could not be found. Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: action_args: {'id': '84'} Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:22:04.858289 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:22:04.859256 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:04.860689 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-416b3d67-849a-49e5-ad04-db01a427de96 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:22:04.862076 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-416b3d67-849a-49e5-ad04-db01a427de96 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.417228 Jul 26 18:22:04.862076 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Jul 26 18:22:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 18:22:04.867921 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-b5eb6cbd-178c-474c-b048-828b423792df admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:04.883560 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-b5eb6cbd-178c-474c-b048-828b423792df admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019203 Jul 26 18:22:04.884132 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Jul 26 18:22:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:22:04.894083 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-959711bd-eab4-4021-ac2e-802d5552117e admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:04.910020 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-959711bd-eab4-4021-ac2e-802d5552117e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019475 Jul 26 18:22:04.910518 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Jul 26 18:22:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:22:04.920468 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-0a42f539-20dd-44ca-80b2-4855e274bd9d admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:04.926216 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.wsgi [None req-0a42f539-20dd-44ca-80b2-4855e274bd9d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-0a42f539-20dd-44ca-80b2-4855e274bd9d admin admin] Request method failure captured: Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Accept: application/json Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Accept-Encoding: gzip, deflate Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Connection: keep-alive Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Content-Length: 0 Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Host: 10.222.0.27 Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Openstack-Api-Version: compute 2.90 Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Openstack-System-Scope: None Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: User-Agent: python-novaclient Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Auth-Token: gAAAAABi4DDM1D9sh2t2gO4rxCKn8k-g2e9VZlpqgBl0kV6Vja3IzUfyUvXd39y4jS1y4m1XS8Oree3p96-Qz-IWmi9NK3-M7jGqfW8n0yOTzx3KOinQpcr74lpDaCLYoK_pDpRfp1QvM4HZ5JSWqjs8yynh9mvLlIqZH_FGoWcKA_BsvPXs8iM Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Domain-Id: None Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Domain-Name: None Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Identity-Status: Confirmed Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Is-Admin-Project: True Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Project-Domain-Id: default Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Project-Domain-Name: Default Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Project-Id: 054ace9b241147df81d052613939294e Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Project-Name: admin Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Role: admin,member,reader Jul 26 18:22:04.927756 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Roles: admin,member,reader Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/054ace9b241147df81d052613939294e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_054ace9b241147df81d052613939294e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/054ace9b241147df81d052613939294e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/054ace9b241147df81d052613939294e"}]}] Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Tenant: admin Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Tenant-Id: 054ace9b241147df81d052613939294e Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Tenant-Name: admin Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User: admin Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User-Domain-Id: default Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User-Domain-Name: Default Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User-Id: 06e6297ddefa4f0c8614872306ae2ddc Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User-Name: admin Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: method: > Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: exception: Flavor 84 could not be found. Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: action_args: {'id': '84'} Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:22:04.929220 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:22:04.930093 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:04.931472 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-0a42f539-20dd-44ca-80b2-4855e274bd9d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:22:04.932693 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-0a42f539-20dd-44ca-80b2-4855e274bd9d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012324 Jul 26 18:22:04.932693 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Jul 26 18:22:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 18:22:05.922960 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-959711bd-eab4-4021-ac2e-802d5552117e admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:05.923984 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-959711bd-eab4-4021-ac2e-802d5552117e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 26 18:22:05.924419 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Jul 26 18:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:22:06.510578 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-4912ce77-f361-4bd7-a40a-30f16e30a4cd admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:06.519116 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.wsgi [None req-4912ce77-f361-4bd7-a40a-30f16e30a4cd admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-4912ce77-f361-4bd7-a40a-30f16e30a4cd admin admin] Request method failure captured: Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Accept: application/json Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Accept-Encoding: gzip, deflate Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Connection: keep-alive Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Content-Length: 0 Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Host: 10.222.0.27 Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Openstack-Api-Version: compute 2.90 Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Openstack-System-Scope: None Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: User-Agent: python-novaclient Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Auth-Token: gAAAAABi4DDNbhTfCrd6js8aVDktUkIeql-mIv2kVofYld6k0olmgY_mJOGTCmXlcyb3qlGFPR9PeZkKqrerDB8IHF3bzqCPY5UaCCXs93xRE6fCGVT0p1zi77IdKSD4OMrKou2Ofk46oSHkxgI8d7-eif4tOH65E5WieVIuX3rX1QlxsJqASQ0 Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Domain-Id: None Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Domain-Name: None Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Identity-Status: Confirmed Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Is-Admin-Project: True Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Project-Domain-Id: default Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Project-Domain-Name: Default Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Project-Id: 054ace9b241147df81d052613939294e Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Project-Name: admin Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Role: admin,member,reader Jul 26 18:22:06.521256 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Roles: admin,member,reader Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/054ace9b241147df81d052613939294e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_054ace9b241147df81d052613939294e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/054ace9b241147df81d052613939294e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/054ace9b241147df81d052613939294e"}]}] Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Tenant: admin Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Tenant-Id: 054ace9b241147df81d052613939294e Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-Tenant-Name: admin Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User: admin Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User-Domain-Id: default Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User-Domain-Name: Default Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User-Id: 06e6297ddefa4f0c8614872306ae2ddc Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: X-User-Name: admin Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: method: > Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: exception: Flavor 451 could not be found. Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: action_args: {'id': '451'} Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:22:06.522879 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:22:06.524085 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jul 26 18:22:06.525408 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-4912ce77-f361-4bd7-a40a-30f16e30a4cd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:22:06.526669 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-4912ce77-f361-4bd7-a40a-30f16e30a4cd admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.461654 Jul 26 18:22:06.526669 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Jul 26 18:22:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 463 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 18:22:06.533063 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-60b5cbe5-487b-4247-9895-b569434ba9f2 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:06.547925 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-60b5cbe5-487b-4247-9895-b569434ba9f2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018491 Jul 26 18:22:06.548491 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Jul 26 18:22:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:22:06.558590 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:06.573751 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018790 Jul 26 18:22:06.574271 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Jul 26 18:22:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:22:06.586029 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-070c481a-7b73-4c2f-a4ae-fc6680402d7a admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:06.591677 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.wsgi [None req-070c481a-7b73-4c2f-a4ae-fc6680402d7a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-070c481a-7b73-4c2f-a4ae-fc6680402d7a admin admin] Request method failure captured: Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Accept: application/json Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Accept-Encoding: gzip, deflate Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Connection: keep-alive Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Content-Length: 0 Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Host: 10.222.0.27 Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Openstack-Api-Version: compute 2.90 Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Openstack-System-Scope: None Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: User-Agent: python-novaclient Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Auth-Token: gAAAAABi4DDNbhTfCrd6js8aVDktUkIeql-mIv2kVofYld6k0olmgY_mJOGTCmXlcyb3qlGFPR9PeZkKqrerDB8IHF3bzqCPY5UaCCXs93xRE6fCGVT0p1zi77IdKSD4OMrKou2Ofk46oSHkxgI8d7-eif4tOH65E5WieVIuX3rX1QlxsJqASQ0 Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Domain-Id: None Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Domain-Name: None Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Identity-Status: Confirmed Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Is-Admin-Project: True Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Project-Domain-Id: default Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Project-Domain-Name: Default Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Project-Id: 054ace9b241147df81d052613939294e Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Project-Name: admin Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Role: admin,member,reader Jul 26 18:22:06.593171 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Roles: admin,member,reader Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/054ace9b241147df81d052613939294e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_054ace9b241147df81d052613939294e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/054ace9b241147df81d052613939294e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/054ace9b241147df81d052613939294e"}]}] Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Tenant: admin Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Tenant-Id: 054ace9b241147df81d052613939294e Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-Tenant-Name: admin Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User: admin Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User-Domain-Id: default Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User-Domain-Name: Default Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User-Id: 06e6297ddefa4f0c8614872306ae2ddc Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: X-User-Name: admin Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: method: > Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: exception: Flavor 451 could not be found. Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: action_args: {'id': '451'} Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:22:06.594640 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:22:06.595600 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: ERROR nova.api.openstack.wsgi Jul 26 18:22:06.596850 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-070c481a-7b73-4c2f-a4ae-fc6680402d7a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:22:06.598064 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-070c481a-7b73-4c2f-a4ae-fc6680402d7a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014113 Jul 26 18:22:06.598064 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Jul 26 18:22:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 18:22:07.705045 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:07.706065 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 26 18:22:07.706438 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Jul 26 18:22:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:22:08.252052 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-e39c69a6-72f8-4f7d-afa7-3327f6344de8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:22:08.272395 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-e39c69a6-72f8-4f7d-afa7-3327f6344de8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.426805 Jul 26 18:22:08.273059 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Jul 26 18:22:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:22:09.265329 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:09.266380 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 26 18:22:09.266767 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Jul 26 18:22:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:22:09.853941 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-c3183d4d-5806-439e-8209-d5538f31f156 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:22:09.874844 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-c3183d4d-5806-439e-8209-d5538f31f156 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.469392 Jul 26 18:22:09.875422 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Jul 26 18:22:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:22:10.856542 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:10.857580 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jul 26 18:22:10.857990 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Jul 26 18:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:22:11.411906 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-94a1d579-e8f6-4d26-9506-50d5ec43d84a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:22:11.433367 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-94a1d579-e8f6-4d26-9506-50d5ec43d84a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.438753 Jul 26 18:22:11.433914 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Jul 26 18:22:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:22:12.440647 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:12.441659 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 26 18:22:12.442056 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Jul 26 18:22:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:22:13.013936 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-2dc371ef-dfea-4403-9460-92a660a7456c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:22:13.035509 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-2dc371ef-dfea-4403-9460-92a660a7456c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.456210 Jul 26 18:22:13.036056 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Jul 26 18:22:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:22:14.007571 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:14.008612 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jul 26 18:22:14.009034 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Jul 26 18:22:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:22:14.563950 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-61c5f497-8525-4ca8-b535-009ca62ce05e admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:22:14.584656 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-61c5f497-8525-4ca8-b535-009ca62ce05e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.440012 Jul 26 18:22:14.585201 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Tue Jul 26 18:22:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:23:06.597782 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:23:06.598785 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-d14f14fa-0023-4341-a1e6-93e9fcaf1fb4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 26 18:23:06.599207 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 930 bytes} [Tue Jul 26 18:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:23:06.615538 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:23:07.050514 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-28c27dc0-8312-42e0-8763-f74dee237159 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:23:07.071750 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-28c27dc0-8312-42e0-8763-f74dee237159 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.463172 Jul 26 18:23:07.072330 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1291 bytes} [Tue Jul 26 18:23:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:23:07.093900 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:23:07.097949 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-15853daa-297d-4215-9bed-3e4d20b4e75b admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:23:07.106594 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-15853daa-297d-4215-9bed-3e4d20b4e75b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014154 Jul 26 18:23:07.107182 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1282 bytes} [Tue Jul 26 18:23:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:23:07.120149 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-b4e2a350-81b5-4ac9-b8f0-0e6990c748b9 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:23:07.128189 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-b4e2a350-81b5-4ac9-b8f0-0e6990c748b9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011694 Jul 26 18:23:07.128748 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1285 bytes} [Tue Jul 26 18:23:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:23:07.141278 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c6571141-e025-4f85-b946-95c48641e510 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:23:07.149941 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c6571141-e025-4f85-b946-95c48641e510 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012614 Jul 26 18:23:07.150561 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1285 bytes} [Tue Jul 26 18:23:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:23:07.163313 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-55a57ee6-ad4a-4b19-89f7-c749f9d1921e admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:23:07.171811 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-55a57ee6-ad4a-4b19-89f7-c749f9d1921e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012405 Jul 26 18:23:07.172358 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1282 bytes} [Tue Jul 26 18:23:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:26:37.984070 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c6571141-e025-4f85-b946-95c48641e510 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:26:37.985379 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c6571141-e025-4f85-b946-95c48641e510 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002060 Jul 26 18:26:37.985840 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Jul 26 18:26:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:26:38.133293 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=6 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:26:38.343072 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-60223f21-bacd-4860-93c0-51870a9db7e3 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:26:38.346344 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 18:26:38.346344 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 26 18:26:38.348150 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-60223f21-bacd-4860-93c0-51870a9db7e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:26:38.348855 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-60223f21-bacd-4860-93c0-51870a9db7e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:26:38.349920 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-60223f21-bacd-4860-93c0-51870a9db7e3 admin admin] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:26:38.350480 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-60223f21-bacd-4860-93c0-51870a9db7e3 admin admin] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:26:38.390466 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-60223f21-bacd-4860-93c0-51870a9db7e3 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.258813 Jul 26 18:26:38.391244 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Jul 26 18:26:38 2022] GET /compute/v2.1/os-services => generated 794 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:26:39.273469 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c6571141-e025-4f85-b946-95c48641e510 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:26:39.274850 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c6571141-e025-4f85-b946-95c48641e510 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001834 Jul 26 18:26:39.275484 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Jul 26 18:26:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:26:39.497966 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-32266644-ece3-4b2b-ae2b-8571ed49f889 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:26:39.501206 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 18:26:39.501206 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 26 18:26:39.503010 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-32266644-ece3-4b2b-ae2b-8571ed49f889 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:26:39.503619 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-32266644-ece3-4b2b-ae2b-8571ed49f889 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:26:39.504678 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-32266644-ece3-4b2b-ae2b-8571ed49f889 admin admin] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:26:39.505438 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-32266644-ece3-4b2b-ae2b-8571ed49f889 admin admin] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:26:39.532221 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-32266644-ece3-4b2b-ae2b-8571ed49f889 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.109038 Jul 26 18:26:39.533464 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Jul 26 18:26:39 2022] GET /compute/v2.1/os-services => generated 794 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 18:26:50.978984 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c6571141-e025-4f85-b946-95c48641e510 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:26:50.980175 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c6571141-e025-4f85-b946-95c48641e510 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Jul 26 18:26:50.980620 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Jul 26 18:26:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:26:51.126981 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_cell0:SELECT=4 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:26:51.127874 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_cell1:SELECT=4 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:26:51.128260 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG dbcounter [-] [103266] Writing DB stats nova_api:SELECT=8 {{(pid=103266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:26:51.187159 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-c1250dc0-0352-427b-845c-b47a3a6164f7 admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:26:51.190044 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 18:26:51.190044 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 26 18:26:51.191745 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-c1250dc0-0352-427b-845c-b47a3a6164f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:26:51.192165 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-c1250dc0-0352-427b-845c-b47a3a6164f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:26:51.193025 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-c1250dc0-0352-427b-845c-b47a3a6164f7 admin admin] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:26:51.193466 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-c1250dc0-0352-427b-845c-b47a3a6164f7 admin admin] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:26:51.226339 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-c1250dc0-0352-427b-845c-b47a3a6164f7 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.102229 Jul 26 18:26:51.226339 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Jul 26 18:26:51 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:26:52.108889 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c6571141-e025-4f85-b946-95c48641e510 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:26:52.110028 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c6571141-e025-4f85-b946-95c48641e510 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 26 18:26:52.110491 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Jul 26 18:26:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:26:52.318725 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG nova.api.openstack.wsgi [None req-d98c2ea7-ebec-4aa2-bd62-a9f4b77052bc admin admin] Calling method '>' {{(pid=103266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:26:52.321367 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 18:26:52.321367 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: warnings.warn(msg) Jul 26 18:26:52.322726 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-d98c2ea7-ebec-4aa2-bd62-a9f4b77052bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:26:52.323216 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-d98c2ea7-ebec-4aa2-bd62-a9f4b77052bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:26:52.324010 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-d98c2ea7-ebec-4aa2-bd62-a9f4b77052bc admin admin] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:26:52.324432 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: DEBUG oslo_concurrency.lockutils [None req-d98c2ea7-ebec-4aa2-bd62-a9f4b77052bc admin admin] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:26:52.347417 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: INFO nova.api.openstack.requestlog [None req-d98c2ea7-ebec-4aa2-bd62-a9f4b77052bc admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.096267 Jul 26 18:26:52.348016 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: [pid: 103266|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Jul 26 18:26:52 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:27:48.530262 dv-cinder-825492-31-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 26 18:27:48.530899 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: Tue Jul 26 18:27:48 2022 - graceful shutdown triggered... Jul 26 18:27:48.531372 dv-cinder-825492-31-iscsi devstack@n-api.service[103266]: Gracefully killing worker 1 (pid: 103266)... Jul 26 18:27:48.531727 dv-cinder-825492-31-iscsi devstack@n-api.service[103267]: Gracefully killing worker 2 (pid: 103267)... Jul 26 18:27:49.532159 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: worker 1 buried after 1 seconds Jul 26 18:27:49.532159 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: worker 2 buried after 1 seconds Jul 26 18:27:49.532159 dv-cinder-825492-31-iscsi devstack@n-api.service[103265]: goodbye to uWSGI. Jul 26 18:27:49.534438 dv-cinder-825492-31-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 26 18:27:49.535130 dv-cinder-825492-31-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 26 18:27:49.538903 dv-cinder-825492-31-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 18:27:49.550289 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 18:27:49 2022] *** Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: nodename: dv-cinder-825492-31-iscsi Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: machine: x86_64 Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: clock source: unix Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: pcre jit disabled Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: detected number of CPU cores: 4 Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: current working directory: / Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: detected binary path: /usr/bin/uwsgi-core Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: your processes number limit is 47680 Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: your memory page size is 4096 bytes Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: detected max file descriptor number: 2048 Jul 26 18:27:49.552372 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: lock engine: pthread robust mutexes Jul 26 18:27:49.553379 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: thunder lock: enabled Jul 26 18:27:49.553379 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 18:27:49.553379 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 18:27:49.592215 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: Python main interpreter initialized at 0x5623db1e69c0 Jul 26 18:27:49.592215 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: python threads support enabled Jul 26 18:27:49.592215 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: your server socket listen backlog is limited to 100 connections Jul 26 18:27:49.592215 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: your mercy for graceful operations on workers is 90 seconds Jul 26 18:27:49.592683 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 18:27:49.592683 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: *** Operational MODE: preforking *** Jul 26 18:27:49.593003 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: *** uWSGI is running in multiple interpreter mode *** Jul 26 18:27:49.593003 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: spawned uWSGI master process (pid: 117985) Jul 26 18:27:49.593190 dv-cinder-825492-31-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 18:27:49.593767 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: spawned uWSGI worker 1 (pid: 117996, cores: 1) Jul 26 18:27:49.594256 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: spawned uWSGI worker 2 (pid: 117997, cores: 1) Jul 26 18:27:49.594555 dv-cinder-825492-31-iscsi devstack@n-api.service[117985]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 18:27:50.250686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 18:27:50.251378 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 18:27:51.399067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 18:27:51.399067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: from cryptography.utils import int_from_bytes Jul 26 18:27:51.400227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 18:27:51.400227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: from cryptography.utils import int_from_bytes Jul 26 18:27:51.405206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 18:27:51.405206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: from cryptography.utils import int_from_bytes Jul 26 18:27:51.406085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 18:27:51.406085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: from cryptography.utils import int_from_bytes Jul 26 18:27:53.834990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 18:27:53.835604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 18:27:53.835706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 18:27:53.835963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 18:27:53.836383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 18:27:53.836523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 18:27:53.836605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 18:27:53.836790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.836896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 18:27:53.837063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.837247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 18:27:53.837407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.837506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 18:27:53.837708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.837828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.838031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.838146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.838342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.838461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.838660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.838764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.838980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.839114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.839308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.839412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.839596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.839730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.839912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.840078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.840242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.840385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-31-iscsi {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.840555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.840746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.840893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.841061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.841215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-31-iscsi {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.841377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.841537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.841712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.841905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.842058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.842201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.842391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.842540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.842700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.842860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.843012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.843223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.844425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.844661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.844874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.845103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.845317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.845317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.845720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.845937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.846164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.846394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.846619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.846852 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.847075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.847293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.847502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.847720 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.847923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.848137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.848356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.848593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.848796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.849028 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.849406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-31-iscsi {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.849708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-31-iscsi {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.849942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.850357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.850580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.851495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.851664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.851816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.852004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.852163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.852319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.852500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.852673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.852865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.853182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.853333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.853486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.853638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.853805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.853968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.854127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.854278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.854433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.854636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.854831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.855002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.855182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.855337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.855553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.855714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.855876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.856027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.856187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.856353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.856497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.856658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.856818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.856979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.857151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.857390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.857549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.857701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.857844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.857994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.858145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.858288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.858441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.858626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.858811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.858982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.859165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.859341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.859488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.859632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.859788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.859933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.860085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.860238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.860390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.860580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.860741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.861533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.861699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.861853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.862007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.862177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.862441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.862595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.862749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.862948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.863186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.863331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.863738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.863899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.864056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.864199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.864342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.864483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.864633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.864793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.864963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.865116 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.865259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.865402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.865545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.865710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.865871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.866015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.866158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.866309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.866460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.866647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.866647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.866990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.867157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.867301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.867444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.867647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.867850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.868003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.868154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.868304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.868459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.868644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.868800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.868944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.869094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.869247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.869398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.869550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.869693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.869854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.870011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.870164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.870397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.870550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.870693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.870843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.871615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.871787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.871944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.872096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.872248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.872404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.872674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.872818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.872974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.873124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.873277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.873431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.873582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.873851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.874015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.877709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.878405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.878566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.878712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.878865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.879054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.879219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.879371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.882619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.882913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.883196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.883377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.883549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.883706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.883882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.884151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.884310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.884472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.884625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.884823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.884968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.885118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.885282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.885435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.885591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.885741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.885892 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.886047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.886199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.886351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.886520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.887386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.887544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.887688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.887843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.888015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.888160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.888311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.888463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.888614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.888756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.888912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.889056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.889199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.889341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.889483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.889633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.889785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.889939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.890083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.890233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.890384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.890527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.890678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.891187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.891429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.891578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.891730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.891883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.892027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.892956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.893240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.893398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.893549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.893711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.893868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.894012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.894189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.894443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.894591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.894747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.894899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.895079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.895240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.895385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.895542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.895695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.895838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.895989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.896139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.896283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 18:27:53.896436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.896587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.896730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.896880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.897031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.897192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.897351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.897495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.897644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.897794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.897947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.898090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.898242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.898385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.898535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.898686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.898836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.899003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.899171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.899363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.899517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.899661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.899810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.899962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.900104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.900246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.900397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.900551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.900695 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.900899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.901070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.901213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.901370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.901515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.901676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.901827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.901984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.902134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.903175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.903434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.903585 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.903741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.903896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.904059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.904203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.904345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.904586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.904747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.904893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.905045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.905201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.905352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.905495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.905652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.905843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.906002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.906152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.906305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.906448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.906673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.906819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.906962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.907130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.907308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.907466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.907625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.907776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.907928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.908082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.908224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.908380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.908534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.908676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.908818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.908976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.909127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.909284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.909427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.909580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.909729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.909877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.910038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.910202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.910353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.910495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.910636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.910786 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.910928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.911100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.911248 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.911407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.911558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.911708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.911815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.911918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.912041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.912134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.912220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.912312 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.912411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.912497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.912580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.912672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.913320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.913464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.913691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.913808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.913918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.914029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.914139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.914248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.914383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.914540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.914779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.914902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.915012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.915239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.915426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.915565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.915705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.915841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.915841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.916098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.916228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.916355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.916482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.916623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.916752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.916928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.917058 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.917185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.917313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.917440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.917440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.917700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.917700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.917950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.917950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.918189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.918189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.918449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.918577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.918705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.918705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.918960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.918960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.919275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.919415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.919543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.919678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.919805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.919942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.920076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.920205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.920342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.920472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.920598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.920735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.920871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.921013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.921284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.921436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.921567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.921709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.921836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.921963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.922109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.922353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.922504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.922636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.922762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.922903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.923551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.923699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.923920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.924060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.924189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.924316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.924443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.924578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.924722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.924943 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.925081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.925217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.925344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.925478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.925621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.925750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.925885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.926020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.926147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.926288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.926427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.926552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.926672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.926782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.926890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.927009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.927156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.927275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.927385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.927493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.927611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.927730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.927842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.927958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.928069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.928189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.928299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.928417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.928547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.928664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.928773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.928889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.929010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.929010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.929010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.929010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.929010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.929538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.929656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.929766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.929875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.929994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.930110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.930233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.930352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.930462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.930592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.930702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.930817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.930978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.931180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.931321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.931476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.931601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.931719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.931828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.931946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.932063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.932172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.932280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.932396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.932591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.932711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.932821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.932974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.933109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.933786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.933932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.934155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.934269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.934378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.934496 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.934612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.934736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.934846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.934972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.935222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.935411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.935575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.935729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.935881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.936047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.936199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.936350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.936508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.936652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.936802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.936952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.937095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.937245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.937411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.937575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.937736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.938880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.939067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.939230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.939392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.939577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.939725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.939876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.940027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.940178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.940338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.940505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.940657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.940808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.940958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.941110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.941273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.941428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.941573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.941717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.941867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.942024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.942175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.942326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.942481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.942632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.942789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.942948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.943192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.943841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.944015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.944185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.944419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.944592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.944744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.944897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.945048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.945225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.945473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.945656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.945846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.945989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.946139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.946282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.946434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.946586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.946738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.946881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.947050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.947214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.947387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.947575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.947731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.947890 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.948049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.948199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.948372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.948533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.948814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.948970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.949123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.949275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.949429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.949583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.949805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.949974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.950120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.950411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.950574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.950738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.950883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.951062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.951219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.951376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.951520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.951681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.951825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.951969 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.952111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.952268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.952428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.952580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.952723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.952865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.953008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.953160 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.953315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.953624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.954106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.954256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.954256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.954648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.954817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.954971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.955827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.955981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.956142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.956295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.956447 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.956598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.956748 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.956903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.957056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.957210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.957362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.957509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.957673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.957861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.958088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.958245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.958390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.958541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.959346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.959515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.959685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.959837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.959981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.959981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.960267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.960267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.960568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.960720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.960872 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.961023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.961186 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.961420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.961588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.961741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.961886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.962037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.962195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.962340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.962495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.962647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.962791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.962951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.963137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.963291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.963458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.963808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.964257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.964408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.964561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.964714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.964859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.965048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.965197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.965769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.966929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.967129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.967937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.968176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.968333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.968486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.968630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.968783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.968945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.969409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.969567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.969714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.969876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.970028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.970188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.970376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.970522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.970673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.970825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.970978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.971210 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.971371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.971516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.971696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.971844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.971989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.972150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.972302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.972476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.972628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.972787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.972939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.973093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.973253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.973405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.973558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.973721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.974064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.974561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.974714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.974870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.975032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.975194 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.975348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.975501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.975661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.975839 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.976095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.976252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.976480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.976642 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.976802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.977130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.977293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.977445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.977613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.977765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.977910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.978061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.978214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.978370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.978524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.978669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.978820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.978965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.979148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.979396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.979553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.979707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.979858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.980002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.980154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.980309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.980464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.980874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.980990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.981093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.981181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.981276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.981370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.981458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.981551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.981637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.981722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.981820 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.981914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.982000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.982000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.982155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.982248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.982343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.982436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.982522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.982522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.982684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.982684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.982860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.982947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.983057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.983146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.983232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.983335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.983335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.983508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.983594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.983680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.983764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.983861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.983985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.985164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.985280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.985378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.985473 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.985625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.985717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.985810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.985905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.985905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.986075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.986188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.986332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.986332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.986504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.986504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.986680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.986774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.986860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.986946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.987116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.987252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.987357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.987452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.987539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.987627 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.987719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.987806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.987906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.987994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.988086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.988184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.988512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.988670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.988770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.988864 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.988951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.989037 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.989123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.989217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.989312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.989423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.989520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.989607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.989693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.989791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.989887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.989974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.990065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.990152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.990238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.990337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.990424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.990524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.990620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.990707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.990805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.990893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.990988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.991092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.991182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.991283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.991382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.991469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.991554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.991639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.991725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.991811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.991904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.991998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.992092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.992185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.992272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.992364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.992459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.992579 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.992666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.992759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.992853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.992946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.993041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.993141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.993229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.993323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.993425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.993525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.993619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.993714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.993800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.993899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.993986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.994085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.994171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.994264 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.994554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.994810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.994908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.995009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.995146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.995241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.995336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.995431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.995525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.995625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.995720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.995852 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.995953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.996056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.996153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.996248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.996336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.996427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.996555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.996655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.996754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.996841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.996926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.997018 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.997167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.997267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.997364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.997487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.997587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.997675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.997760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.997869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998122 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.998924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.999274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.999370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.999483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.999578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.999666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.999759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.999852 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:53.999945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.000037 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.000136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.000229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.000314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.000398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.000481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.000580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.000680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.000766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.000857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.000947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.001031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.001124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.001211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.001211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.001374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.001374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.001526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.001620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.001707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.001796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.001881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.001881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.002032 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.002129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.002231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.002231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.002394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.002476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.002562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.002647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.002732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.002823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.002908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.003001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.003275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.003275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.003492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.003492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.003737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.003842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.003944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.004036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.004130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.004223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.004347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.004466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.004674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.004792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.005025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.005114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.005209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.005310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.005405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.005501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.005588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.005681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.005776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.005926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.006019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.006112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.006199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.006297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.006392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.006479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.006571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.006704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.006797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.006894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.006981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.007092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.007181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.007274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.007361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.007455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.007541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.007615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.007695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.007789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.007884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.007979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.008128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.008251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.008339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.008479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.008581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.008675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.008762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.008837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.008908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.008979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.009069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.009145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.009217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.009288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.009365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.009438 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.009525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.009597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.009668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.009746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.009824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.009896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.009980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.010059 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.010139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.010211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.010281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.010361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.010434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.010511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.010590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.010670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.010742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.010892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.010969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.011117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.011207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.011287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.011367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.011453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.011535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.011614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.011686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.011766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.011846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.011927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.012006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.012086 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.012168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.012240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.012324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.012397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.012487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.012567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.012646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.012725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.012812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.012885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.012955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.013026 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.013103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.013176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.013255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.013328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.013406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.013486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.013560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.013632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.013716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.013795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.013873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.013952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.014032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.014117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.014197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.014269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.014349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.014422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.014492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.014575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.014666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.014742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.014821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.014900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.015222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.015316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.015316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.015316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.015316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.015569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.015640 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.015721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.015801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.015873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.015944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.016021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.016107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.016187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.016267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.016347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.016425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.016497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.016577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.016649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.016727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.016806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.016878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.016957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.017041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.017114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.017185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.017264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.017337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.017420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.017493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.017564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.017641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.017713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.017782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.017865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.017938 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.018017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.018089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.018160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.018160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.018160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.018160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.018160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.018610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.018703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.018803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.018903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.018991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.019125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.019260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.019372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.019482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.019609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.019729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.019841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.019960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.020072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.020195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.020307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.020417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.020417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.020613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.020708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.020804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.020804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.020973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.021083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.021169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.021250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.021346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.021433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.021525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.021617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.021705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.021870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.022038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.022187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.022299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.022494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.022596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.022808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.022903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.023165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.023276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.023493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.023587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.023850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.023946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.024172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.024272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.024497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.024645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.024813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.024918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.025211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.025362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.025462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.025563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.025753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.025855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.026075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.026176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.026384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.026484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.026704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.026797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.027118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.027216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.027724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.027818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.028036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.028138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.028350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.028444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.028662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.028754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.028973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.029066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.029285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.029391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.029597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.029696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.029910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.030003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.030219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.030325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.030536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.030629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.030849 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.030978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.031198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.031414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.031511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.031598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.031814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.031916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.032132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.032232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.032446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.032655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.032763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.032971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.033268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.033369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.033584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.033678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.033916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.034017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.034231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.034323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.034552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.034686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.034869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.034996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.035206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.035420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.035514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.035601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.035796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.035905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.036108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.036202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.036420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.036513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.036734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.036836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.037038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.037130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.037338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.037437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.037652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.037753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.037960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.038060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.038280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.038492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.038586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.038851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.039126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.039257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.039852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.039957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.039957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.040134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.040221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.040313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.040497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.040589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.040811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.040903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.041118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.041209 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.041423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.041516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.041726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.041826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.042030 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.042132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.042334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.042435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.042640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.042739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.042941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.043056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.043273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.043384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.043573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.043666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.043880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.043972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.044181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.044282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.044486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.044577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.044788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.044882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.045092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.045195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.045476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.045593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.045682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.045774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.045984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.046086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.046286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.046386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.046587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.046686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.046889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.046983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.047218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.047314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.047522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.047614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.047832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.047926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.048133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.048234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.048439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.048541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.048745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.048880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.049051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.049155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.049354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.049456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.049661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.049763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.050007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.050117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.050309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.050436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.050622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.050768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.050914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.051066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.051263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.051368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.051675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.051760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.051986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.052078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.052294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.052398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.052606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.052699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.052951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.053161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.053254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.053501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.053784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.053884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.054114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.054215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.054434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.054528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.054757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.054894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.055183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.055291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.055426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.055526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.055733 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.055846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.056035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.056129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.056351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.056443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.056660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.056751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.056969 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.057114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.057278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.057379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.057587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.057678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.057900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.058001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.058207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.058300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.058515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.058607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.058823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.058923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.059158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.059264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.059470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.059572 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.059776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.059868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.060082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.060185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.060390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.060483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.060706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.060802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.061028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.061120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.061343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.061435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.061658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.061758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.061966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.062059 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.062277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.062370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.062581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.062680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.062888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.062981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.063215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.063321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.063536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.063637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.063851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.063944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.064155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.064261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.064475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.064575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.064778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.064871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.065192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.065310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.065502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.065637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.065815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.065927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.066123 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.066217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.066428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.066521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.066745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.066837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.067080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.067177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.067390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.067496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.067707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.067800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.068018 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.068121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.068344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.068445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.068667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.068768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.068974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.069074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.069281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.069377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.069586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.069700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.069886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.069978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.070187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.070279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.070494 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.070596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.070855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.070948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.071203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.071310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.071510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.071602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.071812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.071903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.072117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.072209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.072421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.072513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.072722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.072813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.073025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.073144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.073326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.073429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.073631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.073723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.073928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.074028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.074229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.074322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.074530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.074622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.074829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.074930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.075152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.075247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.075454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.075573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.075762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.075895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.076064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.076194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.076369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.076473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.076669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.076772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.076972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.077073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.077273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.077366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.077602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.077703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.077925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.078017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.078235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.078337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.078552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.078650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.078858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.078949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.079223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.079361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.079547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.079652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.079864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.079967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.080174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.080267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.080485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.080577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.080794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.080896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.081103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.081194 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.081415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.081516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.081723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.081814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.082027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.082128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.082333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.082425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.082639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.082733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.082948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.083112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.083287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.083380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.083610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.083710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.083913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.084020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.084234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.084324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.084546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.084646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.084853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.084952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.085209 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.085311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.085471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.085573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.085783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.085916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.086163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.086294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.086422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.086523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.086732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.086825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.087054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.087163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.087363 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.087471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.087675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.087775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.087987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.088079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.088294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.088397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.088607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.088708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.088921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.089021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.089227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.089405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.089549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.089690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.089854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.089955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.090176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.090288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.090497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.090590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.090838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.090930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.091176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.091270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.091492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.091595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.091805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.091897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.092113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.092213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.092356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 18:27:54.092453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.092708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 18:27:54.092947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117997) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 18:27:54.154065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO dbcounter [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] Registered counter for database nova_api Jul 26 18:27:54.154304 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO dbcounter [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] Registered counter for database nova_api Jul 26 18:27:54.175787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_db.sqlalchemy.engines [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:27:54.177819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_db.sqlalchemy.engines [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:27:54.183003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writer thread running {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:27:54.184931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writer thread running {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:27:54.238463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.context [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed53b5a3-56b8-4096-ad1b-6bf0519db1d4(cell1) {{(pid=117997) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 18:27:54.240176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.context [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed53b5a3-56b8-4096-ad1b-6bf0519db1d4(cell1) {{(pid=117996) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 18:27:54.242704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:27:54.244296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:27:54.244429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:27:54.245152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:27:54.246048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:27:54.246859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:27:54.247385 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:27:54.249071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:27:54.249412 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO dbcounter [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] Registered counter for database nova_cell0 Jul 26 18:27:54.251214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO dbcounter [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] Registered counter for database nova_cell0 Jul 26 18:27:54.253586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO dbcounter [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] Registered counter for database nova_cell1 Jul 26 18:27:54.255526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO dbcounter [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] Registered counter for database nova_cell1 Jul 26 18:27:54.261768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_db.sqlalchemy.engines [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:27:54.264056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_db.sqlalchemy.engines [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:27:54.266504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_db.sqlalchemy.engines [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:27:54.268348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_db.sqlalchemy.engines [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:27:54.268880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writer thread running {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:27:54.274822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writer thread running {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:27:54.276965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writer thread running {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:27:54.406476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writer thread running {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:27:54.417441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO dbcounter [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] Registered counter for database nova_cell0 Jul 26 18:27:54.423479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO dbcounter [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] Registered counter for database nova_cell0 Jul 26 18:27:54.424598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_db.sqlalchemy.engines [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117997) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:27:54.430521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writer thread running {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:27:54.431481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_db.sqlalchemy.engines [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 18:27:54.436578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writer thread running {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 18:27:54.753453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: WARNING keystonemiddleware.auth_token [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 18:27:54.756441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: WARNING keystonemiddleware.auth_token [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 18:27:54.761117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: WARNING keystonemiddleware.auth_token [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 18:27:54.764024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: WARNING keystonemiddleware.auth_token [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 18:27:55.109876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: WARNING keystonemiddleware.auth_token [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 18:27:55.116021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: WARNING keystonemiddleware.auth_token [None req-2c9aa880-c7a6-4334-beeb-e8edb61ce1c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 18:27:55.116912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: WARNING keystonemiddleware.auth_token [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 18:27:55.121560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623db1e69c0 pid: 117997 (default app) Jul 26 18:27:55.123318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: WARNING keystonemiddleware.auth_token [None req-9a7dc3a1-d5b6-4bd7-aede-f56282c753c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 18:27:55.128818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623db1e69c0 pid: 117996 (default app) Jul 26 18:28:40.018874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-be2933aa-9994-4fb4-85c5-ee44e4584d66 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] Calling method '.version_select at 0x7f390b8144c0>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:28:40.058398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:28:40.061005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:28:40.062368 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:28:40.063250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:28:40.840823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-be2933aa-9994-4fb4-85c5-ee44e4584d66 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ce860048-cdec-4897-9090-f1ccb036648a" status: 200 len: 351 microversion: 2.1 time: 1.163962 Jul 26 18:28:40.842084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1/1] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 18:28:39 2022] GET /compute/v2.1/os-volumes/ce860048-cdec-4897-9090-f1ccb036648a => generated 351 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:28:42.759247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8e3287a2-e67f-4178-bc67-6045b0ac5877 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] Calling method '.version_select at 0x7f390b8154c0>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:28:42.791463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=3 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:28:42.793590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=3 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:28:42.795703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=3 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:28:42.797257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=3 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:28:43.296057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8e3287a2-e67f-4178-bc67-6045b0ac5877 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/96057f0f-e9de-42b8-a3cf-42e2e3842c99" status: 200 len: 351 microversion: 2.1 time: 0.828449 Jul 26 18:28:43.296657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1/2] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 18:28:42 2022] GET /compute/v2.1/os-volumes/96057f0f-e9de-42b8-a3cf-42e2e3842c99 => generated 351 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:28:45.239050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-99d84ff7-7a3e-4b4b-afc6-15227df0b9c4 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] Calling method '.version_select at 0x7f390b66d790>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:28:45.350608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-99d84ff7-7a3e-4b4b-afc6-15227df0b9c4 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ca0a35a9-0e1a-4b0f-a750-3546028111d3" status: 200 len: 350 microversion: 2.1 time: 0.116210 Jul 26 18:28:45.351794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 18:28:45 2022] GET /compute/v2.1/os-volumes/ca0a35a9-0e1a-4b0f-a750-3546028111d3 => generated 350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:28:45.366121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-263d2763-f8bf-429a-9b54-b2e0f0524e1e tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] Calling method '.version_select at 0x7f390b66b700>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:28:45.637768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-263d2763-f8bf-429a-9b54-b2e0f0524e1e tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.276144 Jul 26 18:28:45.641247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Jul 26 18:28:45 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:28:45.660533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9df90062-9175-4b9c-877e-c8bea1df2708 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] Calling method '.version_select at 0x7f390b66d940>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:28:45.984050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9df90062-9175-4b9c-877e-c8bea1df2708 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.329218 Jul 26 18:28:45.984050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Jul 26 18:28:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:28:46.002712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d478cbad-ace6-493d-8e25-1673255e6a14 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] Calling method '.version_select at 0x7f390b62c3a0>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:28:46.420834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d478cbad-ace6-493d-8e25-1673255e6a14 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.420518 Jul 26 18:28:46.427076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 3/6] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Jul 26 18:28:45 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:28:46.440424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f4d81ef5-7abe-4b1d-a897-af7d25d2bc5d tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] Calling method '.version_select at 0x7f390b66dee0>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:28:46.899814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f4d81ef5-7abe-4b1d-a897-af7d25d2bc5d tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.463338 Jul 26 18:28:46.901132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Jul 26 18:28:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:28:46.934220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c43019ec-7eb8-47e3-bbb0-f759a9241777 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] Calling method '.version_select at 0x7f390b62c820>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:28:47.290306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c43019ec-7eb8-47e3-bbb0-f759a9241777 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.373493 Jul 26 18:28:47.291630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Jul 26 18:28:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:28:47.321162 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c20819a1-1703-41d3-b197-85603146baa1 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] Calling method '.version_select at 0x7f390b5c8a60>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:28:47.578258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c20819a1-1703-41d3-b197-85603146baa1 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.267865 Jul 26 18:28:47.579257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 5/9] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Jul 26 18:28:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:28:47.596763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e644969b-a8a5-4dc6-a907-c7dbdd908fd1 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] Calling method '.version_select at 0x7f390b5c2550>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:28:47.836155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e644969b-a8a5-4dc6-a907-c7dbdd908fd1 tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.243846 Jul 26 18:28:47.836742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 5/10] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Jul 26 18:28:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:28:47.863287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c40f4d6b-5612-41b5-9c33-a4d923eef41a tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] Calling method '.version_select at 0x7f390b5ceca0>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:28:48.119612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c40f4d6b-5612-41b5-9c33-a4d923eef41a tempest-VolumesTestJSON-1656646422 tempest-VolumesTestJSON-1656646422-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.272692 Jul 26 18:28:48.120297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 6/11] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Jul 26 18:28:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:28:52.239553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2021363407", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:28:52.452742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.network.neutron [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] validate_networks() for [('d771ab36-6c53-4bf5-afa1-e8b5cc654d65', None, None, None, None, None)] {{(pid=117996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:28:53.932457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-41ac744d-452f-4d0d-a129-cf9d86f1e850 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Action: 'create', calling method: .version_select at 0x7f390bf8eaf0>, body: {"keypair": {"name": "tempest-keypair-669500741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBe7TZXKgRFBLCYv6jxMKeuSwXzoEo8nDlpiIYXVL3QG5G2aj3fAh3mGJMWe0DqXPGE8kjMSjOgUSdUReJ913blGFZtxkTWFCfxCSp4g31y2ZbdGxdpjQIVHxDExDayH1Q=="}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:28:54.095936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-41ac744d-452f-4d0d-a129-cf9d86f1e850 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Getting quotas for project d28d9e015838454a91f519b76b8ee3a7. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:28:54.144191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-41ac744d-452f-4d0d-a129-cf9d86f1e850 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Getting quotas for user 2bc8e3428cac482c8bf505107ad00e00 and project d28d9e015838454a91f519b76b8ee3a7. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:28:54.345980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-41ac744d-452f-4d0d-a129-cf9d86f1e850 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.768526 Jul 26 18:28:54.347431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 7/12] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Jul 26 18:28:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:28:56.726388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Flavor limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:28:56.726943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Image limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:28:56.727324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Flavor pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:28:56.727946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Image pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:28:56.728514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:28:56.780061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:28:56.784609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:28:56.786334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:28:56.798265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:28:56.914651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Getting quotas for project e9c0885f4de641028b1e194802620fbc. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:28:56.937890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Getting quotas for user 43205ac588bc432fb8c9628fba37d445 and project e9c0885f4de641028b1e194802620fbc. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:28:56.974485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Going to run 1 instances... {{(pid=117996) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:28:56.987213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:28:57.234036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c3cce2c3-e07e-4733-9867-14e206b557b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.214472 Jul 26 18:28:57.244035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 6/13] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:28:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 5225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 18:28:57.251537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-248db3c4-48c8-4628-adfc-b971db9d9e3f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:28:57.254548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-248db3c4-48c8-4628-adfc-b971db9d9e3f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:28:57.414881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d62fd48b-9d12-4b55-a755-bec355356bcf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Action: 'create', calling method: .version_select at 0x7f390b59e4c0>, body: {"keypair": {"name": "tempest-keypair-1311746217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1G9OVUPTdpErWwHmGea2MvNJRgHTyhQHYB8kb/jVTqHgOM2jZtooQyc0WfLlMQyzT6f9+mgK+g1e5fBgbLb/i2uA13zuti3G6MtjbEXGy3xxlHkOe+0A6Med/1DOGeoQ=="}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:28:57.529587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-d62fd48b-9d12-4b55-a755-bec355356bcf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for project 765e809e332e4a478e09be17e6b3c385. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:28:57.540361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-d62fd48b-9d12-4b55-a755-bec355356bcf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for user 40f43a6429474c5e96db487ee85bbd84 and project 765e809e332e4a478e09be17e6b3c385. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:28:57.611547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d62fd48b-9d12-4b55-a755-bec355356bcf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.536011 Jul 26 18:28:57.612640 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 8/14] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Jul 26 18:28:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:28:57.616895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-248db3c4-48c8-4628-adfc-b971db9d9e3f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:28:57.641883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-248db3c4-48c8-4628-adfc-b971db9d9e3f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1222 microversion: 2.1 time: 0.396247 Jul 26 18:28:57.642719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 7/15] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:28:57 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1222 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:28:58.028279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-326085426", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:28:58.258657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] validate_networks() for [('d771ab36-6c53-4bf5-afa1-e8b5cc654d65', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:29:00.367989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-639313414", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "networks": [{"uuid": "5300d91e-eddf-4017-ac03-af657e804ee1"}]}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:00.478181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.network.neutron [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] validate_networks() for [('5300d91e-eddf-4017-ac03-af657e804ee1', None, None, None, None, None)] {{(pid=117996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:29:01.847222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:29:01.848184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:29:01.849384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:29:01.850696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:29:01.851728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:29:01.907451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:01.909035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:01.915173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:01.916656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:02.055670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Getting quotas for project e9c0885f4de641028b1e194802620fbc. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:29:02.098494 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Getting quotas for user 43205ac588bc432fb8c9628fba37d445 and project e9c0885f4de641028b1e194802620fbc. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:29:02.158144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:29:02.171712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:29:02.409373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-84b72e9e-e80c-4af5-929e-e9ec5c107d47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.386545 Jul 26 18:29:02.411152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 9/16] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:28:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 4389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 18:29:03.149681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7174731f-bad6-40a5-922e-a34ef2d9bd15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Action: 'create', calling method: .version_select at 0x7f390ac729d0>, body: {"keypair": {"name": "tempest-keypair-1998922636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhjIugzuJbmjCs+Y0zsRvsnN1EJKa+ULQlJNpIsLkLQjxHLQzlAMGk+E7EDU860GdhAST6F5tt1/ijjAt3J/Uy6UVtTvwHYIEnxZm1NSkFsznC/RbkQC2GVAftIArauGw=="}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:03.169093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-7174731f-bad6-40a5-922e-a34ef2d9bd15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Getting quotas for project b3955f1bf0e348ea85252259acb1b902. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:29:03.174819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-7174731f-bad6-40a5-922e-a34ef2d9bd15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Getting quotas for user 319c8a4be56b4fc2a00937f2fa36bcba and project b3955f1bf0e348ea85252259acb1b902. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:29:03.247838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7174731f-bad6-40a5-922e-a34ef2d9bd15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.830425 Jul 26 18:29:03.251543 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 10/17] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Jul 26 18:29:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 839 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 18:29:03.279764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3c8c1414-be2e-4df4-9e73-d5982145cf3e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:03.280723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3c8c1414-be2e-4df4-9e73-d5982145cf3e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:03.813577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Flavor limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:29:03.815418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Image limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:29:03.815752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Flavor pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:29:03.816981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Image pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:29:03.817889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:29:03.896872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:03.904731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:03.919231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:03.935333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:04.189253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Getting quotas for project f7afc92817c24e5fb66f77e1f8c03d0c. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:29:04.236348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Getting quotas for user 4443c05af61a421bab770eb9c33dede6 and project f7afc92817c24e5fb66f77e1f8c03d0c. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:29:04.313772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Going to run 1 instances... {{(pid=117996) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:29:04.355498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:29:04.592211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e2112e8a-c82d-49d1-81cb-f62ccfc0bfcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.602923 Jul 26 18:29:04.604772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 8/18] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:28:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 4605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 18:29:04.649525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1280511819", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "621ebb67-4f4a-4dae-b4d5-d0989c4ef140"}], "security_groups": [{"name": "tempest-securitygroup--88230604"}], "key_name": "tempest-keypair-669500741", "user_data": "}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:04.750883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3c8c1414-be2e-4df4-9e73-d5982145cf3e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:04.788696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3c8c1414-be2e-4df4-9e73-d5982145cf3e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1221 microversion: 2.1 time: 1.535093 Jul 26 18:29:04.794527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 11/19] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:03 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1221 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:04.806612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e27dc4a6-2ab4-4d10-987a-eda936108a0b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:04.829519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e27dc4a6-2ab4-4d10-987a-eda936108a0b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:05.389391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e27dc4a6-2ab4-4d10-987a-eda936108a0b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:05.398553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e27dc4a6-2ab4-4d10-987a-eda936108a0b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1214 microversion: 2.1 time: 0.600556 Jul 26 18:29:05.399173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 12/20] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:04 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1214 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:05.755881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.network.neutron [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] validate_networks() for [('621ebb67-4f4a-4dae-b4d5-d0989c4ef140', None, None, None, None, None)] {{(pid=117996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:29:05.819966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ab2fe76d-2b17-4a7e-a98a-6c8aceca1f24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:05.820634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ab2fe76d-2b17-4a7e-a98a-6c8aceca1f24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:05.851712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab2fe76d-2b17-4a7e-a98a-6c8aceca1f24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:05.852242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab2fe76d-2b17-4a7e-a98a-6c8aceca1f24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:05.853107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab2fe76d-2b17-4a7e-a98a-6c8aceca1f24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:05.853547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab2fe76d-2b17-4a7e-a98a-6c8aceca1f24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:06.558182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ab2fe76d-2b17-4a7e-a98a-6c8aceca1f24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:06.590908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ab2fe76d-2b17-4a7e-a98a-6c8aceca1f24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1273 microversion: 2.1 time: 0.775117 Jul 26 18:29:06.600728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 13/21] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:05 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1273 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:06.620286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-082041c3-fee1-4f50-bb22-141daeaab21f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:06.621814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-082041c3-fee1-4f50-bb22-141daeaab21f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:06.649810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-082041c3-fee1-4f50-bb22-141daeaab21f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:06.650470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-082041c3-fee1-4f50-bb22-141daeaab21f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:06.652341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-082041c3-fee1-4f50-bb22-141daeaab21f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:06.652927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-082041c3-fee1-4f50-bb22-141daeaab21f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:06.970042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-082041c3-fee1-4f50-bb22-141daeaab21f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:06.984031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-082041c3-fee1-4f50-bb22-141daeaab21f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1218 microversion: 2.1 time: 0.380926 Jul 26 18:29:06.986628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 14/22] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:06 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1218 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:07.322787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-48104006", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3e4e1db-4202-4baf-8f51-705a169c7395"}], "security_groups": [{"name": "tempest-securitygroup--464282980"}], "key_name": "tempest-keypair-1311746217", "user_data": "}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:07.667329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Flavor limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:29:07.667906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Image limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:29:07.668529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Flavor pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:29:07.668985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Image pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:29:07.669567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:29:07.707316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:07.708008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:07.718562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:07.719206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:07.814782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Getting quotas for project d28d9e015838454a91f519b76b8ee3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:29:07.816899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] validate_networks() for [('b3e4e1db-4202-4baf-8f51-705a169c7395', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:29:07.834132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Getting quotas for user 2bc8e3428cac482c8bf505107ad00e00 and project d28d9e015838454a91f519b76b8ee3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:29:07.894557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Going to run 1 instances... {{(pid=117996) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:29:07.899703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:29:08.079357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-83ef794f-f652-4a66-8f76-ddd02de42fec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.465597 Jul 26 18:29:08.081615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 9/23] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:29:04 2022] POST /compute/v2.1/servers => generated 400 bytes in 3474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 18:29:08.102954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fd8b9dc7-c1bf-4ac0-bb7d-b45f6de9a6ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:08.116438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fd8b9dc7-c1bf-4ac0-bb7d-b45f6de9a6ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:08.135136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd8b9dc7-c1bf-4ac0-bb7d-b45f6de9a6ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:08.135880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd8b9dc7-c1bf-4ac0-bb7d-b45f6de9a6ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:08.136842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd8b9dc7-c1bf-4ac0-bb7d-b45f6de9a6ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:08.149397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd8b9dc7-c1bf-4ac0-bb7d-b45f6de9a6ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:08.701038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fd8b9dc7-c1bf-4ac0-bb7d-b45f6de9a6ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:08.748606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fd8b9dc7-c1bf-4ac0-bb7d-b45f6de9a6ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1279 microversion: 2.1 time: 0.665258 Jul 26 18:29:08.760209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 10/24] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:08 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1279 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:08.779505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-245f233a-4862-4cca-9e74-85557b64bffb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:08.803334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-245f233a-4862-4cca-9e74-85557b64bffb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:08.831661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-245f233a-4862-4cca-9e74-85557b64bffb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:08.837466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-245f233a-4862-4cca-9e74-85557b64bffb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:08.842071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-245f233a-4862-4cca-9e74-85557b64bffb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:08.842986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-245f233a-4862-4cca-9e74-85557b64bffb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:10.010062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-245f233a-4862-4cca-9e74-85557b64bffb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:10.024240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-245f233a-4862-4cca-9e74-85557b64bffb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1272 microversion: 2.1 time: 1.261470 Jul 26 18:29:10.028326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 11/25] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:08 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1272 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:10.044344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e9ba6f8e-7e62-4ecb-a03d-a00656a1bbd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:10.045949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e9ba6f8e-7e62-4ecb-a03d-a00656a1bbd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:10.082411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9ba6f8e-7e62-4ecb-a03d-a00656a1bbd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:10.083335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9ba6f8e-7e62-4ecb-a03d-a00656a1bbd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:10.084560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9ba6f8e-7e62-4ecb-a03d-a00656a1bbd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:10.085165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9ba6f8e-7e62-4ecb-a03d-a00656a1bbd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:10.369894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e9ba6f8e-7e62-4ecb-a03d-a00656a1bbd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:10.434217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e9ba6f8e-7e62-4ecb-a03d-a00656a1bbd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1233 microversion: 2.1 time: 0.402869 Jul 26 18:29:10.437659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 12/26] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:10 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1233 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:10.471745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-174891fc-4e99-4af1-842c-8bf84b633155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:10.476958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-174891fc-4e99-4af1-842c-8bf84b633155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:10.505014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-174891fc-4e99-4af1-842c-8bf84b633155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:10.508099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-174891fc-4e99-4af1-842c-8bf84b633155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:10.512442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-174891fc-4e99-4af1-842c-8bf84b633155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:10.515213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-174891fc-4e99-4af1-842c-8bf84b633155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:10.885604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-174891fc-4e99-4af1-842c-8bf84b633155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:10.924336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-174891fc-4e99-4af1-842c-8bf84b633155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1279 microversion: 2.1 time: 0.476946 Jul 26 18:29:10.925586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 13/27] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:10 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1279 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:11.053972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8a24cb55-9e42-483d-b0e9-24688f34dd4b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:11.056167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8a24cb55-9e42-483d-b0e9-24688f34dd4b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:11.069997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8a24cb55-9e42-483d-b0e9-24688f34dd4b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:11.075060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8a24cb55-9e42-483d-b0e9-24688f34dd4b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:11.076700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8a24cb55-9e42-483d-b0e9-24688f34dd4b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:11.078597 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8a24cb55-9e42-483d-b0e9-24688f34dd4b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:12.009221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:12.194331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:29:12.195159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:29:12.195912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:29:12.196592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:29:12.197351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:29:12.259935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:12.261886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:12.265374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:12.266222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:12.370448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for project 765e809e332e4a478e09be17e6b3c385. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:29:12.382550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for user 40f43a6429474c5e96db487ee85bbd84 and project 765e809e332e4a478e09be17e6b3c385. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:29:12.418639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:29:12.426381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:29:12.563539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8a24cb55-9e42-483d-b0e9-24688f34dd4b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:12.569792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-70a93f67-5f23-49c8-8a49-db9ecb4e0825 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.259490 Jul 26 18:29:12.579431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 15/28] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:29:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 5271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 18:29:12.580757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8a24cb55-9e42-483d-b0e9-24688f34dd4b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 1.531101 Jul 26 18:29:12.581352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 14/29] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:11 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:12.603254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-98c967e8-fcd0-436a-a9d6-ce221a82b92a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:12.603965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-98c967e8-fcd0-436a-a9d6-ce221a82b92a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:12.614619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-86070228-be60-4159-87bc-fa4c2dd0fbf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:12.625476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98c967e8-fcd0-436a-a9d6-ce221a82b92a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:12.625923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98c967e8-fcd0-436a-a9d6-ce221a82b92a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:12.626703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98c967e8-fcd0-436a-a9d6-ce221a82b92a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:12.632013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-86070228-be60-4159-87bc-fa4c2dd0fbf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:12.632160 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98c967e8-fcd0-436a-a9d6-ce221a82b92a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:12.654385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86070228-be60-4159-87bc-fa4c2dd0fbf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:12.655275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86070228-be60-4159-87bc-fa4c2dd0fbf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:12.661172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86070228-be60-4159-87bc-fa4c2dd0fbf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:12.664720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86070228-be60-4159-87bc-fa4c2dd0fbf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:13.135317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-86070228-be60-4159-87bc-fa4c2dd0fbf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:13.146026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-86070228-be60-4159-87bc-fa4c2dd0fbf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1279 microversion: 2.1 time: 0.549862 Jul 26 18:29:13.167813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 15/30] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:12 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1279 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:13.185328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8f614044-1bcb-4418-9043-da0cdb4336d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:13.192063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8f614044-1bcb-4418-9043-da0cdb4336d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:13.194232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=9 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:13.297789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-98c967e8-fcd0-436a-a9d6-ce221a82b92a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:13.323978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-98c967e8-fcd0-436a-a9d6-ce221a82b92a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1295 microversion: 2.1 time: 0.732683 Jul 26 18:29:13.326199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 16/31] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:12 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1295 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:13.615754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ca014d4e-6d5d-4360-b850-70d3dedf1ca8 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:13.616892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ca014d4e-6d5d-4360-b850-70d3dedf1ca8 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:13.626978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca014d4e-6d5d-4360-b850-70d3dedf1ca8 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:13.632671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca014d4e-6d5d-4360-b850-70d3dedf1ca8 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:13.634389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca014d4e-6d5d-4360-b850-70d3dedf1ca8 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:13.637181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca014d4e-6d5d-4360-b850-70d3dedf1ca8 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:14.202303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ca014d4e-6d5d-4360-b850-70d3dedf1ca8 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:14.210238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ca014d4e-6d5d-4360-b850-70d3dedf1ca8 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.598782 Jul 26 18:29:14.211680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8f614044-1bcb-4418-9043-da0cdb4336d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:14.213848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 17/32] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:13 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:14.220347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8f614044-1bcb-4418-9043-da0cdb4336d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1240 microversion: 2.1 time: 1.060377 Jul 26 18:29:14.225506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-37014d86-2781-4e6a-bce8-b1e5c8d24ee1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:14.226124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-37014d86-2781-4e6a-bce8-b1e5c8d24ee1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:14.233578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 16/33] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:13 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1240 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:14.249362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-37014d86-2781-4e6a-bce8-b1e5c8d24ee1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:14.250144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-37014d86-2781-4e6a-bce8-b1e5c8d24ee1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:14.255249 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-37014d86-2781-4e6a-bce8-b1e5c8d24ee1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:14.255920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-37014d86-2781-4e6a-bce8-b1e5c8d24ee1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:14.353135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8c79befb-a02b-48cb-a377-af1c3df0e8f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:14.353905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8c79befb-a02b-48cb-a377-af1c3df0e8f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:14.365561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c79befb-a02b-48cb-a377-af1c3df0e8f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:14.366020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c79befb-a02b-48cb-a377-af1c3df0e8f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:14.366828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c79befb-a02b-48cb-a377-af1c3df0e8f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:14.371473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c79befb-a02b-48cb-a377-af1c3df0e8f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:14.543723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8c79befb-a02b-48cb-a377-af1c3df0e8f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:14.573498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8c79befb-a02b-48cb-a377-af1c3df0e8f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1295 microversion: 2.1 time: 0.225044 Jul 26 18:29:14.575605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 17/34] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:14 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1295 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:14.854366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-37014d86-2781-4e6a-bce8-b1e5c8d24ee1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:14.875105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-37014d86-2781-4e6a-bce8-b1e5c8d24ee1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.656581 Jul 26 18:29:14.877037 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 18/35] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:14 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:15.166587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-657603191", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49290e90-7614-44e5-9ae8-1548f5f0c05d"}], "security_groups": [{"name": "tempest-securitygroup--575959668"}], "key_name": "tempest-keypair-1998922636", "user_data": "}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:15.234847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ebb246fa-3c09-4cf7-be63-0fc6fc8fbc3f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:15.235509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ebb246fa-3c09-4cf7-be63-0fc6fc8fbc3f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:15.249518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebb246fa-3c09-4cf7-be63-0fc6fc8fbc3f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:15.251198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebb246fa-3c09-4cf7-be63-0fc6fc8fbc3f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:15.253848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebb246fa-3c09-4cf7-be63-0fc6fc8fbc3f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:15.255759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebb246fa-3c09-4cf7-be63-0fc6fc8fbc3f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:15.775197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.network.neutron [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] validate_networks() for [('49290e90-7614-44e5-9ae8-1548f5f0c05d', None, None, None, None, None)] {{(pid=117996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:29:15.847744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ebb246fa-3c09-4cf7-be63-0fc6fc8fbc3f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:15.863911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ebb246fa-3c09-4cf7-be63-0fc6fc8fbc3f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.630021 Jul 26 18:29:15.882065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 19/36] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:15 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:15.895107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9b8c4170-cb4f-4efb-b2bf-4f1a70d5687f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:15.898637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9b8c4170-cb4f-4efb-b2bf-4f1a70d5687f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:15.922881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b8c4170-cb4f-4efb-b2bf-4f1a70d5687f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:15.924053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b8c4170-cb4f-4efb-b2bf-4f1a70d5687f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:15.926449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b8c4170-cb4f-4efb-b2bf-4f1a70d5687f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:15.928102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b8c4170-cb4f-4efb-b2bf-4f1a70d5687f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:16.276757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9b8c4170-cb4f-4efb-b2bf-4f1a70d5687f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:16.291749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9b8c4170-cb4f-4efb-b2bf-4f1a70d5687f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1244 microversion: 2.1 time: 0.407269 Jul 26 18:29:16.292533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 20/37] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:15 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1244 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:16.302979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-95a6d817-5fde-4b97-91b3-0f5b377a7b34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:16.308682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-95a6d817-5fde-4b97-91b3-0f5b377a7b34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:16.332211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95a6d817-5fde-4b97-91b3-0f5b377a7b34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:16.335093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95a6d817-5fde-4b97-91b3-0f5b377a7b34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:16.336992 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95a6d817-5fde-4b97-91b3-0f5b377a7b34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:16.337450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95a6d817-5fde-4b97-91b3-0f5b377a7b34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:16.816289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-95a6d817-5fde-4b97-91b3-0f5b377a7b34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:16.835769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-95a6d817-5fde-4b97-91b3-0f5b377a7b34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.536523 Jul 26 18:29:16.841370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 21/38] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:16 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:16.855629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a556b37b-45ce-4afa-b5d0-4728c5ada3a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:16.856914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a556b37b-45ce-4afa-b5d0-4728c5ada3a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:16.868136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a556b37b-45ce-4afa-b5d0-4728c5ada3a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:16.868740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a556b37b-45ce-4afa-b5d0-4728c5ada3a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:16.869388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a556b37b-45ce-4afa-b5d0-4728c5ada3a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:16.869835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a556b37b-45ce-4afa-b5d0-4728c5ada3a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:16.888549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Flavor limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:29:16.889729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Image limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:29:16.890502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Flavor pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:29:16.891334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Image pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:29:16.892479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:29:16.919723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:16.920562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:16.921952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:16.922648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:16.951941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Getting quotas for project b3955f1bf0e348ea85252259acb1b902. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:29:16.958997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Getting quotas for user 319c8a4be56b4fc2a00937f2fa36bcba and project b3955f1bf0e348ea85252259acb1b902. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:29:16.998504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Going to run 1 instances... {{(pid=117996) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:29:17.001373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:29:17.123675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-293d959b-cbad-4a21-b1e0-7f91ed89e247 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.968120 Jul 26 18:29:17.130182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 18/39] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Jul 26 18:29:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 18:29:17.226989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a556b37b-45ce-4afa-b5d0-4728c5ada3a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:17.235753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a556b37b-45ce-4afa-b5d0-4728c5ada3a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.392170 Jul 26 18:29:17.236619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 22/40] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:16 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:17.257189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a7e496c8-6946-4e68-a5ad-a12fa44b7dcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:17.263857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a7e496c8-6946-4e68-a5ad-a12fa44b7dcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:17.301595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7e496c8-6946-4e68-a5ad-a12fa44b7dcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:17.306149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7e496c8-6946-4e68-a5ad-a12fa44b7dcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:17.307111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7e496c8-6946-4e68-a5ad-a12fa44b7dcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:17.307567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7e496c8-6946-4e68-a5ad-a12fa44b7dcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:17.622764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-c34ca461-c41f-4d36-afb1-ce8dd15eccaf req-9aebc027-675c-4d1f-aac6-0856b0c1ebe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fffb9029-1d38-416c-b4ad-a85f17a1db8a", "tag": "409f556e-16d1-4abe-a109-741f1646bdb8"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:17.657935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-c34ca461-c41f-4d36-afb1-ce8dd15eccaf req-9aebc027-675c-4d1f-aac6-0856b0c1ebe9 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:17.658379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-c34ca461-c41f-4d36-afb1-ce8dd15eccaf req-9aebc027-675c-4d1f-aac6-0856b0c1ebe9 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:17.684724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-c34ca461-c41f-4d36-afb1-ce8dd15eccaf req-9aebc027-675c-4d1f-aac6-0856b0c1ebe9 service nova] Creating event network-changed:409f556e-16d1-4abe-a109-741f1646bdb8 for instance fffb9029-1d38-416c-b4ad-a85f17a1db8a on hv-cinder-82549 Jul 26 18:29:17.685524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-c34ca461-c41f-4d36-afb1-ce8dd15eccaf req-9aebc027-675c-4d1f-aac6-0856b0c1ebe9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117996) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 18:29:17.686857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a722da6-1a4f-4a81-aef3-da40bb2b0f06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:17.687473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a722da6-1a4f-4a81-aef3-da40bb2b0f06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:17.688419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a722da6-1a4f-4a81-aef3-da40bb2b0f06 None None] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:17.689015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a722da6-1a4f-4a81-aef3-da40bb2b0f06 None None] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:17.700770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.compute.rpcapi [None req-9a722da6-1a4f-4a81-aef3-da40bb2b0f06 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 18:29:17.702043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a722da6-1a4f-4a81-aef3-da40bb2b0f06 None None] Releasing lock "compute-rpcapi-router" {{(pid=117996) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 18:29:17.721466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a7e496c8-6946-4e68-a5ad-a12fa44b7dcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:17.737651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9a722da6-1a4f-4a81-aef3-da40bb2b0f06 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.605336 Jul 26 18:29:17.738279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 19/41] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:29:17.754416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a7e496c8-6946-4e68-a5ad-a12fa44b7dcd tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.515862 Jul 26 18:29:17.755822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 23/42] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:17 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:17.755936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1e2ddb77-ca08-433f-9428-0cb0a95b8ce1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:17.756530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1e2ddb77-ca08-433f-9428-0cb0a95b8ce1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:17.771404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-96291259-63b4-4da1-b728-1bd774ac6121 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:17.773001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-96291259-63b4-4da1-b728-1bd774ac6121 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:17.780691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:17.785782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96291259-63b4-4da1-b728-1bd774ac6121 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:17.786725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96291259-63b4-4da1-b728-1bd774ac6121 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:17.796860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96291259-63b4-4da1-b728-1bd774ac6121 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:17.800004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96291259-63b4-4da1-b728-1bd774ac6121 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:17.893243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1e2ddb77-ca08-433f-9428-0cb0a95b8ce1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:17.902754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1e2ddb77-ca08-433f-9428-0cb0a95b8ce1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:17.905067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1e2ddb77-ca08-433f-9428-0cb0a95b8ce1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:17.906210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1e2ddb77-ca08-433f-9428-0cb0a95b8ce1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1281 microversion: 2.20 time: 0.156689 Jul 26 18:29:17.906776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 20/43] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:17.947127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-96291259-63b4-4da1-b728-1bd774ac6121 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:17.961311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-96291259-63b4-4da1-b728-1bd774ac6121 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1244 microversion: 2.1 time: 0.202996 Jul 26 18:29:17.962608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 24/44] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:17 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1244 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:17.978047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3bedc136-b7a4-420c-88e0-a3af213bac8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:17.979141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3bedc136-b7a4-420c-88e0-a3af213bac8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:17.988119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bedc136-b7a4-420c-88e0-a3af213bac8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:17.989130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bedc136-b7a4-420c-88e0-a3af213bac8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:17.990838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bedc136-b7a4-420c-88e0-a3af213bac8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:17.991612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bedc136-b7a4-420c-88e0-a3af213bac8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:18.145233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-203b0d61-db38-481a-9102-78cd9af7d239 req-693dbeb4-6195-426d-b1da-075b39d67fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf94d62-c20e-42ae-9403-03100f038397", "tag": "73091f36-aac1-4e25-a6ce-1b43c6c16961"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:18.199371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-203b0d61-db38-481a-9102-78cd9af7d239 req-693dbeb4-6195-426d-b1da-075b39d67fdc service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:18.199823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-203b0d61-db38-481a-9102-78cd9af7d239 req-693dbeb4-6195-426d-b1da-075b39d67fdc service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:18.206825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3bedc136-b7a4-420c-88e0-a3af213bac8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:18.215987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3bedc136-b7a4-420c-88e0-a3af213bac8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.248959 Jul 26 18:29:18.227136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 25/45] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:17 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:18.251993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-203b0d61-db38-481a-9102-78cd9af7d239 req-693dbeb4-6195-426d-b1da-075b39d67fdc service nova] Creating event network-changed:73091f36-aac1-4e25-a6ce-1b43c6c16961 for instance fbf94d62-c20e-42ae-9403-03100f038397 on hv-cinder-82549 Jul 26 18:29:18.259871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-203b0d61-db38-481a-9102-78cd9af7d239 req-693dbeb4-6195-426d-b1da-075b39d67fdc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.351149 Jul 26 18:29:18.260956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fd5bc716-aed4-4c74-abdb-8e223467d01d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:18.262667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 21/46] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:29:18.263546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fd5bc716-aed4-4c74-abdb-8e223467d01d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:18.282750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd5bc716-aed4-4c74-abdb-8e223467d01d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:18.284783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd5bc716-aed4-4c74-abdb-8e223467d01d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:18.286526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd5bc716-aed4-4c74-abdb-8e223467d01d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:18.289256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd5bc716-aed4-4c74-abdb-8e223467d01d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:18.598738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fd5bc716-aed4-4c74-abdb-8e223467d01d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:18.609276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fd5bc716-aed4-4c74-abdb-8e223467d01d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.355493 Jul 26 18:29:18.619194 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 26/47] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:18 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:18.783946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5748d2f1-a0ea-47e5-a3ee-5c2c969940b6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:18.784368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5748d2f1-a0ea-47e5-a3ee-5c2c969940b6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:18.799373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5748d2f1-a0ea-47e5-a3ee-5c2c969940b6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:18.799899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5748d2f1-a0ea-47e5-a3ee-5c2c969940b6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:18.807145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5748d2f1-a0ea-47e5-a3ee-5c2c969940b6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:18.807914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5748d2f1-a0ea-47e5-a3ee-5c2c969940b6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:18.932574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-73a9985e-d3b6-4088-b6be-37a5019bf495 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:18.933642 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-73a9985e-d3b6-4088-b6be-37a5019bf495 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:18.944777 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73a9985e-d3b6-4088-b6be-37a5019bf495 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:18.945664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73a9985e-d3b6-4088-b6be-37a5019bf495 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:18.947209 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73a9985e-d3b6-4088-b6be-37a5019bf495 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:18.948323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73a9985e-d3b6-4088-b6be-37a5019bf495 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:19.047553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5748d2f1-a0ea-47e5-a3ee-5c2c969940b6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:19.068264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5748d2f1-a0ea-47e5-a3ee-5c2c969940b6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.295661 Jul 26 18:29:19.083047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-73a9985e-d3b6-4088-b6be-37a5019bf495 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:19.083711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 22/48] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:18 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:19.093608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-73a9985e-d3b6-4088-b6be-37a5019bf495 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:19.095918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6d82233b-6848-4690-bf9b-08e9b2339e46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:19.096714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6d82233b-6848-4690-bf9b-08e9b2339e46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:19.097861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-73a9985e-d3b6-4088-b6be-37a5019bf495 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:19.103336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-73a9985e-d3b6-4088-b6be-37a5019bf495 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1285 microversion: 2.20 time: 0.174483 Jul 26 18:29:19.104242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 27/49] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:18 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:19.110030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d82233b-6848-4690-bf9b-08e9b2339e46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:19.110499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d82233b-6848-4690-bf9b-08e9b2339e46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:19.111340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d82233b-6848-4690-bf9b-08e9b2339e46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:19.111777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d82233b-6848-4690-bf9b-08e9b2339e46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:19.235035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6d82233b-6848-4690-bf9b-08e9b2339e46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:19.237926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-77b3a377-3c97-4073-a069-9f4896f7e6e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:19.238746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-77b3a377-3c97-4073-a069-9f4896f7e6e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:19.246610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6d82233b-6848-4690-bf9b-08e9b2339e46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1244 microversion: 2.1 time: 0.161509 Jul 26 18:29:19.246920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77b3a377-3c97-4073-a069-9f4896f7e6e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:19.247404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77b3a377-3c97-4073-a069-9f4896f7e6e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:19.258070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77b3a377-3c97-4073-a069-9f4896f7e6e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:19.258070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77b3a377-3c97-4073-a069-9f4896f7e6e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:19.259157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 23/50] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:19 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1244 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:19.486310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-77b3a377-3c97-4073-a069-9f4896f7e6e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:19.497752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-77b3a377-3c97-4073-a069-9f4896f7e6e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.263514 Jul 26 18:29:19.498947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 28/51] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:19 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:19.638416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ea071c6b-002a-497c-b59c-adc3757502b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:19.639364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ea071c6b-002a-497c-b59c-adc3757502b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:19.650071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea071c6b-002a-497c-b59c-adc3757502b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:19.650521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea071c6b-002a-497c-b59c-adc3757502b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:19.651335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea071c6b-002a-497c-b59c-adc3757502b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:19.652128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea071c6b-002a-497c-b59c-adc3757502b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:19.852731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ea071c6b-002a-497c-b59c-adc3757502b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:19.861707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ea071c6b-002a-497c-b59c-adc3757502b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.228022 Jul 26 18:29:19.862301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 24/52] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:19 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:20.103189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2a55f05f-4e90-407d-b2fe-5da82a8ca3ae tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:20.103802 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2a55f05f-4e90-407d-b2fe-5da82a8ca3ae tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:20.116580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a55f05f-4e90-407d-b2fe-5da82a8ca3ae tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:20.117403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a55f05f-4e90-407d-b2fe-5da82a8ca3ae tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:20.118598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a55f05f-4e90-407d-b2fe-5da82a8ca3ae tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:20.119323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a55f05f-4e90-407d-b2fe-5da82a8ca3ae tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:20.139788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c1eec435-ce4a-472e-995c-6faf7c22368a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:20.141436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c1eec435-ce4a-472e-995c-6faf7c22368a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:20.148627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c1eec435-ce4a-472e-995c-6faf7c22368a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:20.149097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c1eec435-ce4a-472e-995c-6faf7c22368a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:20.150066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c1eec435-ce4a-472e-995c-6faf7c22368a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:20.150495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c1eec435-ce4a-472e-995c-6faf7c22368a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:20.259636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c1eec435-ce4a-472e-995c-6faf7c22368a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:20.270001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c1eec435-ce4a-472e-995c-6faf7c22368a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:20.273287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c1eec435-ce4a-472e-995c-6faf7c22368a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:20.275498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c1eec435-ce4a-472e-995c-6faf7c22368a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1285 microversion: 2.20 time: 0.144841 Jul 26 18:29:20.277387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 25/53] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:20.283291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-daebe00a-b1fe-4bcf-80eb-7078986e12ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:20.284175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-daebe00a-b1fe-4bcf-80eb-7078986e12ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:20.293020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-daebe00a-b1fe-4bcf-80eb-7078986e12ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:20.294504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-daebe00a-b1fe-4bcf-80eb-7078986e12ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:20.295654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-daebe00a-b1fe-4bcf-80eb-7078986e12ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:20.296304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-daebe00a-b1fe-4bcf-80eb-7078986e12ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:20.354728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2a55f05f-4e90-407d-b2fe-5da82a8ca3ae tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:20.358304 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:20.365241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2a55f05f-4e90-407d-b2fe-5da82a8ca3ae tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.272758 Jul 26 18:29:20.367971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 29/54] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:20 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:20.369761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-daebe00a-b1fe-4bcf-80eb-7078986e12ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:20.379152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-daebe00a-b1fe-4bcf-80eb-7078986e12ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1244 microversion: 2.1 time: 0.100818 Jul 26 18:29:20.380788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 26/55] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:20 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1244 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:20.519166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b99a2275-6b51-4117-b507-59aaee61d84b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:20.519776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b99a2275-6b51-4117-b507-59aaee61d84b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:20.526854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b99a2275-6b51-4117-b507-59aaee61d84b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:20.527328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b99a2275-6b51-4117-b507-59aaee61d84b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:20.528094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b99a2275-6b51-4117-b507-59aaee61d84b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:20.528515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b99a2275-6b51-4117-b507-59aaee61d84b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:20.662047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b99a2275-6b51-4117-b507-59aaee61d84b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:20.669770 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b99a2275-6b51-4117-b507-59aaee61d84b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.154650 Jul 26 18:29:20.670353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 30/56] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:20 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:20.884013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a1765d60-9350-4761-ae22-fad1b0cd4b19 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:20.884655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a1765d60-9350-4761-ae22-fad1b0cd4b19 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:20.890900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1765d60-9350-4761-ae22-fad1b0cd4b19 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:20.891479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1765d60-9350-4761-ae22-fad1b0cd4b19 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:20.892156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1765d60-9350-4761-ae22-fad1b0cd4b19 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:20.892589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1765d60-9350-4761-ae22-fad1b0cd4b19 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:21.075668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a1765d60-9350-4761-ae22-fad1b0cd4b19 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:21.084142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a1765d60-9350-4761-ae22-fad1b0cd4b19 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.204036 Jul 26 18:29:21.084745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 27/57] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:20 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:21.315649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-47f5f2e7-3ecb-4041-bcfe-f95f6b9cea16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:21.316294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-47f5f2e7-3ecb-4041-bcfe-f95f6b9cea16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:21.323060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47f5f2e7-3ecb-4041-bcfe-f95f6b9cea16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:21.323542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47f5f2e7-3ecb-4041-bcfe-f95f6b9cea16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:21.324321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47f5f2e7-3ecb-4041-bcfe-f95f6b9cea16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:21.324744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47f5f2e7-3ecb-4041-bcfe-f95f6b9cea16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:21.392626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b58e9fab-0c35-4740-9d24-49f1f8c3e847 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:21.395687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b58e9fab-0c35-4740-9d24-49f1f8c3e847 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:21.399154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-47f5f2e7-3ecb-4041-bcfe-f95f6b9cea16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:21.403247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b58e9fab-0c35-4740-9d24-49f1f8c3e847 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:21.403677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b58e9fab-0c35-4740-9d24-49f1f8c3e847 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:21.404451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b58e9fab-0c35-4740-9d24-49f1f8c3e847 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:21.404917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b58e9fab-0c35-4740-9d24-49f1f8c3e847 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:21.408923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-47f5f2e7-3ecb-4041-bcfe-f95f6b9cea16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:21.410767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-47f5f2e7-3ecb-4041-bcfe-f95f6b9cea16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:21.412444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-47f5f2e7-3ecb-4041-bcfe-f95f6b9cea16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1285 microversion: 2.20 time: 0.111068 Jul 26 18:29:21.413088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 31/58] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:21 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:21.417775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-64614e1c-9c33-47c0-8cbf-fab11a8c5981 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:21.418703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-64614e1c-9c33-47c0-8cbf-fab11a8c5981 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:21.425699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-64614e1c-9c33-47c0-8cbf-fab11a8c5981 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:21.426487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-64614e1c-9c33-47c0-8cbf-fab11a8c5981 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:21.427924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-64614e1c-9c33-47c0-8cbf-fab11a8c5981 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:21.428749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-64614e1c-9c33-47c0-8cbf-fab11a8c5981 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:21.521502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-64614e1c-9c33-47c0-8cbf-fab11a8c5981 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:21.534307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-64614e1c-9c33-47c0-8cbf-fab11a8c5981 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1244 microversion: 2.1 time: 0.120060 Jul 26 18:29:21.537600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 32/59] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:21 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1244 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:21.558507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b58e9fab-0c35-4740-9d24-49f1f8c3e847 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:21.566269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b58e9fab-0c35-4740-9d24-49f1f8c3e847 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.177879 Jul 26 18:29:21.566995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 28/60] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:21 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:21.690842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-41af6462-aa6e-4ea4-91cc-52309884a28a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:21.692206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-41af6462-aa6e-4ea4-91cc-52309884a28a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:21.703243 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41af6462-aa6e-4ea4-91cc-52309884a28a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:21.703709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41af6462-aa6e-4ea4-91cc-52309884a28a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:21.704470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41af6462-aa6e-4ea4-91cc-52309884a28a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:21.704899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41af6462-aa6e-4ea4-91cc-52309884a28a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:21.848451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-41af6462-aa6e-4ea4-91cc-52309884a28a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:21.857807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-41af6462-aa6e-4ea4-91cc-52309884a28a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.171074 Jul 26 18:29:21.858612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 33/61] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:21 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:22.105192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f77be4e3-80d8-477d-9855-0623ac7f41a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:22.105819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f77be4e3-80d8-477d-9855-0623ac7f41a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:22.112159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f77be4e3-80d8-477d-9855-0623ac7f41a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:22.112594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f77be4e3-80d8-477d-9855-0623ac7f41a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:22.113337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f77be4e3-80d8-477d-9855-0623ac7f41a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:22.113760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f77be4e3-80d8-477d-9855-0623ac7f41a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:22.117880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:22.265375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f77be4e3-80d8-477d-9855-0623ac7f41a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:22.273478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f77be4e3-80d8-477d-9855-0623ac7f41a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.172104 Jul 26 18:29:22.274072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 29/62] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:22 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:22.436125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ae5fba98-7733-4f11-848b-f64b95853fae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:22.436702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ae5fba98-7733-4f11-848b-f64b95853fae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:22.438481 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:22.439155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=28 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:22.446003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae5fba98-7733-4f11-848b-f64b95853fae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:22.446451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae5fba98-7733-4f11-848b-f64b95853fae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:22.447242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae5fba98-7733-4f11-848b-f64b95853fae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:22.447694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae5fba98-7733-4f11-848b-f64b95853fae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:22.508791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ae5fba98-7733-4f11-848b-f64b95853fae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:22.517094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ae5fba98-7733-4f11-848b-f64b95853fae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:22.518604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ae5fba98-7733-4f11-848b-f64b95853fae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:22.519802 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ae5fba98-7733-4f11-848b-f64b95853fae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1285 microversion: 2.20 time: 0.087719 Jul 26 18:29:22.520338 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 34/63] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:22 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:22.556519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b43192b7-42be-4031-b2d3-ca2c32e9b936 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:22.557167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b43192b7-42be-4031-b2d3-ca2c32e9b936 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:22.563259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b43192b7-42be-4031-b2d3-ca2c32e9b936 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:22.563701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b43192b7-42be-4031-b2d3-ca2c32e9b936 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:22.564477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b43192b7-42be-4031-b2d3-ca2c32e9b936 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:22.564897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b43192b7-42be-4031-b2d3-ca2c32e9b936 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:22.587201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-378b0710-ef0b-49bf-a50e-72c948650a8b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:22.587816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-378b0710-ef0b-49bf-a50e-72c948650a8b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:22.594796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-378b0710-ef0b-49bf-a50e-72c948650a8b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:22.595272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-378b0710-ef0b-49bf-a50e-72c948650a8b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:22.596056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-378b0710-ef0b-49bf-a50e-72c948650a8b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:22.596492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-378b0710-ef0b-49bf-a50e-72c948650a8b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:22.627477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b43192b7-42be-4031-b2d3-ca2c32e9b936 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:22.635725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b43192b7-42be-4031-b2d3-ca2c32e9b936 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1244 microversion: 2.1 time: 0.084041 Jul 26 18:29:22.636320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 30/64] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:22 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:22.736061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-378b0710-ef0b-49bf-a50e-72c948650a8b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:22.744176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-378b0710-ef0b-49bf-a50e-72c948650a8b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.160848 Jul 26 18:29:22.744764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 35/65] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:22 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:22.880167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f513bde6-64b4-44d8-9581-914c9424acec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:22.880762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f513bde6-64b4-44d8-9581-914c9424acec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:22.892211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f513bde6-64b4-44d8-9581-914c9424acec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:22.893003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f513bde6-64b4-44d8-9581-914c9424acec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:22.894388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f513bde6-64b4-44d8-9581-914c9424acec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:22.895164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f513bde6-64b4-44d8-9581-914c9424acec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:23.037078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f513bde6-64b4-44d8-9581-914c9424acec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:23.047984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f513bde6-64b4-44d8-9581-914c9424acec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.171664 Jul 26 18:29:23.048753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 31/66] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:22 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:23.295348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d321949c-bf23-4340-a6ad-d53c79babd20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:23.295851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d321949c-bf23-4340-a6ad-d53c79babd20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:23.302175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d321949c-bf23-4340-a6ad-d53c79babd20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:23.302935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d321949c-bf23-4340-a6ad-d53c79babd20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:23.304093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d321949c-bf23-4340-a6ad-d53c79babd20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:23.304721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d321949c-bf23-4340-a6ad-d53c79babd20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:23.458250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d321949c-bf23-4340-a6ad-d53c79babd20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:23.466783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d321949c-bf23-4340-a6ad-d53c79babd20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.175645 Jul 26 18:29:23.467404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 36/67] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:23 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:23.542437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a5f71e02-d9db-48f5-aed0-f88cb001c5f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:23.543097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a5f71e02-d9db-48f5-aed0-f88cb001c5f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:23.549802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5f71e02-d9db-48f5-aed0-f88cb001c5f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:23.550240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5f71e02-d9db-48f5-aed0-f88cb001c5f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:23.551251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5f71e02-d9db-48f5-aed0-f88cb001c5f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:23.551757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5f71e02-d9db-48f5-aed0-f88cb001c5f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:23.629387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a5f71e02-d9db-48f5-aed0-f88cb001c5f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:23.638598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a5f71e02-d9db-48f5-aed0-f88cb001c5f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:23.640132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a5f71e02-d9db-48f5-aed0-f88cb001c5f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:23.641463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a5f71e02-d9db-48f5-aed0-f88cb001c5f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1285 microversion: 2.20 time: 0.103081 Jul 26 18:29:23.642109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 32/68] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:23 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:23.660664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-07e59aa4-1e9b-47cd-a4bf-63a64305955d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:23.661274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-07e59aa4-1e9b-47cd-a4bf-63a64305955d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:23.668009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07e59aa4-1e9b-47cd-a4bf-63a64305955d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:23.668456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07e59aa4-1e9b-47cd-a4bf-63a64305955d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:23.669278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07e59aa4-1e9b-47cd-a4bf-63a64305955d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:23.669726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07e59aa4-1e9b-47cd-a4bf-63a64305955d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:23.734692 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-07e59aa4-1e9b-47cd-a4bf-63a64305955d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:23.743356 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-07e59aa4-1e9b-47cd-a4bf-63a64305955d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1244 microversion: 2.1 time: 0.086502 Jul 26 18:29:23.743939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 37/69] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:23 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:23.766352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-db362398-5b46-42c1-9199-4ceef6757cf2 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:23.766551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-db362398-5b46-42c1-9199-4ceef6757cf2 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:23.773031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db362398-5b46-42c1-9199-4ceef6757cf2 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:23.773501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db362398-5b46-42c1-9199-4ceef6757cf2 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:23.774399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db362398-5b46-42c1-9199-4ceef6757cf2 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:23.774794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db362398-5b46-42c1-9199-4ceef6757cf2 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:23.925543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-db362398-5b46-42c1-9199-4ceef6757cf2 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:23.933363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-db362398-5b46-42c1-9199-4ceef6757cf2 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.171349 Jul 26 18:29:23.933940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 33/70] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:23 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:24.072229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-164d9c70-0085-4e35-944e-8667480a5c71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:24.072834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-164d9c70-0085-4e35-944e-8667480a5c71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:24.079470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-164d9c70-0085-4e35-944e-8667480a5c71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:24.079916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-164d9c70-0085-4e35-944e-8667480a5c71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:24.080693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-164d9c70-0085-4e35-944e-8667480a5c71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:24.081118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-164d9c70-0085-4e35-944e-8667480a5c71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:24.233473 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-164d9c70-0085-4e35-944e-8667480a5c71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:24.241197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-164d9c70-0085-4e35-944e-8667480a5c71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.173572 Jul 26 18:29:24.241717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 38/71] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:24 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:24.487925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fedd46a7-eb5f-4b9c-9a9d-0a066a2d92d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:24.488529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fedd46a7-eb5f-4b9c-9a9d-0a066a2d92d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:24.494829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fedd46a7-eb5f-4b9c-9a9d-0a066a2d92d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:24.495305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fedd46a7-eb5f-4b9c-9a9d-0a066a2d92d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:24.496088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fedd46a7-eb5f-4b9c-9a9d-0a066a2d92d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:24.496524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fedd46a7-eb5f-4b9c-9a9d-0a066a2d92d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:24.640582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fedd46a7-eb5f-4b9c-9a9d-0a066a2d92d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:24.648490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fedd46a7-eb5f-4b9c-9a9d-0a066a2d92d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.164361 Jul 26 18:29:24.649075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 34/72] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:24 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:24.664763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d6f4f2cc-05ae-43b4-a65b-3d7a3378d1bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:24.665331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d6f4f2cc-05ae-43b4-a65b-3d7a3378d1bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:24.671817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6f4f2cc-05ae-43b4-a65b-3d7a3378d1bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:24.672283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6f4f2cc-05ae-43b4-a65b-3d7a3378d1bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:24.673041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6f4f2cc-05ae-43b4-a65b-3d7a3378d1bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:24.673468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6f4f2cc-05ae-43b4-a65b-3d7a3378d1bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:24.745480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d6f4f2cc-05ae-43b4-a65b-3d7a3378d1bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:24.754007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d6f4f2cc-05ae-43b4-a65b-3d7a3378d1bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:24.755708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d6f4f2cc-05ae-43b4-a65b-3d7a3378d1bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:24.756818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d6f4f2cc-05ae-43b4-a65b-3d7a3378d1bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1285 microversion: 2.20 time: 0.096194 Jul 26 18:29:24.757373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 39/73] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:24.764733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fa0af75d-7dc2-413d-b0e6-e93f7706fb18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:24.765370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fa0af75d-7dc2-413d-b0e6-e93f7706fb18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:24.772364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa0af75d-7dc2-413d-b0e6-e93f7706fb18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:24.772813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa0af75d-7dc2-413d-b0e6-e93f7706fb18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:24.773578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa0af75d-7dc2-413d-b0e6-e93f7706fb18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:24.773977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa0af75d-7dc2-413d-b0e6-e93f7706fb18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:24.839251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fa0af75d-7dc2-413d-b0e6-e93f7706fb18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:24.847272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fa0af75d-7dc2-413d-b0e6-e93f7706fb18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1244 microversion: 2.1 time: 0.086310 Jul 26 18:29:24.847888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 35/74] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:24 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:24.954838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-902ed4ae-1190-4f94-a44e-d3b5300085ff tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:24.955477 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-902ed4ae-1190-4f94-a44e-d3b5300085ff tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:24.961940 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-902ed4ae-1190-4f94-a44e-d3b5300085ff tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:24.962480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-902ed4ae-1190-4f94-a44e-d3b5300085ff tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:24.963349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-902ed4ae-1190-4f94-a44e-d3b5300085ff tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:24.963775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-902ed4ae-1190-4f94-a44e-d3b5300085ff tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:25.197005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-902ed4ae-1190-4f94-a44e-d3b5300085ff tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:25.204594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-902ed4ae-1190-4f94-a44e-d3b5300085ff tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.253594 Jul 26 18:29:25.205173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 40/75] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:24 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:25.262250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-65ed4a1b-ebd4-47d9-aba3-6c2f9e14487a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:25.262949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-65ed4a1b-ebd4-47d9-aba3-6c2f9e14487a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:25.269783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65ed4a1b-ebd4-47d9-aba3-6c2f9e14487a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:25.270163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65ed4a1b-ebd4-47d9-aba3-6c2f9e14487a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:25.271046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65ed4a1b-ebd4-47d9-aba3-6c2f9e14487a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:25.271515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65ed4a1b-ebd4-47d9-aba3-6c2f9e14487a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:25.507934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-65ed4a1b-ebd4-47d9-aba3-6c2f9e14487a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:25.516055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-65ed4a1b-ebd4-47d9-aba3-6c2f9e14487a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.257825 Jul 26 18:29:25.516640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 36/76] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:25 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:25.670433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d5cf0aee-9053-43a1-af53-25c0e73e9b0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:25.671057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d5cf0aee-9053-43a1-af53-25c0e73e9b0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:25.678187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d5cf0aee-9053-43a1-af53-25c0e73e9b0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:25.678619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d5cf0aee-9053-43a1-af53-25c0e73e9b0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:25.679456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d5cf0aee-9053-43a1-af53-25c0e73e9b0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:25.679915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d5cf0aee-9053-43a1-af53-25c0e73e9b0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:25.780799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-36ca0e69-fddd-4f4e-97a6-9e498a09cb74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:25.781690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-36ca0e69-fddd-4f4e-97a6-9e498a09cb74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:25.798664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36ca0e69-fddd-4f4e-97a6-9e498a09cb74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:25.799477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36ca0e69-fddd-4f4e-97a6-9e498a09cb74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:25.800839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36ca0e69-fddd-4f4e-97a6-9e498a09cb74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:25.801575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36ca0e69-fddd-4f4e-97a6-9e498a09cb74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:25.896842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-36ca0e69-fddd-4f4e-97a6-9e498a09cb74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:25.906296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-36ca0e69-fddd-4f4e-97a6-9e498a09cb74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:25.908512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-36ca0e69-fddd-4f4e-97a6-9e498a09cb74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:25.909839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-36ca0e69-fddd-4f4e-97a6-9e498a09cb74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1277 microversion: 2.20 time: 0.134070 Jul 26 18:29:25.910374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 37/77] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1277 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:25.915531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2df6c540-7ebd-4a63-89e2-7f6d02a24a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:25.916415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2df6c540-7ebd-4a63-89e2-7f6d02a24a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:25.932045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2df6c540-7ebd-4a63-89e2-7f6d02a24a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:25.932466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2df6c540-7ebd-4a63-89e2-7f6d02a24a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:25.933230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2df6c540-7ebd-4a63-89e2-7f6d02a24a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:25.933649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2df6c540-7ebd-4a63-89e2-7f6d02a24a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:26.023251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d5cf0aee-9053-43a1-af53-25c0e73e9b0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:26.024945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2df6c540-7ebd-4a63-89e2-7f6d02a24a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:26.041396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2df6c540-7ebd-4a63-89e2-7f6d02a24a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1236 microversion: 2.1 time: 0.129487 Jul 26 18:29:26.055050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d5cf0aee-9053-43a1-af53-25c0e73e9b0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.377306 Jul 26 18:29:26.055498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 38/78] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:25 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1236 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:26.055577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 41/79] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:25 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:26.228229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-826319ef-7a88-4358-87e1-5a0ff39c7d3e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:26.229103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-826319ef-7a88-4358-87e1-5a0ff39c7d3e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:26.238833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-826319ef-7a88-4358-87e1-5a0ff39c7d3e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:26.239663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-826319ef-7a88-4358-87e1-5a0ff39c7d3e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:26.240661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-826319ef-7a88-4358-87e1-5a0ff39c7d3e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:26.241275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-826319ef-7a88-4358-87e1-5a0ff39c7d3e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:26.321285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-4e76a8bb-b513-4ec4-aa4d-ad6aeea12685 req-4bded53f-943e-4bba-bb80-03e068f5e4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8422a278-bb13-476d-9fed-a2ea1b310a91", "tag": "15966349-d3d2-4cea-88a5-c2fb5f9aafe2"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:26.347440 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-4e76a8bb-b513-4ec4-aa4d-ad6aeea12685 req-4bded53f-943e-4bba-bb80-03e068f5e4a9 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:26.355841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-4e76a8bb-b513-4ec4-aa4d-ad6aeea12685 req-4bded53f-943e-4bba-bb80-03e068f5e4a9 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:26.387486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-4e76a8bb-b513-4ec4-aa4d-ad6aeea12685 req-4bded53f-943e-4bba-bb80-03e068f5e4a9 service nova] Creating event network-changed:15966349-d3d2-4cea-88a5-c2fb5f9aafe2 for instance 8422a278-bb13-476d-9fed-a2ea1b310a91 on hv-cinder-82549 Jul 26 18:29:26.389457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-4e76a8bb-b513-4ec4-aa4d-ad6aeea12685 req-4bded53f-943e-4bba-bb80-03e068f5e4a9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117997) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 18:29:26.390854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-279f42df-4b2e-426a-af2b-74390bcd4cc9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:26.391466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-279f42df-4b2e-426a-af2b-74390bcd4cc9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:26.392393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-279f42df-4b2e-426a-af2b-74390bcd4cc9 None None] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:26.392921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-279f42df-4b2e-426a-af2b-74390bcd4cc9 None None] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:26.407499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.compute.rpcapi [None req-279f42df-4b2e-426a-af2b-74390bcd4cc9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 18:29:26.408593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-279f42df-4b2e-426a-af2b-74390bcd4cc9 None None] Releasing lock "compute-rpcapi-router" {{(pid=117997) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 18:29:26.456447 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-279f42df-4b2e-426a-af2b-74390bcd4cc9 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143590 Jul 26 18:29:26.457570 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 42/80] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:29:26.530192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-826319ef-7a88-4358-87e1-5a0ff39c7d3e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:26.547377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8f199c69-b329-44e5-8ac0-b9deaa7c2854 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:26.553990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8f199c69-b329-44e5-8ac0-b9deaa7c2854 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:26.570968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-826319ef-7a88-4358-87e1-5a0ff39c7d3e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.347634 Jul 26 18:29:26.575850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 39/81] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:26 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:26.581427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8f199c69-b329-44e5-8ac0-b9deaa7c2854 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:26.581874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8f199c69-b329-44e5-8ac0-b9deaa7c2854 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:26.582672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8f199c69-b329-44e5-8ac0-b9deaa7c2854 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:26.583557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8f199c69-b329-44e5-8ac0-b9deaa7c2854 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:26.768683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8f199c69-b329-44e5-8ac0-b9deaa7c2854 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:26.776936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8f199c69-b329-44e5-8ac0-b9deaa7c2854 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.241978 Jul 26 18:29:26.777506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 43/82] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:26 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:26.934565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d4c3a368-4506-4b54-ac49-7f491062ac9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:26.935365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d4c3a368-4506-4b54-ac49-7f491062ac9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:26.942961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4c3a368-4506-4b54-ac49-7f491062ac9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:26.943440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4c3a368-4506-4b54-ac49-7f491062ac9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:26.944201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4c3a368-4506-4b54-ac49-7f491062ac9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:26.944627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4c3a368-4506-4b54-ac49-7f491062ac9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:27.012388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d4c3a368-4506-4b54-ac49-7f491062ac9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:27.020713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d4c3a368-4506-4b54-ac49-7f491062ac9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:27.022231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d4c3a368-4506-4b54-ac49-7f491062ac9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:27.027115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d4c3a368-4506-4b54-ac49-7f491062ac9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1277 microversion: 2.20 time: 0.093676 Jul 26 18:29:27.027115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 40/83] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:27.065807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-95112aa4-217c-4698-a050-03a55d6ad84d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:27.066484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-95112aa4-217c-4698-a050-03a55d6ad84d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:27.069516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8d8ce327-1b5b-4cca-90fa-02439698b53b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:27.070209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8d8ce327-1b5b-4cca-90fa-02439698b53b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:27.073958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95112aa4-217c-4698-a050-03a55d6ad84d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:27.074428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95112aa4-217c-4698-a050-03a55d6ad84d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:27.075417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95112aa4-217c-4698-a050-03a55d6ad84d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:27.075876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95112aa4-217c-4698-a050-03a55d6ad84d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:27.078037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d8ce327-1b5b-4cca-90fa-02439698b53b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:27.078513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d8ce327-1b5b-4cca-90fa-02439698b53b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:27.079711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d8ce327-1b5b-4cca-90fa-02439698b53b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:27.080198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d8ce327-1b5b-4cca-90fa-02439698b53b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:27.142421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-95112aa4-217c-4698-a050-03a55d6ad84d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:27.151789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-95112aa4-217c-4698-a050-03a55d6ad84d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1236 microversion: 2.1 time: 0.089693 Jul 26 18:29:27.152282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 44/84] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:27 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:27.227054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8d8ce327-1b5b-4cca-90fa-02439698b53b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:27.237937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8d8ce327-1b5b-4cca-90fa-02439698b53b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.172119 Jul 26 18:29:27.238914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 41/85] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:27 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:27.610297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8344a40e-7e9f-423d-9c8c-4c8691d8bd28 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:27.611048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8344a40e-7e9f-423d-9c8c-4c8691d8bd28 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:27.618138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8344a40e-7e9f-423d-9c8c-4c8691d8bd28 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:27.618686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8344a40e-7e9f-423d-9c8c-4c8691d8bd28 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:27.619549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8344a40e-7e9f-423d-9c8c-4c8691d8bd28 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:27.619998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8344a40e-7e9f-423d-9c8c-4c8691d8bd28 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:27.792215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8344a40e-7e9f-423d-9c8c-4c8691d8bd28 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:27.800591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8344a40e-7e9f-423d-9c8c-4c8691d8bd28 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.194258 Jul 26 18:29:27.800793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2eec8905-7cef-4d64-bff4-9254cd300675 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:27.801077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 45/86] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:27 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:27.801189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2eec8905-7cef-4d64-bff4-9254cd300675 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:27.803400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=10 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:27.809283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2eec8905-7cef-4d64-bff4-9254cd300675 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:27.809822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2eec8905-7cef-4d64-bff4-9254cd300675 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:27.810603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2eec8905-7cef-4d64-bff4-9254cd300675 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:27.811050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2eec8905-7cef-4d64-bff4-9254cd300675 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:27.898216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=30 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:27.968293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2eec8905-7cef-4d64-bff4-9254cd300675 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:27.977481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2eec8905-7cef-4d64-bff4-9254cd300675 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.182405 Jul 26 18:29:27.978362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 42/87] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:27 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:28.047769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5e2930d0-1310-4946-93db-1097d6ce7e82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:28.048449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5e2930d0-1310-4946-93db-1097d6ce7e82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:28.055620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e2930d0-1310-4946-93db-1097d6ce7e82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:28.055972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e2930d0-1310-4946-93db-1097d6ce7e82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:28.056760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e2930d0-1310-4946-93db-1097d6ce7e82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:28.057197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e2930d0-1310-4946-93db-1097d6ce7e82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:28.142130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5e2930d0-1310-4946-93db-1097d6ce7e82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:28.145932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:28.151651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5e2930d0-1310-4946-93db-1097d6ce7e82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:28.153153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5e2930d0-1310-4946-93db-1097d6ce7e82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:28.154289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5e2930d0-1310-4946-93db-1097d6ce7e82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1277 microversion: 2.20 time: 0.110942 Jul 26 18:29:28.154828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 46/88] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:28.174855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b829d8b6-e6b8-4e33-b0bc-adb5da7b06ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:28.175136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b829d8b6-e6b8-4e33-b0bc-adb5da7b06ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:28.181854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b829d8b6-e6b8-4e33-b0bc-adb5da7b06ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:28.182307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b829d8b6-e6b8-4e33-b0bc-adb5da7b06ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:28.183114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b829d8b6-e6b8-4e33-b0bc-adb5da7b06ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:28.183555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b829d8b6-e6b8-4e33-b0bc-adb5da7b06ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:28.250033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b829d8b6-e6b8-4e33-b0bc-adb5da7b06ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:28.259766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d6f7980d-3d25-4328-8f29-5a8954780a13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:28.260371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d6f7980d-3d25-4328-8f29-5a8954780a13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:28.263886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b829d8b6-e6b8-4e33-b0bc-adb5da7b06ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1292 microversion: 2.1 time: 0.093011 Jul 26 18:29:28.264916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 43/89] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:28 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:28.266825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6f7980d-3d25-4328-8f29-5a8954780a13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:28.267286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6f7980d-3d25-4328-8f29-5a8954780a13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:28.268048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6f7980d-3d25-4328-8f29-5a8954780a13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:28.268479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6f7980d-3d25-4328-8f29-5a8954780a13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:28.444255 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d6f7980d-3d25-4328-8f29-5a8954780a13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:28.453451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d6f7980d-3d25-4328-8f29-5a8954780a13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.197604 Jul 26 18:29:28.454093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 47/90] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:28 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:28.479389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-8ea87110-d1fa-4e68-967a-ad6812f58ee1 req-11ffe282-c8c8-49e3-aee5-308d3aee4ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99df3fd1-46e9-4842-9e60-b69d557d60c2", "tag": "53af1993-485e-4c66-b4ad-cc0182bef59d"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:28.489965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-8ea87110-d1fa-4e68-967a-ad6812f58ee1 req-11ffe282-c8c8-49e3-aee5-308d3aee4ab1 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:28.490401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-8ea87110-d1fa-4e68-967a-ad6812f58ee1 req-11ffe282-c8c8-49e3-aee5-308d3aee4ab1 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:28.501761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-8ea87110-d1fa-4e68-967a-ad6812f58ee1 req-11ffe282-c8c8-49e3-aee5-308d3aee4ab1 service nova] Creating event network-changed:53af1993-485e-4c66-b4ad-cc0182bef59d for instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 on hv-cinder-82549 Jul 26 18:29:28.507634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-8ea87110-d1fa-4e68-967a-ad6812f58ee1 req-11ffe282-c8c8-49e3-aee5-308d3aee4ab1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031957 Jul 26 18:29:28.508636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 44/91] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:29:28.824969 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d30e1ddb-f879-491f-85c8-f1231a182a23 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:28.825616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d30e1ddb-f879-491f-85c8-f1231a182a23 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:28.832837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d30e1ddb-f879-491f-85c8-f1231a182a23 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:28.833260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d30e1ddb-f879-491f-85c8-f1231a182a23 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:28.834110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d30e1ddb-f879-491f-85c8-f1231a182a23 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:28.834620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d30e1ddb-f879-491f-85c8-f1231a182a23 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:28.981810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d30e1ddb-f879-491f-85c8-f1231a182a23 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:28.995533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d30e1ddb-f879-491f-85c8-f1231a182a23 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.174345 Jul 26 18:29:28.996566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 48/92] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:28 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:28.999568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-78d2a1a8-88be-46ed-bded-5c2a43a6da74 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:29.000300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-78d2a1a8-88be-46ed-bded-5c2a43a6da74 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:29.007217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-78d2a1a8-88be-46ed-bded-5c2a43a6da74 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:29.007661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-78d2a1a8-88be-46ed-bded-5c2a43a6da74 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:29.008444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-78d2a1a8-88be-46ed-bded-5c2a43a6da74 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:29.008879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-78d2a1a8-88be-46ed-bded-5c2a43a6da74 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:29.163976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-78d2a1a8-88be-46ed-bded-5c2a43a6da74 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:29.176295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d4f399d7-f5fb-4f61-be25-19a8d997766d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:29.176945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d4f399d7-f5fb-4f61-be25-19a8d997766d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:29.178269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-78d2a1a8-88be-46ed-bded-5c2a43a6da74 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.183099 Jul 26 18:29:29.179495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 45/93] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:28 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:29.185148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d4f399d7-f5fb-4f61-be25-19a8d997766d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:29.185595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d4f399d7-f5fb-4f61-be25-19a8d997766d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:29.186423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d4f399d7-f5fb-4f61-be25-19a8d997766d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:29.186874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d4f399d7-f5fb-4f61-be25-19a8d997766d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:29.286883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bd578808-ca38-43dc-aaed-c737ccd7944e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:29.288735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bd578808-ca38-43dc-aaed-c737ccd7944e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:29.291440 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d4f399d7-f5fb-4f61-be25-19a8d997766d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:29.301059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd578808-ca38-43dc-aaed-c737ccd7944e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:29.302074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd578808-ca38-43dc-aaed-c737ccd7944e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:29.303224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd578808-ca38-43dc-aaed-c737ccd7944e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:29.303870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd578808-ca38-43dc-aaed-c737ccd7944e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:29.308414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d4f399d7-f5fb-4f61-be25-19a8d997766d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:29.309985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d4f399d7-f5fb-4f61-be25-19a8d997766d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:29.311174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d4f399d7-f5fb-4f61-be25-19a8d997766d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1277 microversion: 2.20 time: 0.138718 Jul 26 18:29:29.311733 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 49/94] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:29:29.332974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:29.410531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bd578808-ca38-43dc-aaed-c737ccd7944e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:29.418996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bd578808-ca38-43dc-aaed-c737ccd7944e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1292 microversion: 2.1 time: 0.136642 Jul 26 18:29:29.419745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 46/95] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:29 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1292 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:29.474158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-399a2a82-5abc-4d2c-9a28-48c95f28a163 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:29.474759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-399a2a82-5abc-4d2c-9a28-48c95f28a163 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:29.481407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-399a2a82-5abc-4d2c-9a28-48c95f28a163 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:29.481852 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-399a2a82-5abc-4d2c-9a28-48c95f28a163 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:29.482623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-399a2a82-5abc-4d2c-9a28-48c95f28a163 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:29.483105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-399a2a82-5abc-4d2c-9a28-48c95f28a163 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:30.018253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b388c779-0c44-45a5-8ff8-493b2872b756 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:30.019197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b388c779-0c44-45a5-8ff8-493b2872b756 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:30.025931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b388c779-0c44-45a5-8ff8-493b2872b756 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:30.026704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b388c779-0c44-45a5-8ff8-493b2872b756 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:30.027558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b388c779-0c44-45a5-8ff8-493b2872b756 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:30.027972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b388c779-0c44-45a5-8ff8-493b2872b756 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:30.041177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-399a2a82-5abc-4d2c-9a28-48c95f28a163 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:30.052252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-399a2a82-5abc-4d2c-9a28-48c95f28a163 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.581915 Jul 26 18:29:30.066465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 50/96] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:29 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:30.174953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b388c779-0c44-45a5-8ff8-493b2872b756 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:30.187891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b388c779-0c44-45a5-8ff8-493b2872b756 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.173183 Jul 26 18:29:30.188729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 47/97] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:30 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:30.200603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-87bc8070-da63-4bcd-97d7-05310030e59f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:30.201339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-87bc8070-da63-4bcd-97d7-05310030e59f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:30.209625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-87bc8070-da63-4bcd-97d7-05310030e59f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:30.210066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-87bc8070-da63-4bcd-97d7-05310030e59f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:30.210834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-87bc8070-da63-4bcd-97d7-05310030e59f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:30.211282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-87bc8070-da63-4bcd-97d7-05310030e59f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:30.336153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-567cb269-8300-4994-ae20-bf81b5fad313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:30.337053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-567cb269-8300-4994-ae20-bf81b5fad313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:30.352336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-567cb269-8300-4994-ae20-bf81b5fad313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:30.354692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-567cb269-8300-4994-ae20-bf81b5fad313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:30.355840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-567cb269-8300-4994-ae20-bf81b5fad313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:30.357799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-567cb269-8300-4994-ae20-bf81b5fad313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:30.478371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-567cb269-8300-4994-ae20-bf81b5fad313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:30.490374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-567cb269-8300-4994-ae20-bf81b5fad313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:30.505915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-567cb269-8300-4994-ae20-bf81b5fad313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:30.511555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-567cb269-8300-4994-ae20-bf81b5fad313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1341 microversion: 2.20 time: 0.180653 Jul 26 18:29:30.520084 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 48/98] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1341 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:30.530068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ad404173-988f-4729-8205-eda97110f7d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:30.543449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ad404173-988f-4729-8205-eda97110f7d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:30.556670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad404173-988f-4729-8205-eda97110f7d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:30.557121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad404173-988f-4729-8205-eda97110f7d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:30.557901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad404173-988f-4729-8205-eda97110f7d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:30.558652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad404173-988f-4729-8205-eda97110f7d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:30.772983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ad404173-988f-4729-8205-eda97110f7d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:30.792926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ad404173-988f-4729-8205-eda97110f7d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1298 microversion: 2.1 time: 0.271286 Jul 26 18:29:30.793764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 49/99] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:30 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1298 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:30.882584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-87bc8070-da63-4bcd-97d7-05310030e59f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:30.892291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-87bc8070-da63-4bcd-97d7-05310030e59f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.696208 Jul 26 18:29:30.893099 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 51/100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:30 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:31.074435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a54822bc-cb66-425b-a975-024a852aecbe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:31.075074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a54822bc-cb66-425b-a975-024a852aecbe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:31.081766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a54822bc-cb66-425b-a975-024a852aecbe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:31.082214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a54822bc-cb66-425b-a975-024a852aecbe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:31.083042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a54822bc-cb66-425b-a975-024a852aecbe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:31.083506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a54822bc-cb66-425b-a975-024a852aecbe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:31.217777 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-15b17217-497a-4e57-b5b1-7ab7be2f9f4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:31.218762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-15b17217-497a-4e57-b5b1-7ab7be2f9f4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:31.225904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-15b17217-497a-4e57-b5b1-7ab7be2f9f4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:31.226882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-15b17217-497a-4e57-b5b1-7ab7be2f9f4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:31.227998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-15b17217-497a-4e57-b5b1-7ab7be2f9f4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:31.230000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-15b17217-497a-4e57-b5b1-7ab7be2f9f4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:31.640366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a54822bc-cb66-425b-a975-024a852aecbe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:31.655014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a54822bc-cb66-425b-a975-024a852aecbe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.585091 Jul 26 18:29:31.657533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 50/101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:31 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:31.685617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6df4f385-dd9e-4458-a18b-4e1c6fb43ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:31.687094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6df4f385-dd9e-4458-a18b-4e1c6fb43ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:31.717272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6df4f385-dd9e-4458-a18b-4e1c6fb43ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:31.718230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6df4f385-dd9e-4458-a18b-4e1c6fb43ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:31.720732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6df4f385-dd9e-4458-a18b-4e1c6fb43ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:31.721505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6df4f385-dd9e-4458-a18b-4e1c6fb43ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:31.918005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6df4f385-dd9e-4458-a18b-4e1c6fb43ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:31.942788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6df4f385-dd9e-4458-a18b-4e1c6fb43ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:31.950665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6df4f385-dd9e-4458-a18b-4e1c6fb43ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:31.956182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6df4f385-dd9e-4458-a18b-4e1c6fb43ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1339 microversion: 2.20 time: 0.287627 Jul 26 18:29:31.969002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 51/102] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1339 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:32.011067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5f75f8cc-86a6-4494-be15-08fa15da7a82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:32.011946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5f75f8cc-86a6-4494-be15-08fa15da7a82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:32.027194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f75f8cc-86a6-4494-be15-08fa15da7a82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:32.027945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f75f8cc-86a6-4494-be15-08fa15da7a82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:32.029392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f75f8cc-86a6-4494-be15-08fa15da7a82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:32.029960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f75f8cc-86a6-4494-be15-08fa15da7a82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:32.093101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-15b17217-497a-4e57-b5b1-7ab7be2f9f4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:32.132285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-15b17217-497a-4e57-b5b1-7ab7be2f9f4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.919015 Jul 26 18:29:32.133340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 52/103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:31 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:32.159911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-79b43942-fb4b-4c13-8928-fa50cd1e00c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:32.163938 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-79b43942-fb4b-4c13-8928-fa50cd1e00c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:32.220807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79b43942-fb4b-4c13-8928-fa50cd1e00c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:32.222701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79b43942-fb4b-4c13-8928-fa50cd1e00c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:32.227559 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79b43942-fb4b-4c13-8928-fa50cd1e00c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:32.228379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79b43942-fb4b-4c13-8928-fa50cd1e00c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:32.294290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5f75f8cc-86a6-4494-be15-08fa15da7a82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:32.328426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5f75f8cc-86a6-4494-be15-08fa15da7a82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1298 microversion: 2.1 time: 0.346165 Jul 26 18:29:32.329437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 52/104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:31 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1298 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:32.678359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-de70da7b-fcd4-45e4-9355-5deb418f7e46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:32.678979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-de70da7b-fcd4-45e4-9355-5deb418f7e46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:32.685939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de70da7b-fcd4-45e4-9355-5deb418f7e46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:32.686492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de70da7b-fcd4-45e4-9355-5deb418f7e46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:32.687534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de70da7b-fcd4-45e4-9355-5deb418f7e46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:32.687833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de70da7b-fcd4-45e4-9355-5deb418f7e46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:32.888803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-79b43942-fb4b-4c13-8928-fa50cd1e00c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:32.930689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-79b43942-fb4b-4c13-8928-fa50cd1e00c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.787153 Jul 26 18:29:32.947120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 53/105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:32.985308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-de70da7b-fcd4-45e4-9355-5deb418f7e46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:33.008516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-de70da7b-fcd4-45e4-9355-5deb418f7e46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.333711 Jul 26 18:29:33.010028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 53/106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:32 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:33.039668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5b9e004d-17b9-4faf-b84d-45e4d4f08a34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:33.040755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5b9e004d-17b9-4faf-b84d-45e4d4f08a34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:33.051892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b9e004d-17b9-4faf-b84d-45e4d4f08a34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:33.052813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b9e004d-17b9-4faf-b84d-45e4d4f08a34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:33.054618 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b9e004d-17b9-4faf-b84d-45e4d4f08a34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:33.056001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b9e004d-17b9-4faf-b84d-45e4d4f08a34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:33.155929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5b9e004d-17b9-4faf-b84d-45e4d4f08a34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:33.182834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5b9e004d-17b9-4faf-b84d-45e4d4f08a34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:33.186170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5b9e004d-17b9-4faf-b84d-45e4d4f08a34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:33.190180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5b9e004d-17b9-4faf-b84d-45e4d4f08a34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1339 microversion: 2.20 time: 0.178780 Jul 26 18:29:33.190180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 54/107] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:33.198130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-885d71a1-24e9-44ac-bf4b-4a7414b8dc45 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:33.199302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-885d71a1-24e9-44ac-bf4b-4a7414b8dc45 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:33.211537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-885d71a1-24e9-44ac-bf4b-4a7414b8dc45 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:33.212834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-885d71a1-24e9-44ac-bf4b-4a7414b8dc45 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:33.214555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-885d71a1-24e9-44ac-bf4b-4a7414b8dc45 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:33.215966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-885d71a1-24e9-44ac-bf4b-4a7414b8dc45 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:33.356130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-43f9cbce-4c5e-49f7-ae38-64b8497f555c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:33.356974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-43f9cbce-4c5e-49f7-ae38-64b8497f555c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:33.364486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43f9cbce-4c5e-49f7-ae38-64b8497f555c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:33.365341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43f9cbce-4c5e-49f7-ae38-64b8497f555c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:33.366564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43f9cbce-4c5e-49f7-ae38-64b8497f555c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:33.367199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43f9cbce-4c5e-49f7-ae38-64b8497f555c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:33.472147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-885d71a1-24e9-44ac-bf4b-4a7414b8dc45 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:33.493428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-885d71a1-24e9-44ac-bf4b-4a7414b8dc45 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.323764 Jul 26 18:29:33.512760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 54/108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:33 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:33.720179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-43f9cbce-4c5e-49f7-ae38-64b8497f555c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:33.732624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-43f9cbce-4c5e-49f7-ae38-64b8497f555c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.380065 Jul 26 18:29:33.734174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 55/109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:33 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:33.971390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-74036ef9-04d1-48a1-9196-ea592d0793df tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:33.972867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-74036ef9-04d1-48a1-9196-ea592d0793df tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:33.989285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74036ef9-04d1-48a1-9196-ea592d0793df tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:33.990047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74036ef9-04d1-48a1-9196-ea592d0793df tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:33.991480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74036ef9-04d1-48a1-9196-ea592d0793df tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:33.992245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74036ef9-04d1-48a1-9196-ea592d0793df tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:34.044660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-46303d65-6966-4ec5-aa78-34e542a0799f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:34.045701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-46303d65-6966-4ec5-aa78-34e542a0799f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:34.052947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46303d65-6966-4ec5-aa78-34e542a0799f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:34.054975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46303d65-6966-4ec5-aa78-34e542a0799f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:34.056151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46303d65-6966-4ec5-aa78-34e542a0799f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:34.056603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46303d65-6966-4ec5-aa78-34e542a0799f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:34.215576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-74036ef9-04d1-48a1-9196-ea592d0793df tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:34.229790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-74036ef9-04d1-48a1-9196-ea592d0793df tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.266432 Jul 26 18:29:34.231677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 55/110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:33 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:34.241819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1bd5cffd-3f1d-4f3f-ae81-045074dd6bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:34.243408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1bd5cffd-3f1d-4f3f-ae81-045074dd6bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:34.246999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:34.260604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1bd5cffd-3f1d-4f3f-ae81-045074dd6bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:34.261663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1bd5cffd-3f1d-4f3f-ae81-045074dd6bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:34.263103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1bd5cffd-3f1d-4f3f-ae81-045074dd6bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:34.263678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-46303d65-6966-4ec5-aa78-34e542a0799f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:34.264542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1bd5cffd-3f1d-4f3f-ae81-045074dd6bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:34.281272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-46303d65-6966-4ec5-aa78-34e542a0799f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.242074 Jul 26 18:29:34.282515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 56/111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:34 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:34.452017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1bd5cffd-3f1d-4f3f-ae81-045074dd6bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:34.488429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1bd5cffd-3f1d-4f3f-ae81-045074dd6bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:34.493879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1bd5cffd-3f1d-4f3f-ae81-045074dd6bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:34.497166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1bd5cffd-3f1d-4f3f-ae81-045074dd6bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.262824 Jul 26 18:29:34.498267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 56/112] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:34 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:34.524071 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4e384d84-5c01-44da-b190-f8114a5e42bb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:34.526113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4e384d84-5c01-44da-b190-f8114a5e42bb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:34.545692 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e384d84-5c01-44da-b190-f8114a5e42bb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:34.546364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e384d84-5c01-44da-b190-f8114a5e42bb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:34.547566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e384d84-5c01-44da-b190-f8114a5e42bb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:34.548281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e384d84-5c01-44da-b190-f8114a5e42bb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:34.773480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3ca8cd00-8e44-41d6-9d01-c2f9a4cc2d71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:34.774370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3ca8cd00-8e44-41d6-9d01-c2f9a4cc2d71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:34.784812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3ca8cd00-8e44-41d6-9d01-c2f9a4cc2d71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:34.785648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3ca8cd00-8e44-41d6-9d01-c2f9a4cc2d71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:34.786706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3ca8cd00-8e44-41d6-9d01-c2f9a4cc2d71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:34.787398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3ca8cd00-8e44-41d6-9d01-c2f9a4cc2d71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:35.104001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3ca8cd00-8e44-41d6-9d01-c2f9a4cc2d71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:35.114533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3ca8cd00-8e44-41d6-9d01-c2f9a4cc2d71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.345752 Jul 26 18:29:35.117681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 57/113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:34 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:35.265308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c856e7db-182b-45f9-a201-2c1cbb33c4af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:35.266496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c856e7db-182b-45f9-a201-2c1cbb33c4af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:35.282504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c856e7db-182b-45f9-a201-2c1cbb33c4af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:35.284763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c856e7db-182b-45f9-a201-2c1cbb33c4af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:35.290541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c856e7db-182b-45f9-a201-2c1cbb33c4af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:35.291552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c856e7db-182b-45f9-a201-2c1cbb33c4af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:35.407430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4e384d84-5c01-44da-b190-f8114a5e42bb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:35.421712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4e384d84-5c01-44da-b190-f8114a5e42bb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.904343 Jul 26 18:29:35.422399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 57/114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:34 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:35.433812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5f23caa7-b66c-48a6-bf0c-aa3c37cc22f6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:35.434870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5f23caa7-b66c-48a6-bf0c-aa3c37cc22f6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:35.451182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f23caa7-b66c-48a6-bf0c-aa3c37cc22f6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:35.451994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f23caa7-b66c-48a6-bf0c-aa3c37cc22f6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:35.453729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f23caa7-b66c-48a6-bf0c-aa3c37cc22f6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:35.456470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f23caa7-b66c-48a6-bf0c-aa3c37cc22f6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:35.965899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5f23caa7-b66c-48a6-bf0c-aa3c37cc22f6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:35.978423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5f23caa7-b66c-48a6-bf0c-aa3c37cc22f6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.554121 Jul 26 18:29:35.983978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 58/115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:35 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:35.999972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f80b05c1-1a1a-49b5-a27d-8e8ddcd995dc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:36.000925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f80b05c1-1a1a-49b5-a27d-8e8ddcd995dc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:36.001207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c856e7db-182b-45f9-a201-2c1cbb33c4af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:36.017925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c856e7db-182b-45f9-a201-2c1cbb33c4af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.756737 Jul 26 18:29:36.031614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f80b05c1-1a1a-49b5-a27d-8e8ddcd995dc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:36.031614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f80b05c1-1a1a-49b5-a27d-8e8ddcd995dc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:36.031614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f80b05c1-1a1a-49b5-a27d-8e8ddcd995dc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:36.031614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f80b05c1-1a1a-49b5-a27d-8e8ddcd995dc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:36.033715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 58/116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:36.136486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0b94ec3d-fc7e-41d7-b8bf-5c41a7af25f4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:36.137239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0b94ec3d-fc7e-41d7-b8bf-5c41a7af25f4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:36.146487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b94ec3d-fc7e-41d7-b8bf-5c41a7af25f4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:36.148040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b94ec3d-fc7e-41d7-b8bf-5c41a7af25f4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:36.149957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b94ec3d-fc7e-41d7-b8bf-5c41a7af25f4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:36.152503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b94ec3d-fc7e-41d7-b8bf-5c41a7af25f4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:36.408408 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:36.459818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0b94ec3d-fc7e-41d7-b8bf-5c41a7af25f4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:36.490203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0b94ec3d-fc7e-41d7-b8bf-5c41a7af25f4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.357731 Jul 26 18:29:36.493500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 59/117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:36 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:36.502561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-0dd7fc31-a896-46d2-9bb0-da416c0642a7 req-0d6f3f24-5e67-4984-9f15-b95e93664491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ada35c-e092-41a1-a9c4-2177b7e8ae31", "tag": "249fd822-02ca-4f9a-bf6e-53fdc2629e85"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:36.514015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-0dd7fc31-a896-46d2-9bb0-da416c0642a7 req-0d6f3f24-5e67-4984-9f15-b95e93664491 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:36.514819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-0dd7fc31-a896-46d2-9bb0-da416c0642a7 req-0d6f3f24-5e67-4984-9f15-b95e93664491 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:36.519061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f80b05c1-1a1a-49b5-a27d-8e8ddcd995dc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:36.543089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-0dd7fc31-a896-46d2-9bb0-da416c0642a7 req-0d6f3f24-5e67-4984-9f15-b95e93664491 service nova] Creating event network-changed:249fd822-02ca-4f9a-bf6e-53fdc2629e85 for instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 on hv-cinder-82549 Jul 26 18:29:36.545069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f80b05c1-1a1a-49b5-a27d-8e8ddcd995dc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:36.550616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f80b05c1-1a1a-49b5-a27d-8e8ddcd995dc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:36.552327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f80b05c1-1a1a-49b5-a27d-8e8ddcd995dc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.566077 Jul 26 18:29:36.556093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 59/118] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:35 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:36.558044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-0dd7fc31-a896-46d2-9bb0-da416c0642a7 req-0d6f3f24-5e67-4984-9f15-b95e93664491 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062726 Jul 26 18:29:36.564947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 60/119] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:29:36.570490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-afb7aee2-b997-43ee-b3f5-a427e3e1c0d3 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:36.571711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-afb7aee2-b997-43ee-b3f5-a427e3e1c0d3 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:36.590049 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afb7aee2-b997-43ee-b3f5-a427e3e1c0d3 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:36.590951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afb7aee2-b997-43ee-b3f5-a427e3e1c0d3 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:36.592862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afb7aee2-b997-43ee-b3f5-a427e3e1c0d3 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:36.593506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afb7aee2-b997-43ee-b3f5-a427e3e1c0d3 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:36.875122 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-afb7aee2-b997-43ee-b3f5-a427e3e1c0d3 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:36.894638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-afb7aee2-b997-43ee-b3f5-a427e3e1c0d3 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.335242 Jul 26 18:29:36.908577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 60/120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:36 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:37.024119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3fbee20e-7e6a-4f83-a42b-3d626f01b338 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:37.024988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3fbee20e-7e6a-4f83-a42b-3d626f01b338 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:37.046064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-059c9d86-94a0-4f5f-a213-6cc143707785 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:37.046941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-059c9d86-94a0-4f5f-a213-6cc143707785 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:37.048985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3fbee20e-7e6a-4f83-a42b-3d626f01b338 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:37.050034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3fbee20e-7e6a-4f83-a42b-3d626f01b338 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:37.051736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3fbee20e-7e6a-4f83-a42b-3d626f01b338 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:37.054941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3fbee20e-7e6a-4f83-a42b-3d626f01b338 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:37.057152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-059c9d86-94a0-4f5f-a213-6cc143707785 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:37.057609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-059c9d86-94a0-4f5f-a213-6cc143707785 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:37.058408 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-059c9d86-94a0-4f5f-a213-6cc143707785 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:37.058820 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-059c9d86-94a0-4f5f-a213-6cc143707785 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:37.409836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3fbee20e-7e6a-4f83-a42b-3d626f01b338 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:37.423659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3fbee20e-7e6a-4f83-a42b-3d626f01b338 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.405883 Jul 26 18:29:37.440288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 61/121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:37 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:37.453135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-bcee61b5-8956-4d75-a978-c0e18176c7cf req-01135c13-c7ed-47a6-9fac-3670082eea84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240d5470-7916-48a4-b90f-910c88d68384", "tag": "e225f24a-f0f4-4283-af60-d533e1dd5c9d"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:37.469745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-bcee61b5-8956-4d75-a978-c0e18176c7cf req-01135c13-c7ed-47a6-9fac-3670082eea84 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:37.470960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-bcee61b5-8956-4d75-a978-c0e18176c7cf req-01135c13-c7ed-47a6-9fac-3670082eea84 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:37.488547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-059c9d86-94a0-4f5f-a213-6cc143707785 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:37.490653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-bcee61b5-8956-4d75-a978-c0e18176c7cf req-01135c13-c7ed-47a6-9fac-3670082eea84 service nova] Creating event network-changed:e225f24a-f0f4-4283-af60-d533e1dd5c9d for instance 240d5470-7916-48a4-b90f-910c88d68384 on hv-cinder-82549 Jul 26 18:29:37.495943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-bcee61b5-8956-4d75-a978-c0e18176c7cf req-01135c13-c7ed-47a6-9fac-3670082eea84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054170 Jul 26 18:29:37.496792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 62/122] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:29:37.501464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-059c9d86-94a0-4f5f-a213-6cc143707785 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.459376 Jul 26 18:29:37.503157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 61/123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:37 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:37.523800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ba8ee2f5-577a-49f4-aad0-3881ad206cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:37.524512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ba8ee2f5-577a-49f4-aad0-3881ad206cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:37.531475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba8ee2f5-577a-49f4-aad0-3881ad206cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:37.531926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba8ee2f5-577a-49f4-aad0-3881ad206cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:37.532737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba8ee2f5-577a-49f4-aad0-3881ad206cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:37.533150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba8ee2f5-577a-49f4-aad0-3881ad206cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:37.591146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5e5af92a-3076-48db-8df8-75507cc0069f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:37.592431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5e5af92a-3076-48db-8df8-75507cc0069f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:37.600858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e5af92a-3076-48db-8df8-75507cc0069f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:37.601620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e5af92a-3076-48db-8df8-75507cc0069f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:37.602732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e5af92a-3076-48db-8df8-75507cc0069f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:37.603743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e5af92a-3076-48db-8df8-75507cc0069f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:37.709564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ba8ee2f5-577a-49f4-aad0-3881ad206cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:37.722740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ba8ee2f5-577a-49f4-aad0-3881ad206cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.203748 Jul 26 18:29:37.736094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 63/124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:37 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:37.786845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5e5af92a-3076-48db-8df8-75507cc0069f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:37.795909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5e5af92a-3076-48db-8df8-75507cc0069f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:37.797859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5e5af92a-3076-48db-8df8-75507cc0069f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:37.799088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5e5af92a-3076-48db-8df8-75507cc0069f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.212730 Jul 26 18:29:37.799910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 62/125] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:37.922650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d21bde40-18b9-4389-9440-4940c7389976 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:37.924244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d21bde40-18b9-4389-9440-4940c7389976 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:37.934749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d21bde40-18b9-4389-9440-4940c7389976 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:37.935500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d21bde40-18b9-4389-9440-4940c7389976 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:37.936688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d21bde40-18b9-4389-9440-4940c7389976 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:37.937380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d21bde40-18b9-4389-9440-4940c7389976 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:37.977329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:38.133921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d21bde40-18b9-4389-9440-4940c7389976 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:38.145928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d21bde40-18b9-4389-9440-4940c7389976 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.231140 Jul 26 18:29:38.147038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 64/126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:37 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:38.457621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3a7a30b2-add4-4eb8-bcf6-ab848ff91262 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:38.458206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3a7a30b2-add4-4eb8-bcf6-ab848ff91262 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:38.464761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a7a30b2-add4-4eb8-bcf6-ab848ff91262 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:38.465336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a7a30b2-add4-4eb8-bcf6-ab848ff91262 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:38.466442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a7a30b2-add4-4eb8-bcf6-ab848ff91262 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:38.467045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a7a30b2-add4-4eb8-bcf6-ab848ff91262 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:38.489445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:38.521831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-53e393ac-4c71-4c8b-a3a6-1249c46ce4e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:38.522549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-53e393ac-4c71-4c8b-a3a6-1249c46ce4e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:38.532888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53e393ac-4c71-4c8b-a3a6-1249c46ce4e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:38.533340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53e393ac-4c71-4c8b-a3a6-1249c46ce4e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:38.534118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53e393ac-4c71-4c8b-a3a6-1249c46ce4e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:38.534556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53e393ac-4c71-4c8b-a3a6-1249c46ce4e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:38.643341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3a7a30b2-add4-4eb8-bcf6-ab848ff91262 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:38.653939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3a7a30b2-add4-4eb8-bcf6-ab848ff91262 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.200358 Jul 26 18:29:38.656431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 63/127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:38 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:38.733408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-53e393ac-4c71-4c8b-a3a6-1249c46ce4e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:38.744464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-53e393ac-4c71-4c8b-a3a6-1249c46ce4e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.226442 Jul 26 18:29:38.755168 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b2c863ee-b5ee-43cb-a436-1ecadcb6372a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:38.755168 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b2c863ee-b5ee-43cb-a436-1ecadcb6372a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:38.760092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2c863ee-b5ee-43cb-a436-1ecadcb6372a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:38.760559 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2c863ee-b5ee-43cb-a436-1ecadcb6372a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:38.760727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 65/128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:38 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:38.761261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2c863ee-b5ee-43cb-a436-1ecadcb6372a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:38.761695 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2c863ee-b5ee-43cb-a436-1ecadcb6372a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:38.824407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ab98fcf9-503d-40f8-af51-2930ae673313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:38.825727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ab98fcf9-503d-40f8-af51-2930ae673313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:38.835926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab98fcf9-503d-40f8-af51-2930ae673313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:38.836751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab98fcf9-503d-40f8-af51-2930ae673313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:38.838340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab98fcf9-503d-40f8-af51-2930ae673313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:38.839450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab98fcf9-503d-40f8-af51-2930ae673313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:39.073759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ab98fcf9-503d-40f8-af51-2930ae673313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:39.083412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ab98fcf9-503d-40f8-af51-2930ae673313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:39.085029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ab98fcf9-503d-40f8-af51-2930ae673313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:39.086052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ab98fcf9-503d-40f8-af51-2930ae673313 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.268103 Jul 26 18:29:39.101879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 66/129] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:39.169675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-54e1b1c8-920b-4f20-a4b7-1240208f2591 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:39.170299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-54e1b1c8-920b-4f20-a4b7-1240208f2591 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:39.172913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b2c863ee-b5ee-43cb-a436-1ecadcb6372a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:39.178790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54e1b1c8-920b-4f20-a4b7-1240208f2591 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:39.179923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54e1b1c8-920b-4f20-a4b7-1240208f2591 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:39.179923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54e1b1c8-920b-4f20-a4b7-1240208f2591 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:39.180708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54e1b1c8-920b-4f20-a4b7-1240208f2591 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:39.184103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b2c863ee-b5ee-43cb-a436-1ecadcb6372a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.441484 Jul 26 18:29:39.200438 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 64/130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:38 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:39.335359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-54e1b1c8-920b-4f20-a4b7-1240208f2591 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:39.343057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-54e1b1c8-920b-4f20-a4b7-1240208f2591 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.177427 Jul 26 18:29:39.343653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 67/131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:39 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:39.678867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a11cc071-d75b-471d-b871-e53d5753533d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:39.679754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a11cc071-d75b-471d-b871-e53d5753533d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:39.687932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a11cc071-d75b-471d-b871-e53d5753533d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:39.688484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a11cc071-d75b-471d-b871-e53d5753533d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:39.689638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a11cc071-d75b-471d-b871-e53d5753533d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:39.690406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a11cc071-d75b-471d-b871-e53d5753533d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:39.769085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9c7bb110-176c-40de-88c5-fc18ea0e4582 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:39.769940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9c7bb110-176c-40de-88c5-fc18ea0e4582 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:39.777372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c7bb110-176c-40de-88c5-fc18ea0e4582 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:39.777805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c7bb110-176c-40de-88c5-fc18ea0e4582 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:39.778597 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c7bb110-176c-40de-88c5-fc18ea0e4582 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:39.779064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c7bb110-176c-40de-88c5-fc18ea0e4582 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:39.841217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a11cc071-d75b-471d-b871-e53d5753533d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:39.849591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a11cc071-d75b-471d-b871-e53d5753533d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.177419 Jul 26 18:29:39.850283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 65/132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:39 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:39.927284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9c7bb110-176c-40de-88c5-fc18ea0e4582 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:39.935984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9c7bb110-176c-40de-88c5-fc18ea0e4582 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.171573 Jul 26 18:29:39.936661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 68/133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:39 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:40.108742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-882ec1be-5cc1-440f-83b6-9415a057ffd7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:40.109348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-882ec1be-5cc1-440f-83b6-9415a057ffd7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:40.116231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-882ec1be-5cc1-440f-83b6-9415a057ffd7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:40.116651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-882ec1be-5cc1-440f-83b6-9415a057ffd7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:40.117503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-882ec1be-5cc1-440f-83b6-9415a057ffd7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:40.118096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-882ec1be-5cc1-440f-83b6-9415a057ffd7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:40.206164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e2bc2e39-c171-48e3-9917-47be1f7be193 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:40.206717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e2bc2e39-c171-48e3-9917-47be1f7be193 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:40.214859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2bc2e39-c171-48e3-9917-47be1f7be193 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:40.215339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2bc2e39-c171-48e3-9917-47be1f7be193 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:40.216203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2bc2e39-c171-48e3-9917-47be1f7be193 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:40.216632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2bc2e39-c171-48e3-9917-47be1f7be193 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:40.281242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-882ec1be-5cc1-440f-83b6-9415a057ffd7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:40.292752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-882ec1be-5cc1-440f-83b6-9415a057ffd7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:40.295775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-882ec1be-5cc1-440f-83b6-9415a057ffd7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:40.297472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-882ec1be-5cc1-440f-83b6-9415a057ffd7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.192698 Jul 26 18:29:40.298845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 66/134] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:40 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:40.365680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f766bb1c-67a4-4248-a61a-bb4820ee7fcb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:40.366993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f766bb1c-67a4-4248-a61a-bb4820ee7fcb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:40.378747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f766bb1c-67a4-4248-a61a-bb4820ee7fcb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:40.380148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f766bb1c-67a4-4248-a61a-bb4820ee7fcb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:40.381745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f766bb1c-67a4-4248-a61a-bb4820ee7fcb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:40.382493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f766bb1c-67a4-4248-a61a-bb4820ee7fcb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:40.385260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e2bc2e39-c171-48e3-9917-47be1f7be193 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:40.394836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e2bc2e39-c171-48e3-9917-47be1f7be193 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.192705 Jul 26 18:29:40.395520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 69/135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:40 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:40.542153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f766bb1c-67a4-4248-a61a-bb4820ee7fcb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:40.550087 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f766bb1c-67a4-4248-a61a-bb4820ee7fcb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.189618 Jul 26 18:29:40.550684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 67/136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:40 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:40.870820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a21300e6-24b8-456d-9aee-93f59ab77530 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:40.871411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a21300e6-24b8-456d-9aee-93f59ab77530 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:40.878037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a21300e6-24b8-456d-9aee-93f59ab77530 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:40.878485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a21300e6-24b8-456d-9aee-93f59ab77530 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:40.879339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a21300e6-24b8-456d-9aee-93f59ab77530 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:40.879788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a21300e6-24b8-456d-9aee-93f59ab77530 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:40.957873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-21edf1df-82d5-4d04-bc45-56d6caa463a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:40.958484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-21edf1df-82d5-4d04-bc45-56d6caa463a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:40.964820 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-21edf1df-82d5-4d04-bc45-56d6caa463a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:40.965275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-21edf1df-82d5-4d04-bc45-56d6caa463a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:40.966575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-21edf1df-82d5-4d04-bc45-56d6caa463a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:40.967065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-21edf1df-82d5-4d04-bc45-56d6caa463a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:41.023014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a21300e6-24b8-456d-9aee-93f59ab77530 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:41.031808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a21300e6-24b8-456d-9aee-93f59ab77530 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.164866 Jul 26 18:29:41.032404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 70/137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:40 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:41.113150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-21edf1df-82d5-4d04-bc45-56d6caa463a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:41.123547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-21edf1df-82d5-4d04-bc45-56d6caa463a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.169194 Jul 26 18:29:41.124437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 68/138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:40 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:41.333875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5f75e05c-093c-4e50-bcf7-15ea71102a1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:41.334415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5f75e05c-093c-4e50-bcf7-15ea71102a1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:41.341189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f75e05c-093c-4e50-bcf7-15ea71102a1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:41.341656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f75e05c-093c-4e50-bcf7-15ea71102a1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:41.342431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f75e05c-093c-4e50-bcf7-15ea71102a1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:41.342863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f75e05c-093c-4e50-bcf7-15ea71102a1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:41.419073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dc597e1c-c646-4141-8f10-e4ee10451644 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:41.420306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dc597e1c-c646-4141-8f10-e4ee10451644 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:41.429770 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc597e1c-c646-4141-8f10-e4ee10451644 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:41.430668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc597e1c-c646-4141-8f10-e4ee10451644 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:41.431522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc597e1c-c646-4141-8f10-e4ee10451644 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:41.431946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc597e1c-c646-4141-8f10-e4ee10451644 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:41.505948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5f75e05c-093c-4e50-bcf7-15ea71102a1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:41.521260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5f75e05c-093c-4e50-bcf7-15ea71102a1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:41.524529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5f75e05c-093c-4e50-bcf7-15ea71102a1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:41.526909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5f75e05c-093c-4e50-bcf7-15ea71102a1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.197150 Jul 26 18:29:41.527797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 71/139] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:41 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:41.574679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dc597e1c-c646-4141-8f10-e4ee10451644 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:41.577874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-69560449-a89b-4672-ab07-265dfc6aef4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:41.578978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-69560449-a89b-4672-ab07-265dfc6aef4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:41.582366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dc597e1c-c646-4141-8f10-e4ee10451644 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.167212 Jul 26 18:29:41.596982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 69/140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:41 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:41.597169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69560449-a89b-4672-ab07-265dfc6aef4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:41.597169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69560449-a89b-4672-ab07-265dfc6aef4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:41.597169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69560449-a89b-4672-ab07-265dfc6aef4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:41.597169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69560449-a89b-4672-ab07-265dfc6aef4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:41.745306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-69560449-a89b-4672-ab07-265dfc6aef4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:41.754497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-69560449-a89b-4672-ab07-265dfc6aef4e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.184104 Jul 26 18:29:41.755713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 72/141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:41 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:41.855832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-30b139ee-73ff-4b1d-8d63-1e1723bb0d5a req-6e537140-8a8a-4458-8b67-2271e58de01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fffb9029-1d38-416c-b4ad-a85f17a1db8a", "name": "network-vif-plugged", "status": "completed", "tag": "409f556e-16d1-4abe-a109-741f1646bdb8"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:41.867178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-30b139ee-73ff-4b1d-8d63-1e1723bb0d5a req-6e537140-8a8a-4458-8b67-2271e58de01f service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:41.867611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-30b139ee-73ff-4b1d-8d63-1e1723bb0d5a req-6e537140-8a8a-4458-8b67-2271e58de01f service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:41.879868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-30b139ee-73ff-4b1d-8d63-1e1723bb0d5a req-6e537140-8a8a-4458-8b67-2271e58de01f service nova] Creating event network-vif-plugged:409f556e-16d1-4abe-a109-741f1646bdb8 for instance fffb9029-1d38-416c-b4ad-a85f17a1db8a on hv-cinder-82549 Jul 26 18:29:41.885143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-30b139ee-73ff-4b1d-8d63-1e1723bb0d5a req-6e537140-8a8a-4458-8b67-2271e58de01f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095672 Jul 26 18:29:41.885766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 70/142] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:29:42.055078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-766fd8bc-aeae-46f3-ba32-22a24fb84c63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:42.055981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-766fd8bc-aeae-46f3-ba32-22a24fb84c63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:42.062978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-766fd8bc-aeae-46f3-ba32-22a24fb84c63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:42.063479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-766fd8bc-aeae-46f3-ba32-22a24fb84c63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:42.064276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-766fd8bc-aeae-46f3-ba32-22a24fb84c63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:42.064704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-766fd8bc-aeae-46f3-ba32-22a24fb84c63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:42.148446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-80070dab-3102-4f67-8ecf-028b3b424286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:42.150354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-80070dab-3102-4f67-8ecf-028b3b424286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:42.157365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80070dab-3102-4f67-8ecf-028b3b424286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:42.158170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80070dab-3102-4f67-8ecf-028b3b424286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:42.159639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80070dab-3102-4f67-8ecf-028b3b424286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:42.160367 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80070dab-3102-4f67-8ecf-028b3b424286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:42.247428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-766fd8bc-aeae-46f3-ba32-22a24fb84c63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:42.258119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-766fd8bc-aeae-46f3-ba32-22a24fb84c63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.207640 Jul 26 18:29:42.259561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 73/143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:42 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:42.348695 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80070dab-3102-4f67-8ecf-028b3b424286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:42.356767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-80070dab-3102-4f67-8ecf-028b3b424286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.215370 Jul 26 18:29:42.357331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 71/144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:42 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:42.549674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-65992e1d-867f-4702-9c9f-418e1cb41ad7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:42.550681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-65992e1d-867f-4702-9c9f-418e1cb41ad7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:42.557745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65992e1d-867f-4702-9c9f-418e1cb41ad7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:42.558196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65992e1d-867f-4702-9c9f-418e1cb41ad7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:42.559037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65992e1d-867f-4702-9c9f-418e1cb41ad7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:42.559491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65992e1d-867f-4702-9c9f-418e1cb41ad7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:42.608620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cb9e1a11-337d-4785-a84c-8b7f1ccdd749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:42.609744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cb9e1a11-337d-4785-a84c-8b7f1ccdd749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:42.616582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb9e1a11-337d-4785-a84c-8b7f1ccdd749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:42.617017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb9e1a11-337d-4785-a84c-8b7f1ccdd749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:42.617838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb9e1a11-337d-4785-a84c-8b7f1ccdd749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:42.618254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb9e1a11-337d-4785-a84c-8b7f1ccdd749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:42.709718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-65992e1d-867f-4702-9c9f-418e1cb41ad7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:42.719749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-65992e1d-867f-4702-9c9f-418e1cb41ad7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:42.721245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-65992e1d-867f-4702-9c9f-418e1cb41ad7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:42.722366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-65992e1d-867f-4702-9c9f-418e1cb41ad7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.176833 Jul 26 18:29:42.722995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 74/145] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:42.783206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-93b5ba97-00b2-41b0-a9ae-90addece5f6e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:42.783820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-93b5ba97-00b2-41b0-a9ae-90addece5f6e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:42.792170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93b5ba97-00b2-41b0-a9ae-90addece5f6e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:42.793038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93b5ba97-00b2-41b0-a9ae-90addece5f6e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:42.794288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93b5ba97-00b2-41b0-a9ae-90addece5f6e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:42.794876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93b5ba97-00b2-41b0-a9ae-90addece5f6e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:42.801470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cb9e1a11-337d-4785-a84c-8b7f1ccdd749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:42.815909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cb9e1a11-337d-4785-a84c-8b7f1ccdd749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.213509 Jul 26 18:29:42.817405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 72/146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:42 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:43.134063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-93b5ba97-00b2-41b0-a9ae-90addece5f6e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:43.142213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-93b5ba97-00b2-41b0-a9ae-90addece5f6e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.363714 Jul 26 18:29:43.142807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 75/147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:42 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:43.282440 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cb125878-8802-47c8-b7f2-e9c0c4e9eecb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:43.283765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cb125878-8802-47c8-b7f2-e9c0c4e9eecb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:43.292237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb125878-8802-47c8-b7f2-e9c0c4e9eecb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:43.292932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb125878-8802-47c8-b7f2-e9c0c4e9eecb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:43.293991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb125878-8802-47c8-b7f2-e9c0c4e9eecb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:43.294601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb125878-8802-47c8-b7f2-e9c0c4e9eecb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:43.381203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5845ad26-db25-4a04-ba51-0993251bbb32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:43.383697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5845ad26-db25-4a04-ba51-0993251bbb32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:43.396233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5845ad26-db25-4a04-ba51-0993251bbb32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:43.396804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5845ad26-db25-4a04-ba51-0993251bbb32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:43.397701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5845ad26-db25-4a04-ba51-0993251bbb32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:43.398211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5845ad26-db25-4a04-ba51-0993251bbb32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:43.610854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cb125878-8802-47c8-b7f2-e9c0c4e9eecb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:43.630103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cb125878-8802-47c8-b7f2-e9c0c4e9eecb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.353326 Jul 26 18:29:43.634848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 73/148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:43 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:43.733693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5845ad26-db25-4a04-ba51-0993251bbb32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:43.747560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5845ad26-db25-4a04-ba51-0993251bbb32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.372167 Jul 26 18:29:43.769713 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5901c860-f6ef-4944-913b-6a5a4e581f29 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:43.770697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5901c860-f6ef-4944-913b-6a5a4e581f29 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:43.774161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 76/149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:43.775326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:43.792848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5901c860-f6ef-4944-913b-6a5a4e581f29 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:43.793488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5901c860-f6ef-4944-913b-6a5a4e581f29 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:43.795291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5901c860-f6ef-4944-913b-6a5a4e581f29 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:43.795291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5901c860-f6ef-4944-913b-6a5a4e581f29 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:43.838262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-92b42e36-1a54-4643-8308-90c2c13be45f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:43.839038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-92b42e36-1a54-4643-8308-90c2c13be45f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:43.852706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92b42e36-1a54-4643-8308-90c2c13be45f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:43.854307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92b42e36-1a54-4643-8308-90c2c13be45f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:43.855717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92b42e36-1a54-4643-8308-90c2c13be45f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:43.856341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92b42e36-1a54-4643-8308-90c2c13be45f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:44.085762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5901c860-f6ef-4944-913b-6a5a4e581f29 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:44.096344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5901c860-f6ef-4944-913b-6a5a4e581f29 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:44.099609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5901c860-f6ef-4944-913b-6a5a4e581f29 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:44.101362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5901c860-f6ef-4944-913b-6a5a4e581f29 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.335995 Jul 26 18:29:44.103058 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 74/150] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:44.138529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-92b42e36-1a54-4643-8308-90c2c13be45f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:44.146899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-92b42e36-1a54-4643-8308-90c2c13be45f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.312848 Jul 26 18:29:44.147535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 77/151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:43 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:44.171340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f7fc5c8b-b4ff-4c41-b93b-282c7decb76d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:44.171340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f7fc5c8b-b4ff-4c41-b93b-282c7decb76d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:44.179404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7fc5c8b-b4ff-4c41-b93b-282c7decb76d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:44.180108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7fc5c8b-b4ff-4c41-b93b-282c7decb76d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:44.181213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7fc5c8b-b4ff-4c41-b93b-282c7decb76d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:44.182163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7fc5c8b-b4ff-4c41-b93b-282c7decb76d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:44.351346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f7fc5c8b-b4ff-4c41-b93b-282c7decb76d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:44.370177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f7fc5c8b-b4ff-4c41-b93b-282c7decb76d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.208953 Jul 26 18:29:44.371386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 75/152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:44 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:44.664681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-45a23883-5a83-47d4-b4ee-98e7e8881d5a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:44.665129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-45a23883-5a83-47d4-b4ee-98e7e8881d5a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:44.672248 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45a23883-5a83-47d4-b4ee-98e7e8881d5a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:44.672690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45a23883-5a83-47d4-b4ee-98e7e8881d5a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:44.673484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45a23883-5a83-47d4-b4ee-98e7e8881d5a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:44.673914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45a23883-5a83-47d4-b4ee-98e7e8881d5a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:44.780033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a6224245-f0b6-44b1-b40b-33f19d060d5d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:44.780660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a6224245-f0b6-44b1-b40b-33f19d060d5d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:44.787715 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6224245-f0b6-44b1-b40b-33f19d060d5d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:44.788204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6224245-f0b6-44b1-b40b-33f19d060d5d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:44.789171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6224245-f0b6-44b1-b40b-33f19d060d5d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:44.789644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6224245-f0b6-44b1-b40b-33f19d060d5d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:44.845957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-45a23883-5a83-47d4-b4ee-98e7e8881d5a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:44.854604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-45a23883-5a83-47d4-b4ee-98e7e8881d5a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.194002 Jul 26 18:29:44.855258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 78/153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:44 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:44.966717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a6224245-f0b6-44b1-b40b-33f19d060d5d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:44.975371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a6224245-f0b6-44b1-b40b-33f19d060d5d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.199478 Jul 26 18:29:44.975974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 76/154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:44 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:45.137747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9af1681a-5b48-4c3c-aca0-65b72c34960b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:45.138793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9af1681a-5b48-4c3c-aca0-65b72c34960b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:45.149546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9af1681a-5b48-4c3c-aca0-65b72c34960b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:45.150251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9af1681a-5b48-4c3c-aca0-65b72c34960b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:45.151997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9af1681a-5b48-4c3c-aca0-65b72c34960b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:45.152654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9af1681a-5b48-4c3c-aca0-65b72c34960b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:45.175370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bc09d0ce-10a8-4893-aa5e-07441739bb41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:45.175370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bc09d0ce-10a8-4893-aa5e-07441739bb41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:45.184963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc09d0ce-10a8-4893-aa5e-07441739bb41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:45.185717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc09d0ce-10a8-4893-aa5e-07441739bb41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:45.187045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc09d0ce-10a8-4893-aa5e-07441739bb41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:45.187756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc09d0ce-10a8-4893-aa5e-07441739bb41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:45.342478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9af1681a-5b48-4c3c-aca0-65b72c34960b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:45.357430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9af1681a-5b48-4c3c-aca0-65b72c34960b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:45.360653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9af1681a-5b48-4c3c-aca0-65b72c34960b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:45.362666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9af1681a-5b48-4c3c-aca0-65b72c34960b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.231530 Jul 26 18:29:45.363650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 79/155] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:45.395223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9c776c4d-285a-42fa-82ad-3d92c72fc801 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:45.396266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9c776c4d-285a-42fa-82ad-3d92c72fc801 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:45.406100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bc09d0ce-10a8-4893-aa5e-07441739bb41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:45.408129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c776c4d-285a-42fa-82ad-3d92c72fc801 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:45.408697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c776c4d-285a-42fa-82ad-3d92c72fc801 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:45.410027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c776c4d-285a-42fa-82ad-3d92c72fc801 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:45.410809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c776c4d-285a-42fa-82ad-3d92c72fc801 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:45.414964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bc09d0ce-10a8-4893-aa5e-07441739bb41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.249558 Jul 26 18:29:45.416252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 77/156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:45 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:45.621517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9c776c4d-285a-42fa-82ad-3d92c72fc801 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:45.632118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9c776c4d-285a-42fa-82ad-3d92c72fc801 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.243825 Jul 26 18:29:45.632847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 80/157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:45 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:45.884425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5e09b0d2-fd7f-4e63-9c59-080e9e134272 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:45.885173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5e09b0d2-fd7f-4e63-9c59-080e9e134272 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:45.892106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e09b0d2-fd7f-4e63-9c59-080e9e134272 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:45.892632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e09b0d2-fd7f-4e63-9c59-080e9e134272 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:45.893608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e09b0d2-fd7f-4e63-9c59-080e9e134272 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:45.894149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e09b0d2-fd7f-4e63-9c59-080e9e134272 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:46.012046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e4ab1fae-1f6f-49da-9e0f-84ff86029714 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:46.013139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e4ab1fae-1f6f-49da-9e0f-84ff86029714 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:46.021638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e4ab1fae-1f6f-49da-9e0f-84ff86029714 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:46.022122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e4ab1fae-1f6f-49da-9e0f-84ff86029714 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:46.023130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e4ab1fae-1f6f-49da-9e0f-84ff86029714 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:46.024000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e4ab1fae-1f6f-49da-9e0f-84ff86029714 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:46.029257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:46.128300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5e09b0d2-fd7f-4e63-9c59-080e9e134272 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:46.142801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5e09b0d2-fd7f-4e63-9c59-080e9e134272 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.261862 Jul 26 18:29:46.143885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 78/158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:45 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:46.206977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e4ab1fae-1f6f-49da-9e0f-84ff86029714 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:46.221509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e4ab1fae-1f6f-49da-9e0f-84ff86029714 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.215358 Jul 26 18:29:46.222130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 81/159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:46 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:46.385957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e48290f1-6099-46f3-afe9-ef0cd53d40c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:46.386662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e48290f1-6099-46f3-afe9-ef0cd53d40c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:46.393853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e48290f1-6099-46f3-afe9-ef0cd53d40c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:46.394421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e48290f1-6099-46f3-afe9-ef0cd53d40c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:46.395384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e48290f1-6099-46f3-afe9-ef0cd53d40c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:46.396455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e48290f1-6099-46f3-afe9-ef0cd53d40c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:46.437772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3f987484-98ac-4d2a-bdca-3435bb21c704 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:46.438383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3f987484-98ac-4d2a-bdca-3435bb21c704 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:46.445109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f987484-98ac-4d2a-bdca-3435bb21c704 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:46.445802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f987484-98ac-4d2a-bdca-3435bb21c704 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:46.446496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f987484-98ac-4d2a-bdca-3435bb21c704 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:46.446926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f987484-98ac-4d2a-bdca-3435bb21c704 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:46.568178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e48290f1-6099-46f3-afe9-ef0cd53d40c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:46.576801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e48290f1-6099-46f3-afe9-ef0cd53d40c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:46.578415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e48290f1-6099-46f3-afe9-ef0cd53d40c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:46.579700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e48290f1-6099-46f3-afe9-ef0cd53d40c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.197680 Jul 26 18:29:46.580214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 79/160] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:46.607695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3f987484-98ac-4d2a-bdca-3435bb21c704 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:46.616208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3f987484-98ac-4d2a-bdca-3435bb21c704 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.182259 Jul 26 18:29:46.617473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 82/161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:46 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:46.654922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7e7836dc-e915-4e1a-96a0-c0d91302c404 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:46.655569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7e7836dc-e915-4e1a-96a0-c0d91302c404 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:46.663498 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e7836dc-e915-4e1a-96a0-c0d91302c404 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:46.664244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e7836dc-e915-4e1a-96a0-c0d91302c404 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:46.665044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e7836dc-e915-4e1a-96a0-c0d91302c404 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:46.665575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e7836dc-e915-4e1a-96a0-c0d91302c404 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:46.809727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7e7836dc-e915-4e1a-96a0-c0d91302c404 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:46.813328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:46.819864 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7e7836dc-e915-4e1a-96a0-c0d91302c404 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.169142 Jul 26 18:29:46.820335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 80/162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:46 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:47.176556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-31c62f3f-8d9f-4fea-be4f-1485c9fb6968 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:47.177312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-31c62f3f-8d9f-4fea-be4f-1485c9fb6968 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:47.184173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31c62f3f-8d9f-4fea-be4f-1485c9fb6968 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:47.184657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31c62f3f-8d9f-4fea-be4f-1485c9fb6968 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:47.185532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31c62f3f-8d9f-4fea-be4f-1485c9fb6968 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:47.185968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31c62f3f-8d9f-4fea-be4f-1485c9fb6968 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:47.254276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2c2b4c62-39c1-4eb1-b708-497cab1f0d25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:47.255141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2c2b4c62-39c1-4eb1-b708-497cab1f0d25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:47.261991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c2b4c62-39c1-4eb1-b708-497cab1f0d25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:47.262535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c2b4c62-39c1-4eb1-b708-497cab1f0d25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:47.263705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c2b4c62-39c1-4eb1-b708-497cab1f0d25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:47.264222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c2b4c62-39c1-4eb1-b708-497cab1f0d25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:47.336680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-31c62f3f-8d9f-4fea-be4f-1485c9fb6968 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:47.347627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-31c62f3f-8d9f-4fea-be4f-1485c9fb6968 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.175264 Jul 26 18:29:47.348293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 83/163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:47 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:47.425354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2c2b4c62-39c1-4eb1-b708-497cab1f0d25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:47.435280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2c2b4c62-39c1-4eb1-b708-497cab1f0d25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.184671 Jul 26 18:29:47.435791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 81/164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:47 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:47.602619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dea4b3d7-02db-4e8b-8b51-ffb86c806203 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:47.603281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dea4b3d7-02db-4e8b-8b51-ffb86c806203 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:47.610175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dea4b3d7-02db-4e8b-8b51-ffb86c806203 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:47.610616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dea4b3d7-02db-4e8b-8b51-ffb86c806203 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:47.611425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dea4b3d7-02db-4e8b-8b51-ffb86c806203 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:47.611849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dea4b3d7-02db-4e8b-8b51-ffb86c806203 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:47.643405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d8cbc799-1da6-4adc-a48d-d6f9a621e3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:47.644123 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d8cbc799-1da6-4adc-a48d-d6f9a621e3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:47.650864 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8cbc799-1da6-4adc-a48d-d6f9a621e3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:47.651677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8cbc799-1da6-4adc-a48d-d6f9a621e3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:47.652457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8cbc799-1da6-4adc-a48d-d6f9a621e3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:47.653030 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8cbc799-1da6-4adc-a48d-d6f9a621e3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:47.777804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dea4b3d7-02db-4e8b-8b51-ffb86c806203 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:47.786753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dea4b3d7-02db-4e8b-8b51-ffb86c806203 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:47.788757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dea4b3d7-02db-4e8b-8b51-ffb86c806203 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:47.790265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dea4b3d7-02db-4e8b-8b51-ffb86c806203 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.191970 Jul 26 18:29:47.791450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 84/165] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:47 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:47.837929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d8cbc799-1da6-4adc-a48d-d6f9a621e3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:47.842269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a9a18f9c-6d9f-4e2c-8d12-e8201464f3ca tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:47.843046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a9a18f9c-6d9f-4e2c-8d12-e8201464f3ca tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:47.846728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d8cbc799-1da6-4adc-a48d-d6f9a621e3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.212214 Jul 26 18:29:47.847355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 82/166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:47 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:47.851880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9a18f9c-6d9f-4e2c-8d12-e8201464f3ca tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:47.852625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9a18f9c-6d9f-4e2c-8d12-e8201464f3ca tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:47.853765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9a18f9c-6d9f-4e2c-8d12-e8201464f3ca tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:47.854061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9a18f9c-6d9f-4e2c-8d12-e8201464f3ca tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:48.004927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a9a18f9c-6d9f-4e2c-8d12-e8201464f3ca tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:48.014072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a9a18f9c-6d9f-4e2c-8d12-e8201464f3ca tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.175941 Jul 26 18:29:48.014856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 85/167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:47 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:48.370974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4c1f7850-dcef-4719-aa1d-9349f0546ae0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:48.371618 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4c1f7850-dcef-4719-aa1d-9349f0546ae0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:48.378048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c1f7850-dcef-4719-aa1d-9349f0546ae0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:48.378482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c1f7850-dcef-4719-aa1d-9349f0546ae0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:48.379281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c1f7850-dcef-4719-aa1d-9349f0546ae0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:48.379703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c1f7850-dcef-4719-aa1d-9349f0546ae0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:48.456900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-21e5b401-93fc-41b0-aadd-b602bbcca573 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:48.457579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-21e5b401-93fc-41b0-aadd-b602bbcca573 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:48.467712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21e5b401-93fc-41b0-aadd-b602bbcca573 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:48.468657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21e5b401-93fc-41b0-aadd-b602bbcca573 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:48.470184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21e5b401-93fc-41b0-aadd-b602bbcca573 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:48.470950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21e5b401-93fc-41b0-aadd-b602bbcca573 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:48.557606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4c1f7850-dcef-4719-aa1d-9349f0546ae0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:48.568630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4c1f7850-dcef-4719-aa1d-9349f0546ae0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.201465 Jul 26 18:29:48.569736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 83/168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:48 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:48.646355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-21e5b401-93fc-41b0-aadd-b602bbcca573 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:48.657900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-21e5b401-93fc-41b0-aadd-b602bbcca573 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.204864 Jul 26 18:29:48.674743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 86/169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:48 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:48.816696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-297a3cbf-0c0e-482e-bc7f-a3aaead5c166 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:48.817745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-297a3cbf-0c0e-482e-bc7f-a3aaead5c166 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:48.828073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-297a3cbf-0c0e-482e-bc7f-a3aaead5c166 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:48.828728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-297a3cbf-0c0e-482e-bc7f-a3aaead5c166 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:48.829933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-297a3cbf-0c0e-482e-bc7f-a3aaead5c166 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:48.830650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-297a3cbf-0c0e-482e-bc7f-a3aaead5c166 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:48.870444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-433827b9-8f29-4392-8041-b6af4c934096 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:48.871428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-433827b9-8f29-4392-8041-b6af4c934096 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:48.881817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-433827b9-8f29-4392-8041-b6af4c934096 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:48.882767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-433827b9-8f29-4392-8041-b6af4c934096 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:48.883842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-433827b9-8f29-4392-8041-b6af4c934096 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:48.884461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-433827b9-8f29-4392-8041-b6af4c934096 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:49.082134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-433827b9-8f29-4392-8041-b6af4c934096 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:49.093529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-433827b9-8f29-4392-8041-b6af4c934096 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.227886 Jul 26 18:29:49.094060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 87/170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:48 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:49.099174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-59799cf2-8013-4283-b726-7d7ca19111b4 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:49.099789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-59799cf2-8013-4283-b726-7d7ca19111b4 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:49.106831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59799cf2-8013-4283-b726-7d7ca19111b4 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:49.107830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59799cf2-8013-4283-b726-7d7ca19111b4 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:49.109041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59799cf2-8013-4283-b726-7d7ca19111b4 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:49.109781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59799cf2-8013-4283-b726-7d7ca19111b4 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:49.129027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-297a3cbf-0c0e-482e-bc7f-a3aaead5c166 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:49.142096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-297a3cbf-0c0e-482e-bc7f-a3aaead5c166 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:49.144958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-297a3cbf-0c0e-482e-bc7f-a3aaead5c166 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:49.149995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-297a3cbf-0c0e-482e-bc7f-a3aaead5c166 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.340395 Jul 26 18:29:49.150605 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 84/171] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:49.316411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-59799cf2-8013-4283-b726-7d7ca19111b4 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:49.325090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-59799cf2-8013-4283-b726-7d7ca19111b4 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.229591 Jul 26 18:29:49.325766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 88/172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:49 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:49.595806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-09e64f0f-fd42-4311-b94d-1c11872c5bd1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:49.596621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-09e64f0f-fd42-4311-b94d-1c11872c5bd1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:49.609776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09e64f0f-fd42-4311-b94d-1c11872c5bd1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:49.611128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09e64f0f-fd42-4311-b94d-1c11872c5bd1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:49.613220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09e64f0f-fd42-4311-b94d-1c11872c5bd1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:49.614205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09e64f0f-fd42-4311-b94d-1c11872c5bd1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:49.684686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b69e3f70-965e-4bf2-8d8a-e07baa2052b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:49.685575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b69e3f70-965e-4bf2-8d8a-e07baa2052b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:49.701159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b69e3f70-965e-4bf2-8d8a-e07baa2052b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:49.703163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b69e3f70-965e-4bf2-8d8a-e07baa2052b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:49.704675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b69e3f70-965e-4bf2-8d8a-e07baa2052b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:49.705856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b69e3f70-965e-4bf2-8d8a-e07baa2052b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:49.935851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-09e64f0f-fd42-4311-b94d-1c11872c5bd1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:49.944282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-09e64f0f-fd42-4311-b94d-1c11872c5bd1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.352947 Jul 26 18:29:49.945448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 85/173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:49 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:50.108285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b69e3f70-965e-4bf2-8d8a-e07baa2052b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:50.121589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b69e3f70-965e-4bf2-8d8a-e07baa2052b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.440156 Jul 26 18:29:50.124246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 89/174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:49 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:50.127475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ed4b3ff1-7365-4b62-a2bf-7226f55d3d25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:50.128410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ed4b3ff1-7365-4b62-a2bf-7226f55d3d25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:50.136009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed4b3ff1-7365-4b62-a2bf-7226f55d3d25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:50.136746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed4b3ff1-7365-4b62-a2bf-7226f55d3d25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:50.137749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed4b3ff1-7365-4b62-a2bf-7226f55d3d25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:50.138438 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed4b3ff1-7365-4b62-a2bf-7226f55d3d25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:50.174582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9e6d365b-2aed-4378-b436-ecff72d2cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:50.175817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9e6d365b-2aed-4378-b436-ecff72d2cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:50.203674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e6d365b-2aed-4378-b436-ecff72d2cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:50.212997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e6d365b-2aed-4378-b436-ecff72d2cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:50.213809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e6d365b-2aed-4378-b436-ecff72d2cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:50.214260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e6d365b-2aed-4378-b436-ecff72d2cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:50.329709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ed4b3ff1-7365-4b62-a2bf-7226f55d3d25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:50.339297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ed4b3ff1-7365-4b62-a2bf-7226f55d3d25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.218429 Jul 26 18:29:50.344788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 86/175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:50 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:50.358581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-2c640fe0-d6f6-42f8-9d80-7cf58c44bb0a req-97935208-5c97-428a-a9d5-c93769058fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99df3fd1-46e9-4842-9e60-b69d557d60c2", "name": "network-vif-plugged", "status": "completed", "tag": "53af1993-485e-4c66-b4ad-cc0182bef59d"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:50.401938 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-2c640fe0-d6f6-42f8-9d80-7cf58c44bb0a req-97935208-5c97-428a-a9d5-c93769058fd0 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:50.402321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-2c640fe0-d6f6-42f8-9d80-7cf58c44bb0a req-97935208-5c97-428a-a9d5-c93769058fd0 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:50.446202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-2c640fe0-d6f6-42f8-9d80-7cf58c44bb0a req-97935208-5c97-428a-a9d5-c93769058fd0 service nova] Creating event network-vif-plugged:53af1993-485e-4c66-b4ad-cc0182bef59d for instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 on hv-cinder-82549 Jul 26 18:29:50.458530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-2c640fe0-d6f6-42f8-9d80-7cf58c44bb0a req-97935208-5c97-428a-a9d5-c93769058fd0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107174 Jul 26 18:29:50.461622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 87/176] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:29:50.469615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0f3116e5-7889-4964-b1b6-3ec0ee4c0d78 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:50.470465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0f3116e5-7889-4964-b1b6-3ec0ee4c0d78 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:50.479423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f3116e5-7889-4964-b1b6-3ec0ee4c0d78 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:50.480512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f3116e5-7889-4964-b1b6-3ec0ee4c0d78 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:50.482543 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f3116e5-7889-4964-b1b6-3ec0ee4c0d78 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:50.483199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f3116e5-7889-4964-b1b6-3ec0ee4c0d78 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:50.550104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9e6d365b-2aed-4378-b436-ecff72d2cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:50.566398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9e6d365b-2aed-4378-b436-ecff72d2cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:50.569920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9e6d365b-2aed-4378-b436-ecff72d2cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:50.573643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9e6d365b-2aed-4378-b436-ecff72d2cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.401936 Jul 26 18:29:50.590351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 90/177] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:50 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:50.875992 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0f3116e5-7889-4964-b1b6-3ec0ee4c0d78 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:50.884969 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0f3116e5-7889-4964-b1b6-3ec0ee4c0d78 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.421932 Jul 26 18:29:50.909383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 88/178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:50 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:50.977044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-88954211-95d9-4767-827f-4b4b524d6dad tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:50.979670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-88954211-95d9-4767-827f-4b4b524d6dad tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:50.992993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88954211-95d9-4767-827f-4b4b524d6dad tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:50.994081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88954211-95d9-4767-827f-4b4b524d6dad tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:50.997808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88954211-95d9-4767-827f-4b4b524d6dad tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:50.999125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88954211-95d9-4767-827f-4b4b524d6dad tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:51.162811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-284adae7-d9fa-4a1b-a358-3cdb28741e18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:51.164391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-284adae7-d9fa-4a1b-a358-3cdb28741e18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:51.173169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-284adae7-d9fa-4a1b-a358-3cdb28741e18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:51.174235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-284adae7-d9fa-4a1b-a358-3cdb28741e18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:51.175286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-284adae7-d9fa-4a1b-a358-3cdb28741e18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:51.176142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-284adae7-d9fa-4a1b-a358-3cdb28741e18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:51.315369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-88954211-95d9-4767-827f-4b4b524d6dad tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:51.326043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-88954211-95d9-4767-827f-4b4b524d6dad tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.360978 Jul 26 18:29:51.328746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 91/179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:50 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:51.363421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7370b430-3d18-42bd-8d16-af611a23c30b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:51.364140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7370b430-3d18-42bd-8d16-af611a23c30b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:51.376103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7370b430-3d18-42bd-8d16-af611a23c30b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:51.377645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7370b430-3d18-42bd-8d16-af611a23c30b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:51.379675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7370b430-3d18-42bd-8d16-af611a23c30b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:51.380804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7370b430-3d18-42bd-8d16-af611a23c30b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:51.923238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7370b430-3d18-42bd-8d16-af611a23c30b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:51.959507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7370b430-3d18-42bd-8d16-af611a23c30b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.599832 Jul 26 18:29:51.962384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 92/180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:51 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:52.001306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d865610b-59ab-4756-ae06-7332778dfe17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:52.005925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-284adae7-d9fa-4a1b-a358-3cdb28741e18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:52.006215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d865610b-59ab-4756-ae06-7332778dfe17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:52.031241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-284adae7-d9fa-4a1b-a358-3cdb28741e18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.873065 Jul 26 18:29:52.037052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 89/181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:52.039144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d865610b-59ab-4756-ae06-7332778dfe17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:52.043924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d865610b-59ab-4756-ae06-7332778dfe17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:52.045620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d865610b-59ab-4756-ae06-7332778dfe17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:52.049335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d865610b-59ab-4756-ae06-7332778dfe17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:52.053497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-524b3bf0-4717-4601-a822-2cda5fe4fa08 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:52.054766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-524b3bf0-4717-4601-a822-2cda5fe4fa08 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:52.076446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-524b3bf0-4717-4601-a822-2cda5fe4fa08 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:52.077472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-524b3bf0-4717-4601-a822-2cda5fe4fa08 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:52.078629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-524b3bf0-4717-4601-a822-2cda5fe4fa08 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:52.079417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-524b3bf0-4717-4601-a822-2cda5fe4fa08 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:52.531193 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-524b3bf0-4717-4601-a822-2cda5fe4fa08 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:52.542453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-524b3bf0-4717-4601-a822-2cda5fe4fa08 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.501962 Jul 26 18:29:52.550435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 90/182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:52 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:52.571896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a17c7f11-823f-451f-bfa0-165fb1b26010 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:52.572501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a17c7f11-823f-451f-bfa0-165fb1b26010 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:52.579738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a17c7f11-823f-451f-bfa0-165fb1b26010 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:52.580175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a17c7f11-823f-451f-bfa0-165fb1b26010 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:52.581333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a17c7f11-823f-451f-bfa0-165fb1b26010 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:52.581930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a17c7f11-823f-451f-bfa0-165fb1b26010 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:52.667418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d865610b-59ab-4756-ae06-7332778dfe17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:52.683081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d865610b-59ab-4756-ae06-7332778dfe17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:52.686739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d865610b-59ab-4756-ae06-7332778dfe17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:52.688486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d865610b-59ab-4756-ae06-7332778dfe17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.723784 Jul 26 18:29:52.691357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 93/183] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:52.705965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-3281a3a5-2764-4e1e-a786-3d36267ab431 req-8189d706-dfc4-409b-ac6b-b54c6aad1604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf94d62-c20e-42ae-9403-03100f038397", "name": "network-vif-plugged", "status": "completed", "tag": "73091f36-aac1-4e25-a6ce-1b43c6c16961"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:52.732960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-3281a3a5-2764-4e1e-a786-3d36267ab431 req-8189d706-dfc4-409b-ac6b-b54c6aad1604 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:52.735470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-3281a3a5-2764-4e1e-a786-3d36267ab431 req-8189d706-dfc4-409b-ac6b-b54c6aad1604 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:52.760929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-3281a3a5-2764-4e1e-a786-3d36267ab431 req-8189d706-dfc4-409b-ac6b-b54c6aad1604 service nova] Creating event network-vif-plugged:73091f36-aac1-4e25-a6ce-1b43c6c16961 for instance fbf94d62-c20e-42ae-9403-03100f038397 on hv-cinder-82549 Jul 26 18:29:52.773441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-3281a3a5-2764-4e1e-a786-3d36267ab431 req-8189d706-dfc4-409b-ac6b-b54c6aad1604 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080291 Jul 26 18:29:52.775818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 94/184] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:29:52.853812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a17c7f11-823f-451f-bfa0-165fb1b26010 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:52.869270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a17c7f11-823f-451f-bfa0-165fb1b26010 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.303226 Jul 26 18:29:52.870326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 91/185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:52 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:53.029075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-06c36e45-4847-4c59-8356-62dd0fd8e79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:53.039175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-06c36e45-4847-4c59-8356-62dd0fd8e79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:53.068753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-271406e4-faaf-4e43-8ba5-45ae9fe3f3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:53.069475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-271406e4-faaf-4e43-8ba5-45ae9fe3f3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:53.071000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-06c36e45-4847-4c59-8356-62dd0fd8e79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:53.071886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-06c36e45-4847-4c59-8356-62dd0fd8e79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:53.089610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-06c36e45-4847-4c59-8356-62dd0fd8e79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:53.091332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-271406e4-faaf-4e43-8ba5-45ae9fe3f3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:53.092003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-271406e4-faaf-4e43-8ba5-45ae9fe3f3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:53.092579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-06c36e45-4847-4c59-8356-62dd0fd8e79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:53.093346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-271406e4-faaf-4e43-8ba5-45ae9fe3f3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:53.098574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-271406e4-faaf-4e43-8ba5-45ae9fe3f3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:53.373229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-271406e4-faaf-4e43-8ba5-45ae9fe3f3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:53.389418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-271406e4-faaf-4e43-8ba5-45ae9fe3f3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.325100 Jul 26 18:29:53.391711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 92/186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:53 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:53.508698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-06c36e45-4847-4c59-8356-62dd0fd8e79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:53.519241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-06c36e45-4847-4c59-8356-62dd0fd8e79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.512049 Jul 26 18:29:53.520073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 95/187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:53 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:53.579062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-808cae58-f803-4aab-824e-ab32ba633d9d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:53.580023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-808cae58-f803-4aab-824e-ab32ba633d9d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:53.594125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-808cae58-f803-4aab-824e-ab32ba633d9d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:53.595595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-808cae58-f803-4aab-824e-ab32ba633d9d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:53.597271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-808cae58-f803-4aab-824e-ab32ba633d9d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:53.598459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-808cae58-f803-4aab-824e-ab32ba633d9d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:53.727507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-49fa6c15-beea-4f81-a927-0deec329a2d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:53.729062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-49fa6c15-beea-4f81-a927-0deec329a2d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:53.737982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49fa6c15-beea-4f81-a927-0deec329a2d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:53.738752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49fa6c15-beea-4f81-a927-0deec329a2d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:53.747608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49fa6c15-beea-4f81-a927-0deec329a2d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:53.748392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49fa6c15-beea-4f81-a927-0deec329a2d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:53.869372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-808cae58-f803-4aab-824e-ab32ba633d9d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:53.883455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-808cae58-f803-4aab-824e-ab32ba633d9d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.305938 Jul 26 18:29:53.896374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 93/188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:53 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:53.913226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b9c3e119-ea45-4e23-a7f9-d06a38b43829 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:53.914591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b9c3e119-ea45-4e23-a7f9-d06a38b43829 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:53.929396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9c3e119-ea45-4e23-a7f9-d06a38b43829 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:53.930296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9c3e119-ea45-4e23-a7f9-d06a38b43829 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:53.932074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9c3e119-ea45-4e23-a7f9-d06a38b43829 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:53.936060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9c3e119-ea45-4e23-a7f9-d06a38b43829 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:54.074908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-49fa6c15-beea-4f81-a927-0deec329a2d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:54.101815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-49fa6c15-beea-4f81-a927-0deec329a2d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:54.106063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-49fa6c15-beea-4f81-a927-0deec329a2d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:54.108779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-49fa6c15-beea-4f81-a927-0deec329a2d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.389298 Jul 26 18:29:54.110764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 96/189] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:54.278863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b9c3e119-ea45-4e23-a7f9-d06a38b43829 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:54.298394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b9c3e119-ea45-4e23-a7f9-d06a38b43829 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.400157 Jul 26 18:29:54.313501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 94/190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:53 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:54.425845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e45d64ad-37f6-4cbc-9b21-91f9a4b0c89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:54.426813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e45d64ad-37f6-4cbc-9b21-91f9a4b0c89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:54.434423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e45d64ad-37f6-4cbc-9b21-91f9a4b0c89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:54.435155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e45d64ad-37f6-4cbc-9b21-91f9a4b0c89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:54.436275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e45d64ad-37f6-4cbc-9b21-91f9a4b0c89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:54.436712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e45d64ad-37f6-4cbc-9b21-91f9a4b0c89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:54.542216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a48de035-85e8-40b4-919b-fa33765ff7eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:54.543176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a48de035-85e8-40b4-919b-fa33765ff7eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:54.552172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a48de035-85e8-40b4-919b-fa33765ff7eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:54.553227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a48de035-85e8-40b4-919b-fa33765ff7eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:54.554051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a48de035-85e8-40b4-919b-fa33765ff7eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:54.554651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a48de035-85e8-40b4-919b-fa33765ff7eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:54.650205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e45d64ad-37f6-4cbc-9b21-91f9a4b0c89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:54.666426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e45d64ad-37f6-4cbc-9b21-91f9a4b0c89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.246331 Jul 26 18:29:54.668274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 97/191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:54 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:54.838089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a48de035-85e8-40b4-919b-fa33765ff7eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:54.853385 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a48de035-85e8-40b4-919b-fa33765ff7eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.315182 Jul 26 18:29:54.854649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 95/192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:54 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:54.912264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-695288b1-3e31-4ece-8fc3-997301e2295f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:54.913832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-695288b1-3e31-4ece-8fc3-997301e2295f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:54.928347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-695288b1-3e31-4ece-8fc3-997301e2295f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:54.931384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-695288b1-3e31-4ece-8fc3-997301e2295f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:54.933573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-695288b1-3e31-4ece-8fc3-997301e2295f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:54.934797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-695288b1-3e31-4ece-8fc3-997301e2295f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:54.981591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:55.158913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0bebd8d5-6279-4fee-9887-0a6fba20b9c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:55.160056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0bebd8d5-6279-4fee-9887-0a6fba20b9c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:55.171528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bebd8d5-6279-4fee-9887-0a6fba20b9c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:55.172627 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bebd8d5-6279-4fee-9887-0a6fba20b9c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:55.173999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bebd8d5-6279-4fee-9887-0a6fba20b9c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:55.174868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bebd8d5-6279-4fee-9887-0a6fba20b9c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:55.190751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-695288b1-3e31-4ece-8fc3-997301e2295f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:55.205032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-695288b1-3e31-4ece-8fc3-997301e2295f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.299062 Jul 26 18:29:55.219706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 98/193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:54 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:55.341836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-715295a6-3f9a-43fa-b62e-da1060b8a31f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:55.342532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-715295a6-3f9a-43fa-b62e-da1060b8a31f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:55.357169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-715295a6-3f9a-43fa-b62e-da1060b8a31f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:55.358003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-715295a6-3f9a-43fa-b62e-da1060b8a31f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:55.359210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-715295a6-3f9a-43fa-b62e-da1060b8a31f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:55.359800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-715295a6-3f9a-43fa-b62e-da1060b8a31f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:55.410971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0bebd8d5-6279-4fee-9887-0a6fba20b9c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:55.420783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0bebd8d5-6279-4fee-9887-0a6fba20b9c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:55.422396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0bebd8d5-6279-4fee-9887-0a6fba20b9c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:55.423948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0bebd8d5-6279-4fee-9887-0a6fba20b9c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.272799 Jul 26 18:29:55.425111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 96/194] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:55 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:55.625333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-715295a6-3f9a-43fa-b62e-da1060b8a31f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:55.635192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-715295a6-3f9a-43fa-b62e-da1060b8a31f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.302868 Jul 26 18:29:55.636618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 99/195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:55 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:55.700612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4ddee709-aaec-411f-9174-d852487d1313 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:55.702363 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4ddee709-aaec-411f-9174-d852487d1313 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:55.720595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ddee709-aaec-411f-9174-d852487d1313 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:55.721903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ddee709-aaec-411f-9174-d852487d1313 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:55.723825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ddee709-aaec-411f-9174-d852487d1313 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:55.724836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ddee709-aaec-411f-9174-d852487d1313 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:55.882218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cf592577-6ea9-4f76-8312-23d1eac2d526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:55.883349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cf592577-6ea9-4f76-8312-23d1eac2d526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:55.896564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf592577-6ea9-4f76-8312-23d1eac2d526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:55.897584 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf592577-6ea9-4f76-8312-23d1eac2d526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:55.898757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf592577-6ea9-4f76-8312-23d1eac2d526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:55.899613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf592577-6ea9-4f76-8312-23d1eac2d526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:55.993684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4ddee709-aaec-411f-9174-d852487d1313 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:56.027970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4ddee709-aaec-411f-9174-d852487d1313 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.338921 Jul 26 18:29:56.034918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 97/196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:56.239914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cf592577-6ea9-4f76-8312-23d1eac2d526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:56.250407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fc230aa6-7fa3-4355-8a4a-a8691102dd0b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:56.251323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fc230aa6-7fa3-4355-8a4a-a8691102dd0b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:56.266075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cf592577-6ea9-4f76-8312-23d1eac2d526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.387731 Jul 26 18:29:56.273175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 100/197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:55 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:56.274702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc230aa6-7fa3-4355-8a4a-a8691102dd0b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:56.275562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc230aa6-7fa3-4355-8a4a-a8691102dd0b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:56.277230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc230aa6-7fa3-4355-8a4a-a8691102dd0b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:56.277953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc230aa6-7fa3-4355-8a4a-a8691102dd0b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:56.347998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:56.452562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-008deb85-0ab4-4205-a8f4-aa15aac3fc53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:56.453479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-008deb85-0ab4-4205-a8f4-aa15aac3fc53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:56.481444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-008deb85-0ab4-4205-a8f4-aa15aac3fc53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:56.482170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-008deb85-0ab4-4205-a8f4-aa15aac3fc53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:56.483771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-008deb85-0ab4-4205-a8f4-aa15aac3fc53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:56.484501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-008deb85-0ab4-4205-a8f4-aa15aac3fc53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:56.642058 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fc230aa6-7fa3-4355-8a4a-a8691102dd0b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:56.659637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fc230aa6-7fa3-4355-8a4a-a8691102dd0b tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.424292 Jul 26 18:29:56.662558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 98/198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:56 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:56.668328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-0b42cd44-f437-4951-917d-1fceacd42c31 req-23515d50-de23-4b91-8671-da6d4e669a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8422a278-bb13-476d-9fed-a2ea1b310a91", "name": "network-vif-plugged", "status": "completed", "tag": "15966349-d3d2-4cea-88a5-c2fb5f9aafe2"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:29:56.691144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-0b42cd44-f437-4951-917d-1fceacd42c31 req-23515d50-de23-4b91-8671-da6d4e669a60 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:56.691904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-0b42cd44-f437-4951-917d-1fceacd42c31 req-23515d50-de23-4b91-8671-da6d4e669a60 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:56.706101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-0b42cd44-f437-4951-917d-1fceacd42c31 req-23515d50-de23-4b91-8671-da6d4e669a60 service nova] Creating event network-vif-plugged:15966349-d3d2-4cea-88a5-c2fb5f9aafe2 for instance 8422a278-bb13-476d-9fed-a2ea1b310a91 on hv-cinder-82549 Jul 26 18:29:56.712985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-0b42cd44-f437-4951-917d-1fceacd42c31 req-23515d50-de23-4b91-8671-da6d4e669a60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048468 Jul 26 18:29:56.718120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 99/199] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:29:56.724764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-afddc0c6-b941-4ec7-9270-05ee9d3da5d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:56.725735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-afddc0c6-b941-4ec7-9270-05ee9d3da5d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:56.734143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afddc0c6-b941-4ec7-9270-05ee9d3da5d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:56.734908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afddc0c6-b941-4ec7-9270-05ee9d3da5d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:56.736024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afddc0c6-b941-4ec7-9270-05ee9d3da5d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:56.737006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afddc0c6-b941-4ec7-9270-05ee9d3da5d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:56.940043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-008deb85-0ab4-4205-a8f4-aa15aac3fc53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:56.961192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-008deb85-0ab4-4205-a8f4-aa15aac3fc53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:56.965652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-008deb85-0ab4-4205-a8f4-aa15aac3fc53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:56.968872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-008deb85-0ab4-4205-a8f4-aa15aac3fc53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.521214 Jul 26 18:29:56.970944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 101/200] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:56 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:29:57.060316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e214e32b-87f2-427a-ac18-f2ecd2e55891 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:57.061405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e214e32b-87f2-427a-ac18-f2ecd2e55891 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:57.073913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e214e32b-87f2-427a-ac18-f2ecd2e55891 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:57.088241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e214e32b-87f2-427a-ac18-f2ecd2e55891 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:57.090034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e214e32b-87f2-427a-ac18-f2ecd2e55891 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:57.090825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e214e32b-87f2-427a-ac18-f2ecd2e55891 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:57.324253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-afddc0c6-b941-4ec7-9270-05ee9d3da5d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:57.344174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-afddc0c6-b941-4ec7-9270-05ee9d3da5d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.615479 Jul 26 18:29:57.344174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 100/201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:56 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:57.348756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-757ba146-023f-4030-ad7e-325231914ac0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:57.350187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-757ba146-023f-4030-ad7e-325231914ac0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:57.357225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-757ba146-023f-4030-ad7e-325231914ac0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:57.357949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-757ba146-023f-4030-ad7e-325231914ac0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:57.358862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-757ba146-023f-4030-ad7e-325231914ac0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:57.359425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-757ba146-023f-4030-ad7e-325231914ac0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:57.566984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-757ba146-023f-4030-ad7e-325231914ac0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:57.576314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-757ba146-023f-4030-ad7e-325231914ac0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.238523 Jul 26 18:29:57.577133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 101/202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:57 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:57.694778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-46fe6556-dbb6-4036-907d-3f44569424d0 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:57.696074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-46fe6556-dbb6-4036-907d-3f44569424d0 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:57.710103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e214e32b-87f2-427a-ac18-f2ecd2e55891 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:57.742809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46fe6556-dbb6-4036-907d-3f44569424d0 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:57.744159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46fe6556-dbb6-4036-907d-3f44569424d0 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:57.745050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e214e32b-87f2-427a-ac18-f2ecd2e55891 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.684101 Jul 26 18:29:57.747059 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46fe6556-dbb6-4036-907d-3f44569424d0 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:57.759802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 102/203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:57 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:57.760947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46fe6556-dbb6-4036-907d-3f44569424d0 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:58.015686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c393cc86-9d01-4924-b183-7998e5b47940 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:58.016599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c393cc86-9d01-4924-b183-7998e5b47940 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:58.032279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c393cc86-9d01-4924-b183-7998e5b47940 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:58.036884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c393cc86-9d01-4924-b183-7998e5b47940 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:58.040390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c393cc86-9d01-4924-b183-7998e5b47940 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:58.044533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c393cc86-9d01-4924-b183-7998e5b47940 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:58.158182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-46fe6556-dbb6-4036-907d-3f44569424d0 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:58.171269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-46fe6556-dbb6-4036-907d-3f44569424d0 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1314 microversion: 2.1 time: 0.480561 Jul 26 18:29:58.172306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 102/204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:57 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:58.368421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4b56541e-a4c1-46db-a1ce-ad0335416a06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:58.368421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4b56541e-a4c1-46db-a1ce-ad0335416a06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:58.387776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b56541e-a4c1-46db-a1ce-ad0335416a06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:58.389216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b56541e-a4c1-46db-a1ce-ad0335416a06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:58.390747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b56541e-a4c1-46db-a1ce-ad0335416a06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:58.396260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b56541e-a4c1-46db-a1ce-ad0335416a06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:58.398712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c393cc86-9d01-4924-b183-7998e5b47940 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:58.418117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c393cc86-9d01-4924-b183-7998e5b47940 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:58.425199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c393cc86-9d01-4924-b183-7998e5b47940 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:58.454861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c393cc86-9d01-4924-b183-7998e5b47940 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.436607 Jul 26 18:29:58.463293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 103/205] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:29:58.613899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e6053889-36c7-44bf-9ae0-f9496be3d542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:58.615088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e6053889-36c7-44bf-9ae0-f9496be3d542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:58.629146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6053889-36c7-44bf-9ae0-f9496be3d542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:58.630729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6053889-36c7-44bf-9ae0-f9496be3d542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:58.632711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6053889-36c7-44bf-9ae0-f9496be3d542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:58.634253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6053889-36c7-44bf-9ae0-f9496be3d542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:58.846913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4b56541e-a4c1-46db-a1ce-ad0335416a06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:58.870196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4b56541e-a4c1-46db-a1ce-ad0335416a06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.515496 Jul 26 18:29:58.883609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 103/206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:58 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:58.903070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8ebe0165-8448-4540-983a-81ebe44e98ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:58.910771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8ebe0165-8448-4540-983a-81ebe44e98ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:58.941966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ebe0165-8448-4540-983a-81ebe44e98ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:58.943449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ebe0165-8448-4540-983a-81ebe44e98ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:58.952736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ebe0165-8448-4540-983a-81ebe44e98ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:58.955710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ebe0165-8448-4540-983a-81ebe44e98ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:58.987260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e6053889-36c7-44bf-9ae0-f9496be3d542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:59.001404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e6053889-36c7-44bf-9ae0-f9496be3d542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.394397 Jul 26 18:29:59.011290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 104/207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:58 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:59.218137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5c7bf477-9300-47d2-8ed6-942b7d97ed5d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:59.221665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5c7bf477-9300-47d2-8ed6-942b7d97ed5d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:59.257837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c7bf477-9300-47d2-8ed6-942b7d97ed5d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:59.260343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c7bf477-9300-47d2-8ed6-942b7d97ed5d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:59.262552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c7bf477-9300-47d2-8ed6-942b7d97ed5d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:59.269729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c7bf477-9300-47d2-8ed6-942b7d97ed5d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:59.723137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8ebe0165-8448-4540-983a-81ebe44e98ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:59.758994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8ebe0165-8448-4540-983a-81ebe44e98ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1361 microversion: 2.1 time: 0.871125 Jul 26 18:29:59.760144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 104/208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:58 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1361 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:29:59.799894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-42d026fa-373c-412f-8039-bf684de2daf2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:59.801101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-42d026fa-373c-412f-8039-bf684de2daf2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:59.816218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5c7bf477-9300-47d2-8ed6-942b7d97ed5d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:29:59.827703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42d026fa-373c-412f-8039-bf684de2daf2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:59.829645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5c7bf477-9300-47d2-8ed6-942b7d97ed5d tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1502 microversion: 2.1 time: 0.627325 Jul 26 18:29:59.831457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 105/209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:59 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1502 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:29:59.832415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42d026fa-373c-412f-8039-bf684de2daf2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:59.834040 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42d026fa-373c-412f-8039-bf684de2daf2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:59.835770 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42d026fa-373c-412f-8039-bf684de2daf2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:59.908509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f56b06d3-fa8c-4fc2-b0a1-c8597410afdc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:29:59.909123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f56b06d3-fa8c-4fc2-b0a1-c8597410afdc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:29:59.911286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:29:59.924828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f56b06d3-fa8c-4fc2-b0a1-c8597410afdc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:59.925272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f56b06d3-fa8c-4fc2-b0a1-c8597410afdc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:29:59.926121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f56b06d3-fa8c-4fc2-b0a1-c8597410afdc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:29:59.926554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f56b06d3-fa8c-4fc2-b0a1-c8597410afdc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:00.333087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f56b06d3-fa8c-4fc2-b0a1-c8597410afdc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:00.343329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f56b06d3-fa8c-4fc2-b0a1-c8597410afdc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.439038 Jul 26 18:30:00.344745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 106/210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:29:59 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:00.362102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-792fa64b-46fa-4694-9b78-a6ec36550580 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:00.362754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-792fa64b-46fa-4694-9b78-a6ec36550580 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:00.383365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-792fa64b-46fa-4694-9b78-a6ec36550580 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:00.384151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-792fa64b-46fa-4694-9b78-a6ec36550580 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:00.385167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-792fa64b-46fa-4694-9b78-a6ec36550580 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:00.385817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-792fa64b-46fa-4694-9b78-a6ec36550580 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:00.608541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-42d026fa-373c-412f-8039-bf684de2daf2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:00.642591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-42d026fa-373c-412f-8039-bf684de2daf2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:00.648887 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-42d026fa-373c-412f-8039-bf684de2daf2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:00.651721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-42d026fa-373c-412f-8039-bf684de2daf2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.886513 Jul 26 18:30:00.657078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 105/211] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:29:59 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:30:00.713091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-792fa64b-46fa-4694-9b78-a6ec36550580 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:00.772756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-792fa64b-46fa-4694-9b78-a6ec36550580 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.421760 Jul 26 18:30:00.785944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fa070cb2-4e02-42fc-8aa1-088579845a9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:00.786778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fa070cb2-4e02-42fc-8aa1-088579845a9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:00.803425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 107/212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:00 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:00.825203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa070cb2-4e02-42fc-8aa1-088579845a9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:00.827124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa070cb2-4e02-42fc-8aa1-088579845a9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:00.829484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa070cb2-4e02-42fc-8aa1-088579845a9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:00.833093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa070cb2-4e02-42fc-8aa1-088579845a9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:01.274837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-139c5355-7e92-42f9-a054-c2bceb335835 req-95f7c4d4-d4e1-45c1-8c15-c0865358b371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240d5470-7916-48a4-b90f-910c88d68384", "name": "network-vif-plugged", "status": "completed", "tag": "e225f24a-f0f4-4283-af60-d533e1dd5c9d"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:30:01.330705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-139c5355-7e92-42f9-a054-c2bceb335835 req-95f7c4d4-d4e1-45c1-8c15-c0865358b371 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:01.333512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-139c5355-7e92-42f9-a054-c2bceb335835 req-95f7c4d4-d4e1-45c1-8c15-c0865358b371 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:01.377540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-139c5355-7e92-42f9-a054-c2bceb335835 req-95f7c4d4-d4e1-45c1-8c15-c0865358b371 service nova] Creating event network-vif-plugged:e225f24a-f0f4-4283-af60-d533e1dd5c9d for instance 240d5470-7916-48a4-b90f-910c88d68384 on hv-cinder-82549 Jul 26 18:30:01.388713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-139c5355-7e92-42f9-a054-c2bceb335835 req-95f7c4d4-d4e1-45c1-8c15-c0865358b371 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118978 Jul 26 18:30:01.392717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 108/213] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:30:01.406717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-103395b4-ab92-48ed-a927-8000ed392348 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:01.411137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-103395b4-ab92-48ed-a927-8000ed392348 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:01.423533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-103395b4-ab92-48ed-a927-8000ed392348 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:01.426460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-103395b4-ab92-48ed-a927-8000ed392348 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:01.428357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-103395b4-ab92-48ed-a927-8000ed392348 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:01.429412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-103395b4-ab92-48ed-a927-8000ed392348 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:01.559633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fa070cb2-4e02-42fc-8aa1-088579845a9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:01.586408 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fa070cb2-4e02-42fc-8aa1-088579845a9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1546 microversion: 2.1 time: 0.808418 Jul 26 18:30:01.612608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 106/214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:00 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1546 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:01.624705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9a0d62ed-7876-48e9-83a5-bcb2b42a7c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:01.625076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9a0d62ed-7876-48e9-83a5-bcb2b42a7c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:01.671755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a0d62ed-7876-48e9-83a5-bcb2b42a7c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:01.673133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a0d62ed-7876-48e9-83a5-bcb2b42a7c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:01.674451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a0d62ed-7876-48e9-83a5-bcb2b42a7c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:01.675475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a0d62ed-7876-48e9-83a5-bcb2b42a7c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:02.170900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-103395b4-ab92-48ed-a927-8000ed392348 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:02.182964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-103395b4-ab92-48ed-a927-8000ed392348 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 0.788411 Jul 26 18:30:02.186413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 109/215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:01 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:02.198236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-51f08a16-94c4-4252-9a97-f277e3fe7c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:02.200495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-51f08a16-94c4-4252-9a97-f277e3fe7c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:02.208361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51f08a16-94c4-4252-9a97-f277e3fe7c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:02.209372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51f08a16-94c4-4252-9a97-f277e3fe7c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:02.210547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51f08a16-94c4-4252-9a97-f277e3fe7c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:02.211447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51f08a16-94c4-4252-9a97-f277e3fe7c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:02.282623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9a0d62ed-7876-48e9-83a5-bcb2b42a7c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.666124 Jul 26 18:30:02.284301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 107/216] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Jul 26 18:30:01 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-interface => generated 284 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:30:02.290236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-65458bab-4ca3-479f-bf62-9f22765b2d57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:02.292954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-65458bab-4ca3-479f-bf62-9f22765b2d57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:02.307864 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65458bab-4ca3-479f-bf62-9f22765b2d57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:02.311745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65458bab-4ca3-479f-bf62-9f22765b2d57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:02.312918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65458bab-4ca3-479f-bf62-9f22765b2d57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:02.313565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65458bab-4ca3-479f-bf62-9f22765b2d57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:02.459328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-51f08a16-94c4-4252-9a97-f277e3fe7c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:02.475569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-51f08a16-94c4-4252-9a97-f277e3fe7c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:02.478477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-51f08a16-94c4-4252-9a97-f277e3fe7c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:02.480465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-51f08a16-94c4-4252-9a97-f277e3fe7c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.292556 Jul 26 18:30:02.482630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 110/217] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:30:02 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:30:02.491544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-100d7710-1900-410a-b44c-db24bc6b5246 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c96e0065-6ac0-4919-9010-dc71997f3048"}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:30:02.495676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-100d7710-1900-410a-b44c-db24bc6b5246 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:02.506415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-100d7710-1900-410a-b44c-db24bc6b5246 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:02.507509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-100d7710-1900-410a-b44c-db24bc6b5246 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:02.508934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-100d7710-1900-410a-b44c-db24bc6b5246 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:02.509978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-100d7710-1900-410a-b44c-db24bc6b5246 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:03.608785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-65458bab-4ca3-479f-bf62-9f22765b2d57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:03.633697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-65458bab-4ca3-479f-bf62-9f22765b2d57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 1.337263 Jul 26 18:30:03.636370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 108/218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:02 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:03.699656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4155e8a7-c174-4a5b-8092-714cc504254f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:03.704136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4155e8a7-c174-4a5b-8092-714cc504254f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:03.732768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4155e8a7-c174-4a5b-8092-714cc504254f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:03.733524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4155e8a7-c174-4a5b-8092-714cc504254f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:03.738111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4155e8a7-c174-4a5b-8092-714cc504254f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:03.738900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4155e8a7-c174-4a5b-8092-714cc504254f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:04.769868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-100d7710-1900-410a-b44c-db24bc6b5246 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "POST /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.284530 Jul 26 18:30:04.795367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 111/219] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Jul 26 18:30:02 2022] POST /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a/os-volume_attachments => generated 194 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:30:04.817708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c009eaac-467d-4d11-9e58-db91e71244f3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:04.819447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c009eaac-467d-4d11-9e58-db91e71244f3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:04.834135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c009eaac-467d-4d11-9e58-db91e71244f3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:04.836145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c009eaac-467d-4d11-9e58-db91e71244f3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:04.838386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c009eaac-467d-4d11-9e58-db91e71244f3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:04.839608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c009eaac-467d-4d11-9e58-db91e71244f3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:04.877242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4155e8a7-c174-4a5b-8092-714cc504254f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:04.908623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4155e8a7-c174-4a5b-8092-714cc504254f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1321 microversion: 2.1 time: 1.260237 Jul 26 18:30:04.910221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 109/220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:03 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1321 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:04.930308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a803613a-d3d8-4019-9b60-461933c6e06e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:04.935013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a803613a-d3d8-4019-9b60-461933c6e06e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:04.971786 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a803613a-d3d8-4019-9b60-461933c6e06e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:04.972611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a803613a-d3d8-4019-9b60-461933c6e06e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:04.974044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a803613a-d3d8-4019-9b60-461933c6e06e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:04.974584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a803613a-d3d8-4019-9b60-461933c6e06e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:05.158437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c009eaac-467d-4d11-9e58-db91e71244f3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:05.173564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c009eaac-467d-4d11-9e58-db91e71244f3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:05.175326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c009eaac-467d-4d11-9e58-db91e71244f3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:05.176606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c009eaac-467d-4d11-9e58-db91e71244f3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.378590 Jul 26 18:30:05.177393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 112/221] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:30:04 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:30:05.660165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a803613a-d3d8-4019-9b60-461933c6e06e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:05.673893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a803613a-d3d8-4019-9b60-461933c6e06e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.761127 Jul 26 18:30:05.675835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 110/222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:04 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:05.839561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-4ca6fa8f-493f-4723-8d1f-313241de4eee req-ad929ee9-496d-41bd-be89-9303bd6c6d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ada35c-e092-41a1-a9c4-2177b7e8ae31", "name": "network-vif-plugged", "status": "completed", "tag": "249fd822-02ca-4f9a-bf6e-53fdc2629e85"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:30:05.870495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-4ca6fa8f-493f-4723-8d1f-313241de4eee req-ad929ee9-496d-41bd-be89-9303bd6c6d91 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:05.872220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-4ca6fa8f-493f-4723-8d1f-313241de4eee req-ad929ee9-496d-41bd-be89-9303bd6c6d91 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:05.901462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-4ca6fa8f-493f-4723-8d1f-313241de4eee req-ad929ee9-496d-41bd-be89-9303bd6c6d91 service nova] Creating event network-vif-plugged:249fd822-02ca-4f9a-bf6e-53fdc2629e85 for instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 on hv-cinder-82549 Jul 26 18:30:05.919585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-4ca6fa8f-493f-4723-8d1f-313241de4eee req-ad929ee9-496d-41bd-be89-9303bd6c6d91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093678 Jul 26 18:30:05.923905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 113/223] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:30:05.933034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-08acca2d-241c-4338-b352-3fd3a180a52c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:05.934559 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-08acca2d-241c-4338-b352-3fd3a180a52c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:05.946496 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08acca2d-241c-4338-b352-3fd3a180a52c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:05.947267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08acca2d-241c-4338-b352-3fd3a180a52c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:05.950929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08acca2d-241c-4338-b352-3fd3a180a52c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:05.954717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08acca2d-241c-4338-b352-3fd3a180a52c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:06.208561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7853d8c1-a211-4725-b6eb-8ae91561b32c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:06.209270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7853d8c1-a211-4725-b6eb-8ae91561b32c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:06.229412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7853d8c1-a211-4725-b6eb-8ae91561b32c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:06.230173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7853d8c1-a211-4725-b6eb-8ae91561b32c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:06.231200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7853d8c1-a211-4725-b6eb-8ae91561b32c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:06.232015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7853d8c1-a211-4725-b6eb-8ae91561b32c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:06.553741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7853d8c1-a211-4725-b6eb-8ae91561b32c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:06.560344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-08acca2d-241c-4338-b352-3fd3a180a52c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:06.570883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7853d8c1-a211-4725-b6eb-8ae91561b32c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:06.576199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-08acca2d-241c-4338-b352-3fd3a180a52c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1515 microversion: 2.1 time: 0.649565 Jul 26 18:30:06.576917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7853d8c1-a211-4725-b6eb-8ae91561b32c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:06.579058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7853d8c1-a211-4725-b6eb-8ae91561b32c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1406 microversion: 2.20 time: 0.374584 Jul 26 18:30:06.581627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 114/224] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:30:06 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1406 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:30:06.583466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 111/225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:05 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1515 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:06.600549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ef5d047b-4f87-49b6-b4aa-f17d5d2349f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:30:06.602857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ef5d047b-4f87-49b6-b4aa-f17d5d2349f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:06.610244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef5d047b-4f87-49b6-b4aa-f17d5d2349f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:06.610685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef5d047b-4f87-49b6-b4aa-f17d5d2349f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:06.611744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef5d047b-4f87-49b6-b4aa-f17d5d2349f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:06.612145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef5d047b-4f87-49b6-b4aa-f17d5d2349f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:06.617035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:30:06.647793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.objects.instance [None req-ef5d047b-4f87-49b6-b4aa-f17d5d2349f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lazy-loading 'flavor' on Instance uuid 8422a278-bb13-476d-9fed-a2ea1b310a91 {{(pid=117996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:30:06.726827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-68fb8f0a-1f67-404f-b95c-520a95a67ffe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:06.730104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-68fb8f0a-1f67-404f-b95c-520a95a67ffe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:06.775587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68fb8f0a-1f67-404f-b95c-520a95a67ffe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:06.776286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68fb8f0a-1f67-404f-b95c-520a95a67ffe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:06.777186 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68fb8f0a-1f67-404f-b95c-520a95a67ffe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:06.777659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68fb8f0a-1f67-404f-b95c-520a95a67ffe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:06.868740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ef5d047b-4f87-49b6-b4aa-f17d5d2349f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "POST /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91/action" status: 200 len: 32 microversion: 2.1 time: 0.251778 Jul 26 18:30:06.874870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 115/226] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:30:06 2022] POST /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91/action => generated 32 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 18:30:06.886713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2268601a-c8b8-4914-bdc6-248fa45499e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:06.892374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2268601a-c8b8-4914-bdc6-248fa45499e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:06.900090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2268601a-c8b8-4914-bdc6-248fa45499e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:06.901143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2268601a-c8b8-4914-bdc6-248fa45499e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:06.902104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2268601a-c8b8-4914-bdc6-248fa45499e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:06.902703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2268601a-c8b8-4914-bdc6-248fa45499e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:07.180900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2268601a-c8b8-4914-bdc6-248fa45499e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:07.194584 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2268601a-c8b8-4914-bdc6-248fa45499e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.318279 Jul 26 18:30:07.200055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 116/227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:06 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:07.607045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2a385311-b816-4955-9256-100ffdecad0b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:07.608332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2a385311-b816-4955-9256-100ffdecad0b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:07.624347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a385311-b816-4955-9256-100ffdecad0b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:07.624733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a385311-b816-4955-9256-100ffdecad0b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:07.625725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a385311-b816-4955-9256-100ffdecad0b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:07.626223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a385311-b816-4955-9256-100ffdecad0b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:07.986168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2a385311-b816-4955-9256-100ffdecad0b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:08.002215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2a385311-b816-4955-9256-100ffdecad0b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:08.004379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2a385311-b816-4955-9256-100ffdecad0b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:08.005821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2a385311-b816-4955-9256-100ffdecad0b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1598 microversion: 2.20 time: 0.403505 Jul 26 18:30:08.007443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 117/228] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:30:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1598 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:30:08.051931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ed6c6060-6903-4e3a-9332-4e53a68d0cfb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:08.052758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ed6c6060-6903-4e3a-9332-4e53a68d0cfb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:08.077379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed6c6060-6903-4e3a-9332-4e53a68d0cfb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:08.077869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed6c6060-6903-4e3a-9332-4e53a68d0cfb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:08.081179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed6c6060-6903-4e3a-9332-4e53a68d0cfb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:08.082963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed6c6060-6903-4e3a-9332-4e53a68d0cfb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:08.156051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-68fb8f0a-1f67-404f-b95c-520a95a67ffe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:08.177877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-68fb8f0a-1f67-404f-b95c-520a95a67ffe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 1.467516 Jul 26 18:30:08.201784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 112/229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:06 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:08.229776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2330e432-b00a-4543-90fd-4a1a600e9974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:08.231315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2330e432-b00a-4543-90fd-4a1a600e9974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:08.261891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2330e432-b00a-4543-90fd-4a1a600e9974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:08.263068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2330e432-b00a-4543-90fd-4a1a600e9974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:08.268582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2330e432-b00a-4543-90fd-4a1a600e9974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:08.269999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2330e432-b00a-4543-90fd-4a1a600e9974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:08.418648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ed6c6060-6903-4e3a-9332-4e53a68d0cfb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.375597 Jul 26 18:30:08.420705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 118/230] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Jul 26 18:30:08 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-interface => generated 284 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:30:08.577325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-74178c69-204e-4ee3-8ced-16eac5d18e46 req-85737827-f7bd-45c4-9a91-371caef42b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99df3fd1-46e9-4842-9e60-b69d557d60c2", "tag": "53af1993-485e-4c66-b4ad-cc0182bef59d"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:30:08.618511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-74178c69-204e-4ee3-8ced-16eac5d18e46 req-85737827-f7bd-45c4-9a91-371caef42b6b service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:08.622687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-74178c69-204e-4ee3-8ced-16eac5d18e46 req-85737827-f7bd-45c4-9a91-371caef42b6b service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:08.684338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-74178c69-204e-4ee3-8ced-16eac5d18e46 req-85737827-f7bd-45c4-9a91-371caef42b6b service nova] Creating event network-changed:53af1993-485e-4c66-b4ad-cc0182bef59d for instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 on hv-cinder-82549 Jul 26 18:30:08.702368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-74178c69-204e-4ee3-8ced-16eac5d18e46 req-85737827-f7bd-45c4-9a91-371caef42b6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132665 Jul 26 18:30:08.708371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 119/231] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:30:09.008544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2330e432-b00a-4543-90fd-4a1a600e9974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:09.019038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2330e432-b00a-4543-90fd-4a1a600e9974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.797276 Jul 26 18:30:09.022244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 113/232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:08 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:09.214808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-07923a40-35ac-4581-9f21-96d9f20a14ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:09.217050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-07923a40-35ac-4581-9f21-96d9f20a14ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:09.252997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07923a40-35ac-4581-9f21-96d9f20a14ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:09.256737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07923a40-35ac-4581-9f21-96d9f20a14ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:09.261440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07923a40-35ac-4581-9f21-96d9f20a14ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:09.263088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07923a40-35ac-4581-9f21-96d9f20a14ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:09.942148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-07923a40-35ac-4581-9f21-96d9f20a14ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:09.956190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-07923a40-35ac-4581-9f21-96d9f20a14ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1365 microversion: 2.1 time: 0.753343 Jul 26 18:30:09.957835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 120/233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:09 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1365 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:10.058233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-82565475-c833-410b-89bb-ebb9c796422b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:10.059536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-82565475-c833-410b-89bb-ebb9c796422b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:10.068262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-82565475-c833-410b-89bb-ebb9c796422b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:10.069635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-82565475-c833-410b-89bb-ebb9c796422b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:10.071171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-82565475-c833-410b-89bb-ebb9c796422b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:10.071822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-82565475-c833-410b-89bb-ebb9c796422b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:10.978092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e13f10ff-b9db-4428-af56-529bdbef1784 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:10.979152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e13f10ff-b9db-4428-af56-529bdbef1784 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:10.989038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e13f10ff-b9db-4428-af56-529bdbef1784 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:10.989485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e13f10ff-b9db-4428-af56-529bdbef1784 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:10.990295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e13f10ff-b9db-4428-af56-529bdbef1784 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:11.002059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e13f10ff-b9db-4428-af56-529bdbef1784 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:11.246920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-82565475-c833-410b-89bb-ebb9c796422b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:11.307163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-82565475-c833-410b-89bb-ebb9c796422b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 1.226122 Jul 26 18:30:11.309908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 114/234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:10 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:11.665126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-bb11692b-74cd-4ace-b409-3a54b74d511c req-c4f03c4c-f5bb-4a5b-8739-c3b2f32c46f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240d5470-7916-48a4-b90f-910c88d68384", "tag": "e225f24a-f0f4-4283-af60-d533e1dd5c9d"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:30:11.681552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-bb11692b-74cd-4ace-b409-3a54b74d511c req-c4f03c4c-f5bb-4a5b-8739-c3b2f32c46f6 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:11.682422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-bb11692b-74cd-4ace-b409-3a54b74d511c req-c4f03c4c-f5bb-4a5b-8739-c3b2f32c46f6 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:11.697835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-bb11692b-74cd-4ace-b409-3a54b74d511c req-c4f03c4c-f5bb-4a5b-8739-c3b2f32c46f6 service nova] Creating event network-changed:e225f24a-f0f4-4283-af60-d533e1dd5c9d for instance 240d5470-7916-48a4-b90f-910c88d68384 on hv-cinder-82549 Jul 26 18:30:11.698473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e13f10ff-b9db-4428-af56-529bdbef1784 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:11.704410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-bb11692b-74cd-4ace-b409-3a54b74d511c req-c4f03c4c-f5bb-4a5b-8739-c3b2f32c46f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046954 Jul 26 18:30:11.705825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 115/235] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:30:11.721191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e13f10ff-b9db-4428-af56-529bdbef1784 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1556 microversion: 2.1 time: 0.746921 Jul 26 18:30:11.722705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 121/236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:10 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1556 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:30:11.793850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-94607845-05a1-48a0-87bd-99799018561f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:11.795693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-94607845-05a1-48a0-87bd-99799018561f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:11.814083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94607845-05a1-48a0-87bd-99799018561f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:11.814537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94607845-05a1-48a0-87bd-99799018561f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:11.815361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94607845-05a1-48a0-87bd-99799018561f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:11.815804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94607845-05a1-48a0-87bd-99799018561f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:11.884575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:30:12.364428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e1286d8d-aa28-4e2d-b1fd-bcd40f1082b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:12.369146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e1286d8d-aa28-4e2d-b1fd-bcd40f1082b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:12.419342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1286d8d-aa28-4e2d-b1fd-bcd40f1082b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:12.421945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1286d8d-aa28-4e2d-b1fd-bcd40f1082b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:12.429415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1286d8d-aa28-4e2d-b1fd-bcd40f1082b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:12.433939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1286d8d-aa28-4e2d-b1fd-bcd40f1082b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:12.595755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-94607845-05a1-48a0-87bd-99799018561f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.851568 Jul 26 18:30:12.598502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 116/237] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Jul 26 18:30:11 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-interface => generated 285 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:30:13.494517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e1286d8d-aa28-4e2d-b1fd-bcd40f1082b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:13.505430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e1286d8d-aa28-4e2d-b1fd-bcd40f1082b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 1.178832 Jul 26 18:30:13.517944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 122/238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:12 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:14.547557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2542dd5b-8f57-4121-b2e7-05886f9dbf8f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:14.550168 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2542dd5b-8f57-4121-b2e7-05886f9dbf8f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:14.567668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=85 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:30:14.581277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2542dd5b-8f57-4121-b2e7-05886f9dbf8f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:14.582929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2542dd5b-8f57-4121-b2e7-05886f9dbf8f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:14.585079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2542dd5b-8f57-4121-b2e7-05886f9dbf8f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:14.586000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2542dd5b-8f57-4121-b2e7-05886f9dbf8f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:15.020708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2542dd5b-8f57-4121-b2e7-05886f9dbf8f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:15.032707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2542dd5b-8f57-4121-b2e7-05886f9dbf8f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.494540 Jul 26 18:30:15.033982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 117/239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:14 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:16.082046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-329593c1-2c85-482f-995f-552a11686ca1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:16.083083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-329593c1-2c85-482f-995f-552a11686ca1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:16.131812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-329593c1-2c85-482f-995f-552a11686ca1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:16.132572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-329593c1-2c85-482f-995f-552a11686ca1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:16.144612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-329593c1-2c85-482f-995f-552a11686ca1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:16.145164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-329593c1-2c85-482f-995f-552a11686ca1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:16.290933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-f5d44341-2e17-47eb-aab0-fa32c53b79f5 req-4cc4832b-a904-4b9e-b738-b21c585d8be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ada35c-e092-41a1-a9c4-2177b7e8ae31", "tag": "249fd822-02ca-4f9a-bf6e-53fdc2629e85"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:30:16.304964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-f5d44341-2e17-47eb-aab0-fa32c53b79f5 req-4cc4832b-a904-4b9e-b738-b21c585d8be2 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:16.312086 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-f5d44341-2e17-47eb-aab0-fa32c53b79f5 req-4cc4832b-a904-4b9e-b738-b21c585d8be2 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:16.373314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-f5d44341-2e17-47eb-aab0-fa32c53b79f5 req-4cc4832b-a904-4b9e-b738-b21c585d8be2 service nova] Creating event network-changed:249fd822-02ca-4f9a-bf6e-53fdc2629e85 for instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 on hv-cinder-82549 Jul 26 18:30:16.391318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-f5d44341-2e17-47eb-aab0-fa32c53b79f5 req-4cc4832b-a904-4b9e-b738-b21c585d8be2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102160 Jul 26 18:30:16.393385 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 118/240] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:30:16.721526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-329593c1-2c85-482f-995f-552a11686ca1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:16.733983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-329593c1-2c85-482f-995f-552a11686ca1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.659677 Jul 26 18:30:16.735007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 123/241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:16 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:16.847980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d0e72cf3-97c8-4779-b3c2-0b5b8f00aab5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:16.849562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d0e72cf3-97c8-4779-b3c2-0b5b8f00aab5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:16.878684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0e72cf3-97c8-4779-b3c2-0b5b8f00aab5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:16.881954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0e72cf3-97c8-4779-b3c2-0b5b8f00aab5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:16.884661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0e72cf3-97c8-4779-b3c2-0b5b8f00aab5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:16.885896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0e72cf3-97c8-4779-b3c2-0b5b8f00aab5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:17.017208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d0e72cf3-97c8-4779-b3c2-0b5b8f00aab5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 18:30:17.316576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d0e72cf3-97c8-4779-b3c2-0b5b8f00aab5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 204 len: 0 microversion: 2.1 time: 0.475658 Jul 26 18:30:17.319618 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 119/242] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 18:30:16 2022] DELETE /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:30:17.328113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-606d4cc3-1ccc-4229-a99f-be44604ed650 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:17.329820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-606d4cc3-1ccc-4229-a99f-be44604ed650 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:17.344771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-606d4cc3-1ccc-4229-a99f-be44604ed650 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:17.348143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-606d4cc3-1ccc-4229-a99f-be44604ed650 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:17.350452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-606d4cc3-1ccc-4229-a99f-be44604ed650 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:17.351197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-606d4cc3-1ccc-4229-a99f-be44604ed650 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:17.772141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-138a0f6a-cb2f-47af-95a5-bac49badbb4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:17.773452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-138a0f6a-cb2f-47af-95a5-bac49badbb4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:17.813328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-138a0f6a-cb2f-47af-95a5-bac49badbb4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:17.816720 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-138a0f6a-cb2f-47af-95a5-bac49badbb4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:17.822336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-138a0f6a-cb2f-47af-95a5-bac49badbb4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:17.823172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-138a0f6a-cb2f-47af-95a5-bac49badbb4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:17.836118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-606d4cc3-1ccc-4229-a99f-be44604ed650 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:17.850450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-606d4cc3-1ccc-4229-a99f-be44604ed650 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1554 microversion: 2.1 time: 0.525238 Jul 26 18:30:17.863316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 124/243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:17 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1554 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:18.662297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-138a0f6a-cb2f-47af-95a5-bac49badbb4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:18.676967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-138a0f6a-cb2f-47af-95a5-bac49badbb4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.922236 Jul 26 18:30:18.683124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 120/244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:17 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:18.878128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f841c44b-e815-4c2c-95ac-09cd93b108a9 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:18.879276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f841c44b-e815-4c2c-95ac-09cd93b108a9 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:18.902862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f841c44b-e815-4c2c-95ac-09cd93b108a9 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:18.903663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f841c44b-e815-4c2c-95ac-09cd93b108a9 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:18.904979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f841c44b-e815-4c2c-95ac-09cd93b108a9 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:18.912107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f841c44b-e815-4c2c-95ac-09cd93b108a9 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:19.312647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f841c44b-e815-4c2c-95ac-09cd93b108a9 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:19.346039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f841c44b-e815-4c2c-95ac-09cd93b108a9 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1554 microversion: 2.1 time: 0.473430 Jul 26 18:30:19.347263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 125/245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:18 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1554 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:30:19.731243 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-96527c3d-b0c7-458a-8e06-d993b995d875 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:19.733840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-96527c3d-b0c7-458a-8e06-d993b995d875 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:19.765321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96527c3d-b0c7-458a-8e06-d993b995d875 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:19.769751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96527c3d-b0c7-458a-8e06-d993b995d875 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:19.773412 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96527c3d-b0c7-458a-8e06-d993b995d875 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:19.777838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96527c3d-b0c7-458a-8e06-d993b995d875 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:20.236788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-96527c3d-b0c7-458a-8e06-d993b995d875 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:20.248908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-96527c3d-b0c7-458a-8e06-d993b995d875 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.528453 Jul 26 18:30:20.254834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 121/246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:19 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:20.383448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7cb14c32-d967-4673-94f1-63f10f9527f6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:20.386858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7cb14c32-d967-4673-94f1-63f10f9527f6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:20.415612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cb14c32-d967-4673-94f1-63f10f9527f6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:20.418360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cb14c32-d967-4673-94f1-63f10f9527f6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:20.420922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cb14c32-d967-4673-94f1-63f10f9527f6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:20.425586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cb14c32-d967-4673-94f1-63f10f9527f6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:21.279446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-57427a3f-5771-4784-97da-c174eb4dafa3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:21.280913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-57427a3f-5771-4784-97da-c174eb4dafa3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:21.295842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-57427a3f-5771-4784-97da-c174eb4dafa3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:21.297971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-57427a3f-5771-4784-97da-c174eb4dafa3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:21.300935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-57427a3f-5771-4784-97da-c174eb4dafa3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:21.301663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-57427a3f-5771-4784-97da-c174eb4dafa3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:21.384364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7cb14c32-d967-4673-94f1-63f10f9527f6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:21.406624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7cb14c32-d967-4673-94f1-63f10f9527f6 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1554 microversion: 2.1 time: 1.040245 Jul 26 18:30:21.417862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 126/247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:20 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1554 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:21.600997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-57427a3f-5771-4784-97da-c174eb4dafa3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:21.627759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-57427a3f-5771-4784-97da-c174eb4dafa3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.351611 Jul 26 18:30:21.630082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 122/248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:21 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:30:22.451455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-16cb5255-c035-4ee6-bddf-48a82ddccf0f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:22.457519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-16cb5255-c035-4ee6-bddf-48a82ddccf0f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:22.481096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16cb5255-c035-4ee6-bddf-48a82ddccf0f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:22.481473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16cb5255-c035-4ee6-bddf-48a82ddccf0f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:22.482763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16cb5255-c035-4ee6-bddf-48a82ddccf0f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:22.483700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16cb5255-c035-4ee6-bddf-48a82ddccf0f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:22.612280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-5ee19d7d-e6f3-4585-9725-f057c7ff2ab6 req-a417cacd-8ee5-48d2-bd17-8bcf0bbcca2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fffb9029-1d38-416c-b4ad-a85f17a1db8a", "name": "network-vif-deleted", "tag": "409f556e-16d1-4abe-a109-741f1646bdb8"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:30:22.687330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-5ee19d7d-e6f3-4585-9725-f057c7ff2ab6 req-a417cacd-8ee5-48d2-bd17-8bcf0bbcca2c service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:22.691794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-5ee19d7d-e6f3-4585-9725-f057c7ff2ab6 req-a417cacd-8ee5-48d2-bd17-8bcf0bbcca2c service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:22.735198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-5ee19d7d-e6f3-4585-9725-f057c7ff2ab6 req-a417cacd-8ee5-48d2-bd17-8bcf0bbcca2c service nova] Creating event network-vif-deleted:409f556e-16d1-4abe-a109-741f1646bdb8 for instance fffb9029-1d38-416c-b4ad-a85f17a1db8a on hv-cinder-82549 Jul 26 18:30:22.753871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-5ee19d7d-e6f3-4585-9725-f057c7ff2ab6 req-a417cacd-8ee5-48d2-bd17-8bcf0bbcca2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149255 Jul 26 18:30:22.755406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 123/249] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:30:22.775148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e2c9c504-c4ee-45cf-a2a2-5a8bd85b0812 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:22.776763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e2c9c504-c4ee-45cf-a2a2-5a8bd85b0812 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:22.820995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e2c9c504-c4ee-45cf-a2a2-5a8bd85b0812 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:22.821738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e2c9c504-c4ee-45cf-a2a2-5a8bd85b0812 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:22.822977 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e2c9c504-c4ee-45cf-a2a2-5a8bd85b0812 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:22.823785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e2c9c504-c4ee-45cf-a2a2-5a8bd85b0812 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:23.205031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-16cb5255-c035-4ee6-bddf-48a82ddccf0f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4443c05af61a421bab770eb9c33dede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7afc92817c24e5fb66f77e1f8c03d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:23.234236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-16cb5255-c035-4ee6-bddf-48a82ddccf0f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 200 len: 1512 microversion: 2.1 time: 0.799081 Jul 26 18:30:23.240750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 127/250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:22 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 1512 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:23.291981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e2c9c504-c4ee-45cf-a2a2-5a8bd85b0812 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:23.314711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e2c9c504-c4ee-45cf-a2a2-5a8bd85b0812 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.557364 Jul 26 18:30:23.334501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 124/251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:22 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:24.273572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e9fcc740-fa09-4b58-a14d-7db6b371e7eb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:24.290143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e9fcc740-fa09-4b58-a14d-7db6b371e7eb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:24.315485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9fcc740-fa09-4b58-a14d-7db6b371e7eb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:24.316452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9fcc740-fa09-4b58-a14d-7db6b371e7eb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:24.317902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9fcc740-fa09-4b58-a14d-7db6b371e7eb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:24.318678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9fcc740-fa09-4b58-a14d-7db6b371e7eb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:24.358544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5685eb85-8494-471d-be26-b401ed12be02 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:24.359534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5685eb85-8494-471d-be26-b401ed12be02 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:24.373535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5685eb85-8494-471d-be26-b401ed12be02 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:24.375014 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5685eb85-8494-471d-be26-b401ed12be02 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:24.380133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5685eb85-8494-471d-be26-b401ed12be02 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:24.381377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5685eb85-8494-471d-be26-b401ed12be02 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:24.381650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-e9fcc740-fa09-4b58-a14d-7db6b371e7eb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] HTTP exception thrown: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e9fcc740-fa09-4b58-a14d-7db6b371e7eb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Request method failure captured: Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a HTTP/1.1 Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJrwzRwGsixzeH-Lm7HfLaLkkG25umv-a-RXaYLYwZ8xaRNp_1uHLo8liF4w0kMoC37tejRsJeWRn3up18osj2lXqhHwM7kf0dhzj9IlpLaN0MG3-4qKYOKOEU_dxGEeLuLoW90tpqzsUMoFYfH5haqSIh6qf9OwQFhZvzaYK7VLXM Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: f7afc92817c24e5fb66f77e1f8c03d0c Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-DeleteServersTestJSON-191695927 Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 18:30:24.411794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 18:30:24.414579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f7afc92817c24e5fb66f77e1f8c03d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f7afc92817c24e5fb66f77e1f8c03d0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7afc92817c24e5fb66f77e1f8c03d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7afc92817c24e5fb66f77e1f8c03d0c"}]}] Jul 26 18:30:24.414579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-DeleteServersTestJSON-191695927 Jul 26 18:30:24.414579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: f7afc92817c24e5fb66f77e1f8c03d0c Jul 26 18:30:24.414579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-DeleteServersTestJSON-191695927 Jul 26 18:30:24.414579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-DeleteServersTestJSON-191695927-project Jul 26 18:30:24.414579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 18:30:24.414579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 18:30:24.414579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 4443c05af61a421bab770eb9c33dede6 Jul 26 18:30:24.414579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-DeleteServersTestJSON-191695927-project Jul 26 18:30:24.414579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 18:30:24.414579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:24.414579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': 'fffb9029-1d38-416c-b4ad-a85f17a1db8a'} Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:30:24.416459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:24.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:24.427506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e9fcc740-fa09-4b58-a14d-7db6b371e7eb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Returning 404 to user: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:30:24.427506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e9fcc740-fa09-4b58-a14d-7db6b371e7eb tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 404 len: 111 microversion: 2.1 time: 0.156240 Jul 26 18:30:24.427506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 128/252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:24 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 18:30:24.750760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-302aa920-2870-4f3a-bec4-35cbb90e6f0e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:24.754335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-302aa920-2870-4f3a-bec4-35cbb90e6f0e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:24.781077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-302aa920-2870-4f3a-bec4-35cbb90e6f0e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:24.782420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-302aa920-2870-4f3a-bec4-35cbb90e6f0e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:24.784601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-302aa920-2870-4f3a-bec4-35cbb90e6f0e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:24.785758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-302aa920-2870-4f3a-bec4-35cbb90e6f0e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:24.823008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-302aa920-2870-4f3a-bec4-35cbb90e6f0e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] HTTP exception thrown: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-302aa920-2870-4f3a-bec4-35cbb90e6f0e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Request method failure captured: Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a/os-volume_attachments HTTP/1.1 Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJrwzRwGsixzeH-Lm7HfLaLkkG25umv-a-RXaYLYwZ8xaRNp_1uHLo8liF4w0kMoC37tejRsJeWRn3up18osj2lXqhHwM7kf0dhzj9IlpLaN0MG3-4qKYOKOEU_dxGEeLuLoW90tpqzsUMoFYfH5haqSIh6qf9OwQFhZvzaYK7VLXM Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: f7afc92817c24e5fb66f77e1f8c03d0c Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-DeleteServersTestJSON-191695927 Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 18:30:24.832479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 18:30:24.835441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f7afc92817c24e5fb66f77e1f8c03d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f7afc92817c24e5fb66f77e1f8c03d0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7afc92817c24e5fb66f77e1f8c03d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7afc92817c24e5fb66f77e1f8c03d0c"}]}] Jul 26 18:30:24.835441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-DeleteServersTestJSON-191695927 Jul 26 18:30:24.835441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: f7afc92817c24e5fb66f77e1f8c03d0c Jul 26 18:30:24.835441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-DeleteServersTestJSON-191695927 Jul 26 18:30:24.835441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-DeleteServersTestJSON-191695927-project Jul 26 18:30:24.835441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 18:30:24.835441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 18:30:24.835441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 4443c05af61a421bab770eb9c33dede6 Jul 26 18:30:24.835441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-DeleteServersTestJSON-191695927-project Jul 26 18:30:24.835441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 18:30:24.835441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:24.835441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'server_id': 'fffb9029-1d38-416c-b4ad-a85f17a1db8a'} Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:30:24.836977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:24.839480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:24.848258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-302aa920-2870-4f3a-bec4-35cbb90e6f0e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Returning 404 to user: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:30:24.850478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-302aa920-2870-4f3a-bec4-35cbb90e6f0e tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.106570 Jul 26 18:30:24.852410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 129/253] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:30:24 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a/os-volume_attachments => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 18:30:24.993667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5685eb85-8494-471d-be26-b401ed12be02 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:25.001664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5685eb85-8494-471d-be26-b401ed12be02 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.648138 Jul 26 18:30:25.018239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 125/254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:24 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:26.042711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8b38e0b3-8afa-4772-b806-344404d256d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:26.046742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8b38e0b3-8afa-4772-b806-344404d256d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:26.064870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b38e0b3-8afa-4772-b806-344404d256d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:26.065178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b38e0b3-8afa-4772-b806-344404d256d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:26.066861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b38e0b3-8afa-4772-b806-344404d256d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:26.067706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b38e0b3-8afa-4772-b806-344404d256d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:26.481788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d3b96111-1d87-4c07-8efc-fe8bbb7e89d5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:26.483926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d3b96111-1d87-4c07-8efc-fe8bbb7e89d5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:26.512078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3b96111-1d87-4c07-8efc-fe8bbb7e89d5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:26.513287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3b96111-1d87-4c07-8efc-fe8bbb7e89d5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:26.514905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3b96111-1d87-4c07-8efc-fe8bbb7e89d5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:26.516079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3b96111-1d87-4c07-8efc-fe8bbb7e89d5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:26.567947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-d3b96111-1d87-4c07-8efc-fe8bbb7e89d5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] HTTP exception thrown: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:26.595983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8b38e0b3-8afa-4772-b806-344404d256d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d3b96111-1d87-4c07-8efc-fe8bbb7e89d5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Request method failure captured: Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: request: DELETE /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a HTTP/1.1 Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Connection: close Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Host: 10.222.0.27 Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.10 Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABi4DJrwzRwGsixzeH-Lm7HfLaLkkG25umv-a-RXaYLYwZ8xaRNp_1uHLo8liF4w0kMoC37tejRsJeWRn3up18osj2lXqhHwM7kf0dhzj9IlpLaN0MG3-4qKYOKOEU_dxGEeLuLoW90tpqzsUMoFYfH5haqSIh6qf9OwQFhZvzaYK7VLXM Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Id: f7afc92817c24e5fb66f77e1f8c03d0c Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-DeleteServersTestJSON-191695927 Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Role: reader,member Jul 26 18:30:26.602749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Roles: reader,member Jul 26 18:30:26.605104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f7afc92817c24e5fb66f77e1f8c03d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f7afc92817c24e5fb66f77e1f8c03d0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7afc92817c24e5fb66f77e1f8c03d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7afc92817c24e5fb66f77e1f8c03d0c"}]}] Jul 26 18:30:26.605104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-DeleteServersTestJSON-191695927 Jul 26 18:30:26.605104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant-Id: f7afc92817c24e5fb66f77e1f8c03d0c Jul 26 18:30:26.605104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-DeleteServersTestJSON-191695927 Jul 26 18:30:26.605104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User: tempest-DeleteServersTestJSON-191695927-project Jul 26 18:30:26.605104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 26 18:30:26.605104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 26 18:30:26.605104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Id: 4443c05af61a421bab770eb9c33dede6 Jul 26 18:30:26.605104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-DeleteServersTestJSON-191695927-project Jul 26 18:30:26.605104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: method: > Jul 26 18:30:26.605104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: exception: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:26.605104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: action_args: {'id': 'fffb9029-1d38-416c-b4ad-a85f17a1db8a'} Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:30:26.607980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:26.612671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:30:26.619851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d3b96111-1d87-4c07-8efc-fe8bbb7e89d5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Returning 404 to user: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:30:26.620074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8b38e0b3-8afa-4772-b806-344404d256d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.587515 Jul 26 18:30:26.631899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d3b96111-1d87-4c07-8efc-fe8bbb7e89d5 tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 404 len: 111 microversion: 2.1 time: 0.149020 Jul 26 18:30:26.633393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 130/255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:26 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:26.633665 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 126/256] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 18:30:26 2022] DELETE /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 18:30:26.662150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c234b3da-e7b8-414c-b5a2-ca072c3fc28f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:26.681070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c234b3da-e7b8-414c-b5a2-ca072c3fc28f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] [instance: fffb9029-1d38-416c-b4ad-a85f17a1db8a] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:26.707552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c234b3da-e7b8-414c-b5a2-ca072c3fc28f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:26.709696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c234b3da-e7b8-414c-b5a2-ca072c3fc28f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:26.713399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c234b3da-e7b8-414c-b5a2-ca072c3fc28f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:26.719957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c234b3da-e7b8-414c-b5a2-ca072c3fc28f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:26.767548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-c234b3da-e7b8-414c-b5a2-ca072c3fc28f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] HTTP exception thrown: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c234b3da-e7b8-414c-b5a2-ca072c3fc28f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Request method failure captured: Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a HTTP/1.1 Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJrwzRwGsixzeH-Lm7HfLaLkkG25umv-a-RXaYLYwZ8xaRNp_1uHLo8liF4w0kMoC37tejRsJeWRn3up18osj2lXqhHwM7kf0dhzj9IlpLaN0MG3-4qKYOKOEU_dxGEeLuLoW90tpqzsUMoFYfH5haqSIh6qf9OwQFhZvzaYK7VLXM Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: f7afc92817c24e5fb66f77e1f8c03d0c Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-DeleteServersTestJSON-191695927 Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 18:30:26.771844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 18:30:26.774331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f7afc92817c24e5fb66f77e1f8c03d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f7afc92817c24e5fb66f77e1f8c03d0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7afc92817c24e5fb66f77e1f8c03d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7afc92817c24e5fb66f77e1f8c03d0c"}]}] Jul 26 18:30:26.774331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-DeleteServersTestJSON-191695927 Jul 26 18:30:26.774331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: f7afc92817c24e5fb66f77e1f8c03d0c Jul 26 18:30:26.774331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-DeleteServersTestJSON-191695927 Jul 26 18:30:26.774331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-DeleteServersTestJSON-191695927-project Jul 26 18:30:26.774331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 18:30:26.774331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 18:30:26.774331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 4443c05af61a421bab770eb9c33dede6 Jul 26 18:30:26.774331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-DeleteServersTestJSON-191695927-project Jul 26 18:30:26.774331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 18:30:26.774331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:26.774331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': 'fffb9029-1d38-416c-b4ad-a85f17a1db8a'} Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:30:26.775990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. Jul 26 18:30:26.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:30:26.783995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c234b3da-e7b8-414c-b5a2-ca072c3fc28f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] Returning 404 to user: Instance fffb9029-1d38-416c-b4ad-a85f17a1db8a could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:30:26.786464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c234b3da-e7b8-414c-b5a2-ca072c3fc28f tempest-DeleteServersTestJSON-191695927 tempest-DeleteServersTestJSON-191695927-project] 10.222.0.27 "GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a" status: 404 len: 111 microversion: 2.1 time: 0.152407 Jul 26 18:30:26.788063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 131/257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:26 2022] GET /compute/v2.1/servers/fffb9029-1d38-416c-b4ad-a85f17a1db8a => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 18:30:27.663418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f19f0b89-58f0-423e-b316-6cfb21e5e381 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:27.666186 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f19f0b89-58f0-423e-b316-6cfb21e5e381 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:27.700311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f19f0b89-58f0-423e-b316-6cfb21e5e381 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:27.700980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f19f0b89-58f0-423e-b316-6cfb21e5e381 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:27.702330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f19f0b89-58f0-423e-b316-6cfb21e5e381 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:27.703100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f19f0b89-58f0-423e-b316-6cfb21e5e381 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:28.575815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f19f0b89-58f0-423e-b316-6cfb21e5e381 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:28.591983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f19f0b89-58f0-423e-b316-6cfb21e5e381 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.938070 Jul 26 18:30:28.611747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 127/258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:27 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:29.622986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a0da3083-e488-4f32-b265-55e9d517b607 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:29.626474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a0da3083-e488-4f32-b265-55e9d517b607 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:29.674004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0da3083-e488-4f32-b265-55e9d517b607 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:29.693260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0da3083-e488-4f32-b265-55e9d517b607 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:29.696068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0da3083-e488-4f32-b265-55e9d517b607 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:29.697185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0da3083-e488-4f32-b265-55e9d517b607 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:31.086304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a0da3083-e488-4f32-b265-55e9d517b607 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:31.103791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:30:31.142577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a0da3083-e488-4f32-b265-55e9d517b607 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 1.528628 Jul 26 18:30:31.148412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 132/259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:29 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:32.173741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5deeba65-ecc9-40cc-a71c-cf99b79c6fe5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:32.176243 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5deeba65-ecc9-40cc-a71c-cf99b79c6fe5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:32.194011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5deeba65-ecc9-40cc-a71c-cf99b79c6fe5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:32.200204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5deeba65-ecc9-40cc-a71c-cf99b79c6fe5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:32.201132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5deeba65-ecc9-40cc-a71c-cf99b79c6fe5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:32.201608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5deeba65-ecc9-40cc-a71c-cf99b79c6fe5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:33.836315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5deeba65-ecc9-40cc-a71c-cf99b79c6fe5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:33.864940 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5deeba65-ecc9-40cc-a71c-cf99b79c6fe5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 1.694899 Jul 26 18:30:33.901279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 128/260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:32 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:34.930142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0253721e-7bfa-42e8-b80a-4d93395d54fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:34.942065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0253721e-7bfa-42e8-b80a-4d93395d54fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:34.996438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=54 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:30:35.020008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0253721e-7bfa-42e8-b80a-4d93395d54fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:35.043600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0253721e-7bfa-42e8-b80a-4d93395d54fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:35.047517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0253721e-7bfa-42e8-b80a-4d93395d54fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:35.061738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0253721e-7bfa-42e8-b80a-4d93395d54fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:36.271601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0253721e-7bfa-42e8-b80a-4d93395d54fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:36.352983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0253721e-7bfa-42e8-b80a-4d93395d54fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 1.436298 Jul 26 18:30:36.353928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 133/261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:34 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:37.417802 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2e865219-06b9-4469-a122-2ca9506daa06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:37.421143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2e865219-06b9-4469-a122-2ca9506daa06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:37.485533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e865219-06b9-4469-a122-2ca9506daa06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:37.486337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e865219-06b9-4469-a122-2ca9506daa06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:37.487977 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e865219-06b9-4469-a122-2ca9506daa06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:37.489677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e865219-06b9-4469-a122-2ca9506daa06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:38.402193 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2e865219-06b9-4469-a122-2ca9506daa06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:38.426808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2e865219-06b9-4469-a122-2ca9506daa06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 1.046252 Jul 26 18:30:38.450136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 129/262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:37 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:39.472840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3e8e9b41-409c-40fd-abd4-8037d2eb91e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:39.485415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3e8e9b41-409c-40fd-abd4-8037d2eb91e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:39.516258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e8e9b41-409c-40fd-abd4-8037d2eb91e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:39.517031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e8e9b41-409c-40fd-abd4-8037d2eb91e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:39.523253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e8e9b41-409c-40fd-abd4-8037d2eb91e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:39.524034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e8e9b41-409c-40fd-abd4-8037d2eb91e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:39.961295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3e8e9b41-409c-40fd-abd4-8037d2eb91e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:39.972948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3e8e9b41-409c-40fd-abd4-8037d2eb91e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.523656 Jul 26 18:30:39.974325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 134/263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:39 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:41.003482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9759339d-898b-4ae3-b492-57cb2aaaae47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:41.004889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9759339d-898b-4ae3-b492-57cb2aaaae47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:41.026400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9759339d-898b-4ae3-b492-57cb2aaaae47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:41.027090 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9759339d-898b-4ae3-b492-57cb2aaaae47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:41.028274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9759339d-898b-4ae3-b492-57cb2aaaae47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:41.028862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9759339d-898b-4ae3-b492-57cb2aaaae47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:41.340973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9759339d-898b-4ae3-b492-57cb2aaaae47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:41.355646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9759339d-898b-4ae3-b492-57cb2aaaae47 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.358923 Jul 26 18:30:41.355646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 130/264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:40 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:42.379418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-39673373-d13e-4083-9efa-5a2f7b65349b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:42.381159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-39673373-d13e-4083-9efa-5a2f7b65349b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:42.394071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39673373-d13e-4083-9efa-5a2f7b65349b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:42.395190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39673373-d13e-4083-9efa-5a2f7b65349b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:42.396553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39673373-d13e-4083-9efa-5a2f7b65349b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:42.397337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39673373-d13e-4083-9efa-5a2f7b65349b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:42.792034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-39673373-d13e-4083-9efa-5a2f7b65349b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:42.809189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-39673373-d13e-4083-9efa-5a2f7b65349b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.434839 Jul 26 18:30:42.810680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 135/265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:42 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:43.837433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e02738f3-6889-4aec-80d9-77b10bdb796e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:43.838462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e02738f3-6889-4aec-80d9-77b10bdb796e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:43.873798 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e02738f3-6889-4aec-80d9-77b10bdb796e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:43.874549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e02738f3-6889-4aec-80d9-77b10bdb796e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:43.888592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e02738f3-6889-4aec-80d9-77b10bdb796e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:43.898414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e02738f3-6889-4aec-80d9-77b10bdb796e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:43.957117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:30:44.234929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e02738f3-6889-4aec-80d9-77b10bdb796e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:44.248972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e02738f3-6889-4aec-80d9-77b10bdb796e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.418771 Jul 26 18:30:44.250905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 131/266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:43 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:45.291385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-34c3c8d8-b4ec-4cba-906b-7f7721207d7c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:45.295439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-34c3c8d8-b4ec-4cba-906b-7f7721207d7c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:45.319774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34c3c8d8-b4ec-4cba-906b-7f7721207d7c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:45.322348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34c3c8d8-b4ec-4cba-906b-7f7721207d7c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:45.327123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34c3c8d8-b4ec-4cba-906b-7f7721207d7c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:45.328286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34c3c8d8-b4ec-4cba-906b-7f7721207d7c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:45.767791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-34c3c8d8-b4ec-4cba-906b-7f7721207d7c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:45.787397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-34c3c8d8-b4ec-4cba-906b-7f7721207d7c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.501656 Jul 26 18:30:45.804026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 136/267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:45 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:46.838748 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c0cbf33f-3c86-43e1-810f-ca792110310e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:46.842425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c0cbf33f-3c86-43e1-810f-ca792110310e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:46.887651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:30:46.893134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0cbf33f-3c86-43e1-810f-ca792110310e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:46.894879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0cbf33f-3c86-43e1-810f-ca792110310e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:46.896633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0cbf33f-3c86-43e1-810f-ca792110310e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:46.897642 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0cbf33f-3c86-43e1-810f-ca792110310e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:47.366681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c0cbf33f-3c86-43e1-810f-ca792110310e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:47.376787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c0cbf33f-3c86-43e1-810f-ca792110310e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1521 microversion: 2.1 time: 0.546286 Jul 26 18:30:47.381079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 132/268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:46 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1521 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:48.416748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-17b1b78b-672b-4a0c-b395-213e5bc0541e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:48.418111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-17b1b78b-672b-4a0c-b395-213e5bc0541e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:48.426950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17b1b78b-672b-4a0c-b395-213e5bc0541e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:48.427851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17b1b78b-672b-4a0c-b395-213e5bc0541e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:48.429184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17b1b78b-672b-4a0c-b395-213e5bc0541e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:48.429908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17b1b78b-672b-4a0c-b395-213e5bc0541e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:48.705841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-17b1b78b-672b-4a0c-b395-213e5bc0541e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:48.758772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-17b1b78b-672b-4a0c-b395-213e5bc0541e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1501 microversion: 2.1 time: 0.344605 Jul 26 18:30:48.763266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 137/269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:48 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1501 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:30:48.796422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-96666921-6b71-4481-96b9-fdebe391e07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:48.797260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-96666921-6b71-4481-96b9-fdebe391e07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:48.806162 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96666921-6b71-4481-96b9-fdebe391e07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:48.806660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96666921-6b71-4481-96b9-fdebe391e07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:48.807619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96666921-6b71-4481-96b9-fdebe391e07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:48.807884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96666921-6b71-4481-96b9-fdebe391e07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:49.173127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-96666921-6b71-4481-96b9-fdebe391e07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:49.190966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-96666921-6b71-4481-96b9-fdebe391e07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1516 microversion: 2.1 time: 0.400884 Jul 26 18:30:49.191664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 133/270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:48 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1516 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:51.033652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a5b8bb53-a65d-4088-b995-ba001bf493f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:30:51.036073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a5b8bb53-a65d-4088-b995-ba001bf493f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:51.043933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5b8bb53-a65d-4088-b995-ba001bf493f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:51.044443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5b8bb53-a65d-4088-b995-ba001bf493f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:51.045446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5b8bb53-a65d-4088-b995-ba001bf493f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:51.046141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5b8bb53-a65d-4088-b995-ba001bf493f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:51.079767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.objects.instance [None req-a5b8bb53-a65d-4088-b995-ba001bf493f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lazy-loading 'flavor' on Instance uuid fbf94d62-c20e-42ae-9403-03100f038397 {{(pid=117996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:30:51.189365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a5b8bb53-a65d-4088-b995-ba001bf493f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "POST /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397/action" status: 200 len: 32 microversion: 2.1 time: 0.160112 Jul 26 18:30:51.190504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 138/271] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:30:51 2022] POST /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 18:30:51.203175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0c6a32d0-19a1-48e6-990d-3061abcaa012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:51.204541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0c6a32d0-19a1-48e6-990d-3061abcaa012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:51.218285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c6a32d0-19a1-48e6-990d-3061abcaa012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:51.218798 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c6a32d0-19a1-48e6-990d-3061abcaa012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:51.219912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c6a32d0-19a1-48e6-990d-3061abcaa012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:51.220429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c6a32d0-19a1-48e6-990d-3061abcaa012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:51.516678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0c6a32d0-19a1-48e6-990d-3061abcaa012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:51.548636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0c6a32d0-19a1-48e6-990d-3061abcaa012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.349359 Jul 26 18:30:51.551654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 134/272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:51 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:30:52.596210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1b154291-b29a-43a8-a48a-7e00a25e71d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:52.597659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1b154291-b29a-43a8-a48a-7e00a25e71d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:52.613643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b154291-b29a-43a8-a48a-7e00a25e71d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:52.614435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b154291-b29a-43a8-a48a-7e00a25e71d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:52.615513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b154291-b29a-43a8-a48a-7e00a25e71d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:52.616160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b154291-b29a-43a8-a48a-7e00a25e71d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:52.874336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1b154291-b29a-43a8-a48a-7e00a25e71d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:52.894265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1b154291-b29a-43a8-a48a-7e00a25e71d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.305308 Jul 26 18:30:52.895312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 139/273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:52 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:53.931154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cb0b6ddc-779d-4921-a7e4-75bed5f87c1c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:53.936355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cb0b6ddc-779d-4921-a7e4-75bed5f87c1c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:53.950542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb0b6ddc-779d-4921-a7e4-75bed5f87c1c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:53.951336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb0b6ddc-779d-4921-a7e4-75bed5f87c1c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:53.952895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb0b6ddc-779d-4921-a7e4-75bed5f87c1c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:53.954085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb0b6ddc-779d-4921-a7e4-75bed5f87c1c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:54.208398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cb0b6ddc-779d-4921-a7e4-75bed5f87c1c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:54.218329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cb0b6ddc-779d-4921-a7e4-75bed5f87c1c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.305005 Jul 26 18:30:54.219379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 135/274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:53 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:54.475383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f35458d8-67f9-4df8-9d42-f61430991c6d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Action: 'create', calling method: .version_select at 0x7f390a2aef70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1650664673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/2fPk1fJ3Yo51j0ZBYv1eORboaeSC3kIEtKr61f/us/b3LGwsr50Dzh7ZoDfckAqairnIX6dORLsokmeEZ9EiFxG3huiyb70d8SkXVrerwPvIOAXsA0/hh7r9vMNRcyQ=="}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:30:54.504949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-f35458d8-67f9-4df8-9d42-f61430991c6d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Getting quotas for project ce7168da907a4465b0e919131bb0373e. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:30:54.509675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-f35458d8-67f9-4df8-9d42-f61430991c6d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Getting quotas for user 54c4e94a090544d7a977dabe32884f98 and project ce7168da907a4465b0e919131bb0373e. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:30:54.555593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f35458d8-67f9-4df8-9d42-f61430991c6d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.086772 Jul 26 18:30:54.556220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 140/275] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Jul 26 18:30:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:30:54.670991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-598154120", "imageRef": "94e87ac4-98cc-427e-9f22-79bac558dd91", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1650664673", "networks": [{"uuid": "67019445-e683-4b7b-9bd3-aa3e7d4e52a7"}]}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:30:54.732805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] validate_networks() for [('67019445-e683-4b7b-9bd3-aa3e7d4e52a7', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:30:55.172816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:30:55.173928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:30:55.174245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:30:55.174740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:30:55.175290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:30:55.185774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:55.186226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:55.187138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:55.187473 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:55.206038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Getting quotas for project ce7168da907a4465b0e919131bb0373e. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:30:55.210616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Getting quotas for user 54c4e94a090544d7a977dabe32884f98 and project ce7168da907a4465b0e919131bb0373e. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:30:55.223865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:30:55.226069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94e87ac4-98cc-427e-9f22-79bac558dd91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:30:55.240449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5309301c-0e40-47f2-a386-f656f112cb67 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:55.241542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5309301c-0e40-47f2-a386-f656f112cb67 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:55.248644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5309301c-0e40-47f2-a386-f656f112cb67 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:55.249419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5309301c-0e40-47f2-a386-f656f112cb67 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:55.250793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5309301c-0e40-47f2-a386-f656f112cb67 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:55.251460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5309301c-0e40-47f2-a386-f656f112cb67 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:55.281339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c5ec42f7-18bc-4a2f-a20a-0bf49e03955f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614262 Jul 26 18:30:55.288208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 136/276] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:30:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 18:30:55.293885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-183acab9-45e6-4f62-a0f9-b74a5bd137c0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:55.294500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-183acab9-45e6-4f62-a0f9-b74a5bd137c0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:55.370558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-183acab9-45e6-4f62-a0f9-b74a5bd137c0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:55.379805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-183acab9-45e6-4f62-a0f9-b74a5bd137c0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1258 microversion: 2.1 time: 0.089555 Jul 26 18:30:55.381231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 137/277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:55 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1258 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:55.525806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5309301c-0e40-47f2-a386-f656f112cb67 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:55.540205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5309301c-0e40-47f2-a386-f656f112cb67 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.304242 Jul 26 18:30:55.540808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 141/278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:55 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:30:56.409256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7a50a3bd-31e9-4903-8ee2-c01a77e82ed8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:56.410325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7a50a3bd-31e9-4903-8ee2-c01a77e82ed8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:56.421910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a50a3bd-31e9-4903-8ee2-c01a77e82ed8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:56.422615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a50a3bd-31e9-4903-8ee2-c01a77e82ed8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:56.423929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a50a3bd-31e9-4903-8ee2-c01a77e82ed8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:56.424637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a50a3bd-31e9-4903-8ee2-c01a77e82ed8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:56.506027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a50a3bd-31e9-4903-8ee2-c01a77e82ed8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:56.514817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7a50a3bd-31e9-4903-8ee2-c01a77e82ed8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1262 microversion: 2.1 time: 0.112637 Jul 26 18:30:56.515439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 138/279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:56 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1262 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:56.562247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2b13eec8-415b-4b1b-88a4-8c737838d846 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:56.562828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2b13eec8-415b-4b1b-88a4-8c737838d846 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:56.570542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b13eec8-415b-4b1b-88a4-8c737838d846 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:56.570993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b13eec8-415b-4b1b-88a4-8c737838d846 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:56.571816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b13eec8-415b-4b1b-88a4-8c737838d846 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:56.572249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b13eec8-415b-4b1b-88a4-8c737838d846 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:56.712485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2b13eec8-415b-4b1b-88a4-8c737838d846 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:56.720627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2b13eec8-415b-4b1b-88a4-8c737838d846 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.162639 Jul 26 18:30:56.721212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 142/280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:56 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:57.539491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-23125741-1f36-4a02-9598-23acc2d2cc32 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:57.540880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-23125741-1f36-4a02-9598-23acc2d2cc32 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:57.547951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23125741-1f36-4a02-9598-23acc2d2cc32 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:57.548476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23125741-1f36-4a02-9598-23acc2d2cc32 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:57.549635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23125741-1f36-4a02-9598-23acc2d2cc32 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:57.549966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23125741-1f36-4a02-9598-23acc2d2cc32 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:57.629300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-23125741-1f36-4a02-9598-23acc2d2cc32 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:57.639048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-23125741-1f36-4a02-9598-23acc2d2cc32 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1262 microversion: 2.1 time: 0.105266 Jul 26 18:30:57.640049 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 139/281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:57 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1262 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:57.752446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e5805547-c88e-4dd5-a34b-13ca3c8539e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:57.752855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e5805547-c88e-4dd5-a34b-13ca3c8539e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:57.762929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5805547-c88e-4dd5-a34b-13ca3c8539e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:57.763550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5805547-c88e-4dd5-a34b-13ca3c8539e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:57.764899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5805547-c88e-4dd5-a34b-13ca3c8539e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:57.765639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5805547-c88e-4dd5-a34b-13ca3c8539e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:57.942178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e5805547-c88e-4dd5-a34b-13ca3c8539e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:57.950552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e5805547-c88e-4dd5-a34b-13ca3c8539e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.205671 Jul 26 18:30:57.951964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 143/282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:57 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:58.661131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ebc40bde-6d44-4772-b12f-130de2403eb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:58.661731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ebc40bde-6d44-4772-b12f-130de2403eb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:58.672423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebc40bde-6d44-4772-b12f-130de2403eb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:58.672957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebc40bde-6d44-4772-b12f-130de2403eb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:58.674388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebc40bde-6d44-4772-b12f-130de2403eb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:58.674834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ebc40bde-6d44-4772-b12f-130de2403eb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:58.747755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ebc40bde-6d44-4772-b12f-130de2403eb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:58.758072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ebc40bde-6d44-4772-b12f-130de2403eb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1316 microversion: 2.1 time: 0.100869 Jul 26 18:30:58.758657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 140/283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:58 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1316 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:58.973779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c5b47e7b-0c41-4a17-9504-686ac0887b06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:58.974387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c5b47e7b-0c41-4a17-9504-686ac0887b06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:58.985095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5b47e7b-0c41-4a17-9504-686ac0887b06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:58.985556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5b47e7b-0c41-4a17-9504-686ac0887b06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:58.986483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5b47e7b-0c41-4a17-9504-686ac0887b06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:58.987126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5b47e7b-0c41-4a17-9504-686ac0887b06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:59.506757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c5b47e7b-0c41-4a17-9504-686ac0887b06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:30:59.527241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c5b47e7b-0c41-4a17-9504-686ac0887b06 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.549766 Jul 26 18:30:59.528518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 144/284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:58 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:30:59.783314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d26be342-2d97-4412-8d8e-8e5aa5e144c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:30:59.784104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d26be342-2d97-4412-8d8e-8e5aa5e144c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:30:59.802125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d26be342-2d97-4412-8d8e-8e5aa5e144c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:59.803627 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d26be342-2d97-4412-8d8e-8e5aa5e144c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:30:59.808555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d26be342-2d97-4412-8d8e-8e5aa5e144c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:30:59.809467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d26be342-2d97-4412-8d8e-8e5aa5e144c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:00.025755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d26be342-2d97-4412-8d8e-8e5aa5e144c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:00.036324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d26be342-2d97-4412-8d8e-8e5aa5e144c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.257511 Jul 26 18:31:00.036995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 141/285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:30:59 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:00.561208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b41a1c48-bcd9-44b0-b0b9-c4c694343031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:00.562082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b41a1c48-bcd9-44b0-b0b9-c4c694343031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:00.572302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b41a1c48-bcd9-44b0-b0b9-c4c694343031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:00.573026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b41a1c48-bcd9-44b0-b0b9-c4c694343031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:00.574267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b41a1c48-bcd9-44b0-b0b9-c4c694343031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:00.574972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b41a1c48-bcd9-44b0-b0b9-c4c694343031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:00.763479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b41a1c48-bcd9-44b0-b0b9-c4c694343031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:00.778494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b41a1c48-bcd9-44b0-b0b9-c4c694343031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.223704 Jul 26 18:31:00.791682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 145/286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:00 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:01.058225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7b45b0bc-f783-445c-97e9-a8a347e50c61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:01.058842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7b45b0bc-f783-445c-97e9-a8a347e50c61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:01.074614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b45b0bc-f783-445c-97e9-a8a347e50c61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:01.075122 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b45b0bc-f783-445c-97e9-a8a347e50c61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:01.076059 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b45b0bc-f783-445c-97e9-a8a347e50c61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:01.076500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b45b0bc-f783-445c-97e9-a8a347e50c61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:01.286753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7b45b0bc-f783-445c-97e9-a8a347e50c61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:01.329953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7b45b0bc-f783-445c-97e9-a8a347e50c61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.274772 Jul 26 18:31:01.339497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 142/287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:01 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:01.808536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6e31c2e2-7473-4b0b-a989-584830d6e685 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:01.812944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6e31c2e2-7473-4b0b-a989-584830d6e685 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:01.863277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6e31c2e2-7473-4b0b-a989-584830d6e685 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:01.868193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6e31c2e2-7473-4b0b-a989-584830d6e685 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:01.873789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6e31c2e2-7473-4b0b-a989-584830d6e685 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:01.874581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6e31c2e2-7473-4b0b-a989-584830d6e685 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:02.353105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-58cc2da2-68c2-41e0-8db3-bb1545424c42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:02.354055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-58cc2da2-68c2-41e0-8db3-bb1545424c42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:02.362838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58cc2da2-68c2-41e0-8db3-bb1545424c42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:02.362838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58cc2da2-68c2-41e0-8db3-bb1545424c42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:02.364042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58cc2da2-68c2-41e0-8db3-bb1545424c42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:02.364358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58cc2da2-68c2-41e0-8db3-bb1545424c42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:02.379152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6e31c2e2-7473-4b0b-a989-584830d6e685 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:02.389077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6e31c2e2-7473-4b0b-a989-584830d6e685 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.590185 Jul 26 18:31:02.392792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 146/288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:01 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:02.584726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-58cc2da2-68c2-41e0-8db3-bb1545424c42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:02.625801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-58cc2da2-68c2-41e0-8db3-bb1545424c42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.276699 Jul 26 18:31:02.648453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 143/289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:02 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:03.411852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fa2f3b9e-e734-4d8d-abef-a633aa5d455c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:03.413321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fa2f3b9e-e734-4d8d-abef-a633aa5d455c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:03.421972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa2f3b9e-e734-4d8d-abef-a633aa5d455c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:03.422894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa2f3b9e-e734-4d8d-abef-a633aa5d455c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:03.424585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa2f3b9e-e734-4d8d-abef-a633aa5d455c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:03.425199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa2f3b9e-e734-4d8d-abef-a633aa5d455c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:03.648071 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6d386388-5b4c-44eb-8694-0c1849b6f878 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:03.649399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6d386388-5b4c-44eb-8694-0c1849b6f878 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:03.662034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d386388-5b4c-44eb-8694-0c1849b6f878 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:03.662908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d386388-5b4c-44eb-8694-0c1849b6f878 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:03.663943 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d386388-5b4c-44eb-8694-0c1849b6f878 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:03.665600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d386388-5b4c-44eb-8694-0c1849b6f878 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:03.684667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fa2f3b9e-e734-4d8d-abef-a633aa5d455c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:03.691242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fa2f3b9e-e734-4d8d-abef-a633aa5d455c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.283612 Jul 26 18:31:03.692446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 147/290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:03 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:03.870245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6d386388-5b4c-44eb-8694-0c1849b6f878 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:03.878444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6d386388-5b4c-44eb-8694-0c1849b6f878 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.234498 Jul 26 18:31:03.879309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 144/291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:03 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:04.716355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-06c88d9c-4d81-49cb-81bd-d316dcb75d59 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:04.716943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-06c88d9c-4d81-49cb-81bd-d316dcb75d59 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:04.719333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=4 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:04.725894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-06c88d9c-4d81-49cb-81bd-d316dcb75d59 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:04.726337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-06c88d9c-4d81-49cb-81bd-d316dcb75d59 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:04.727168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-06c88d9c-4d81-49cb-81bd-d316dcb75d59 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:04.727647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-06c88d9c-4d81-49cb-81bd-d316dcb75d59 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:04.778300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:04.901601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d7152856-4fcc-4360-8f0a-9f044580bbaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:04.902950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d7152856-4fcc-4360-8f0a-9f044580bbaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:04.911716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7152856-4fcc-4360-8f0a-9f044580bbaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:04.912355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7152856-4fcc-4360-8f0a-9f044580bbaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:04.913032 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7152856-4fcc-4360-8f0a-9f044580bbaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:04.913746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7152856-4fcc-4360-8f0a-9f044580bbaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:04.961240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-06c88d9c-4d81-49cb-81bd-d316dcb75d59 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:04.973229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-06c88d9c-4d81-49cb-81bd-d316dcb75d59 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.261107 Jul 26 18:31:04.974010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 148/292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:04 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:05.136346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d7152856-4fcc-4360-8f0a-9f044580bbaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:05.149498 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d7152856-4fcc-4360-8f0a-9f044580bbaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.248388 Jul 26 18:31:05.151415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 145/293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:04 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:05.893327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1953270005", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "networks": [{"uuid": "c3a6d545-67b2-478f-9852-5b21f928ad15"}]}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:31:05.903067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:06.007997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3457d7db-151f-4141-8ec8-afff2eefa87a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:06.008636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3457d7db-151f-4141-8ec8-afff2eefa87a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:06.010666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:06.011418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=8 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:06.017792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3457d7db-151f-4141-8ec8-afff2eefa87a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:06.019009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3457d7db-151f-4141-8ec8-afff2eefa87a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:06.020247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3457d7db-151f-4141-8ec8-afff2eefa87a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:06.021007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3457d7db-151f-4141-8ec8-afff2eefa87a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:06.204384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3457d7db-151f-4141-8ec8-afff2eefa87a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:06.217847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3457d7db-151f-4141-8ec8-afff2eefa87a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.214132 Jul 26 18:31:06.219972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 146/294] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:06 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:06.236503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a520e5ee-5d13-4b0d-a671-b64f7b63837f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:06.239581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a520e5ee-5d13-4b0d-a671-b64f7b63837f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:06.246022 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a520e5ee-5d13-4b0d-a671-b64f7b63837f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:06.246460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a520e5ee-5d13-4b0d-a671-b64f7b63837f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:06.247274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a520e5ee-5d13-4b0d-a671-b64f7b63837f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:06.247704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a520e5ee-5d13-4b0d-a671-b64f7b63837f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:06.456310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a520e5ee-5d13-4b0d-a671-b64f7b63837f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:06.465824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a520e5ee-5d13-4b0d-a671-b64f7b63837f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.241750 Jul 26 18:31:06.466735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 147/295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:06 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:07.117977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.network.neutron [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] validate_networks() for [('c3a6d545-67b2-478f-9852-5b21f928ad15', None, None, None, None, None)] {{(pid=117996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:31:07.260789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5b900d9c-df2d-4f80-b182-f9cb89699da3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:07.263759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5b900d9c-df2d-4f80-b182-f9cb89699da3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:07.287758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b900d9c-df2d-4f80-b182-f9cb89699da3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:07.288690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b900d9c-df2d-4f80-b182-f9cb89699da3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:07.293943 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b900d9c-df2d-4f80-b182-f9cb89699da3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:07.294885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b900d9c-df2d-4f80-b182-f9cb89699da3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:07.619959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5b900d9c-df2d-4f80-b182-f9cb89699da3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:07.628808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5b900d9c-df2d-4f80-b182-f9cb89699da3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.383577 Jul 26 18:31:07.629395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 148/296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:07 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:07.634157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-43fe22be-49bd-48ad-8041-6959522e1770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:07.634756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-43fe22be-49bd-48ad-8041-6959522e1770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:07.641062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43fe22be-49bd-48ad-8041-6959522e1770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:07.641598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43fe22be-49bd-48ad-8041-6959522e1770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:07.642440 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43fe22be-49bd-48ad-8041-6959522e1770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:07.642976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43fe22be-49bd-48ad-8041-6959522e1770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:07.663813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:07.726994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Flavor limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:31:07.727694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Image limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:31:07.728238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Flavor pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:31:07.728769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Image pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:31:07.729333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:31:07.745679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:07.749374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:07.752905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:07.753618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:07.799311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Getting quotas for project 7d2f5ab1f6ad4eba871884ce60ebd64d. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:31:07.807159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Getting quotas for user 710de14924c9488284988508cc003332 and project 7d2f5ab1f6ad4eba871884ce60ebd64d. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:31:07.825358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Going to run 1 instances... {{(pid=117996) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:31:07.827838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:31:07.843941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-43fe22be-49bd-48ad-8041-6959522e1770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:07.852615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-43fe22be-49bd-48ad-8041-6959522e1770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.222055 Jul 26 18:31:07.853445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 149/297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:07 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:07.898468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-70d2db52-96d9-4f61-8a65-39168cf99f96 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.008563 Jul 26 18:31:07.899692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 149/298] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:31:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 18:31:07.916569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-304446cb-9408-4f68-b7a1-6fe0643ce3b6 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:07.917204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-304446cb-9408-4f68-b7a1-6fe0643ce3b6 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:07.990550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-304446cb-9408-4f68-b7a1-6fe0643ce3b6 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:08.000593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-304446cb-9408-4f68-b7a1-6fe0643ce3b6 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1214 microversion: 2.1 time: 0.092604 Jul 26 18:31:08.009574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 150/299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:07 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:08.653641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e65bc389-b561-4702-b26c-4ab0f3055d95 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:08.654758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e65bc389-b561-4702-b26c-4ab0f3055d95 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:08.664339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e65bc389-b561-4702-b26c-4ab0f3055d95 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:08.664845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e65bc389-b561-4702-b26c-4ab0f3055d95 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:08.665635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e65bc389-b561-4702-b26c-4ab0f3055d95 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:08.666070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e65bc389-b561-4702-b26c-4ab0f3055d95 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:08.831296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e65bc389-b561-4702-b26c-4ab0f3055d95 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:08.844709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e65bc389-b561-4702-b26c-4ab0f3055d95 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.198034 Jul 26 18:31:08.845828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 150/300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:08 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:08.877769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0220f5af-4999-4db2-8b08-5329d0a9555d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:08.878851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0220f5af-4999-4db2-8b08-5329d0a9555d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:08.889619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0220f5af-4999-4db2-8b08-5329d0a9555d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:08.890330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0220f5af-4999-4db2-8b08-5329d0a9555d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:08.891650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0220f5af-4999-4db2-8b08-5329d0a9555d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:08.892393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0220f5af-4999-4db2-8b08-5329d0a9555d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:09.026638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-81595d49-f2dd-4f16-85e3-578fea41d393 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:09.027824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-81595d49-f2dd-4f16-85e3-578fea41d393 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:09.039724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81595d49-f2dd-4f16-85e3-578fea41d393 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:09.040492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81595d49-f2dd-4f16-85e3-578fea41d393 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:09.042044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81595d49-f2dd-4f16-85e3-578fea41d393 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:09.042828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81595d49-f2dd-4f16-85e3-578fea41d393 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:09.071695 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0220f5af-4999-4db2-8b08-5329d0a9555d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:09.081595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0220f5af-4999-4db2-8b08-5329d0a9555d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.211023 Jul 26 18:31:09.083170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 151/301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:08 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:09.161828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-81595d49-f2dd-4f16-85e3-578fea41d393 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:09.170186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-81595d49-f2dd-4f16-85e3-578fea41d393 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.151336 Jul 26 18:31:09.170769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 151/302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:09 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:09.872951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aeafde2b-a83c-4eb9-90e8-3dc56aa34321 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:09.873563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aeafde2b-a83c-4eb9-90e8-3dc56aa34321 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:09.880127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aeafde2b-a83c-4eb9-90e8-3dc56aa34321 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:09.880828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aeafde2b-a83c-4eb9-90e8-3dc56aa34321 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:09.881346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aeafde2b-a83c-4eb9-90e8-3dc56aa34321 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:09.881781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aeafde2b-a83c-4eb9-90e8-3dc56aa34321 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:10.077103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-aeafde2b-a83c-4eb9-90e8-3dc56aa34321 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:10.085664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aeafde2b-a83c-4eb9-90e8-3dc56aa34321 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.216498 Jul 26 18:31:10.099998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 152/303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:09 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:10.114219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5ea09246-f035-4a2f-9b07-a3dfd26547b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:10.114850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5ea09246-f035-4a2f-9b07-a3dfd26547b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:10.122144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ea09246-f035-4a2f-9b07-a3dfd26547b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:10.122886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ea09246-f035-4a2f-9b07-a3dfd26547b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:10.123698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ea09246-f035-4a2f-9b07-a3dfd26547b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:10.124142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ea09246-f035-4a2f-9b07-a3dfd26547b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:10.196818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ee035452-a321-45ed-8acb-6f662662cfed tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:10.197453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ee035452-a321-45ed-8acb-6f662662cfed tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:10.204925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee035452-a321-45ed-8acb-6f662662cfed tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:10.205369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee035452-a321-45ed-8acb-6f662662cfed tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:10.206141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee035452-a321-45ed-8acb-6f662662cfed tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:10.206575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee035452-a321-45ed-8acb-6f662662cfed tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:10.287370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ee035452-a321-45ed-8acb-6f662662cfed tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:10.292414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5ea09246-f035-4a2f-9b07-a3dfd26547b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:10.297868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ee035452-a321-45ed-8acb-6f662662cfed tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.104499 Jul 26 18:31:10.299170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 153/304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:10 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:10.302095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5ea09246-f035-4a2f-9b07-a3dfd26547b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.192209 Jul 26 18:31:10.302888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 152/305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:11.108432 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8267e62a-465e-4f39-9732-46d26b2d2e35 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:11.109207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8267e62a-465e-4f39-9732-46d26b2d2e35 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:11.116422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8267e62a-465e-4f39-9732-46d26b2d2e35 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:11.116875 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8267e62a-465e-4f39-9732-46d26b2d2e35 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:11.117645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8267e62a-465e-4f39-9732-46d26b2d2e35 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:11.118075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8267e62a-465e-4f39-9732-46d26b2d2e35 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:11.297435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8267e62a-465e-4f39-9732-46d26b2d2e35 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:11.312368 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8267e62a-465e-4f39-9732-46d26b2d2e35 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.207992 Jul 26 18:31:11.313605 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 154/306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:11 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:11.324348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4f90a6cf-0fd5-4794-8820-ce8f3cc57dc6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:11.326253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fad7023a-7aa3-4992-850e-f71398bbf954 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:11.326526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4f90a6cf-0fd5-4794-8820-ce8f3cc57dc6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:11.326922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fad7023a-7aa3-4992-850e-f71398bbf954 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:11.333954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f90a6cf-0fd5-4794-8820-ce8f3cc57dc6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:11.334332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fad7023a-7aa3-4992-850e-f71398bbf954 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:11.334835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fad7023a-7aa3-4992-850e-f71398bbf954 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:11.334958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f90a6cf-0fd5-4794-8820-ce8f3cc57dc6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:11.336004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f90a6cf-0fd5-4794-8820-ce8f3cc57dc6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:11.336130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fad7023a-7aa3-4992-850e-f71398bbf954 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:11.336536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f90a6cf-0fd5-4794-8820-ce8f3cc57dc6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:11.336703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fad7023a-7aa3-4992-850e-f71398bbf954 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:11.424788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fad7023a-7aa3-4992-850e-f71398bbf954 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:11.435051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fad7023a-7aa3-4992-850e-f71398bbf954 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.112375 Jul 26 18:31:11.435935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 155/307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:11 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:11.573620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4f90a6cf-0fd5-4794-8820-ce8f3cc57dc6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:11.587943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4f90a6cf-0fd5-4794-8820-ce8f3cc57dc6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.267527 Jul 26 18:31:11.589057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 153/308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:11 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:12.339415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5df70ce2-b67d-498a-9da3-ec7674644f63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:12.340419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5df70ce2-b67d-498a-9da3-ec7674644f63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:12.348210 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5df70ce2-b67d-498a-9da3-ec7674644f63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:12.348370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5df70ce2-b67d-498a-9da3-ec7674644f63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:12.349134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5df70ce2-b67d-498a-9da3-ec7674644f63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:12.349561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5df70ce2-b67d-498a-9da3-ec7674644f63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:12.459391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e9f9ff62-d6cf-49a3-b3b7-1cd12b79accf tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:12.460174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e9f9ff62-d6cf-49a3-b3b7-1cd12b79accf tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:12.466899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9f9ff62-d6cf-49a3-b3b7-1cd12b79accf tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:12.467392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9f9ff62-d6cf-49a3-b3b7-1cd12b79accf tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:12.468157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9f9ff62-d6cf-49a3-b3b7-1cd12b79accf tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:12.468590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9f9ff62-d6cf-49a3-b3b7-1cd12b79accf tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:12.520467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5df70ce2-b67d-498a-9da3-ec7674644f63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:12.529206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5df70ce2-b67d-498a-9da3-ec7674644f63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.195091 Jul 26 18:31:12.529806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 156/309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:12 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:12.550186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e9f9ff62-d6cf-49a3-b3b7-1cd12b79accf tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:12.558063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e9f9ff62-d6cf-49a3-b3b7-1cd12b79accf tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.103327 Jul 26 18:31:12.561026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 154/310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:12 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:12.621498 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9a2b5e3b-0e26-421f-b8c0-9b25655552a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:12.622119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9a2b5e3b-0e26-421f-b8c0-9b25655552a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:12.629251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a2b5e3b-0e26-421f-b8c0-9b25655552a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:12.629696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a2b5e3b-0e26-421f-b8c0-9b25655552a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:12.630466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a2b5e3b-0e26-421f-b8c0-9b25655552a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:12.630896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a2b5e3b-0e26-421f-b8c0-9b25655552a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:12.782402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9a2b5e3b-0e26-421f-b8c0-9b25655552a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:12.792372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9a2b5e3b-0e26-421f-b8c0-9b25655552a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.174831 Jul 26 18:31:12.793347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 157/311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:12 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:13.549882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0f07edad-81cc-48f1-9d1f-ffe0212dad2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:13.550881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f07edad-81cc-48f1-9d1f-ffe0212dad2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:13.557425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f07edad-81cc-48f1-9d1f-ffe0212dad2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:13.557956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f07edad-81cc-48f1-9d1f-ffe0212dad2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:13.558817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f07edad-81cc-48f1-9d1f-ffe0212dad2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:13.559352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f07edad-81cc-48f1-9d1f-ffe0212dad2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:13.579400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-99589cba-0a1f-4eb3-8ddb-dc845ab40c6f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:13.580183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-99589cba-0a1f-4eb3-8ddb-dc845ab40c6f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:13.587242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99589cba-0a1f-4eb3-8ddb-dc845ab40c6f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:13.587650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99589cba-0a1f-4eb3-8ddb-dc845ab40c6f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:13.588441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99589cba-0a1f-4eb3-8ddb-dc845ab40c6f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:13.588901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99589cba-0a1f-4eb3-8ddb-dc845ab40c6f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:13.674926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-99589cba-0a1f-4eb3-8ddb-dc845ab40c6f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:13.686772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-99589cba-0a1f-4eb3-8ddb-dc845ab40c6f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.111007 Jul 26 18:31:13.687880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 158/312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:13 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:13.734075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0f07edad-81cc-48f1-9d1f-ffe0212dad2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:13.743241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0f07edad-81cc-48f1-9d1f-ffe0212dad2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.197119 Jul 26 18:31:13.744628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 155/313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:13 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:13.814403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-00402298-4e64-4028-ad64-29693e1897d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:13.815096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-00402298-4e64-4028-ad64-29693e1897d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:13.822624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00402298-4e64-4028-ad64-29693e1897d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:13.823103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00402298-4e64-4028-ad64-29693e1897d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:13.823881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00402298-4e64-4028-ad64-29693e1897d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:13.824306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00402298-4e64-4028-ad64-29693e1897d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:13.983928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-00402298-4e64-4028-ad64-29693e1897d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:13.991824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-00402298-4e64-4028-ad64-29693e1897d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.181406 Jul 26 18:31:13.992490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 159/314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:14.709933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8c288f6f-e120-4a03-9302-12d7a4c08675 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:14.710556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8c288f6f-e120-4a03-9302-12d7a4c08675 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:14.717884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c288f6f-e120-4a03-9302-12d7a4c08675 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:14.718328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c288f6f-e120-4a03-9302-12d7a4c08675 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:14.719151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c288f6f-e120-4a03-9302-12d7a4c08675 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:14.719580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c288f6f-e120-4a03-9302-12d7a4c08675 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:14.768617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4dad2ff2-3124-4bd5-9fd3-524b286c9135 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:14.769503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4dad2ff2-3124-4bd5-9fd3-524b286c9135 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:14.778211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4dad2ff2-3124-4bd5-9fd3-524b286c9135 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:14.778817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4dad2ff2-3124-4bd5-9fd3-524b286c9135 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:14.779810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4dad2ff2-3124-4bd5-9fd3-524b286c9135 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:14.780257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4dad2ff2-3124-4bd5-9fd3-524b286c9135 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:14.801478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8c288f6f-e120-4a03-9302-12d7a4c08675 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:14.816491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8c288f6f-e120-4a03-9302-12d7a4c08675 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.110791 Jul 26 18:31:14.817406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 156/315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:14 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:14.990474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4dad2ff2-3124-4bd5-9fd3-524b286c9135 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:14.998639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4dad2ff2-3124-4bd5-9fd3-524b286c9135 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.236855 Jul 26 18:31:14.999360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 160/316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:14 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:15.013698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cbd9336a-962c-42af-b42a-7a07871a5e15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:15.014884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cbd9336a-962c-42af-b42a-7a07871a5e15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:15.021883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbd9336a-962c-42af-b42a-7a07871a5e15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:15.022505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbd9336a-962c-42af-b42a-7a07871a5e15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:15.023459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbd9336a-962c-42af-b42a-7a07871a5e15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:15.023964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbd9336a-962c-42af-b42a-7a07871a5e15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:15.179199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cbd9336a-962c-42af-b42a-7a07871a5e15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:15.187331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cbd9336a-962c-42af-b42a-7a07871a5e15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.177624 Jul 26 18:31:15.187927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 157/317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:15 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:15.837663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4c549d1e-4ffe-4017-bc58-b987efc47a5a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:15.838272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4c549d1e-4ffe-4017-bc58-b987efc47a5a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:15.844744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c549d1e-4ffe-4017-bc58-b987efc47a5a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:15.845241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c549d1e-4ffe-4017-bc58-b987efc47a5a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:15.846236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c549d1e-4ffe-4017-bc58-b987efc47a5a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:15.852682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c549d1e-4ffe-4017-bc58-b987efc47a5a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:15.930681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4c549d1e-4ffe-4017-bc58-b987efc47a5a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:15.942836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4c549d1e-4ffe-4017-bc58-b987efc47a5a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.108774 Jul 26 18:31:15.943851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 161/318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:15 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:16.030339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-575610a6-04ba-487e-a404-e0e3c6ed8ceb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:16.031425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-575610a6-04ba-487e-a404-e0e3c6ed8ceb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:16.038708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-575610a6-04ba-487e-a404-e0e3c6ed8ceb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:16.039194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-575610a6-04ba-487e-a404-e0e3c6ed8ceb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:16.039984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-575610a6-04ba-487e-a404-e0e3c6ed8ceb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:16.040423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-575610a6-04ba-487e-a404-e0e3c6ed8ceb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:16.196695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-575610a6-04ba-487e-a404-e0e3c6ed8ceb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:16.204579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-575610a6-04ba-487e-a404-e0e3c6ed8ceb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.178133 Jul 26 18:31:16.205221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 158/319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:16 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:16.209651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8e8b2cbe-8123-4326-b23d-2d1b81e03da9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:16.210257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8e8b2cbe-8123-4326-b23d-2d1b81e03da9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:16.216565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e8b2cbe-8123-4326-b23d-2d1b81e03da9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:16.217266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e8b2cbe-8123-4326-b23d-2d1b81e03da9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:16.218197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e8b2cbe-8123-4326-b23d-2d1b81e03da9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:16.218621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e8b2cbe-8123-4326-b23d-2d1b81e03da9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:16.382321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8e8b2cbe-8123-4326-b23d-2d1b81e03da9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:16.390508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8e8b2cbe-8123-4326-b23d-2d1b81e03da9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.184501 Jul 26 18:31:16.391152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 162/320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:16 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:16.966190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-df17734c-5979-4dc6-8339-4a635394d23b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:16.966838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-df17734c-5979-4dc6-8339-4a635394d23b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:16.973250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df17734c-5979-4dc6-8339-4a635394d23b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:16.973688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df17734c-5979-4dc6-8339-4a635394d23b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:16.974451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df17734c-5979-4dc6-8339-4a635394d23b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:16.974879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df17734c-5979-4dc6-8339-4a635394d23b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:17.057144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-df17734c-5979-4dc6-8339-4a635394d23b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:17.066153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-df17734c-5979-4dc6-8339-4a635394d23b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.104767 Jul 26 18:31:17.067002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 159/321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:16 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:17.228070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-23034a4b-9c8d-4582-8522-f7577df86bdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:17.228771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-23034a4b-9c8d-4582-8522-f7577df86bdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:17.230906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:17.236962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23034a4b-9c8d-4582-8522-f7577df86bdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:17.237516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23034a4b-9c8d-4582-8522-f7577df86bdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:17.238359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23034a4b-9c8d-4582-8522-f7577df86bdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:17.238858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23034a4b-9c8d-4582-8522-f7577df86bdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:17.417689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-93bb0004-6793-4e4f-a62f-47a4c932654b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:17.419242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-93bb0004-6793-4e4f-a62f-47a4c932654b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:17.419807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-23034a4b-9c8d-4582-8522-f7577df86bdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:17.434846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-23034a4b-9c8d-4582-8522-f7577df86bdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.210531 Jul 26 18:31:17.437332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93bb0004-6793-4e4f-a62f-47a4c932654b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:17.439675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93bb0004-6793-4e4f-a62f-47a4c932654b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:17.443315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93bb0004-6793-4e4f-a62f-47a4c932654b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:17.445448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93bb0004-6793-4e4f-a62f-47a4c932654b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:17.455433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 163/322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:17 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:17.640708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-93bb0004-6793-4e4f-a62f-47a4c932654b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:17.649520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-93bb0004-6793-4e4f-a62f-47a4c932654b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.239637 Jul 26 18:31:17.650437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 160/323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:17 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:18.095115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3a423e7f-8915-4508-a732-d0fc15545fa3 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:18.096256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3a423e7f-8915-4508-a732-d0fc15545fa3 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:18.099044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:18.105668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a423e7f-8915-4508-a732-d0fc15545fa3 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:18.106202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a423e7f-8915-4508-a732-d0fc15545fa3 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:18.107053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a423e7f-8915-4508-a732-d0fc15545fa3 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:18.107999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a423e7f-8915-4508-a732-d0fc15545fa3 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:18.197354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3a423e7f-8915-4508-a732-d0fc15545fa3 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:18.206824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3a423e7f-8915-4508-a732-d0fc15545fa3 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.119423 Jul 26 18:31:18.207653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 164/324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:18 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:18.474831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-45463613-3e9d-4d73-ab55-03bde80eecf8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:18.476274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-45463613-3e9d-4d73-ab55-03bde80eecf8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:18.482486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:18.483967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=6 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:18.486483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45463613-3e9d-4d73-ab55-03bde80eecf8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:18.487209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45463613-3e9d-4d73-ab55-03bde80eecf8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:18.488138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45463613-3e9d-4d73-ab55-03bde80eecf8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:18.488742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45463613-3e9d-4d73-ab55-03bde80eecf8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:18.663398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-45463613-3e9d-4d73-ab55-03bde80eecf8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:18.676615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7a5284b8-b703-4cc7-90d0-3dacb0ec36c1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:18.677245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-45463613-3e9d-4d73-ab55-03bde80eecf8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.206442 Jul 26 18:31:18.677842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7a5284b8-b703-4cc7-90d0-3dacb0ec36c1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:18.689397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a5284b8-b703-4cc7-90d0-3dacb0ec36c1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:18.690534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a5284b8-b703-4cc7-90d0-3dacb0ec36c1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:18.692461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a5284b8-b703-4cc7-90d0-3dacb0ec36c1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:18.693089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 161/325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:18 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:18.693815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a5284b8-b703-4cc7-90d0-3dacb0ec36c1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:19.124901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a5284b8-b703-4cc7-90d0-3dacb0ec36c1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:19.133420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7a5284b8-b703-4cc7-90d0-3dacb0ec36c1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.465086 Jul 26 18:31:19.134021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 165/326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:18 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:19.231714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1b3df373-d2d8-46c1-8917-9925fa98ba6e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:19.232468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1b3df373-d2d8-46c1-8917-9925fa98ba6e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:19.239980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b3df373-d2d8-46c1-8917-9925fa98ba6e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:19.240559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b3df373-d2d8-46c1-8917-9925fa98ba6e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:19.241603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b3df373-d2d8-46c1-8917-9925fa98ba6e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:19.242132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b3df373-d2d8-46c1-8917-9925fa98ba6e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:19.306336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1b3df373-d2d8-46c1-8917-9925fa98ba6e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:19.314956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1b3df373-d2d8-46c1-8917-9925fa98ba6e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.088334 Jul 26 18:31:19.315836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 162/327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:19 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:19.699588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-26604a68-f6b8-4898-acf8-068cf1c768ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:19.700195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-26604a68-f6b8-4898-acf8-068cf1c768ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:19.706491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26604a68-f6b8-4898-acf8-068cf1c768ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:19.706927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26604a68-f6b8-4898-acf8-068cf1c768ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:19.707712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26604a68-f6b8-4898-acf8-068cf1c768ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:19.708140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26604a68-f6b8-4898-acf8-068cf1c768ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:19.847188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-26604a68-f6b8-4898-acf8-068cf1c768ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:19.855219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-26604a68-f6b8-4898-acf8-068cf1c768ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.159658 Jul 26 18:31:19.855830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 166/328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:19 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:20.158359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e64db179-1bbc-47b4-a383-c75cc2a2c876 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:20.159269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e64db179-1bbc-47b4-a383-c75cc2a2c876 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:20.167640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e64db179-1bbc-47b4-a383-c75cc2a2c876 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:20.168092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e64db179-1bbc-47b4-a383-c75cc2a2c876 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:20.168890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e64db179-1bbc-47b4-a383-c75cc2a2c876 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:20.169335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e64db179-1bbc-47b4-a383-c75cc2a2c876 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:20.328219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e64db179-1bbc-47b4-a383-c75cc2a2c876 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:20.338315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bf3083b4-be05-4857-9eed-88bb7562da8a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:20.338930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bf3083b4-be05-4857-9eed-88bb7562da8a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:20.340015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e64db179-1bbc-47b4-a383-c75cc2a2c876 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.185766 Jul 26 18:31:20.340725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 163/329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:20.345620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf3083b4-be05-4857-9eed-88bb7562da8a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:20.346069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf3083b4-be05-4857-9eed-88bb7562da8a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:20.346847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf3083b4-be05-4857-9eed-88bb7562da8a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:20.347308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf3083b4-be05-4857-9eed-88bb7562da8a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:20.350277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:20.413959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bf3083b4-be05-4857-9eed-88bb7562da8a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:20.422142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bf3083b4-be05-4857-9eed-88bb7562da8a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.088098 Jul 26 18:31:20.422748 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 167/330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:20 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:20.878063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-45bcf3de-20b8-4fd1-8cb9-7033aadcf1b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:20.878937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-45bcf3de-20b8-4fd1-8cb9-7033aadcf1b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:20.886130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45bcf3de-20b8-4fd1-8cb9-7033aadcf1b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:20.886578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45bcf3de-20b8-4fd1-8cb9-7033aadcf1b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:20.887400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45bcf3de-20b8-4fd1-8cb9-7033aadcf1b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:20.887831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45bcf3de-20b8-4fd1-8cb9-7033aadcf1b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:21.034960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-45bcf3de-20b8-4fd1-8cb9-7033aadcf1b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:21.058503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-45bcf3de-20b8-4fd1-8cb9-7033aadcf1b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.184943 Jul 26 18:31:21.060080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 164/331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:20 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:21.375510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c3adb2f9-f52e-462d-baf3-eec0da8a7678 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:21.376538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c3adb2f9-f52e-462d-baf3-eec0da8a7678 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:21.384251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3adb2f9-f52e-462d-baf3-eec0da8a7678 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:21.384954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3adb2f9-f52e-462d-baf3-eec0da8a7678 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:21.385937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3adb2f9-f52e-462d-baf3-eec0da8a7678 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:21.386458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3adb2f9-f52e-462d-baf3-eec0da8a7678 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:21.459449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5cb782b4-abe9-494d-90e9-bef1dc6105ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:21.460473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5cb782b4-abe9-494d-90e9-bef1dc6105ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:21.470055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cb782b4-abe9-494d-90e9-bef1dc6105ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:21.470711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cb782b4-abe9-494d-90e9-bef1dc6105ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:21.471982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cb782b4-abe9-494d-90e9-bef1dc6105ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:21.473048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cb782b4-abe9-494d-90e9-bef1dc6105ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:21.574974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5cb782b4-abe9-494d-90e9-bef1dc6105ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:21.578710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:21.584537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5cb782b4-abe9-494d-90e9-bef1dc6105ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.131535 Jul 26 18:31:21.585372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 165/332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:21 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:21.715941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c3adb2f9-f52e-462d-baf3-eec0da8a7678 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:21.724789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c3adb2f9-f52e-462d-baf3-eec0da8a7678 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.353713 Jul 26 18:31:21.725384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 168/333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:21 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:22.081711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5319a2fb-212e-4367-bac9-5355f7e293ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:22.082314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5319a2fb-212e-4367-bac9-5355f7e293ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:22.088881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5319a2fb-212e-4367-bac9-5355f7e293ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:22.089322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5319a2fb-212e-4367-bac9-5355f7e293ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:22.090096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5319a2fb-212e-4367-bac9-5355f7e293ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:22.090525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5319a2fb-212e-4367-bac9-5355f7e293ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:22.260198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5319a2fb-212e-4367-bac9-5355f7e293ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:22.268423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5319a2fb-212e-4367-bac9-5355f7e293ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.191170 Jul 26 18:31:22.269019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 166/334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:22 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:22.616445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-926791af-c489-42d5-b853-3c626479970e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:22.617165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-926791af-c489-42d5-b853-3c626479970e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:22.623917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-926791af-c489-42d5-b853-3c626479970e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:22.624365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-926791af-c489-42d5-b853-3c626479970e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:22.625128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-926791af-c489-42d5-b853-3c626479970e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:22.625529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-926791af-c489-42d5-b853-3c626479970e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:22.702382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-926791af-c489-42d5-b853-3c626479970e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:22.713390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-926791af-c489-42d5-b853-3c626479970e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.100631 Jul 26 18:31:22.714397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 169/335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:22 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:22.746491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4d9209d9-aed6-41f4-94b0-475245c4b8cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:22.747275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4d9209d9-aed6-41f4-94b0-475245c4b8cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:22.755680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d9209d9-aed6-41f4-94b0-475245c4b8cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:22.758333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d9209d9-aed6-41f4-94b0-475245c4b8cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:22.759280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d9209d9-aed6-41f4-94b0-475245c4b8cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:22.759674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d9209d9-aed6-41f4-94b0-475245c4b8cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:22.905699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4d9209d9-aed6-41f4-94b0-475245c4b8cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:22.913767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4d9209d9-aed6-41f4-94b0-475245c4b8cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.171192 Jul 26 18:31:22.914349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 167/336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:22 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:23.290372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-41415aee-eec3-408c-9611-bd5ff290ac6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:23.290979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-41415aee-eec3-408c-9611-bd5ff290ac6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:23.297614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41415aee-eec3-408c-9611-bd5ff290ac6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:23.298076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41415aee-eec3-408c-9611-bd5ff290ac6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:23.298854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41415aee-eec3-408c-9611-bd5ff290ac6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:23.299317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41415aee-eec3-408c-9611-bd5ff290ac6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:23.468277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-41415aee-eec3-408c-9611-bd5ff290ac6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:23.477039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-41415aee-eec3-408c-9611-bd5ff290ac6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.190645 Jul 26 18:31:23.477681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 170/337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:23 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:23.735828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-61c8d5f8-2819-4017-94a6-b4b29111bda2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:23.736525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-61c8d5f8-2819-4017-94a6-b4b29111bda2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:23.743401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61c8d5f8-2819-4017-94a6-b4b29111bda2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:23.743831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61c8d5f8-2819-4017-94a6-b4b29111bda2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:23.744610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61c8d5f8-2819-4017-94a6-b4b29111bda2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:23.745060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61c8d5f8-2819-4017-94a6-b4b29111bda2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:23.815514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-61c8d5f8-2819-4017-94a6-b4b29111bda2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:23.823944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-61c8d5f8-2819-4017-94a6-b4b29111bda2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1218 microversion: 2.1 time: 0.091919 Jul 26 18:31:23.824527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 168/338] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:23 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:23.936125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c7995ef0-b413-4ec1-8b08-070fd164252c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:23.936828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c7995ef0-b413-4ec1-8b08-070fd164252c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:23.943725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c7995ef0-b413-4ec1-8b08-070fd164252c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:23.944167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c7995ef0-b413-4ec1-8b08-070fd164252c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:23.944922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c7995ef0-b413-4ec1-8b08-070fd164252c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:23.945346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c7995ef0-b413-4ec1-8b08-070fd164252c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:24.088349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c7995ef0-b413-4ec1-8b08-070fd164252c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:24.096036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c7995ef0-b413-4ec1-8b08-070fd164252c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.164140 Jul 26 18:31:24.096647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 171/339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:23 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:24.501189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b62a8511-0c48-4bbd-a4bd-e582a7d912a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:24.501768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b62a8511-0c48-4bbd-a4bd-e582a7d912a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:24.509203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b62a8511-0c48-4bbd-a4bd-e582a7d912a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:24.509655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b62a8511-0c48-4bbd-a4bd-e582a7d912a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:24.510447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b62a8511-0c48-4bbd-a4bd-e582a7d912a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:24.510864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b62a8511-0c48-4bbd-a4bd-e582a7d912a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:24.786278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b62a8511-0c48-4bbd-a4bd-e582a7d912a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:24.797730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b62a8511-0c48-4bbd-a4bd-e582a7d912a2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.303301 Jul 26 18:31:24.811046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 169/340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:24 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:24.850339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fdfc3a66-5d55-41f4-a4a8-5fa029a8e646 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:24.851506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fdfc3a66-5d55-41f4-a4a8-5fa029a8e646 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:24.866811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdfc3a66-5d55-41f4-a4a8-5fa029a8e646 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:24.867704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdfc3a66-5d55-41f4-a4a8-5fa029a8e646 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:24.868809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdfc3a66-5d55-41f4-a4a8-5fa029a8e646 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:24.869353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdfc3a66-5d55-41f4-a4a8-5fa029a8e646 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:24.936747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fdfc3a66-5d55-41f4-a4a8-5fa029a8e646 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:24.949920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fdfc3a66-5d55-41f4-a4a8-5fa029a8e646 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1266 microversion: 2.1 time: 0.107013 Jul 26 18:31:24.950946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 172/341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:24 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:25.120862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-439da81a-f1f3-4e13-a38b-eec7d675d44b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:25.121486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-439da81a-f1f3-4e13-a38b-eec7d675d44b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:25.129487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-439da81a-f1f3-4e13-a38b-eec7d675d44b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:25.129847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-439da81a-f1f3-4e13-a38b-eec7d675d44b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:25.130621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-439da81a-f1f3-4e13-a38b-eec7d675d44b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:25.131085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-439da81a-f1f3-4e13-a38b-eec7d675d44b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:25.446474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-439da81a-f1f3-4e13-a38b-eec7d675d44b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:25.458306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-439da81a-f1f3-4e13-a38b-eec7d675d44b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.341642 Jul 26 18:31:25.459116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 170/342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:25 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:25.512517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-4f730528-87d8-4e48-b758-0dbe00493f81 req-c154d76b-d4ee-46c5-b4a6-207dcf173b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9982c007-1157-4c63-93e8-3733712f06e0", "tag": "4e31fc31-19bc-4733-a6d9-9e1a584d4781"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:31:25.522599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-4f730528-87d8-4e48-b758-0dbe00493f81 req-c154d76b-d4ee-46c5-b4a6-207dcf173b09 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:25.523058 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-4f730528-87d8-4e48-b758-0dbe00493f81 req-c154d76b-d4ee-46c5-b4a6-207dcf173b09 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:25.535787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-4f730528-87d8-4e48-b758-0dbe00493f81 req-c154d76b-d4ee-46c5-b4a6-207dcf173b09 service nova] Creating event network-changed:4e31fc31-19bc-4733-a6d9-9e1a584d4781 for instance 9982c007-1157-4c63-93e8-3733712f06e0 on hv-cinder-82549 Jul 26 18:31:25.543586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-4f730528-87d8-4e48-b758-0dbe00493f81 req-c154d76b-d4ee-46c5-b4a6-207dcf173b09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034520 Jul 26 18:31:25.548206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 173/343] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:31:25.822764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-15f97108-110e-4206-bbad-23bbd4dc16ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:25.823371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-15f97108-110e-4206-bbad-23bbd4dc16ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:25.830427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15f97108-110e-4206-bbad-23bbd4dc16ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:25.830871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15f97108-110e-4206-bbad-23bbd4dc16ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:25.831688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15f97108-110e-4206-bbad-23bbd4dc16ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:25.832124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15f97108-110e-4206-bbad-23bbd4dc16ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:25.979436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-79372169-7921-4f99-9dc5-d7dd5addc702 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:25.980131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-79372169-7921-4f99-9dc5-d7dd5addc702 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:25.987406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79372169-7921-4f99-9dc5-d7dd5addc702 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:25.987953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79372169-7921-4f99-9dc5-d7dd5addc702 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:25.991545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15f97108-110e-4206-bbad-23bbd4dc16ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:25.995335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79372169-7921-4f99-9dc5-d7dd5addc702 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:25.995794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79372169-7921-4f99-9dc5-d7dd5addc702 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:26.005403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-15f97108-110e-4206-bbad-23bbd4dc16ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.186785 Jul 26 18:31:26.005992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 171/344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:25 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:26.102565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-79372169-7921-4f99-9dc5-d7dd5addc702 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:26.111450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-79372169-7921-4f99-9dc5-d7dd5addc702 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1272 microversion: 2.1 time: 0.136255 Jul 26 18:31:26.111982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 174/345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:25 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:26.484986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a3e33117-bfae-4538-bc2f-5cd6efc55644 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:26.486131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a3e33117-bfae-4538-bc2f-5cd6efc55644 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:26.497420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3e33117-bfae-4538-bc2f-5cd6efc55644 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:26.498206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3e33117-bfae-4538-bc2f-5cd6efc55644 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:26.499643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3e33117-bfae-4538-bc2f-5cd6efc55644 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:26.500395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3e33117-bfae-4538-bc2f-5cd6efc55644 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:26.668271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a3e33117-bfae-4538-bc2f-5cd6efc55644 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:26.676899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a3e33117-bfae-4538-bc2f-5cd6efc55644 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.199236 Jul 26 18:31:26.677503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 172/346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:26 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:27.038358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c84e619e-5708-4d8c-9050-9466f88252d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:27.038962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c84e619e-5708-4d8c-9050-9466f88252d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:27.046926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c84e619e-5708-4d8c-9050-9466f88252d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:27.047801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c84e619e-5708-4d8c-9050-9466f88252d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:27.048669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c84e619e-5708-4d8c-9050-9466f88252d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:27.049179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c84e619e-5708-4d8c-9050-9466f88252d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:27.135289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8f0916d3-0856-42f6-826b-62122512d7c2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:27.136080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8f0916d3-0856-42f6-826b-62122512d7c2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:27.144694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f0916d3-0856-42f6-826b-62122512d7c2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:27.145140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f0916d3-0856-42f6-826b-62122512d7c2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:27.146179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f0916d3-0856-42f6-826b-62122512d7c2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:27.146749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f0916d3-0856-42f6-826b-62122512d7c2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:27.207277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c84e619e-5708-4d8c-9050-9466f88252d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:27.215733 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c84e619e-5708-4d8c-9050-9466f88252d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.181588 Jul 26 18:31:27.216430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 175/347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:27 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:27.348165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8f0916d3-0856-42f6-826b-62122512d7c2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:27.356317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8f0916d3-0856-42f6-826b-62122512d7c2 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.225947 Jul 26 18:31:27.356903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 173/348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:27 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:27.701649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f97de686-9c6f-419c-93e2-c45165e6a698 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:27.702699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f97de686-9c6f-419c-93e2-c45165e6a698 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:27.712457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f97de686-9c6f-419c-93e2-c45165e6a698 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:27.714499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f97de686-9c6f-419c-93e2-c45165e6a698 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:27.716611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f97de686-9c6f-419c-93e2-c45165e6a698 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:27.717888 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f97de686-9c6f-419c-93e2-c45165e6a698 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:27.987148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f97de686-9c6f-419c-93e2-c45165e6a698 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:28.003635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f97de686-9c6f-419c-93e2-c45165e6a698 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.307065 Jul 26 18:31:28.005475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 176/349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:28.195477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-233e2578-41d3-413e-bdb8-aeb227b3d5f9 req-ed3b8503-fefc-46e7-82bd-d77bc0444996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361dcc32-2e44-44c1-ad49-a30e51076546", "tag": "90340188-6b35-473a-9f94-71a5273e2b1d"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:31:28.208272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-233e2578-41d3-413e-bdb8-aeb227b3d5f9 req-ed3b8503-fefc-46e7-82bd-d77bc0444996 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:28.208825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-233e2578-41d3-413e-bdb8-aeb227b3d5f9 req-ed3b8503-fefc-46e7-82bd-d77bc0444996 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:28.224389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-233e2578-41d3-413e-bdb8-aeb227b3d5f9 req-ed3b8503-fefc-46e7-82bd-d77bc0444996 service nova] Creating event network-changed:90340188-6b35-473a-9f94-71a5273e2b1d for instance 361dcc32-2e44-44c1-ad49-a30e51076546 on hv-cinder-82549 Jul 26 18:31:28.229644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-233e2578-41d3-413e-bdb8-aeb227b3d5f9 req-ed3b8503-fefc-46e7-82bd-d77bc0444996 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037839 Jul 26 18:31:28.230230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 174/350] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:31:28.238326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e4d841cd-8032-4907-bed5-3c88f9a19cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:28.239053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e4d841cd-8032-4907-bed5-3c88f9a19cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:28.245903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e4d841cd-8032-4907-bed5-3c88f9a19cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:28.246415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e4d841cd-8032-4907-bed5-3c88f9a19cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:28.247233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e4d841cd-8032-4907-bed5-3c88f9a19cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:28.247679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e4d841cd-8032-4907-bed5-3c88f9a19cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:28.379586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-88221e63-230d-4b58-805c-254a4be68709 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:28.380292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-88221e63-230d-4b58-805c-254a4be68709 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:28.389896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88221e63-230d-4b58-805c-254a4be68709 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:28.390679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88221e63-230d-4b58-805c-254a4be68709 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:28.392312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88221e63-230d-4b58-805c-254a4be68709 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:28.392855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88221e63-230d-4b58-805c-254a4be68709 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:28.415826 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e4d841cd-8032-4907-bed5-3c88f9a19cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:28.424422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e4d841cd-8032-4907-bed5-3c88f9a19cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.190145 Jul 26 18:31:28.425137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 177/351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:28 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:28.563200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-88221e63-230d-4b58-805c-254a4be68709 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:28.572333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-88221e63-230d-4b58-805c-254a4be68709 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.197227 Jul 26 18:31:28.572885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 175/352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:28 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:29.030358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e98de60e-dc36-44a5-b97e-ee8e1924e7e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:29.030960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e98de60e-dc36-44a5-b97e-ee8e1924e7e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:29.037875 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e98de60e-dc36-44a5-b97e-ee8e1924e7e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:29.038356 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e98de60e-dc36-44a5-b97e-ee8e1924e7e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:29.039188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e98de60e-dc36-44a5-b97e-ee8e1924e7e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:29.039612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e98de60e-dc36-44a5-b97e-ee8e1924e7e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:29.202160 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e98de60e-dc36-44a5-b97e-ee8e1924e7e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:29.210742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e98de60e-dc36-44a5-b97e-ee8e1924e7e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.184416 Jul 26 18:31:29.211402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 178/353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:29 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:29.455081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-226634cb-112c-4ef8-a75a-fca16c0e6abf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:29.455619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-226634cb-112c-4ef8-a75a-fca16c0e6abf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:29.463148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-226634cb-112c-4ef8-a75a-fca16c0e6abf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:29.463591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-226634cb-112c-4ef8-a75a-fca16c0e6abf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:29.464512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-226634cb-112c-4ef8-a75a-fca16c0e6abf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:29.464981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-226634cb-112c-4ef8-a75a-fca16c0e6abf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:29.596673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3835b158-53fc-428b-9cb6-259f5b2e20c9 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:29.597323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3835b158-53fc-428b-9cb6-259f5b2e20c9 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:29.605583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-226634cb-112c-4ef8-a75a-fca16c0e6abf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:29.606609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3835b158-53fc-428b-9cb6-259f5b2e20c9 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:29.607385 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3835b158-53fc-428b-9cb6-259f5b2e20c9 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:29.608256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3835b158-53fc-428b-9cb6-259f5b2e20c9 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:29.608693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3835b158-53fc-428b-9cb6-259f5b2e20c9 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:29.614365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-226634cb-112c-4ef8-a75a-fca16c0e6abf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.163353 Jul 26 18:31:29.614947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 176/354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:29 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:29.750041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3835b158-53fc-428b-9cb6-259f5b2e20c9 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:29.761614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3835b158-53fc-428b-9cb6-259f5b2e20c9 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.171007 Jul 26 18:31:29.762301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 179/355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:29 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:30.233126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-940269f6-5bdb-46e7-819d-406245b74a6b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:30.233583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-940269f6-5bdb-46e7-819d-406245b74a6b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:30.240382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-940269f6-5bdb-46e7-819d-406245b74a6b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:30.240892 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-940269f6-5bdb-46e7-819d-406245b74a6b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:30.241698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-940269f6-5bdb-46e7-819d-406245b74a6b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:30.242144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-940269f6-5bdb-46e7-819d-406245b74a6b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:30.391405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-940269f6-5bdb-46e7-819d-406245b74a6b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:30.400568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-940269f6-5bdb-46e7-819d-406245b74a6b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.171195 Jul 26 18:31:30.401171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 177/356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:30 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:30.636105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8c8efafd-9034-4164-91ca-d57f7ec060d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:30.636685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8c8efafd-9034-4164-91ca-d57f7ec060d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:30.643569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c8efafd-9034-4164-91ca-d57f7ec060d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:30.643930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c8efafd-9034-4164-91ca-d57f7ec060d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:30.644716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c8efafd-9034-4164-91ca-d57f7ec060d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:30.645148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c8efafd-9034-4164-91ca-d57f7ec060d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:30.785560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2f208ed8-b7cb-4a5d-b457-46ae1633cb40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:30.786186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2f208ed8-b7cb-4a5d-b457-46ae1633cb40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:30.794995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f208ed8-b7cb-4a5d-b457-46ae1633cb40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:30.795486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f208ed8-b7cb-4a5d-b457-46ae1633cb40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:30.796284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f208ed8-b7cb-4a5d-b457-46ae1633cb40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:30.796719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f208ed8-b7cb-4a5d-b457-46ae1633cb40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:30.812642 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8c8efafd-9034-4164-91ca-d57f7ec060d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:30.822550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8c8efafd-9034-4164-91ca-d57f7ec060d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.190360 Jul 26 18:31:30.823170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 180/357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:30 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:30.944227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2f208ed8-b7cb-4a5d-b457-46ae1633cb40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:30.952640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2f208ed8-b7cb-4a5d-b457-46ae1633cb40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.172323 Jul 26 18:31:30.953226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 178/358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:30 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:31.422856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5f2e15de-5034-4650-bbf2-46b2a3f7f55b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:31.423606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5f2e15de-5034-4650-bbf2-46b2a3f7f55b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:31.430200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f2e15de-5034-4650-bbf2-46b2a3f7f55b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:31.430617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f2e15de-5034-4650-bbf2-46b2a3f7f55b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:31.431465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f2e15de-5034-4650-bbf2-46b2a3f7f55b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:31.431896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f2e15de-5034-4650-bbf2-46b2a3f7f55b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:31.583199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5f2e15de-5034-4650-bbf2-46b2a3f7f55b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:31.591401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5f2e15de-5034-4650-bbf2-46b2a3f7f55b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.172781 Jul 26 18:31:31.592002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 181/359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:31 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:31.846295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-73564408-8f0a-4791-b549-4335c8a98ed9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:31.846882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-73564408-8f0a-4791-b549-4335c8a98ed9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:31.854097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73564408-8f0a-4791-b549-4335c8a98ed9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:31.854545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73564408-8f0a-4791-b549-4335c8a98ed9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:31.855379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73564408-8f0a-4791-b549-4335c8a98ed9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:31.855810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73564408-8f0a-4791-b549-4335c8a98ed9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:32.004985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-73564408-8f0a-4791-b549-4335c8a98ed9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:32.013176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-73564408-8f0a-4791-b549-4335c8a98ed9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.170993 Jul 26 18:31:32.013817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 179/360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:31 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:32.038308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2b490c07-a38b-478f-9785-eb4bde22c149 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:32.039208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2b490c07-a38b-478f-9785-eb4bde22c149 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:32.049707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b490c07-a38b-478f-9785-eb4bde22c149 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:32.050168 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b490c07-a38b-478f-9785-eb4bde22c149 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:32.051266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b490c07-a38b-478f-9785-eb4bde22c149 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:32.052095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b490c07-a38b-478f-9785-eb4bde22c149 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:32.238301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2b490c07-a38b-478f-9785-eb4bde22c149 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:32.248074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2b490c07-a38b-478f-9785-eb4bde22c149 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.213773 Jul 26 18:31:32.248687 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 182/361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:32 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:32.615507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f5e76d42-16a2-45f6-9ed4-8559f77d26bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:32.616164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f5e76d42-16a2-45f6-9ed4-8559f77d26bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:32.623192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5e76d42-16a2-45f6-9ed4-8559f77d26bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:32.623746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5e76d42-16a2-45f6-9ed4-8559f77d26bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:32.624531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5e76d42-16a2-45f6-9ed4-8559f77d26bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:32.624972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5e76d42-16a2-45f6-9ed4-8559f77d26bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:32.767337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f5e76d42-16a2-45f6-9ed4-8559f77d26bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:32.777046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f5e76d42-16a2-45f6-9ed4-8559f77d26bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.166102 Jul 26 18:31:32.777622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 180/362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:32 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:33.039455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9056b4a4-d368-40b5-946a-4f9dde68602d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:33.040281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9056b4a4-d368-40b5-946a-4f9dde68602d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:33.048375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9056b4a4-d368-40b5-946a-4f9dde68602d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:33.048821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9056b4a4-d368-40b5-946a-4f9dde68602d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:33.049556 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9056b4a4-d368-40b5-946a-4f9dde68602d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:33.049981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9056b4a4-d368-40b5-946a-4f9dde68602d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:33.202431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9056b4a4-d368-40b5-946a-4f9dde68602d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:33.211014 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9056b4a4-d368-40b5-946a-4f9dde68602d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.177973 Jul 26 18:31:33.211648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 183/363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:33 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:33.269783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e54ddbce-5806-4f08-8061-dfd0637d29eb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:33.270408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e54ddbce-5806-4f08-8061-dfd0637d29eb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:33.278079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e54ddbce-5806-4f08-8061-dfd0637d29eb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:33.278527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e54ddbce-5806-4f08-8061-dfd0637d29eb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:33.279382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e54ddbce-5806-4f08-8061-dfd0637d29eb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:33.279835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e54ddbce-5806-4f08-8061-dfd0637d29eb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:33.416198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e54ddbce-5806-4f08-8061-dfd0637d29eb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:33.424321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e54ddbce-5806-4f08-8061-dfd0637d29eb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.158454 Jul 26 18:31:33.425091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 181/364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:33 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:33.799495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-885666cf-dae4-476b-87bd-3fb1c29ee378 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:33.800107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-885666cf-dae4-476b-87bd-3fb1c29ee378 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:33.806842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-885666cf-dae4-476b-87bd-3fb1c29ee378 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:33.807312 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-885666cf-dae4-476b-87bd-3fb1c29ee378 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:33.808094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-885666cf-dae4-476b-87bd-3fb1c29ee378 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:33.808524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-885666cf-dae4-476b-87bd-3fb1c29ee378 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:33.824958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:33.962145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-885666cf-dae4-476b-87bd-3fb1c29ee378 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:33.971045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-885666cf-dae4-476b-87bd-3fb1c29ee378 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.175584 Jul 26 18:31:33.971666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 184/365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:33 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:34.234820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bd50daa2-d989-475d-8422-304c00887ef5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:34.235455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bd50daa2-d989-475d-8422-304c00887ef5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:34.241761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd50daa2-d989-475d-8422-304c00887ef5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:34.242212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd50daa2-d989-475d-8422-304c00887ef5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:34.243037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd50daa2-d989-475d-8422-304c00887ef5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:34.243456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd50daa2-d989-475d-8422-304c00887ef5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:34.401194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bd50daa2-d989-475d-8422-304c00887ef5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:34.415973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bd50daa2-d989-475d-8422-304c00887ef5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.185105 Jul 26 18:31:34.416664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 182/366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:34 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:34.446717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-327e0960-c225-4183-a824-5f1180d13d5f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:34.447350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-327e0960-c225-4183-a824-5f1180d13d5f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:34.453590 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-327e0960-c225-4183-a824-5f1180d13d5f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:34.454027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-327e0960-c225-4183-a824-5f1180d13d5f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:34.454842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-327e0960-c225-4183-a824-5f1180d13d5f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:34.455334 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-327e0960-c225-4183-a824-5f1180d13d5f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:34.618171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-327e0960-c225-4183-a824-5f1180d13d5f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:34.626137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-327e0960-c225-4183-a824-5f1180d13d5f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.183227 Jul 26 18:31:34.626692 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 185/367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:34 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:34.991603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1c8ca75e-89a1-49a8-8ee7-83615ff64ec6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:34.992215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1c8ca75e-89a1-49a8-8ee7-83615ff64ec6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:34.999316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1c8ca75e-89a1-49a8-8ee7-83615ff64ec6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:34.999819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1c8ca75e-89a1-49a8-8ee7-83615ff64ec6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:35.000564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1c8ca75e-89a1-49a8-8ee7-83615ff64ec6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:35.000999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1c8ca75e-89a1-49a8-8ee7-83615ff64ec6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:35.005771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:35.171064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1c8ca75e-89a1-49a8-8ee7-83615ff64ec6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:35.179433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1c8ca75e-89a1-49a8-8ee7-83615ff64ec6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.191621 Jul 26 18:31:35.180023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 183/368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:34 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:35.438769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fdcc0867-2d6e-407b-b4e5-08814f904935 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:35.439542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fdcc0867-2d6e-407b-b4e5-08814f904935 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:35.447392 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdcc0867-2d6e-407b-b4e5-08814f904935 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:35.448179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdcc0867-2d6e-407b-b4e5-08814f904935 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:35.448644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdcc0867-2d6e-407b-b4e5-08814f904935 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:35.449070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdcc0867-2d6e-407b-b4e5-08814f904935 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:35.599923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fdcc0867-2d6e-407b-b4e5-08814f904935 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:35.609463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fdcc0867-2d6e-407b-b4e5-08814f904935 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.174849 Jul 26 18:31:35.610090 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 186/369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:35 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:35.646779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b7571e64-ac44-4d0a-93f6-35ab63f1272c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:35.647369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b7571e64-ac44-4d0a-93f6-35ab63f1272c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:35.654718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7571e64-ac44-4d0a-93f6-35ab63f1272c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:35.655192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7571e64-ac44-4d0a-93f6-35ab63f1272c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:35.655951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7571e64-ac44-4d0a-93f6-35ab63f1272c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:35.656379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7571e64-ac44-4d0a-93f6-35ab63f1272c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:35.806027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b7571e64-ac44-4d0a-93f6-35ab63f1272c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:35.814041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b7571e64-ac44-4d0a-93f6-35ab63f1272c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.171126 Jul 26 18:31:35.814599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 184/370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:35 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:36.200766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9554afde-7ccd-4386-b43c-e3b63d6fe523 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:36.201248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9554afde-7ccd-4386-b43c-e3b63d6fe523 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:36.208362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9554afde-7ccd-4386-b43c-e3b63d6fe523 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:36.208807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9554afde-7ccd-4386-b43c-e3b63d6fe523 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:36.209588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9554afde-7ccd-4386-b43c-e3b63d6fe523 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:36.210023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9554afde-7ccd-4386-b43c-e3b63d6fe523 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:36.349435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9554afde-7ccd-4386-b43c-e3b63d6fe523 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:36.357429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9554afde-7ccd-4386-b43c-e3b63d6fe523 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.161022 Jul 26 18:31:36.358192 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 187/371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:36 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:36.634610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6529b7fd-e85b-4e5c-910a-221be0d7d2bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:36.635712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6529b7fd-e85b-4e5c-910a-221be0d7d2bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:36.638395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:36.644980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6529b7fd-e85b-4e5c-910a-221be0d7d2bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:36.645743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6529b7fd-e85b-4e5c-910a-221be0d7d2bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:36.646170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6529b7fd-e85b-4e5c-910a-221be0d7d2bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:36.646574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6529b7fd-e85b-4e5c-910a-221be0d7d2bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:36.789748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6529b7fd-e85b-4e5c-910a-221be0d7d2bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:36.798307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6529b7fd-e85b-4e5c-910a-221be0d7d2bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.170764 Jul 26 18:31:36.798900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 185/372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:36 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:36.835426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8a469499-8e12-4af6-b56e-122f8ad9767f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:36.836045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8a469499-8e12-4af6-b56e-122f8ad9767f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:36.842765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a469499-8e12-4af6-b56e-122f8ad9767f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:36.843240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a469499-8e12-4af6-b56e-122f8ad9767f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:36.844024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a469499-8e12-4af6-b56e-122f8ad9767f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:36.844454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a469499-8e12-4af6-b56e-122f8ad9767f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:36.998193 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8a469499-8e12-4af6-b56e-122f8ad9767f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:37.006545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8a469499-8e12-4af6-b56e-122f8ad9767f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.174952 Jul 26 18:31:37.007233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 188/373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:36 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:37.383369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0f812704-6841-43b0-9fa4-17686104946f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:37.383888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f812704-6841-43b0-9fa4-17686104946f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:37.390964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f812704-6841-43b0-9fa4-17686104946f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:37.391454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f812704-6841-43b0-9fa4-17686104946f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:37.392241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f812704-6841-43b0-9fa4-17686104946f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:37.392667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f812704-6841-43b0-9fa4-17686104946f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:37.556728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0f812704-6841-43b0-9fa4-17686104946f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:37.565089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0f812704-6841-43b0-9fa4-17686104946f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.185835 Jul 26 18:31:37.565683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 186/374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:37 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:37.820822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7809406d-98b7-461f-87bb-a0d037c8edc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:37.821513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7809406d-98b7-461f-87bb-a0d037c8edc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:37.828513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7809406d-98b7-461f-87bb-a0d037c8edc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:37.829015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7809406d-98b7-461f-87bb-a0d037c8edc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:37.829795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7809406d-98b7-461f-87bb-a0d037c8edc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:37.830223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7809406d-98b7-461f-87bb-a0d037c8edc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:37.982792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7809406d-98b7-461f-87bb-a0d037c8edc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:37.990840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7809406d-98b7-461f-87bb-a0d037c8edc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.174268 Jul 26 18:31:37.991462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 189/375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:37 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:38.029043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0409bb65-2e6b-4fed-a78e-ffd3dddbf283 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:38.029756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0409bb65-2e6b-4fed-a78e-ffd3dddbf283 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:38.037356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0409bb65-2e6b-4fed-a78e-ffd3dddbf283 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:38.037800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0409bb65-2e6b-4fed-a78e-ffd3dddbf283 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:38.038584 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0409bb65-2e6b-4fed-a78e-ffd3dddbf283 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:38.038990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0409bb65-2e6b-4fed-a78e-ffd3dddbf283 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:38.194891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0409bb65-2e6b-4fed-a78e-ffd3dddbf283 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:38.202918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0409bb65-2e6b-4fed-a78e-ffd3dddbf283 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.178394 Jul 26 18:31:38.203513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 187/376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:38 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:38.587598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c7776202-0c51-4208-b38c-0749c2f4003a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:38.588179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c7776202-0c51-4208-b38c-0749c2f4003a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:38.594555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c7776202-0c51-4208-b38c-0749c2f4003a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:38.594988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c7776202-0c51-4208-b38c-0749c2f4003a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:38.595811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c7776202-0c51-4208-b38c-0749c2f4003a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:38.596213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c7776202-0c51-4208-b38c-0749c2f4003a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:38.770870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c7776202-0c51-4208-b38c-0749c2f4003a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:38.785193 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c7776202-0c51-4208-b38c-0749c2f4003a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.201025 Jul 26 18:31:38.786270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 190/377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:38 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:39.012909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dbf1ce04-92fb-400b-99d9-bb9d0edb8a46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:39.013522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dbf1ce04-92fb-400b-99d9-bb9d0edb8a46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:39.020565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dbf1ce04-92fb-400b-99d9-bb9d0edb8a46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:39.021002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dbf1ce04-92fb-400b-99d9-bb9d0edb8a46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:39.021785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dbf1ce04-92fb-400b-99d9-bb9d0edb8a46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:39.022179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dbf1ce04-92fb-400b-99d9-bb9d0edb8a46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:39.170901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dbf1ce04-92fb-400b-99d9-bb9d0edb8a46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:39.182074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dbf1ce04-92fb-400b-99d9-bb9d0edb8a46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.173302 Jul 26 18:31:39.183058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 188/378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:39 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:39.224612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aa82e0b3-803a-4648-934a-4713d43654c0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:39.225197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aa82e0b3-803a-4648-934a-4713d43654c0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:39.232161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa82e0b3-803a-4648-934a-4713d43654c0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:39.232846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa82e0b3-803a-4648-934a-4713d43654c0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:39.233676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa82e0b3-803a-4648-934a-4713d43654c0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:39.234184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa82e0b3-803a-4648-934a-4713d43654c0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:39.382655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-aa82e0b3-803a-4648-934a-4713d43654c0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:39.391599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aa82e0b3-803a-4648-934a-4713d43654c0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.170984 Jul 26 18:31:39.392285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 191/379] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:39 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:39.809447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-758a4679-5335-4adf-9547-2588cfb3e3c0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:39.810068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-758a4679-5335-4adf-9547-2588cfb3e3c0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:39.819175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-758a4679-5335-4adf-9547-2588cfb3e3c0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:39.820204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-758a4679-5335-4adf-9547-2588cfb3e3c0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:39.821695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-758a4679-5335-4adf-9547-2588cfb3e3c0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:39.822862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-758a4679-5335-4adf-9547-2588cfb3e3c0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:39.974957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-758a4679-5335-4adf-9547-2588cfb3e3c0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:39.982876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-758a4679-5335-4adf-9547-2588cfb3e3c0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.177311 Jul 26 18:31:39.983494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 189/380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:39 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:40.205462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e508096a-7a0a-43db-9167-d87b603866ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:40.205972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e508096a-7a0a-43db-9167-d87b603866ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:40.212624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e508096a-7a0a-43db-9167-d87b603866ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:40.213098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e508096a-7a0a-43db-9167-d87b603866ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:40.213894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e508096a-7a0a-43db-9167-d87b603866ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:40.214423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e508096a-7a0a-43db-9167-d87b603866ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:40.376617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e508096a-7a0a-43db-9167-d87b603866ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:40.385175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e508096a-7a0a-43db-9167-d87b603866ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.184302 Jul 26 18:31:40.386070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 192/381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:40 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:40.414579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-699055b0-e2de-4250-be6f-81b80f4f9e85 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:40.415222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-699055b0-e2de-4250-be6f-81b80f4f9e85 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:40.422456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-699055b0-e2de-4250-be6f-81b80f4f9e85 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:40.422903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-699055b0-e2de-4250-be6f-81b80f4f9e85 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:40.423704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-699055b0-e2de-4250-be6f-81b80f4f9e85 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:40.424222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-699055b0-e2de-4250-be6f-81b80f4f9e85 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:40.567767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-699055b0-e2de-4250-be6f-81b80f4f9e85 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:40.577175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-699055b0-e2de-4250-be6f-81b80f4f9e85 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.166563 Jul 26 18:31:40.578019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 190/382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:40 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:41.005621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cad9f0fd-d2dc-48bf-900e-acfb8fb57c09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:41.006214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cad9f0fd-d2dc-48bf-900e-acfb8fb57c09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:41.012578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cad9f0fd-d2dc-48bf-900e-acfb8fb57c09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:41.013017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cad9f0fd-d2dc-48bf-900e-acfb8fb57c09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:41.013771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cad9f0fd-d2dc-48bf-900e-acfb8fb57c09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:41.014299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cad9f0fd-d2dc-48bf-900e-acfb8fb57c09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:41.161712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cad9f0fd-d2dc-48bf-900e-acfb8fb57c09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:41.171980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cad9f0fd-d2dc-48bf-900e-acfb8fb57c09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.170459 Jul 26 18:31:41.172590 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 193/383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:41 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:41.408508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-57e42ca4-c1d5-46c3-808b-9a133ee24565 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:41.409025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-57e42ca4-c1d5-46c3-808b-9a133ee24565 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:41.415830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57e42ca4-c1d5-46c3-808b-9a133ee24565 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:41.416548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57e42ca4-c1d5-46c3-808b-9a133ee24565 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:41.417046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57e42ca4-c1d5-46c3-808b-9a133ee24565 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:41.417479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57e42ca4-c1d5-46c3-808b-9a133ee24565 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:41.571668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-57e42ca4-c1d5-46c3-808b-9a133ee24565 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:41.580486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-57e42ca4-c1d5-46c3-808b-9a133ee24565 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.175870 Jul 26 18:31:41.581094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 191/384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:41 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:41.598322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2f9ee221-0bac-4250-9361-d963944a6ed1 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:41.598922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2f9ee221-0bac-4250-9361-d963944a6ed1 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:41.605450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f9ee221-0bac-4250-9361-d963944a6ed1 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:41.605890 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f9ee221-0bac-4250-9361-d963944a6ed1 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:41.606716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f9ee221-0bac-4250-9361-d963944a6ed1 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:41.607173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f9ee221-0bac-4250-9361-d963944a6ed1 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:41.774542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2f9ee221-0bac-4250-9361-d963944a6ed1 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:41.786827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2f9ee221-0bac-4250-9361-d963944a6ed1 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.192224 Jul 26 18:31:41.787521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 194/385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:41 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:42.194197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-75028480-5cec-426b-a3dd-0fad2fbe8ed4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:42.194790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-75028480-5cec-426b-a3dd-0fad2fbe8ed4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:42.201331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75028480-5cec-426b-a3dd-0fad2fbe8ed4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:42.201777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75028480-5cec-426b-a3dd-0fad2fbe8ed4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:42.202550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75028480-5cec-426b-a3dd-0fad2fbe8ed4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:42.202983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75028480-5cec-426b-a3dd-0fad2fbe8ed4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:42.354071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-75028480-5cec-426b-a3dd-0fad2fbe8ed4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:42.362428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-75028480-5cec-426b-a3dd-0fad2fbe8ed4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.172306 Jul 26 18:31:42.363004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 192/386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:42 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:42.602123 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-32536c73-7e55-46a1-855f-3b1463a56eda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:42.603095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-32536c73-7e55-46a1-855f-3b1463a56eda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:42.609262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32536c73-7e55-46a1-855f-3b1463a56eda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:42.609703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32536c73-7e55-46a1-855f-3b1463a56eda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:42.610475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32536c73-7e55-46a1-855f-3b1463a56eda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:42.610912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32536c73-7e55-46a1-855f-3b1463a56eda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:42.765342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-32536c73-7e55-46a1-855f-3b1463a56eda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:42.774301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-32536c73-7e55-46a1-855f-3b1463a56eda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.176186 Jul 26 18:31:42.775338 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 195/387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:42 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:42.809003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-88737ab2-b2c2-4430-803a-6d72ee96d10e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:42.809698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-88737ab2-b2c2-4430-803a-6d72ee96d10e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:42.816709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88737ab2-b2c2-4430-803a-6d72ee96d10e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:42.817221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88737ab2-b2c2-4430-803a-6d72ee96d10e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:42.818035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88737ab2-b2c2-4430-803a-6d72ee96d10e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:42.818514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88737ab2-b2c2-4430-803a-6d72ee96d10e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:42.969705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-88737ab2-b2c2-4430-803a-6d72ee96d10e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:42.983539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-88737ab2-b2c2-4430-803a-6d72ee96d10e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.178684 Jul 26 18:31:42.985040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 193/388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:42 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:43.387006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-40495460-b723-48b9-b974-b6ce6cd6182d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:43.388021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-40495460-b723-48b9-b974-b6ce6cd6182d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:43.397049 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40495460-b723-48b9-b974-b6ce6cd6182d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:43.397745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40495460-b723-48b9-b974-b6ce6cd6182d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:43.398740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40495460-b723-48b9-b974-b6ce6cd6182d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:43.399914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40495460-b723-48b9-b974-b6ce6cd6182d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:43.565623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-40495460-b723-48b9-b974-b6ce6cd6182d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:43.576700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-40495460-b723-48b9-b974-b6ce6cd6182d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.196136 Jul 26 18:31:43.577633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 196/389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:43 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:43.816555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-96753078-e98d-403b-92cd-3f2a2a9d749f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:43.824867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-96753078-e98d-403b-92cd-3f2a2a9d749f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:43.846701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96753078-e98d-403b-92cd-3f2a2a9d749f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:43.848810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96753078-e98d-403b-92cd-3f2a2a9d749f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:43.850217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96753078-e98d-403b-92cd-3f2a2a9d749f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:43.850848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96753078-e98d-403b-92cd-3f2a2a9d749f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:44.006866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1d702d0a-8dd1-4fea-bb58-8cc10b07ec57 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:44.008187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1d702d0a-8dd1-4fea-bb58-8cc10b07ec57 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:44.032779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-96753078-e98d-403b-92cd-3f2a2a9d749f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:44.035262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d702d0a-8dd1-4fea-bb58-8cc10b07ec57 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:44.035957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d702d0a-8dd1-4fea-bb58-8cc10b07ec57 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:44.036960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d702d0a-8dd1-4fea-bb58-8cc10b07ec57 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:44.037397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d702d0a-8dd1-4fea-bb58-8cc10b07ec57 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:44.042001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-96753078-e98d-403b-92cd-3f2a2a9d749f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1502 microversion: 2.1 time: 0.243571 Jul 26 18:31:44.043232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 194/390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:43 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:44.049039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-0715d637-b4dd-4e81-ac08-bc30e98ca669 req-c0dc4a7f-62a9-46ce-91f0-5425197beeea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9982c007-1157-4c63-93e8-3733712f06e0", "name": "network-vif-plugged", "status": "completed", "tag": "4e31fc31-19bc-4733-a6d9-9e1a584d4781"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:31:44.066967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-0715d637-b4dd-4e81-ac08-bc30e98ca669 req-c0dc4a7f-62a9-46ce-91f0-5425197beeea service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:44.068393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-0715d637-b4dd-4e81-ac08-bc30e98ca669 req-c0dc4a7f-62a9-46ce-91f0-5425197beeea service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:44.096430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-0715d637-b4dd-4e81-ac08-bc30e98ca669 req-c0dc4a7f-62a9-46ce-91f0-5425197beeea service nova] Creating event network-vif-plugged:4e31fc31-19bc-4733-a6d9-9e1a584d4781 for instance 9982c007-1157-4c63-93e8-3733712f06e0 on hv-cinder-82549 Jul 26 18:31:44.103438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-0715d637-b4dd-4e81-ac08-bc30e98ca669 req-c0dc4a7f-62a9-46ce-91f0-5425197beeea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058606 Jul 26 18:31:44.104053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 195/391] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:31:44.110424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6735c9cb-1599-428e-841c-27c21f18919a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df73962b-5272-4305-83e1-058d2ff9d4aa"}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:31:44.114062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6735c9cb-1599-428e-841c-27c21f18919a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:44.123621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6735c9cb-1599-428e-841c-27c21f18919a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:44.124067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6735c9cb-1599-428e-841c-27c21f18919a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:44.124856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6735c9cb-1599-428e-841c-27c21f18919a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:44.125330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6735c9cb-1599-428e-841c-27c21f18919a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:44.156620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-6735c9cb-1599-428e-841c-27c21f18919a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] HTTP exception thrown: Cannot 'attach_volume' instance fbf94d62-c20e-42ae-9403-03100f038397 while it is in vm_state rescued Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6735c9cb-1599-428e-841c-27c21f18919a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Request method failure captured: Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: POST /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397/os-volume_attachments HTTP/1.1 Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 74 Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJjI9s6qbx1uWj8Nh66RGFe9XimgHtp2LwzuRf32bwhuJGkOcImrFPHTXWz9VlFKeYvhELtnyHFrl8Fiy_hnmeqfO-iBWzE616j4e4cR9PoNFd2DwrMhNI8UyNEmjYxg5IbFeBWPPU2AsHoRn9xmyr-3O8gVOXj23V9PZ_Y1nWusfI Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: e9c0885f4de641028b1e194802620fbc Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593014913 Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 18:31:44.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 18:31:44.161041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e9c0885f4de641028b1e194802620fbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e9c0885f4de641028b1e194802620fbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9c0885f4de641028b1e194802620fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9c0885f4de641028b1e194802620fbc"}]}] Jul 26 18:31:44.161041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593014913 Jul 26 18:31:44.161041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: e9c0885f4de641028b1e194802620fbc Jul 26 18:31:44.161041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593014913 Jul 26 18:31:44.161041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-ServerRescueNegativeTestJSON-593014913-project Jul 26 18:31:44.161041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 18:31:44.161041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 18:31:44.161041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 43205ac588bc432fb8c9628fba37d445 Jul 26 18:31:44.161041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593014913-project Jul 26 18:31:44.161041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Jul 26 18:31:44.161041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {"volumeAttachment": {"volumeId": "df73962b-5272-4305-83e1-058d2ff9d4aa"}} Jul 26 18:31:44.161041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Cannot 'attach_volume' instance fbf94d62-c20e-42ae-9403-03100f038397 while it is in vm_state rescued Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'server_id': 'fbf94d62-c20e-42ae-9403-03100f038397', 'body': {'volumeAttachment': {'volumeId': 'df73962b-5272-4305-83e1-058d2ff9d4aa'}}} Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fbf94d62-c20e-42ae-9403-03100f038397 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:31:44.163625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fbf94d62-c20e-42ae-9403-03100f038397 while it is in vm_state rescued Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:31:44.166476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:31:44.168809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:31:44.168809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:31:44.168809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fbf94d62-c20e-42ae-9403-03100f038397 while it is in vm_state rescued Jul 26 18:31:44.168809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:31:44.168809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6735c9cb-1599-428e-841c-27c21f18919a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Returning 409 to user: Cannot 'attach_volume' instance fbf94d62-c20e-42ae-9403-03100f038397 while it is in vm_state rescued {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:31:44.168809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6735c9cb-1599-428e-841c-27c21f18919a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "POST /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053443 Jul 26 18:31:44.168809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 196/392] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Jul 26 18:31:44 2022] POST /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 18:31:44.171906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-53a22779-94d9-4e3f-b9cb-9f0abe65446c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:31:44.172519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-53a22779-94d9-4e3f-b9cb-9f0abe65446c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:44.179396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53a22779-94d9-4e3f-b9cb-9f0abe65446c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:44.179850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53a22779-94d9-4e3f-b9cb-9f0abe65446c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:44.180632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53a22779-94d9-4e3f-b9cb-9f0abe65446c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:44.181077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53a22779-94d9-4e3f-b9cb-9f0abe65446c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:44.239030 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d702d0a-8dd1-4fea-bb58-8cc10b07ec57 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:44.259182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1d702d0a-8dd1-4fea-bb58-8cc10b07ec57 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.256529 Jul 26 18:31:44.271638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 197/393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:44 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:44.271799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-53a22779-94d9-4e3f-b9cb-9f0abe65446c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "POST /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397/action" status: 202 len: 0 microversion: 2.1 time: 0.100199 Jul 26 18:31:44.271799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 197/394] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:31:44 2022] POST /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 18:31:44.274340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b718f06d-b9de-4714-9007-ccc15a231766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:44.275539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b718f06d-b9de-4714-9007-ccc15a231766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:44.282653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b718f06d-b9de-4714-9007-ccc15a231766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:44.283256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b718f06d-b9de-4714-9007-ccc15a231766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:44.284062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b718f06d-b9de-4714-9007-ccc15a231766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:44.284606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b718f06d-b9de-4714-9007-ccc15a231766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:44.450446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b718f06d-b9de-4714-9007-ccc15a231766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:44.459237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b718f06d-b9de-4714-9007-ccc15a231766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1510 microversion: 2.1 time: 0.188720 Jul 26 18:31:44.459829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 198/395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:44 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:44.598797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-67cd8bff-6c6b-4889-a2bc-3e1afb6fb17f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:44.599771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-67cd8bff-6c6b-4889-a2bc-3e1afb6fb17f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:44.610019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-67cd8bff-6c6b-4889-a2bc-3e1afb6fb17f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:44.610459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-67cd8bff-6c6b-4889-a2bc-3e1afb6fb17f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:44.611530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-67cd8bff-6c6b-4889-a2bc-3e1afb6fb17f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:44.612097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-67cd8bff-6c6b-4889-a2bc-3e1afb6fb17f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:44.903174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-67cd8bff-6c6b-4889-a2bc-3e1afb6fb17f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:44.919860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-67cd8bff-6c6b-4889-a2bc-3e1afb6fb17f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.324638 Jul 26 18:31:44.932246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 198/396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:44 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:45.296659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5a850f74-d675-4c77-9ffa-7a1b6345b786 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:45.297264 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5a850f74-d675-4c77-9ffa-7a1b6345b786 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:45.303453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a850f74-d675-4c77-9ffa-7a1b6345b786 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:45.303904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a850f74-d675-4c77-9ffa-7a1b6345b786 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:45.304690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a850f74-d675-4c77-9ffa-7a1b6345b786 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:45.305124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a850f74-d675-4c77-9ffa-7a1b6345b786 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:45.452613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5a850f74-d675-4c77-9ffa-7a1b6345b786 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:45.461119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5a850f74-d675-4c77-9ffa-7a1b6345b786 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.168518 Jul 26 18:31:45.461696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 199/397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:45 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:45.480296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-40e8b765-0cf2-4860-a6af-6490496eb180 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:45.481028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-40e8b765-0cf2-4860-a6af-6490496eb180 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:45.487844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40e8b765-0cf2-4860-a6af-6490496eb180 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:45.488316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40e8b765-0cf2-4860-a6af-6490496eb180 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:45.489373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40e8b765-0cf2-4860-a6af-6490496eb180 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:45.490011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40e8b765-0cf2-4860-a6af-6490496eb180 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:45.638842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-40e8b765-0cf2-4860-a6af-6490496eb180 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:45.643324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:45.648256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-40e8b765-0cf2-4860-a6af-6490496eb180 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1510 microversion: 2.1 time: 0.171832 Jul 26 18:31:45.648837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 199/398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:45 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:45.954329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2b06a596-c1f1-4f7e-acd5-ea1d2e55d57b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:45.954909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2b06a596-c1f1-4f7e-acd5-ea1d2e55d57b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:45.961796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b06a596-c1f1-4f7e-acd5-ea1d2e55d57b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:45.961796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b06a596-c1f1-4f7e-acd5-ea1d2e55d57b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:45.963004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b06a596-c1f1-4f7e-acd5-ea1d2e55d57b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:45.963469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b06a596-c1f1-4f7e-acd5-ea1d2e55d57b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:46.117984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2b06a596-c1f1-4f7e-acd5-ea1d2e55d57b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:46.129668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2b06a596-c1f1-4f7e-acd5-ea1d2e55d57b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.179586 Jul 26 18:31:46.130237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 200/399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:45 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:46.483009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-79a9b819-8edd-4bd5-93a1-2f36fa62f6e8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:46.483585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-79a9b819-8edd-4bd5-93a1-2f36fa62f6e8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:46.491396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79a9b819-8edd-4bd5-93a1-2f36fa62f6e8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:46.491827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79a9b819-8edd-4bd5-93a1-2f36fa62f6e8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:46.492605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79a9b819-8edd-4bd5-93a1-2f36fa62f6e8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:46.493031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79a9b819-8edd-4bd5-93a1-2f36fa62f6e8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:46.633188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-79a9b819-8edd-4bd5-93a1-2f36fa62f6e8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:46.645422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-79a9b819-8edd-4bd5-93a1-2f36fa62f6e8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.166086 Jul 26 18:31:46.645992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 200/400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:46 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:46.671206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1a6dcad2-7e89-4d3a-902c-3c90cbb0d026 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:46.671796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1a6dcad2-7e89-4d3a-902c-3c90cbb0d026 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:46.678461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a6dcad2-7e89-4d3a-902c-3c90cbb0d026 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:46.678906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a6dcad2-7e89-4d3a-902c-3c90cbb0d026 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:46.679695 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a6dcad2-7e89-4d3a-902c-3c90cbb0d026 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:46.680126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a6dcad2-7e89-4d3a-902c-3c90cbb0d026 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:46.682629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:46.818315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1a6dcad2-7e89-4d3a-902c-3c90cbb0d026 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:46.829181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1a6dcad2-7e89-4d3a-902c-3c90cbb0d026 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1510 microversion: 2.1 time: 0.161699 Jul 26 18:31:46.829787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 201/401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:46 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:47.151742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8b6ef76e-310a-4a75-886c-09c09a9a8945 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:47.152391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8b6ef76e-310a-4a75-886c-09c09a9a8945 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:47.158686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b6ef76e-310a-4a75-886c-09c09a9a8945 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:47.159177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b6ef76e-310a-4a75-886c-09c09a9a8945 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:47.159940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b6ef76e-310a-4a75-886c-09c09a9a8945 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:47.160376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b6ef76e-310a-4a75-886c-09c09a9a8945 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:47.299675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8b6ef76e-310a-4a75-886c-09c09a9a8945 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:47.307943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8b6ef76e-310a-4a75-886c-09c09a9a8945 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.160534 Jul 26 18:31:47.308510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 201/402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:47 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:47.668238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b3b8ab0f-9ba8-4ffe-9d25-9ee52f383dcd tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:47.668765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b3b8ab0f-9ba8-4ffe-9d25-9ee52f383dcd tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:47.670967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=78 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:47.677091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3b8ab0f-9ba8-4ffe-9d25-9ee52f383dcd tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:47.677873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3b8ab0f-9ba8-4ffe-9d25-9ee52f383dcd tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:47.678414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3b8ab0f-9ba8-4ffe-9d25-9ee52f383dcd tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:47.678850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3b8ab0f-9ba8-4ffe-9d25-9ee52f383dcd tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:47.819938 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b3b8ab0f-9ba8-4ffe-9d25-9ee52f383dcd tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:47.830994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b3b8ab0f-9ba8-4ffe-9d25-9ee52f383dcd tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.167064 Jul 26 18:31:47.831778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 202/403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:47 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:47.857053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b57ec6f2-c8ef-4513-b6ee-5a61f4ea9e4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:47.857685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b57ec6f2-c8ef-4513-b6ee-5a61f4ea9e4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:47.864815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b57ec6f2-c8ef-4513-b6ee-5a61f4ea9e4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:47.865335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b57ec6f2-c8ef-4513-b6ee-5a61f4ea9e4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:47.866098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b57ec6f2-c8ef-4513-b6ee-5a61f4ea9e4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:47.866533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b57ec6f2-c8ef-4513-b6ee-5a61f4ea9e4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:48.012225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b57ec6f2-c8ef-4513-b6ee-5a61f4ea9e4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:48.020476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b57ec6f2-c8ef-4513-b6ee-5a61f4ea9e4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1510 microversion: 2.1 time: 0.167206 Jul 26 18:31:48.021046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 202/404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:47 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:48.333896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9b4cdf08-74b0-4248-9523-1164de223fca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:48.334602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9b4cdf08-74b0-4248-9523-1164de223fca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:48.342758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b4cdf08-74b0-4248-9523-1164de223fca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:48.343482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b4cdf08-74b0-4248-9523-1164de223fca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:48.344610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b4cdf08-74b0-4248-9523-1164de223fca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:48.345294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b4cdf08-74b0-4248-9523-1164de223fca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:48.483935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9b4cdf08-74b0-4248-9523-1164de223fca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:48.492513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9b4cdf08-74b0-4248-9523-1164de223fca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.164038 Jul 26 18:31:48.493102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 203/405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:48 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:48.853125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ec538126-8e39-48dd-b37f-1b019958273e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:48.853778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ec538126-8e39-48dd-b37f-1b019958273e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:48.860288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec538126-8e39-48dd-b37f-1b019958273e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:48.861039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec538126-8e39-48dd-b37f-1b019958273e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:48.861496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec538126-8e39-48dd-b37f-1b019958273e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:48.861930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec538126-8e39-48dd-b37f-1b019958273e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:49.005284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ec538126-8e39-48dd-b37f-1b019958273e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:49.016925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ec538126-8e39-48dd-b37f-1b019958273e tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.167613 Jul 26 18:31:49.017611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 203/406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:48 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:49.042142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c1ee1e4a-7d28-4223-85a5-ccf7e0e6a14f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:49.042763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c1ee1e4a-7d28-4223-85a5-ccf7e0e6a14f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:49.049072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1ee1e4a-7d28-4223-85a5-ccf7e0e6a14f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:49.049515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1ee1e4a-7d28-4223-85a5-ccf7e0e6a14f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:49.050266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1ee1e4a-7d28-4223-85a5-ccf7e0e6a14f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:49.050694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1ee1e4a-7d28-4223-85a5-ccf7e0e6a14f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:49.200766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c1ee1e4a-7d28-4223-85a5-ccf7e0e6a14f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:49.209315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c1ee1e4a-7d28-4223-85a5-ccf7e0e6a14f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1510 microversion: 2.1 time: 0.171088 Jul 26 18:31:49.209903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 204/407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:49 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:49.514788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b0f403fd-8c44-4e61-ba45-55bdab457abf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:49.515446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b0f403fd-8c44-4e61-ba45-55bdab457abf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:49.525640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0f403fd-8c44-4e61-ba45-55bdab457abf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:49.526089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0f403fd-8c44-4e61-ba45-55bdab457abf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:49.526870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0f403fd-8c44-4e61-ba45-55bdab457abf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:49.527328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0f403fd-8c44-4e61-ba45-55bdab457abf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:49.668131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b0f403fd-8c44-4e61-ba45-55bdab457abf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:49.678264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b0f403fd-8c44-4e61-ba45-55bdab457abf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.167340 Jul 26 18:31:49.679392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 204/408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:49 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:50.044685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d8f25daf-4b86-40e7-aff9-d7e6c60717ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:50.045376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d8f25daf-4b86-40e7-aff9-d7e6c60717ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:50.052131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8f25daf-4b86-40e7-aff9-d7e6c60717ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:50.052580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8f25daf-4b86-40e7-aff9-d7e6c60717ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:50.053445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8f25daf-4b86-40e7-aff9-d7e6c60717ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:50.053876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8f25daf-4b86-40e7-aff9-d7e6c60717ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:50.232067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5c5d5c3d-ca4b-4bb9-a02a-280fc00f0f92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:50.233963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5c5d5c3d-ca4b-4bb9-a02a-280fc00f0f92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:50.246917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c5d5c3d-ca4b-4bb9-a02a-280fc00f0f92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:50.247786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c5d5c3d-ca4b-4bb9-a02a-280fc00f0f92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:50.249003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c5d5c3d-ca4b-4bb9-a02a-280fc00f0f92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:50.249695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c5d5c3d-ca4b-4bb9-a02a-280fc00f0f92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:50.607584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d8f25daf-4b86-40e7-aff9-d7e6c60717ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:50.616390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d8f25daf-4b86-40e7-aff9-d7e6c60717ad tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.576189 Jul 26 18:31:50.623436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 205/409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:50 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:50.702831 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-40b3d921-9b81-4f00-b633-c1fc84d5985b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:50.703769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-40b3d921-9b81-4f00-b633-c1fc84d5985b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:50.713066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40b3d921-9b81-4f00-b633-c1fc84d5985b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:50.713066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40b3d921-9b81-4f00-b633-c1fc84d5985b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:50.713066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40b3d921-9b81-4f00-b633-c1fc84d5985b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:50.713066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40b3d921-9b81-4f00-b633-c1fc84d5985b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:50.720023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5c5d5c3d-ca4b-4bb9-a02a-280fc00f0f92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:50.732793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5c5d5c3d-ca4b-4bb9-a02a-280fc00f0f92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1510 microversion: 2.1 time: 0.504765 Jul 26 18:31:50.733883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 205/410] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:50 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1510 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:50.869024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-40b3d921-9b81-4f00-b633-c1fc84d5985b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:50.879356 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-40b3d921-9b81-4f00-b633-c1fc84d5985b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.180733 Jul 26 18:31:50.880058 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 206/411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:50 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:51.638510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8fe7646f-6cf1-4043-8fa1-617d03b7bd66 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:51.639116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8fe7646f-6cf1-4043-8fa1-617d03b7bd66 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:51.646168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fe7646f-6cf1-4043-8fa1-617d03b7bd66 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:51.646724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fe7646f-6cf1-4043-8fa1-617d03b7bd66 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:51.647685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fe7646f-6cf1-4043-8fa1-617d03b7bd66 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:51.648151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fe7646f-6cf1-4043-8fa1-617d03b7bd66 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:51.759355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4e887d5d-46d8-4c01-8397-54beb0adb006 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:51.760804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4e887d5d-46d8-4c01-8397-54beb0adb006 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:51.769784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e887d5d-46d8-4c01-8397-54beb0adb006 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:51.770567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e887d5d-46d8-4c01-8397-54beb0adb006 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:51.772399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e887d5d-46d8-4c01-8397-54beb0adb006 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:51.772399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e887d5d-46d8-4c01-8397-54beb0adb006 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:51.801998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8fe7646f-6cf1-4043-8fa1-617d03b7bd66 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:51.819010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8fe7646f-6cf1-4043-8fa1-617d03b7bd66 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.184401 Jul 26 18:31:51.820674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 206/412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:51 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:51.901153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3c081661-0b17-4879-8f50-9452f9dfd726 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:51.901669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3c081661-0b17-4879-8f50-9452f9dfd726 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:51.909776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c081661-0b17-4879-8f50-9452f9dfd726 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:51.910223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c081661-0b17-4879-8f50-9452f9dfd726 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:51.911001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c081661-0b17-4879-8f50-9452f9dfd726 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:51.911460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c081661-0b17-4879-8f50-9452f9dfd726 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:51.924242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4e887d5d-46d8-4c01-8397-54beb0adb006 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:51.933040 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4e887d5d-46d8-4c01-8397-54beb0adb006 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1510 microversion: 2.1 time: 0.179570 Jul 26 18:31:51.933660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 207/413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:51 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:52.064380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3c081661-0b17-4879-8f50-9452f9dfd726 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:52.072814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3c081661-0b17-4879-8f50-9452f9dfd726 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.175923 Jul 26 18:31:52.073394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 207/414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:51 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:52.844807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0bafffb8-3348-4858-b170-987818f39a61 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:52.845424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0bafffb8-3348-4858-b170-987818f39a61 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:52.853410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bafffb8-3348-4858-b170-987818f39a61 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:52.853867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bafffb8-3348-4858-b170-987818f39a61 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:52.854654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bafffb8-3348-4858-b170-987818f39a61 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:52.855092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bafffb8-3348-4858-b170-987818f39a61 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:52.960649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1db7edba-887b-44fe-ab15-b25867d340d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:52.962691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1db7edba-887b-44fe-ab15-b25867d340d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:52.970898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1db7edba-887b-44fe-ab15-b25867d340d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:52.971638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1db7edba-887b-44fe-ab15-b25867d340d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:52.972822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1db7edba-887b-44fe-ab15-b25867d340d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:52.973472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1db7edba-887b-44fe-ab15-b25867d340d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:53.041707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0bafffb8-3348-4858-b170-987818f39a61 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:53.050450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0bafffb8-3348-4858-b170-987818f39a61 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.212588 Jul 26 18:31:53.063095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 208/415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:52 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:53.094560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-11877ba1-9c31-4e62-bd01-e9dafb6d98e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:53.095399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-11877ba1-9c31-4e62-bd01-e9dafb6d98e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:53.102671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11877ba1-9c31-4e62-bd01-e9dafb6d98e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:53.103154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11877ba1-9c31-4e62-bd01-e9dafb6d98e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:53.103988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11877ba1-9c31-4e62-bd01-e9dafb6d98e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:53.104366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11877ba1-9c31-4e62-bd01-e9dafb6d98e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:53.131700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1db7edba-887b-44fe-ab15-b25867d340d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:53.140394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1db7edba-887b-44fe-ab15-b25867d340d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1510 microversion: 2.1 time: 0.185966 Jul 26 18:31:53.140983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 208/416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:52 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:53.249077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-11877ba1-9c31-4e62-bd01-e9dafb6d98e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:53.257217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-11877ba1-9c31-4e62-bd01-e9dafb6d98e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1358 microversion: 2.1 time: 0.166490 Jul 26 18:31:53.257798 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 209/417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:53 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:54.083366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3000b0f8-56e2-4dc4-9dc1-e8aa8dd6cd38 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:54.083366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3000b0f8-56e2-4dc4-9dc1-e8aa8dd6cd38 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:54.083366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3000b0f8-56e2-4dc4-9dc1-e8aa8dd6cd38 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:54.083366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3000b0f8-56e2-4dc4-9dc1-e8aa8dd6cd38 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:54.084147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3000b0f8-56e2-4dc4-9dc1-e8aa8dd6cd38 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:54.084147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3000b0f8-56e2-4dc4-9dc1-e8aa8dd6cd38 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:54.162475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-31acfa6f-6703-4acf-827b-199c8e6ee0da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:54.163095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-31acfa6f-6703-4acf-827b-199c8e6ee0da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:54.169646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31acfa6f-6703-4acf-827b-199c8e6ee0da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:54.170062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31acfa6f-6703-4acf-827b-199c8e6ee0da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:54.170855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31acfa6f-6703-4acf-827b-199c8e6ee0da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:54.171320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31acfa6f-6703-4acf-827b-199c8e6ee0da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:54.238012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3000b0f8-56e2-4dc4-9dc1-e8aa8dd6cd38 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:54.246398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3000b0f8-56e2-4dc4-9dc1-e8aa8dd6cd38 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.176699 Jul 26 18:31:54.247457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 209/418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:54 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:54.291831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2181e8c0-859e-4f35-80fc-e9bb1d6040e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:54.292452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2181e8c0-859e-4f35-80fc-e9bb1d6040e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:54.306546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2181e8c0-859e-4f35-80fc-e9bb1d6040e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:54.307333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2181e8c0-859e-4f35-80fc-e9bb1d6040e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:54.309697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2181e8c0-859e-4f35-80fc-e9bb1d6040e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:54.311048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2181e8c0-859e-4f35-80fc-e9bb1d6040e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:54.331930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-31acfa6f-6703-4acf-827b-199c8e6ee0da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:54.346918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-31acfa6f-6703-4acf-827b-199c8e6ee0da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1510 microversion: 2.1 time: 0.188243 Jul 26 18:31:54.347968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 210/419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:54 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:54.460945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2181e8c0-859e-4f35-80fc-e9bb1d6040e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:54.468832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2181e8c0-859e-4f35-80fc-e9bb1d6040e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1549 microversion: 2.1 time: 0.181741 Jul 26 18:31:54.469404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 210/420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1549 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:54.492245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c6f8a537-291d-4dfc-8a86-6b772b6c8665 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:54.493198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c6f8a537-291d-4dfc-8a86-6b772b6c8665 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:54.500433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c6f8a537-291d-4dfc-8a86-6b772b6c8665 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:54.500903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c6f8a537-291d-4dfc-8a86-6b772b6c8665 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:54.501900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c6f8a537-291d-4dfc-8a86-6b772b6c8665 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:54.502413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c6f8a537-291d-4dfc-8a86-6b772b6c8665 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:54.647605 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c6f8a537-291d-4dfc-8a86-6b772b6c8665 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:54.656127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c6f8a537-291d-4dfc-8a86-6b772b6c8665 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1549 microversion: 2.1 time: 0.169578 Jul 26 18:31:54.656723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 211/421] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:54.677918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f844714f-3133-4c54-97d0-35cf96d8c4a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:54.683700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f844714f-3133-4c54-97d0-35cf96d8c4a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:54.684598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f844714f-3133-4c54-97d0-35cf96d8c4a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Searching by: {'deleted': False, 'project_id': 'ce7168da907a4465b0e919131bb0373e'} {{(pid=117996) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 18:31:54.694009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f844714f-3133-4c54-97d0-35cf96d8c4a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:54.694592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f844714f-3133-4c54-97d0-35cf96d8c4a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:54.695448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f844714f-3133-4c54-97d0-35cf96d8c4a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:54.695875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f844714f-3133-4c54-97d0-35cf96d8c4a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:54.806336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.multi_cell_list [None req-f844714f-3133-4c54-97d0-35cf96d8c4a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117996) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 18:31:54.928487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f844714f-3133-4c54-97d0-35cf96d8c4a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.255103 Jul 26 18:31:54.929489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 211/422] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Jul 26 18:31:54 2022] GET /compute/v2.1/servers => generated 342 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:31:54.945673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7050a0fd-da66-49a3-9ede-b4d9ae77adc9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:54.946666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7050a0fd-da66-49a3-9ede-b4d9ae77adc9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:54.960172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7050a0fd-da66-49a3-9ede-b4d9ae77adc9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:54.960629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7050a0fd-da66-49a3-9ede-b4d9ae77adc9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:54.961479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7050a0fd-da66-49a3-9ede-b4d9ae77adc9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:54.961918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7050a0fd-da66-49a3-9ede-b4d9ae77adc9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:55.121725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7050a0fd-da66-49a3-9ede-b4d9ae77adc9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:55.129906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7050a0fd-da66-49a3-9ede-b4d9ae77adc9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1549 microversion: 2.1 time: 0.191235 Jul 26 18:31:55.141750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 212/423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1549 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:55.268736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8dbcac7a-9577-402b-9b9f-0fa6b5e43e21 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:55.269314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8dbcac7a-9577-402b-9b9f-0fa6b5e43e21 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:55.281725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8dbcac7a-9577-402b-9b9f-0fa6b5e43e21 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:55.282294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8dbcac7a-9577-402b-9b9f-0fa6b5e43e21 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:55.282952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8dbcac7a-9577-402b-9b9f-0fa6b5e43e21 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:55.283408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8dbcac7a-9577-402b-9b9f-0fa6b5e43e21 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:55.390195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bb857e17-b81b-496c-9533-97793c0e2b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:55.391471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bb857e17-b81b-496c-9533-97793c0e2b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:55.404851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb857e17-b81b-496c-9533-97793c0e2b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:55.406175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb857e17-b81b-496c-9533-97793c0e2b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:55.408022 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb857e17-b81b-496c-9533-97793c0e2b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:55.408794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb857e17-b81b-496c-9533-97793c0e2b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:55.488113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8dbcac7a-9577-402b-9b9f-0fa6b5e43e21 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:55.502361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8dbcac7a-9577-402b-9b9f-0fa6b5e43e21 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.237429 Jul 26 18:31:55.513999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 212/424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:55 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:55.643446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bb857e17-b81b-496c-9533-97793c0e2b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:55.652702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bb857e17-b81b-496c-9533-97793c0e2b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1510 microversion: 2.1 time: 0.270695 Jul 26 18:31:55.653297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 213/425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:55 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:56.397108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-283d924f-171b-4978-9e17-cfd6a4d0c730 req-22529313-9500-4d46-b88e-57dda09fe175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361dcc32-2e44-44c1-ad49-a30e51076546", "name": "network-vif-plugged", "status": "completed", "tag": "90340188-6b35-473a-9f94-71a5273e2b1d"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:31:56.409410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-283d924f-171b-4978-9e17-cfd6a4d0c730 req-22529313-9500-4d46-b88e-57dda09fe175 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:56.410153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-283d924f-171b-4978-9e17-cfd6a4d0c730 req-22529313-9500-4d46-b88e-57dda09fe175 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:56.422833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-283d924f-171b-4978-9e17-cfd6a4d0c730 req-22529313-9500-4d46-b88e-57dda09fe175 service nova] Creating event network-vif-plugged:90340188-6b35-473a-9f94-71a5273e2b1d for instance 361dcc32-2e44-44c1-ad49-a30e51076546 on hv-cinder-82549 Jul 26 18:31:56.432617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-283d924f-171b-4978-9e17-cfd6a4d0c730 req-22529313-9500-4d46-b88e-57dda09fe175 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043000 Jul 26 18:31:56.433246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 213/426] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:31:56.546963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-742725be-a001-47be-9f34-09e6b3f87363 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:56.548238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-742725be-a001-47be-9f34-09e6b3f87363 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:56.557763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-742725be-a001-47be-9f34-09e6b3f87363 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:56.558463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-742725be-a001-47be-9f34-09e6b3f87363 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:56.559999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-742725be-a001-47be-9f34-09e6b3f87363 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:56.560725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-742725be-a001-47be-9f34-09e6b3f87363 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:56.676719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b7e1dbc4-2911-49a7-a9ae-f59ef2e36cb0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:56.677857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b7e1dbc4-2911-49a7-a9ae-f59ef2e36cb0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:56.693975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7e1dbc4-2911-49a7-a9ae-f59ef2e36cb0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:56.695141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7e1dbc4-2911-49a7-a9ae-f59ef2e36cb0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:56.699425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7e1dbc4-2911-49a7-a9ae-f59ef2e36cb0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:56.700609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7e1dbc4-2911-49a7-a9ae-f59ef2e36cb0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:56.748296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-742725be-a001-47be-9f34-09e6b3f87363 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:56.757674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-742725be-a001-47be-9f34-09e6b3f87363 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.216138 Jul 26 18:31:56.758474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 214/427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:56 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:56.881238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ca2fa8d2-73e7-423b-8488-fbc595138cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d265e72f-c895-4778-91cc-5cbed9088144"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:31:56.883956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ca2fa8d2-73e7-423b-8488-fbc595138cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:56.890271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca2fa8d2-73e7-423b-8488-fbc595138cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:56.890787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca2fa8d2-73e7-423b-8488-fbc595138cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:56.891664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca2fa8d2-73e7-423b-8488-fbc595138cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:56.892224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca2fa8d2-73e7-423b-8488-fbc595138cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:56.922446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b7e1dbc4-2911-49a7-a9ae-f59ef2e36cb0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:56.932027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b7e1dbc4-2911-49a7-a9ae-f59ef2e36cb0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1510 microversion: 2.1 time: 0.260012 Jul 26 18:31:56.933436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 214/428] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:56 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:57.780465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8cd6358b-b3ca-4004-9856-35ec03423c08 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:57.781881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8cd6358b-b3ca-4004-9856-35ec03423c08 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:57.796339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8cd6358b-b3ca-4004-9856-35ec03423c08 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:57.797308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8cd6358b-b3ca-4004-9856-35ec03423c08 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:57.799062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8cd6358b-b3ca-4004-9856-35ec03423c08 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:57.801019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8cd6358b-b3ca-4004-9856-35ec03423c08 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:57.802050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ca2fa8d2-73e7-423b-8488-fbc595138cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "POST /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.924528 Jul 26 18:31:57.802837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 215/429] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Jul 26 18:31:56 2022] POST /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 194 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:31:57.958461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-03520062-d16e-4567-860b-ac9d853c1d5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:57.959475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-03520062-d16e-4567-860b-ac9d853c1d5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:57.966410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03520062-d16e-4567-860b-ac9d853c1d5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:57.967000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03520062-d16e-4567-860b-ac9d853c1d5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:57.967899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03520062-d16e-4567-860b-ac9d853c1d5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:57.968452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03520062-d16e-4567-860b-ac9d853c1d5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:57.986290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:58.055756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8cd6358b-b3ca-4004-9856-35ec03423c08 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:58.066194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8cd6358b-b3ca-4004-9856-35ec03423c08 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.289909 Jul 26 18:31:58.066675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 215/430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:57 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:58.142518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-03520062-d16e-4567-860b-ac9d853c1d5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:58.153130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-03520062-d16e-4567-860b-ac9d853c1d5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1516 microversion: 2.1 time: 0.202456 Jul 26 18:31:58.153724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 216/431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:57 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1516 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:31:59.093912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9ae68006-049e-4e3b-9666-5a422c34d3e0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:31:59.095131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9ae68006-049e-4e3b-9666-5a422c34d3e0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:31:59.104439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ae68006-049e-4e3b-9666-5a422c34d3e0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:59.104888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ae68006-049e-4e3b-9666-5a422c34d3e0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:59.105692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ae68006-049e-4e3b-9666-5a422c34d3e0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:31:59.106132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ae68006-049e-4e3b-9666-5a422c34d3e0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:31:59.278431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9ae68006-049e-4e3b-9666-5a422c34d3e0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:31:59.282238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:31:59.287413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9ae68006-049e-4e3b-9666-5a422c34d3e0 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1314 microversion: 2.1 time: 0.200904 Jul 26 18:31:59.288047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 216/432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:31:59 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:31:59.720685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-07e89f6d-2e53-4a9f-acad-33cf3c7c8ebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Action: 'create', calling method: .version_select at 0x7f39098f6670>, body: {"keypair": {"name": "tempest-keypair-1413116797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEWbpHiNCqXADYjBydjm3PrjJ7n/Hrt/S3JA/tsBjU3Yj9LNiDcJrUWHIcpM/+YyLiHi4JwiXg0nBUif5Vm7JScKtoXu5AUpL0vMc1CFoIt+SHdebH6b0eAQzPgI/+kJQ=="}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:31:59.740274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-07e89f6d-2e53-4a9f-acad-33cf3c7c8ebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Getting quotas for project e9c0885f4de641028b1e194802620fbc. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:31:59.745317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-07e89f6d-2e53-4a9f-acad-33cf3c7c8ebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Getting quotas for user 43205ac588bc432fb8c9628fba37d445 and project e9c0885f4de641028b1e194802620fbc. Resources: {'key_pairs'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:31:59.759447 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR oslo.messaging._drivers.impl_rabbit [None req-07e89f6d-2e53-4a9f-acad-33cf3c7c8ebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [e80904dd-de1e-4508-99e0-6778e39264d3] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 18:32:00.309359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-846ed586-abc2-406e-a434-71ad5c4a8988 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:00.309982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-846ed586-abc2-406e-a434-71ad5c4a8988 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:00.317558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-846ed586-abc2-406e-a434-71ad5c4a8988 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:00.318098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-846ed586-abc2-406e-a434-71ad5c4a8988 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:00.318856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-846ed586-abc2-406e-a434-71ad5c4a8988 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:00.319315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-846ed586-abc2-406e-a434-71ad5c4a8988 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:00.517826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-846ed586-abc2-406e-a434-71ad5c4a8988 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:00.526755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-846ed586-abc2-406e-a434-71ad5c4a8988 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1497 microversion: 2.1 time: 0.221462 Jul 26 18:32:00.527392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 217/433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:00 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1497 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:00.771328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [None req-07e89f6d-2e53-4a9f-acad-33cf3c7c8ebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [e80904dd-de1e-4508-99e0-6778e39264d3] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 48448. Jul 26 18:32:00.800040 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-07e89f6d-2e53-4a9f-acad-33cf3c7c8ebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.084231 Jul 26 18:32:00.801106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 217/434] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Jul 26 18:31:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:01.154681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a78c47dc-d3e3-4f66-b354-22fbba7de8b8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:01.155213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a78c47dc-d3e3-4f66-b354-22fbba7de8b8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:01.161390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a78c47dc-d3e3-4f66-b354-22fbba7de8b8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:01.161939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a78c47dc-d3e3-4f66-b354-22fbba7de8b8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:01.162856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a78c47dc-d3e3-4f66-b354-22fbba7de8b8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:01.163315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a78c47dc-d3e3-4f66-b354-22fbba7de8b8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:01.190845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a78c47dc-d3e3-4f66-b354-22fbba7de8b8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Going to try to terminate instance {{(pid=117996) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 18:32:01.309236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a78c47dc-d3e3-4f66-b354-22fbba7de8b8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "DELETE /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 204 len: 0 microversion: 2.1 time: 0.157842 Jul 26 18:32:01.310052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 218/435] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 18:32:01 2022] DELETE /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:32:01.325941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b588128f-4384-4d79-a36e-c692d436f3a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:01.326280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b588128f-4384-4d79-a36e-c692d436f3a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:01.334488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b588128f-4384-4d79-a36e-c692d436f3a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:01.335142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b588128f-4384-4d79-a36e-c692d436f3a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:01.335788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b588128f-4384-4d79-a36e-c692d436f3a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:01.336318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b588128f-4384-4d79-a36e-c692d436f3a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:01.561030 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b588128f-4384-4d79-a36e-c692d436f3a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:01.575232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b588128f-4384-4d79-a36e-c692d436f3a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1503 microversion: 2.1 time: 0.253465 Jul 26 18:32:01.575232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 218/436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:01 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:02.364014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-393347356", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d771ab36-6c53-4bf5-afa1-e8b5cc654d65"}], "security_groups": [{"name": "tempest-securitygroup--1515044970"}], "key_name": "tempest-keypair-1413116797", "user_data": "}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:02.479896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.network.neutron [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] validate_networks() for [('d771ab36-6c53-4bf5-afa1-e8b5cc654d65', None, None, None, None, None)] {{(pid=117996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:32:02.589914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a4e1dcab-999c-433c-988a-4e6146534c95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:02.590669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a4e1dcab-999c-433c-988a-4e6146534c95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:02.597352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4e1dcab-999c-433c-988a-4e6146534c95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:02.597753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4e1dcab-999c-433c-988a-4e6146534c95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:02.598726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4e1dcab-999c-433c-988a-4e6146534c95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:02.599263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4e1dcab-999c-433c-988a-4e6146534c95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:02.743036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a4e1dcab-999c-433c-988a-4e6146534c95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:02.753709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a4e1dcab-999c-433c-988a-4e6146534c95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1503 microversion: 2.1 time: 0.167512 Jul 26 18:32:02.754397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 219/437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:02 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:02.873686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Flavor limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:32:02.874125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Image limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:32:02.874583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Flavor pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:32:02.874976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Image pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:32:02.875407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:32:02.885472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:02.885893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:02.886681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:02.887145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:02.906811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Getting quotas for project e9c0885f4de641028b1e194802620fbc. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:32:02.912114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Getting quotas for user 43205ac588bc432fb8c9628fba37d445 and project e9c0885f4de641028b1e194802620fbc. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:32:02.923939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Going to run 1 instances... {{(pid=117996) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:32:02.926200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:32:02.976497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e68c27b3-6e88-4f0e-8638-c3aeef295047 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.619585 Jul 26 18:32:02.977132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 219/438] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:32:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 18:32:02.990500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e546a99c-c5a2-44b9-b55e-db65afafca51 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:02.991211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e546a99c-c5a2-44b9-b55e-db65afafca51 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:03.048284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e546a99c-c5a2-44b9-b55e-db65afafca51 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:03.055351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e546a99c-c5a2-44b9-b55e-db65afafca51 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1245 microversion: 2.1 time: 0.070945 Jul 26 18:32:03.056073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 220/439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:03.777444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1d7c1a94-5b6a-4087-939e-474412f60d95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:03.779414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1d7c1a94-5b6a-4087-939e-474412f60d95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:03.787768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d7c1a94-5b6a-4087-939e-474412f60d95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:03.788692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d7c1a94-5b6a-4087-939e-474412f60d95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:03.790128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d7c1a94-5b6a-4087-939e-474412f60d95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:03.790840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d7c1a94-5b6a-4087-939e-474412f60d95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:03.853578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-f794b259-b68b-461e-8412-63e2c810f71c req-61cdd919-72a9-4d38-a56c-5f9d499217e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361dcc32-2e44-44c1-ad49-a30e51076546", "name": "network-vif-deleted", "tag": "90340188-6b35-473a-9f94-71a5273e2b1d"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:03.865569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-f794b259-b68b-461e-8412-63e2c810f71c req-61cdd919-72a9-4d38-a56c-5f9d499217e1 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:03.866376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-f794b259-b68b-461e-8412-63e2c810f71c req-61cdd919-72a9-4d38-a56c-5f9d499217e1 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:03.875231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1d7c1a94-5b6a-4087-939e-474412f60d95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:03.878630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-f794b259-b68b-461e-8412-63e2c810f71c req-61cdd919-72a9-4d38-a56c-5f9d499217e1 service nova] Creating event network-vif-deleted:90340188-6b35-473a-9f94-71a5273e2b1d for instance 361dcc32-2e44-44c1-ad49-a30e51076546 on hv-cinder-82549 Jul 26 18:32:03.884355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-f794b259-b68b-461e-8412-63e2c810f71c req-61cdd919-72a9-4d38-a56c-5f9d499217e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034806 Jul 26 18:32:03.885074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 221/440] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:03.886391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1d7c1a94-5b6a-4087-939e-474412f60d95 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1461 microversion: 2.1 time: 0.113647 Jul 26 18:32:03.887078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 220/441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:03 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1461 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:04.078106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-101402e7-c37b-47f2-875e-6021c1fd772a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:04.079525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-101402e7-c37b-47f2-875e-6021c1fd772a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:04.086678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-101402e7-c37b-47f2-875e-6021c1fd772a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:04.087191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-101402e7-c37b-47f2-875e-6021c1fd772a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:04.087946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-101402e7-c37b-47f2-875e-6021c1fd772a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:04.088373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-101402e7-c37b-47f2-875e-6021c1fd772a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:04.162964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-101402e7-c37b-47f2-875e-6021c1fd772a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:04.172308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-101402e7-c37b-47f2-875e-6021c1fd772a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1297 microversion: 2.1 time: 0.098536 Jul 26 18:32:04.172893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 222/442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:04 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1297 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:04.909062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-31477471-51bf-4903-961f-aca12e2e0368 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:04.909888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-31477471-51bf-4903-961f-aca12e2e0368 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:04.917015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31477471-51bf-4903-961f-aca12e2e0368 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:04.917456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31477471-51bf-4903-961f-aca12e2e0368 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:04.918219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31477471-51bf-4903-961f-aca12e2e0368 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:04.918625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31477471-51bf-4903-961f-aca12e2e0368 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:04.952493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31477471-51bf-4903-961f-aca12e2e0368 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:04.952830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31477471-51bf-4903-961f-aca12e2e0368 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:04.953273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.objects.instance [None req-31477471-51bf-4903-961f-aca12e2e0368 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lazy-loading 'fault' on Instance uuid 361dcc32-2e44-44c1-ad49-a30e51076546 {{(pid=117996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:32:05.001056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-31477471-51bf-4903-961f-aca12e2e0368 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:05.009435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-31477471-51bf-4903-961f-aca12e2e0368 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 200 len: 1304 microversion: 2.1 time: 0.104346 Jul 26 18:32:05.010002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 221/443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:04 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:05.205130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-98f1bb43-bee1-4c93-9ccd-fcfce747cb70 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:05.206127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-98f1bb43-bee1-4c93-9ccd-fcfce747cb70 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:05.217765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98f1bb43-bee1-4c93-9ccd-fcfce747cb70 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:05.218310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98f1bb43-bee1-4c93-9ccd-fcfce747cb70 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:05.219211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98f1bb43-bee1-4c93-9ccd-fcfce747cb70 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:05.219711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98f1bb43-bee1-4c93-9ccd-fcfce747cb70 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:05.290697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-98f1bb43-bee1-4c93-9ccd-fcfce747cb70 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:05.299048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-98f1bb43-bee1-4c93-9ccd-fcfce747cb70 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1303 microversion: 2.1 time: 0.101004 Jul 26 18:32:05.299824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 223/444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:05 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:06.033545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4ac17765-2f0d-4b12-ad7b-799ebf81276c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:06.034168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4ac17765-2f0d-4b12-ad7b-799ebf81276c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: 361dcc32-2e44-44c1-ad49-a30e51076546] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:06.047057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ac17765-2f0d-4b12-ad7b-799ebf81276c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:06.047616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ac17765-2f0d-4b12-ad7b-799ebf81276c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:06.048430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ac17765-2f0d-4b12-ad7b-799ebf81276c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:06.048864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ac17765-2f0d-4b12-ad7b-799ebf81276c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:06.064106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-4ac17765-2f0d-4b12-ad7b-799ebf81276c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] HTTP exception thrown: Instance 361dcc32-2e44-44c1-ad49-a30e51076546 could not be found. Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4ac17765-2f0d-4b12-ad7b-799ebf81276c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Request method failure captured: Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 HTTP/1.1 Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DLmL6VMqK2H9spc4RV4-aILivadQKeUSf5VadafDvKiibCVYC-jOH7tjolM98BoRfDYspWO25jKbXGwXm2dnbsiG87dc8OqCfqcEqCvk5LLaxv4_Z2h9o1t3eW1B2ObU7BxouLYFI-AiT2ZGc8waScKeBBR1OiMiAHSo_JOSz3dMzo Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 7d2f5ab1f6ad4eba871884ce60ebd64d Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesActionsTest-1845566747 Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 18:32:06.065780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 18:32:06.067263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d2f5ab1f6ad4eba871884ce60ebd64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d2f5ab1f6ad4eba871884ce60ebd64d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d2f5ab1f6ad4eba871884ce60ebd64d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d2f5ab1f6ad4eba871884ce60ebd64d"}]}] Jul 26 18:32:06.067263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesActionsTest-1845566747 Jul 26 18:32:06.067263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 7d2f5ab1f6ad4eba871884ce60ebd64d Jul 26 18:32:06.067263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesActionsTest-1845566747 Jul 26 18:32:06.067263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesActionsTest-1845566747-project Jul 26 18:32:06.067263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 18:32:06.067263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 18:32:06.067263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 710de14924c9488284988508cc003332 Jul 26 18:32:06.067263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesActionsTest-1845566747-project Jul 26 18:32:06.067263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 18:32:06.067263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 361dcc32-2e44-44c1-ad49-a30e51076546 could not be found. Jul 26 18:32:06.067263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '361dcc32-2e44-44c1-ad49-a30e51076546'} Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361dcc32-2e44-44c1-ad49-a30e51076546 could not be found. Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:32:06.068064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361dcc32-2e44-44c1-ad49-a30e51076546 could not be found. Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361dcc32-2e44-44c1-ad49-a30e51076546 could not be found. Jul 26 18:32:06.069172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:32:06.070218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4ac17765-2f0d-4b12-ad7b-799ebf81276c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Returning 404 to user: Instance 361dcc32-2e44-44c1-ad49-a30e51076546 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:32:06.070218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4ac17765-2f0d-4b12-ad7b-799ebf81276c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546" status: 404 len: 111 microversion: 2.1 time: 0.038630 Jul 26 18:32:06.070218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 222/445] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:06 2022] GET /compute/v2.1/servers/361dcc32-2e44-44c1-ad49-a30e51076546 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 18:32:06.180532 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1196006803", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "networks": [{"uuid": "c3a6d545-67b2-478f-9852-5b21f928ad15"}]}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:06.244624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] validate_networks() for [('c3a6d545-67b2-478f-9852-5b21f928ad15', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:32:06.323863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-53e210d2-8a05-47bf-a65a-3704976b5fdb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:06.324785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-53e210d2-8a05-47bf-a65a-3704976b5fdb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:06.326946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:06.334564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53e210d2-8a05-47bf-a65a-3704976b5fdb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:06.335518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53e210d2-8a05-47bf-a65a-3704976b5fdb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:06.336687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53e210d2-8a05-47bf-a65a-3704976b5fdb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:06.337476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53e210d2-8a05-47bf-a65a-3704976b5fdb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:06.551799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-53e210d2-8a05-47bf-a65a-3704976b5fdb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:06.560217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-53e210d2-8a05-47bf-a65a-3704976b5fdb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1371 microversion: 2.1 time: 0.240234 Jul 26 18:32:06.560778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 223/446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:06 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:06.615581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:32:06.616207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:32:06.616736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:32:06.617200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:32:06.617754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:32:06.628420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:06.628809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:06.629580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:06.629998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:06.652072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Getting quotas for project 7d2f5ab1f6ad4eba871884ce60ebd64d. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:32:06.658594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Getting quotas for user 710de14924c9488284988508cc003332 and project 7d2f5ab1f6ad4eba871884ce60ebd64d. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:32:06.672107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:32:06.675985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:32:06.727854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cb0f80da-ee20-4350-a550-b0a149ee38df tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550929 Jul 26 18:32:06.728739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 224/447] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:32:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 18:32:06.740821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e98faa1d-1ce2-48d6-aeee-50840df879cd tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:06.741658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e98faa1d-1ce2-48d6-aeee-50840df879cd tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:06.818717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e98faa1d-1ce2-48d6-aeee-50840df879cd tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:06.830336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e98faa1d-1ce2-48d6-aeee-50840df879cd tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1214 microversion: 2.1 time: 0.094105 Jul 26 18:32:06.831934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 224/448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:06 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:06.930508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-21e1426c-0729-4b95-8029-963d237b5a3c req-ccc5d5ab-c179-4319-a0cd-972d43b44c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26b67fc-cc0a-41a7-8568-17f2eed10fb2", "tag": "b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:06.943229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-21e1426c-0729-4b95-8029-963d237b5a3c req-ccc5d5ab-c179-4319-a0cd-972d43b44c81 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:06.943657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-21e1426c-0729-4b95-8029-963d237b5a3c req-ccc5d5ab-c179-4319-a0cd-972d43b44c81 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:06.955432 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-21e1426c-0729-4b95-8029-963d237b5a3c req-ccc5d5ab-c179-4319-a0cd-972d43b44c81 service nova] Creating event network-changed:b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2 for instance e26b67fc-cc0a-41a7-8568-17f2eed10fb2 on hv-cinder-82549 Jul 26 18:32:06.961246 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-21e1426c-0729-4b95-8029-963d237b5a3c req-ccc5d5ab-c179-4319-a0cd-972d43b44c81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035169 Jul 26 18:32:06.961565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 225/449] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:32:07.581784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-58074fea-45bf-4946-9002-844918919973 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:07.583202 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-58074fea-45bf-4946-9002-844918919973 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:07.590159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-58074fea-45bf-4946-9002-844918919973 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:07.590602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-58074fea-45bf-4946-9002-844918919973 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:07.591400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-58074fea-45bf-4946-9002-844918919973 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:07.591828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-58074fea-45bf-4946-9002-844918919973 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:07.664990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-80b90398-0084-43fd-adfd-dd23dad1300f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:07.666583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-80b90398-0084-43fd-adfd-dd23dad1300f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:07.673829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80b90398-0084-43fd-adfd-dd23dad1300f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:07.674273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80b90398-0084-43fd-adfd-dd23dad1300f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:07.675047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80b90398-0084-43fd-adfd-dd23dad1300f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:07.675483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80b90398-0084-43fd-adfd-dd23dad1300f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:07.751493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-58074fea-45bf-4946-9002-844918919973 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:07.759405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-58074fea-45bf-4946-9002-844918919973 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1371 microversion: 2.1 time: 0.181736 Jul 26 18:32:07.759975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 225/450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:07 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:07.822029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80b90398-0084-43fd-adfd-dd23dad1300f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:07.831511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-80b90398-0084-43fd-adfd-dd23dad1300f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1595 microversion: 2.1 time: 0.175439 Jul 26 18:32:07.832093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 226/451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:07 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1595 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:07.851967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0eb36b71-707e-466b-9525-82c1b46c92a7 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:07.852648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0eb36b71-707e-466b-9525-82c1b46c92a7 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:07.860054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0eb36b71-707e-466b-9525-82c1b46c92a7 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:07.860505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0eb36b71-707e-466b-9525-82c1b46c92a7 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:07.861609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0eb36b71-707e-466b-9525-82c1b46c92a7 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:07.862449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0eb36b71-707e-466b-9525-82c1b46c92a7 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:07.984580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0eb36b71-707e-466b-9525-82c1b46c92a7 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:07.993389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0eb36b71-707e-466b-9525-82c1b46c92a7 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1266 microversion: 2.1 time: 0.145355 Jul 26 18:32:07.996974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 226/452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:07 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:08.781759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5210cc06-ea67-40e2-909b-ceeaf9e49959 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:08.782124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5210cc06-ea67-40e2-909b-ceeaf9e49959 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:08.796131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5210cc06-ea67-40e2-909b-ceeaf9e49959 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:08.796603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5210cc06-ea67-40e2-909b-ceeaf9e49959 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:08.797675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5210cc06-ea67-40e2-909b-ceeaf9e49959 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:08.798145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5210cc06-ea67-40e2-909b-ceeaf9e49959 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:09.015291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5963a10a-33e2-4763-b8b7-258fdc0af645 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:09.016655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5963a10a-33e2-4763-b8b7-258fdc0af645 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:09.024627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5963a10a-33e2-4763-b8b7-258fdc0af645 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:09.025191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5963a10a-33e2-4763-b8b7-258fdc0af645 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:09.026086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5963a10a-33e2-4763-b8b7-258fdc0af645 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:09.026583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5963a10a-33e2-4763-b8b7-258fdc0af645 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:09.092729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5963a10a-33e2-4763-b8b7-258fdc0af645 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:09.101141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5963a10a-33e2-4763-b8b7-258fdc0af645 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1272 microversion: 2.1 time: 0.090727 Jul 26 18:32:09.101850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 227/453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:09 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:09.145578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5210cc06-ea67-40e2-909b-ceeaf9e49959 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:09.153902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5210cc06-ea67-40e2-909b-ceeaf9e49959 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1371 microversion: 2.1 time: 0.376614 Jul 26 18:32:09.154466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 227/454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1371 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:10.122162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1b55c445-aedf-404d-a2cd-5a1d7b1d1f12 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:10.122800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1b55c445-aedf-404d-a2cd-5a1d7b1d1f12 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:10.129693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b55c445-aedf-404d-a2cd-5a1d7b1d1f12 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:10.130176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b55c445-aedf-404d-a2cd-5a1d7b1d1f12 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:10.130952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b55c445-aedf-404d-a2cd-5a1d7b1d1f12 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:10.131422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b55c445-aedf-404d-a2cd-5a1d7b1d1f12 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:10.175647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-83c2ae81-c07c-475c-8591-5efb4bfe16e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:10.177792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-83c2ae81-c07c-475c-8591-5efb4bfe16e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:10.184651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83c2ae81-c07c-475c-8591-5efb4bfe16e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:10.185110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83c2ae81-c07c-475c-8591-5efb4bfe16e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:10.185866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83c2ae81-c07c-475c-8591-5efb4bfe16e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:10.186289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83c2ae81-c07c-475c-8591-5efb4bfe16e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:10.268676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1b55c445-aedf-404d-a2cd-5a1d7b1d1f12 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:10.277319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1b55c445-aedf-404d-a2cd-5a1d7b1d1f12 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1314 microversion: 2.1 time: 0.159054 Jul 26 18:32:10.277916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 228/455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:10 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:10.401747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-83c2ae81-c07c-475c-8591-5efb4bfe16e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:10.409814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-83c2ae81-c07c-475c-8591-5efb4bfe16e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1371 microversion: 2.1 time: 0.238150 Jul 26 18:32:10.410366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 228/456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:10 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:10.633685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-0e49db81-a629-4034-9481-9331ecfdee82 req-d8f9bc15-af5e-43c3-bc35-40cb657ce349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9982c007-1157-4c63-93e8-3733712f06e0", "tag": "4e31fc31-19bc-4733-a6d9-9e1a584d4781"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:10.643743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-0e49db81-a629-4034-9481-9331ecfdee82 req-d8f9bc15-af5e-43c3-bc35-40cb657ce349 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:10.644296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-0e49db81-a629-4034-9481-9331ecfdee82 req-d8f9bc15-af5e-43c3-bc35-40cb657ce349 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:10.659600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-0e49db81-a629-4034-9481-9331ecfdee82 req-d8f9bc15-af5e-43c3-bc35-40cb657ce349 service nova] Creating event network-changed:4e31fc31-19bc-4733-a6d9-9e1a584d4781 for instance 9982c007-1157-4c63-93e8-3733712f06e0 on hv-cinder-82549 Jul 26 18:32:10.665060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-0e49db81-a629-4034-9481-9331ecfdee82 req-d8f9bc15-af5e-43c3-bc35-40cb657ce349 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035087 Jul 26 18:32:10.665672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 229/457] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:32:11.298648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fd5e7775-8b1c-4aeb-b67d-fb16f4f04c19 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:11.299964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fd5e7775-8b1c-4aeb-b67d-fb16f4f04c19 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:11.307496 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd5e7775-8b1c-4aeb-b67d-fb16f4f04c19 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:11.307992 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd5e7775-8b1c-4aeb-b67d-fb16f4f04c19 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:11.308958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd5e7775-8b1c-4aeb-b67d-fb16f4f04c19 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:11.309701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd5e7775-8b1c-4aeb-b67d-fb16f4f04c19 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:11.431722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-61534808-a36a-457f-b899-72f682ee5d1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:11.433113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-61534808-a36a-457f-b899-72f682ee5d1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:11.443980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61534808-a36a-457f-b899-72f682ee5d1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:11.444767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61534808-a36a-457f-b899-72f682ee5d1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:11.446864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61534808-a36a-457f-b899-72f682ee5d1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:11.447657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61534808-a36a-457f-b899-72f682ee5d1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:11.465791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fd5e7775-8b1c-4aeb-b67d-fb16f4f04c19 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:11.475862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fd5e7775-8b1c-4aeb-b67d-fb16f4f04c19 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1314 microversion: 2.1 time: 0.180796 Jul 26 18:32:11.476784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 229/458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:11 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:11.667512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-61534808-a36a-457f-b899-72f682ee5d1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:11.679097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-61534808-a36a-457f-b899-72f682ee5d1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1371 microversion: 2.1 time: 0.251482 Jul 26 18:32:11.693142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 230/459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:12.279561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9a2d652a-7b82-4f7d-98e3-3582e0932fc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2014500368"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:12.280109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9a2d652a-7b82-4f7d-98e3-3582e0932fc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:12.290477 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a2d652a-7b82-4f7d-98e3-3582e0932fc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:12.291228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a2d652a-7b82-4f7d-98e3-3582e0932fc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:12.292700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a2d652a-7b82-4f7d-98e3-3582e0932fc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:12.293150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a2d652a-7b82-4f7d-98e3-3582e0932fc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:12.497466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9d2583a3-ead9-4f1b-9674-cdec827f3986 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:12.498074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9d2583a3-ead9-4f1b-9674-cdec827f3986 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:12.505607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d2583a3-ead9-4f1b-9674-cdec827f3986 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:12.506050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d2583a3-ead9-4f1b-9674-cdec827f3986 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:12.507000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d2583a3-ead9-4f1b-9674-cdec827f3986 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:12.507616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d2583a3-ead9-4f1b-9674-cdec827f3986 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:12.521512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.network.security_group_api [None req-9a2d652a-7b82-4f7d-98e3-3582e0932fc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Adding security group ae472c22-c396-4a84-9eca-8215ad72adca to port 4e31fc31-19bc-4733-a6d9-9e1a584d4781 Jul 26 18:32:12.652583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9d2583a3-ead9-4f1b-9674-cdec827f3986 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:12.660508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9d2583a3-ead9-4f1b-9674-cdec827f3986 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1314 microversion: 2.1 time: 0.166955 Jul 26 18:32:12.661199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 231/460] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:12 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:12.684591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-3264b21a-3734-413a-bdb4-b7453d25e8d5 req-d4f3245d-f06a-42e2-b76d-ac6b560b90d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bffe40dc-5489-4292-b5b3-78bae13951d2", "tag": "d9ab03be-5655-494b-8c5d-a40ee4bf0107"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:12.694752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-3264b21a-3734-413a-bdb4-b7453d25e8d5 req-d4f3245d-f06a-42e2-b76d-ac6b560b90d7 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:12.695224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-3264b21a-3734-413a-bdb4-b7453d25e8d5 req-d4f3245d-f06a-42e2-b76d-ac6b560b90d7 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:12.707595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-3264b21a-3734-413a-bdb4-b7453d25e8d5 req-d4f3245d-f06a-42e2-b76d-ac6b560b90d7 service nova] Creating event network-changed:d9ab03be-5655-494b-8c5d-a40ee4bf0107 for instance bffe40dc-5489-4292-b5b3-78bae13951d2 on hv-cinder-82549 Jul 26 18:32:12.712787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-3264b21a-3734-413a-bdb4-b7453d25e8d5 req-d4f3245d-f06a-42e2-b76d-ac6b560b90d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032175 Jul 26 18:32:12.713723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 232/461] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:12.718874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5869c17b-1972-4076-8cb8-e58121510e24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:12.719622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5869c17b-1972-4076-8cb8-e58121510e24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:12.726616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5869c17b-1972-4076-8cb8-e58121510e24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:12.727127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5869c17b-1972-4076-8cb8-e58121510e24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:12.727864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5869c17b-1972-4076-8cb8-e58121510e24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:12.728300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5869c17b-1972-4076-8cb8-e58121510e24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:12.865937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5869c17b-1972-4076-8cb8-e58121510e24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:12.873827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5869c17b-1972-4076-8cb8-e58121510e24 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1371 microversion: 2.1 time: 0.158905 Jul 26 18:32:12.874365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 233/462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:12 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:13.173847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9a2d652a-7b82-4f7d-98e3-3582e0932fc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "POST /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/action" status: 202 len: 0 microversion: 2.1 time: 0.900426 Jul 26 18:32:13.174821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 230/463] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:32:12 2022] POST /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/action => generated 0 bytes in 902 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:32:13.183642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a9db2a46-b40b-48ad-95b4-081a5fdb83a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:13.184253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a9db2a46-b40b-48ad-95b4-081a5fdb83a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:13.189754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=4 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:13.191994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9db2a46-b40b-48ad-95b4-081a5fdb83a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:13.192512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9db2a46-b40b-48ad-95b4-081a5fdb83a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:13.193347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9db2a46-b40b-48ad-95b4-081a5fdb83a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:13.193772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9db2a46-b40b-48ad-95b4-081a5fdb83a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:13.356487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a9db2a46-b40b-48ad-95b4-081a5fdb83a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:13.366064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a9db2a46-b40b-48ad-95b4-081a5fdb83a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1761 microversion: 2.1 time: 0.187047 Jul 26 18:32:13.367998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 234/464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1761 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:13.686331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e3952953-c8b4-4dc4-8cc8-ae4b30cb07d8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:13.686914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e3952953-c8b4-4dc4-8cc8-ae4b30cb07d8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:13.695185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3952953-c8b4-4dc4-8cc8-ae4b30cb07d8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:13.695508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3952953-c8b4-4dc4-8cc8-ae4b30cb07d8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:13.696261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3952953-c8b4-4dc4-8cc8-ae4b30cb07d8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:13.696689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3952953-c8b4-4dc4-8cc8-ae4b30cb07d8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:13.834445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e3952953-c8b4-4dc4-8cc8-ae4b30cb07d8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:13.845721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e3952953-c8b4-4dc4-8cc8-ae4b30cb07d8 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1314 microversion: 2.1 time: 0.165999 Jul 26 18:32:13.846603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 231/465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:13 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:13.897230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-61f002db-7930-43b0-8ba7-63cb921666d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:13.898422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-61f002db-7930-43b0-8ba7-63cb921666d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:13.905944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61f002db-7930-43b0-8ba7-63cb921666d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:13.906383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61f002db-7930-43b0-8ba7-63cb921666d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:13.907172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61f002db-7930-43b0-8ba7-63cb921666d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:13.907594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61f002db-7930-43b0-8ba7-63cb921666d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:13.912838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:14.043074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-61f002db-7930-43b0-8ba7-63cb921666d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:14.050702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-61f002db-7930-43b0-8ba7-63cb921666d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1371 microversion: 2.1 time: 0.159277 Jul 26 18:32:14.051299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 235/466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:13 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:14.739061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-47c5c840-e2ff-4590-ad9b-baa285858c18 req-c92ae380-6a4c-441a-8bee-f265f471f87f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9982c007-1157-4c63-93e8-3733712f06e0", "tag": "4e31fc31-19bc-4733-a6d9-9e1a584d4781"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:14.752648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-47c5c840-e2ff-4590-ad9b-baa285858c18 req-c92ae380-6a4c-441a-8bee-f265f471f87f service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:14.753091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-47c5c840-e2ff-4590-ad9b-baa285858c18 req-c92ae380-6a4c-441a-8bee-f265f471f87f service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:14.770749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-47c5c840-e2ff-4590-ad9b-baa285858c18 req-c92ae380-6a4c-441a-8bee-f265f471f87f service nova] Creating event network-changed:4e31fc31-19bc-4733-a6d9-9e1a584d4781 for instance 9982c007-1157-4c63-93e8-3733712f06e0 on hv-cinder-82549 Jul 26 18:32:14.782704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-47c5c840-e2ff-4590-ad9b-baa285858c18 req-c92ae380-6a4c-441a-8bee-f265f471f87f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047329 Jul 26 18:32:14.783766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 232/467] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:14.868612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-09c8e124-d6c2-44ab-8114-11aa38dffda5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:14.869213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-09c8e124-d6c2-44ab-8114-11aa38dffda5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:14.875499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09c8e124-d6c2-44ab-8114-11aa38dffda5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:14.875943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09c8e124-d6c2-44ab-8114-11aa38dffda5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:14.876709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09c8e124-d6c2-44ab-8114-11aa38dffda5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:14.877130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09c8e124-d6c2-44ab-8114-11aa38dffda5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:15.032174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-09c8e124-d6c2-44ab-8114-11aa38dffda5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:15.040014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-09c8e124-d6c2-44ab-8114-11aa38dffda5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1314 microversion: 2.1 time: 0.175537 Jul 26 18:32:15.040588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 236/468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:14 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:15.075330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d6adbcc5-eee8-493b-8d8c-eadc896ece12 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:15.076026 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d6adbcc5-eee8-493b-8d8c-eadc896ece12 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:15.085398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6adbcc5-eee8-493b-8d8c-eadc896ece12 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:15.085853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6adbcc5-eee8-493b-8d8c-eadc896ece12 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:15.086654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6adbcc5-eee8-493b-8d8c-eadc896ece12 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:15.087127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6adbcc5-eee8-493b-8d8c-eadc896ece12 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:15.233444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d6adbcc5-eee8-493b-8d8c-eadc896ece12 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:15.245088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d6adbcc5-eee8-493b-8d8c-eadc896ece12 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1371 microversion: 2.1 time: 0.176193 Jul 26 18:32:15.246021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 233/469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:15.896078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-15c31c7e-a752-4c56-b4bc-9edf3fb6ea20 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:15.896565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-15c31c7e-a752-4c56-b4bc-9edf3fb6ea20 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:15.903190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15c31c7e-a752-4c56-b4bc-9edf3fb6ea20 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:15.903635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15c31c7e-a752-4c56-b4bc-9edf3fb6ea20 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:15.904671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15c31c7e-a752-4c56-b4bc-9edf3fb6ea20 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:15.905399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15c31c7e-a752-4c56-b4bc-9edf3fb6ea20 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:15.939471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-15c31c7e-a752-4c56-b4bc-9edf3fb6ea20 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/ips" status: 200 len: 143 microversion: 2.1 time: 0.047361 Jul 26 18:32:15.940058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 237/470] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Jul 26 18:32:15 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/ips => generated 143 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:16.061823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-edd6961b-b9ab-4b4d-b663-57476960fa90 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:16.062383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-edd6961b-b9ab-4b4d-b663-57476960fa90 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:16.069501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-edd6961b-b9ab-4b4d-b663-57476960fa90 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:16.069941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-edd6961b-b9ab-4b4d-b663-57476960fa90 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:16.070761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-edd6961b-b9ab-4b4d-b663-57476960fa90 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:16.071134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-edd6961b-b9ab-4b4d-b663-57476960fa90 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:16.226743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-edd6961b-b9ab-4b4d-b663-57476960fa90 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:16.234720 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-edd6961b-b9ab-4b4d-b663-57476960fa90 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1314 microversion: 2.1 time: 0.176836 Jul 26 18:32:16.235359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 234/471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:16 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:16.272601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cb9b80fb-4170-4ff0-92e8-1e7d88598b72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:16.273532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cb9b80fb-4170-4ff0-92e8-1e7d88598b72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:16.281298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb9b80fb-4170-4ff0-92e8-1e7d88598b72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:16.281745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb9b80fb-4170-4ff0-92e8-1e7d88598b72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:16.282512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb9b80fb-4170-4ff0-92e8-1e7d88598b72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:16.282943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb9b80fb-4170-4ff0-92e8-1e7d88598b72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:16.431164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cb9b80fb-4170-4ff0-92e8-1e7d88598b72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:16.439365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cb9b80fb-4170-4ff0-92e8-1e7d88598b72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1371 microversion: 2.1 time: 0.172439 Jul 26 18:32:16.439920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 238/472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:16.796871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-937d1fb3-28f9-45ef-8080-96bd55850a35 req-ef9a8ddf-2cf1-4e20-a146-682d4e28ebf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26b67fc-cc0a-41a7-8568-17f2eed10fb2", "name": "network-vif-plugged", "status": "completed", "tag": "b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:16.803330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:16.804330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=12 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:16.808790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-937d1fb3-28f9-45ef-8080-96bd55850a35 req-ef9a8ddf-2cf1-4e20-a146-682d4e28ebf4 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:16.809215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-937d1fb3-28f9-45ef-8080-96bd55850a35 req-ef9a8ddf-2cf1-4e20-a146-682d4e28ebf4 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:16.821383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-937d1fb3-28f9-45ef-8080-96bd55850a35 req-ef9a8ddf-2cf1-4e20-a146-682d4e28ebf4 service nova] Creating event network-vif-plugged:b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2 for instance e26b67fc-cc0a-41a7-8568-17f2eed10fb2 on hv-cinder-82549 Jul 26 18:32:16.826258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-937d1fb3-28f9-45ef-8080-96bd55850a35 req-ef9a8ddf-2cf1-4e20-a146-682d4e28ebf4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Jul 26 18:32:16.826866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 235/473] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:17.262426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-748dee41-fd3a-4fb2-9897-132eb6d695e5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:17.263383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-748dee41-fd3a-4fb2-9897-132eb6d695e5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:17.266099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=8 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:17.274058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-748dee41-fd3a-4fb2-9897-132eb6d695e5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:17.275155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-748dee41-fd3a-4fb2-9897-132eb6d695e5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:17.275973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-748dee41-fd3a-4fb2-9897-132eb6d695e5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:17.276399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-748dee41-fd3a-4fb2-9897-132eb6d695e5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:17.430355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-748dee41-fd3a-4fb2-9897-132eb6d695e5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:17.438841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-748dee41-fd3a-4fb2-9897-132eb6d695e5 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1314 microversion: 2.1 time: 0.182942 Jul 26 18:32:17.445999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 239/474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:17 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:17.464151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d619ab67-74b1-4d86-940c-fa107f8138de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:17.464830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d619ab67-74b1-4d86-940c-fa107f8138de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:17.473390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d619ab67-74b1-4d86-940c-fa107f8138de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:17.474130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d619ab67-74b1-4d86-940c-fa107f8138de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:17.474900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d619ab67-74b1-4d86-940c-fa107f8138de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:17.475540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d619ab67-74b1-4d86-940c-fa107f8138de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:17.622042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d619ab67-74b1-4d86-940c-fa107f8138de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:17.630294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d619ab67-74b1-4d86-940c-fa107f8138de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1371 microversion: 2.1 time: 0.172456 Jul 26 18:32:17.631432 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 236/475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:17 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:18.463922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4efc5f4e-5408-4933-9a6e-c140fc1ae00a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:18.465741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4efc5f4e-5408-4933-9a6e-c140fc1ae00a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:18.473609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4efc5f4e-5408-4933-9a6e-c140fc1ae00a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:18.474207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4efc5f4e-5408-4933-9a6e-c140fc1ae00a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:18.475262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4efc5f4e-5408-4933-9a6e-c140fc1ae00a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:18.475709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4efc5f4e-5408-4933-9a6e-c140fc1ae00a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:18.658319 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2754bf6c-5714-4a30-baf4-8f3159024d54 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:18.660420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2754bf6c-5714-4a30-baf4-8f3159024d54 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:18.669091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:18.673387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2754bf6c-5714-4a30-baf4-8f3159024d54 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:18.674004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2754bf6c-5714-4a30-baf4-8f3159024d54 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:18.675823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2754bf6c-5714-4a30-baf4-8f3159024d54 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:18.676435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2754bf6c-5714-4a30-baf4-8f3159024d54 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:18.838647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4efc5f4e-5408-4933-9a6e-c140fc1ae00a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:18.859011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4efc5f4e-5408-4933-9a6e-c140fc1ae00a tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1314 microversion: 2.1 time: 0.395942 Jul 26 18:32:18.861845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 240/476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:18 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:18.867886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9abe048c-eec1-4687-a85b-57a2332769fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc626daa-443b-4762-b1a3-a60c2545fc1b"}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:18.871173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9abe048c-eec1-4687-a85b-57a2332769fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:18.889930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9abe048c-eec1-4687-a85b-57a2332769fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:18.890756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9abe048c-eec1-4687-a85b-57a2332769fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:18.891639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9abe048c-eec1-4687-a85b-57a2332769fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:18.892216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9abe048c-eec1-4687-a85b-57a2332769fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:19.264653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2754bf6c-5714-4a30-baf4-8f3159024d54 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:19.275561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2754bf6c-5714-4a30-baf4-8f3159024d54 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1371 microversion: 2.1 time: 0.624791 Jul 26 18:32:19.285853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 237/477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1371 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:19.342898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9abe048c-eec1-4687-a85b-57a2332769fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "POST /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.479597 Jul 26 18:32:19.343699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 241/478] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Jul 26 18:32:18 2022] POST /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:19.881290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4ff09d98-cb40-4415-ad81-7e96e202ae18 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:19.882322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4ff09d98-cb40-4415-ad81-7e96e202ae18 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:19.891353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ff09d98-cb40-4415-ad81-7e96e202ae18 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:19.891797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ff09d98-cb40-4415-ad81-7e96e202ae18 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:19.892583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ff09d98-cb40-4415-ad81-7e96e202ae18 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:19.893011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ff09d98-cb40-4415-ad81-7e96e202ae18 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:20.105271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4ff09d98-cb40-4415-ad81-7e96e202ae18 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:20.107533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:20.116243 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4ff09d98-cb40-4415-ad81-7e96e202ae18 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1314 microversion: 2.1 time: 0.238801 Jul 26 18:32:20.116838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 238/479] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:19 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:20.298567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a8cb9605-d28f-41ec-b366-4282e8afe552 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:20.299278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a8cb9605-d28f-41ec-b366-4282e8afe552 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:20.313066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8cb9605-d28f-41ec-b366-4282e8afe552 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:20.313520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8cb9605-d28f-41ec-b366-4282e8afe552 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:20.314318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8cb9605-d28f-41ec-b366-4282e8afe552 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:20.314769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8cb9605-d28f-41ec-b366-4282e8afe552 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:20.453418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a8cb9605-d28f-41ec-b366-4282e8afe552 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:20.461110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a8cb9605-d28f-41ec-b366-4282e8afe552 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1371 microversion: 2.1 time: 0.167660 Jul 26 18:32:20.461658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 242/480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:20 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:21.138254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2e7d9ae3-d273-4201-b0c3-78370ad23d4f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:21.138991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2e7d9ae3-d273-4201-b0c3-78370ad23d4f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:21.145767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e7d9ae3-d273-4201-b0c3-78370ad23d4f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:21.146203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e7d9ae3-d273-4201-b0c3-78370ad23d4f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:21.147203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e7d9ae3-d273-4201-b0c3-78370ad23d4f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:21.147629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e7d9ae3-d273-4201-b0c3-78370ad23d4f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:21.148330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-443e9f5d-0f78-466c-8699-de3ed35b1e0d req-11dbbf1c-cb75-4249-a216-40e33007d524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bffe40dc-5489-4292-b5b3-78bae13951d2", "name": "network-vif-plugged", "status": "completed", "tag": "d9ab03be-5655-494b-8c5d-a40ee4bf0107"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:21.161340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-443e9f5d-0f78-466c-8699-de3ed35b1e0d req-11dbbf1c-cb75-4249-a216-40e33007d524 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:21.161885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-443e9f5d-0f78-466c-8699-de3ed35b1e0d req-11dbbf1c-cb75-4249-a216-40e33007d524 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:21.180297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-443e9f5d-0f78-466c-8699-de3ed35b1e0d req-11dbbf1c-cb75-4249-a216-40e33007d524 service nova] Creating event network-vif-plugged:d9ab03be-5655-494b-8c5d-a40ee4bf0107 for instance bffe40dc-5489-4292-b5b3-78bae13951d2 on hv-cinder-82549 Jul 26 18:32:21.185870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-443e9f5d-0f78-466c-8699-de3ed35b1e0d req-11dbbf1c-cb75-4249-a216-40e33007d524 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041611 Jul 26 18:32:21.187087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 243/481] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:21.317269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2e7d9ae3-d273-4201-b0c3-78370ad23d4f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:21.327008 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2e7d9ae3-d273-4201-b0c3-78370ad23d4f tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1314 microversion: 2.1 time: 0.194087 Jul 26 18:32:21.327810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 239/482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:21 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:21.482514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2786cff5-a30f-4a7a-ae01-078bcd8d690d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:21.483244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2786cff5-a30f-4a7a-ae01-078bcd8d690d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:21.490458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2786cff5-a30f-4a7a-ae01-078bcd8d690d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:21.490828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2786cff5-a30f-4a7a-ae01-078bcd8d690d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:21.491688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2786cff5-a30f-4a7a-ae01-078bcd8d690d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:21.492113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2786cff5-a30f-4a7a-ae01-078bcd8d690d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:21.643050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2786cff5-a30f-4a7a-ae01-078bcd8d690d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:21.651948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2786cff5-a30f-4a7a-ae01-078bcd8d690d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1371 microversion: 2.1 time: 0.173658 Jul 26 18:32:21.652709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 244/483] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:22.351626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4aacce03-edd4-4bcc-87cc-e6be414d7bee tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:22.352239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4aacce03-edd4-4bcc-87cc-e6be414d7bee tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:22.359217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4aacce03-edd4-4bcc-87cc-e6be414d7bee tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:22.359656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4aacce03-edd4-4bcc-87cc-e6be414d7bee tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:22.360409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4aacce03-edd4-4bcc-87cc-e6be414d7bee tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:22.360858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4aacce03-edd4-4bcc-87cc-e6be414d7bee tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:22.408820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2a6d76f9-f014-4fc8-acbd-ad74f412f09b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:22.409299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2a6d76f9-f014-4fc8-acbd-ad74f412f09b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:22.416545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a6d76f9-f014-4fc8-acbd-ad74f412f09b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:22.416973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a6d76f9-f014-4fc8-acbd-ad74f412f09b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:22.417744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a6d76f9-f014-4fc8-acbd-ad74f412f09b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:22.418172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a6d76f9-f014-4fc8-acbd-ad74f412f09b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:22.445113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2a6d76f9-f014-4fc8-acbd-ad74f412f09b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/ips" status: 200 len: 151 microversion: 2.20 time: 0.040334 Jul 26 18:32:22.446011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 245/484] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Jul 26 18:32:22 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:32:22.525140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4aacce03-edd4-4bcc-87cc-e6be414d7bee tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:22.541913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4aacce03-edd4-4bcc-87cc-e6be414d7bee tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1314 microversion: 2.1 time: 0.194243 Jul 26 18:32:22.555814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 240/485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:22 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:22.675184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b28a02c0-8dbd-4811-8996-2eccd428fae9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:22.676322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b28a02c0-8dbd-4811-8996-2eccd428fae9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:22.687169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b28a02c0-8dbd-4811-8996-2eccd428fae9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:22.687896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b28a02c0-8dbd-4811-8996-2eccd428fae9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:22.689281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b28a02c0-8dbd-4811-8996-2eccd428fae9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:22.689825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b28a02c0-8dbd-4811-8996-2eccd428fae9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:22.850547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b28a02c0-8dbd-4811-8996-2eccd428fae9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:22.858759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b28a02c0-8dbd-4811-8996-2eccd428fae9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1565 microversion: 2.1 time: 0.188447 Jul 26 18:32:22.859532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 246/486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:22.880024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b888b36e-f73e-4813-844d-2d39683c532c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:22.880535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b888b36e-f73e-4813-844d-2d39683c532c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:22.887098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b888b36e-f73e-4813-844d-2d39683c532c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:22.887546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b888b36e-f73e-4813-844d-2d39683c532c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:22.888308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b888b36e-f73e-4813-844d-2d39683c532c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:22.888738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b888b36e-f73e-4813-844d-2d39683c532c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:22.974466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b888b36e-f73e-4813-844d-2d39683c532c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098393 Jul 26 18:32:22.975092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 241/487] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Jul 26 18:32:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:23.564515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f57f7487-9528-48a6-a845-592fea88b596 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:23.565081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f57f7487-9528-48a6-a845-592fea88b596 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:23.572761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f57f7487-9528-48a6-a845-592fea88b596 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:23.573480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f57f7487-9528-48a6-a845-592fea88b596 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:23.574429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f57f7487-9528-48a6-a845-592fea88b596 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:23.575012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f57f7487-9528-48a6-a845-592fea88b596 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:23.722129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f57f7487-9528-48a6-a845-592fea88b596 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:23.730894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f57f7487-9528-48a6-a845-592fea88b596 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1314 microversion: 2.1 time: 0.170156 Jul 26 18:32:23.731549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 247/488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:23 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:23.980359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-b13c588f-c0d0-42a7-b597-f9c4b32abf7c req-7826e147-c23f-4f2f-a7a2-400bd4fe3b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26b67fc-cc0a-41a7-8568-17f2eed10fb2", "tag": "b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:23.989727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-b13c588f-c0d0-42a7-b597-f9c4b32abf7c req-7826e147-c23f-4f2f-a7a2-400bd4fe3b98 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:23.990211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-b13c588f-c0d0-42a7-b597-f9c4b32abf7c req-7826e147-c23f-4f2f-a7a2-400bd4fe3b98 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:24.004601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-b13c588f-c0d0-42a7-b597-f9c4b32abf7c req-7826e147-c23f-4f2f-a7a2-400bd4fe3b98 service nova] Creating event network-changed:b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2 for instance e26b67fc-cc0a-41a7-8568-17f2eed10fb2 on hv-cinder-82549 Jul 26 18:32:24.009862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-b13c588f-c0d0-42a7-b597-f9c4b32abf7c req-7826e147-c23f-4f2f-a7a2-400bd4fe3b98 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034347 Jul 26 18:32:24.010550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 242/489] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:32:24.039470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ce0f2fe8-db76-4f1d-a91b-1f767b1d128e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:24.040098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ce0f2fe8-db76-4f1d-a91b-1f767b1d128e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:24.046201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce0f2fe8-db76-4f1d-a91b-1f767b1d128e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:24.046643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce0f2fe8-db76-4f1d-a91b-1f767b1d128e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:24.047445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce0f2fe8-db76-4f1d-a91b-1f767b1d128e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:24.047866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce0f2fe8-db76-4f1d-a91b-1f767b1d128e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:24.071574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ce0f2fe8-db76-4f1d-a91b-1f767b1d128e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/ips" status: 200 len: 150 microversion: 2.1 time: 0.036047 Jul 26 18:32:24.072163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 248/490] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Jul 26 18:32:24 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:24.688047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d7fd5caa-8b44-45d2-8487-3eb5baf6172f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:24.688670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d7fd5caa-8b44-45d2-8487-3eb5baf6172f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:24.695440 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fd5caa-8b44-45d2-8487-3eb5baf6172f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:24.695848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fd5caa-8b44-45d2-8487-3eb5baf6172f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:24.696683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fd5caa-8b44-45d2-8487-3eb5baf6172f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:24.697198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fd5caa-8b44-45d2-8487-3eb5baf6172f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:24.725822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-d7fd5caa-8b44-45d2-8487-3eb5baf6172f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lazy-loading 'flavor' on Instance uuid 240d5470-7916-48a4-b90f-910c88d68384 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:32:24.756291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1462349c-cf84-4562-b5db-05d55d661a0c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:24.757338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1462349c-cf84-4562-b5db-05d55d661a0c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:24.765190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1462349c-cf84-4562-b5db-05d55d661a0c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:24.765737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1462349c-cf84-4562-b5db-05d55d661a0c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:24.766982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1462349c-cf84-4562-b5db-05d55d661a0c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:24.767813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1462349c-cf84-4562-b5db-05d55d661a0c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:24.945813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1462349c-cf84-4562-b5db-05d55d661a0c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:24.959545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1462349c-cf84-4562-b5db-05d55d661a0c tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1496 microversion: 2.1 time: 0.204618 Jul 26 18:32:24.960266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 249/491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:24 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1496 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:24.965982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d7fd5caa-8b44-45d2-8487-3eb5baf6172f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "POST /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/action" status: 202 len: 0 microversion: 2.20 time: 0.282010 Jul 26 18:32:24.967500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 243/492] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Jul 26 18:32:24 2022] POST /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:32:24.977695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f29d8f51-dc03-48fb-945d-99e1c0394fe0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:24.978612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f29d8f51-dc03-48fb-945d-99e1c0394fe0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:24.985548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f29d8f51-dc03-48fb-945d-99e1c0394fe0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:24.985990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f29d8f51-dc03-48fb-945d-99e1c0394fe0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:24.986970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f29d8f51-dc03-48fb-945d-99e1c0394fe0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:24.987457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f29d8f51-dc03-48fb-945d-99e1c0394fe0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:25.198285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f29d8f51-dc03-48fb-945d-99e1c0394fe0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:25.209690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f29d8f51-dc03-48fb-945d-99e1c0394fe0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:25.211416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f29d8f51-dc03-48fb-945d-99e1c0394fe0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:25.212620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f29d8f51-dc03-48fb-945d-99e1c0394fe0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.240756 Jul 26 18:32:25.213610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 250/493] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:25.871628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ed8151c6-ff1e-4f2d-ba08-af17cef20d40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:25.872195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ed8151c6-ff1e-4f2d-ba08-af17cef20d40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:25.880068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed8151c6-ff1e-4f2d-ba08-af17cef20d40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:25.880500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed8151c6-ff1e-4f2d-ba08-af17cef20d40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:25.881261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed8151c6-ff1e-4f2d-ba08-af17cef20d40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:25.881688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed8151c6-ff1e-4f2d-ba08-af17cef20d40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:25.909192 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ed8151c6-ff1e-4f2d-ba08-af17cef20d40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 18:32:25.991734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ed8151c6-ff1e-4f2d-ba08-af17cef20d40 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 204 len: 0 microversion: 2.1 time: 0.124313 Jul 26 18:32:25.992688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 244/494] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 18:32:25 2022] DELETE /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:32:26.000862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-716758bb-726e-42d6-9b89-82027ab982bb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:26.001476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-716758bb-726e-42d6-9b89-82027ab982bb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:26.009761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-716758bb-726e-42d6-9b89-82027ab982bb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:26.010215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-716758bb-726e-42d6-9b89-82027ab982bb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:26.010980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-716758bb-726e-42d6-9b89-82027ab982bb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:26.011433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-716758bb-726e-42d6-9b89-82027ab982bb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:26.154907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-716758bb-726e-42d6-9b89-82027ab982bb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:26.163241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-716758bb-726e-42d6-9b89-82027ab982bb tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1502 microversion: 2.1 time: 0.166152 Jul 26 18:32:26.163873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 251/495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:25 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:26.236469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-31b0dd92-de8f-4998-89d2-a8e313de1c7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:26.237354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-31b0dd92-de8f-4998-89d2-a8e313de1c7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:26.244488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31b0dd92-de8f-4998-89d2-a8e313de1c7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:26.244940 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31b0dd92-de8f-4998-89d2-a8e313de1c7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:26.245701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31b0dd92-de8f-4998-89d2-a8e313de1c7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:26.246125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31b0dd92-de8f-4998-89d2-a8e313de1c7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:26.402741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-31b0dd92-de8f-4998-89d2-a8e313de1c7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:26.412360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-31b0dd92-de8f-4998-89d2-a8e313de1c7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:26.414012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-31b0dd92-de8f-4998-89d2-a8e313de1c7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:26.415269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-31b0dd92-de8f-4998-89d2-a8e313de1c7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.183318 Jul 26 18:32:26.415793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 245/496] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:26.584935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-30ef732f-0baa-44dd-99e9-f3e0e4b06d59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e6c66e5-b4d7-4483-886f-8c594e6e7bcb"}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:26.587357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-30ef732f-0baa-44dd-99e9-f3e0e4b06d59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:26.593620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30ef732f-0baa-44dd-99e9-f3e0e4b06d59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:26.594038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30ef732f-0baa-44dd-99e9-f3e0e4b06d59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:26.594804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30ef732f-0baa-44dd-99e9-f3e0e4b06d59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:26.595437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30ef732f-0baa-44dd-99e9-f3e0e4b06d59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:26.599339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:27.185738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6be3f915-6aaa-4aaa-92cb-6e8b2e752cd6 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:27.186337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6be3f915-6aaa-4aaa-92cb-6e8b2e752cd6 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:27.192685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6be3f915-6aaa-4aaa-92cb-6e8b2e752cd6 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:27.193127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6be3f915-6aaa-4aaa-92cb-6e8b2e752cd6 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:27.193884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6be3f915-6aaa-4aaa-92cb-6e8b2e752cd6 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:27.194307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6be3f915-6aaa-4aaa-92cb-6e8b2e752cd6 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:27.338703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6be3f915-6aaa-4aaa-92cb-6e8b2e752cd6 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:27.354121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6be3f915-6aaa-4aaa-92cb-6e8b2e752cd6 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1502 microversion: 2.1 time: 0.172458 Jul 26 18:32:27.354988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 246/497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:27 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:27.443545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c9aca1c2-99b9-41a4-aefd-063b413e07ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:27.444163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c9aca1c2-99b9-41a4-aefd-063b413e07ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:27.450568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c9aca1c2-99b9-41a4-aefd-063b413e07ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:27.451005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c9aca1c2-99b9-41a4-aefd-063b413e07ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:27.452382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c9aca1c2-99b9-41a4-aefd-063b413e07ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:27.452822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c9aca1c2-99b9-41a4-aefd-063b413e07ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:27.603236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c9aca1c2-99b9-41a4-aefd-063b413e07ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:27.612235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c9aca1c2-99b9-41a4-aefd-063b413e07ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:27.613859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c9aca1c2-99b9-41a4-aefd-063b413e07ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:27.615355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c9aca1c2-99b9-41a4-aefd-063b413e07ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.176050 Jul 26 18:32:27.616314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 247/498] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:27 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:32:28.375273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-03655bfb-f34f-40a0-a662-7a2beac923da tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:28.375997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-03655bfb-f34f-40a0-a662-7a2beac923da tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:28.385937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03655bfb-f34f-40a0-a662-7a2beac923da tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:28.386425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03655bfb-f34f-40a0-a662-7a2beac923da tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:28.387420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03655bfb-f34f-40a0-a662-7a2beac923da tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:28.387898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03655bfb-f34f-40a0-a662-7a2beac923da tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:28.544698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-03655bfb-f34f-40a0-a662-7a2beac923da tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:28.552928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-03655bfb-f34f-40a0-a662-7a2beac923da tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1502 microversion: 2.1 time: 0.181556 Jul 26 18:32:28.553660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 248/499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:28 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:28.638663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-88e97255-23cb-42e5-ba3d-ae6799d5efbc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:28.639386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-88e97255-23cb-42e5-ba3d-ae6799d5efbc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:28.646250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-88e97255-23cb-42e5-ba3d-ae6799d5efbc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:28.646787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-88e97255-23cb-42e5-ba3d-ae6799d5efbc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:28.647616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-88e97255-23cb-42e5-ba3d-ae6799d5efbc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:28.648053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-88e97255-23cb-42e5-ba3d-ae6799d5efbc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:28.796428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-88e97255-23cb-42e5-ba3d-ae6799d5efbc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:28.804619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-88e97255-23cb-42e5-ba3d-ae6799d5efbc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:28.806325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-88e97255-23cb-42e5-ba3d-ae6799d5efbc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:28.807806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-88e97255-23cb-42e5-ba3d-ae6799d5efbc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.173387 Jul 26 18:32:28.808386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 249/500] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:29.046839 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1393527348", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "networks": [{"uuid": "9c8b029e-7412-425b-b2f3-f692c581bfae"}]}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:29.100828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] validate_networks() for [('9c8b029e-7412-425b-b2f3-f692c581bfae', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:32:29.402804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-30ef732f-0baa-44dd-99e9-f3e0e4b06d59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "POST /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.822099 Jul 26 18:32:29.403580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 252/501] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Jul 26 18:32:26 2022] POST /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 194 bytes in 2824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:29.577743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c1e7644a-22a3-4a19-b9a3-2298d6cfba77 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:29.578645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c1e7644a-22a3-4a19-b9a3-2298d6cfba77 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:29.585321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c1e7644a-22a3-4a19-b9a3-2298d6cfba77 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:29.585771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c1e7644a-22a3-4a19-b9a3-2298d6cfba77 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:29.586720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c1e7644a-22a3-4a19-b9a3-2298d6cfba77 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:29.587517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c1e7644a-22a3-4a19-b9a3-2298d6cfba77 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:29.631699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:32:29.632855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:32:29.633369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:32:29.633761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:32:29.634196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:32:29.655781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:29.660069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:29.661118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:29.662361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:29.687734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Getting quotas for project 4a3a3d4e1a54483ebf824780b87b97e6. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:32:29.692660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Getting quotas for user f2b9730f230249638cfc64f7b0ae9014 and project 4a3a3d4e1a54483ebf824780b87b97e6. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:32:29.725074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:32:29.727764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:32:29.738535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c1e7644a-22a3-4a19-b9a3-2298d6cfba77 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:29.748841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c1e7644a-22a3-4a19-b9a3-2298d6cfba77 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1502 microversion: 2.1 time: 0.175733 Jul 26 18:32:29.759713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 253/502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:29 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:29.791167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5b19861f-2a36-4778-91b9-c3d32ea4cbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748135 Jul 26 18:32:29.791851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 250/503] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:32:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 18:32:29.803573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d15847b3-73be-468d-bc55-d77a4cd9fe5e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:29.804547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d15847b3-73be-468d-bc55-d77a4cd9fe5e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:29.832883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3c63b2c4-c94f-4e2a-b30d-44a565a476f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:29.833680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3c63b2c4-c94f-4e2a-b30d-44a565a476f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:29.841924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c63b2c4-c94f-4e2a-b30d-44a565a476f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:29.842579 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c63b2c4-c94f-4e2a-b30d-44a565a476f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:29.843663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c63b2c4-c94f-4e2a-b30d-44a565a476f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:29.844330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c63b2c4-c94f-4e2a-b30d-44a565a476f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:29.858460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d15847b3-73be-468d-bc55-d77a4cd9fe5e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:29.866333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d15847b3-73be-468d-bc55-d77a4cd9fe5e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1219 microversion: 2.1 time: 0.066638 Jul 26 18:32:29.879088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 254/504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:29 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:30.125008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-08591c60-d267-47da-972f-84395e60f63a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:30.133670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-08591c60-d267-47da-972f-84395e60f63a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:30.134254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-08591c60-d267-47da-972f-84395e60f63a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:30.209064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-08591c60-d267-47da-972f-84395e60f63a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Going to try to stop instance {{(pid=117996) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 18:32:30.268764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-08591c60-d267-47da-972f-84395e60f63a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "POST /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/action" status: 202 len: 0 microversion: 2.1 time: 0.147544 Jul 26 18:32:30.269897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 255/505] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:32:30 2022] POST /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:32:30.281113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-eeae6037-c0ae-4940-b004-cfcc7e20774e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:30.282134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-eeae6037-c0ae-4940-b004-cfcc7e20774e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:30.290607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eeae6037-c0ae-4940-b004-cfcc7e20774e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:30.291328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eeae6037-c0ae-4940-b004-cfcc7e20774e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:30.292117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eeae6037-c0ae-4940-b004-cfcc7e20774e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:30.292552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eeae6037-c0ae-4940-b004-cfcc7e20774e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:30.311921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3c63b2c4-c94f-4e2a-b30d-44a565a476f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:30.329589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3c63b2c4-c94f-4e2a-b30d-44a565a476f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:30.331443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3c63b2c4-c94f-4e2a-b30d-44a565a476f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:30.333583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3c63b2c4-c94f-4e2a-b30d-44a565a476f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.507031 Jul 26 18:32:30.334396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 251/506] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:30.339805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-4a146802-c44a-465a-aebf-056cd7247176 req-c6bc9a15-1b25-482f-8591-bd311c8c9057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bffe40dc-5489-4292-b5b3-78bae13951d2", "name": "network-vif-deleted", "tag": "d9ab03be-5655-494b-8c5d-a40ee4bf0107"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:30.354450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-4a146802-c44a-465a-aebf-056cd7247176 req-c6bc9a15-1b25-482f-8591-bd311c8c9057 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:30.355206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-4a146802-c44a-465a-aebf-056cd7247176 req-c6bc9a15-1b25-482f-8591-bd311c8c9057 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:30.368744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-4a146802-c44a-465a-aebf-056cd7247176 req-c6bc9a15-1b25-482f-8591-bd311c8c9057 service nova] Creating event network-vif-deleted:d9ab03be-5655-494b-8c5d-a40ee4bf0107 for instance bffe40dc-5489-4292-b5b3-78bae13951d2 on hv-cinder-82549 Jul 26 18:32:30.375167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-4a146802-c44a-465a-aebf-056cd7247176 req-c6bc9a15-1b25-482f-8591-bd311c8c9057 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039336 Jul 26 18:32:30.375869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 252/507] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:30.457235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-eeae6037-c0ae-4940-b004-cfcc7e20774e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:30.465640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-eeae6037-c0ae-4940-b004-cfcc7e20774e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.191547 Jul 26 18:32:30.466208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 256/508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:30 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:30.771259 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e24cd734-6b11-4254-8fb9-4497846145a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:30.771935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e24cd734-6b11-4254-8fb9-4497846145a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:30.779427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e24cd734-6b11-4254-8fb9-4497846145a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:30.780011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e24cd734-6b11-4254-8fb9-4497846145a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:30.780910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e24cd734-6b11-4254-8fb9-4497846145a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:30.782460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e24cd734-6b11-4254-8fb9-4497846145a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:30.817297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e24cd734-6b11-4254-8fb9-4497846145a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:30.817958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e24cd734-6b11-4254-8fb9-4497846145a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:30.818407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-e24cd734-6b11-4254-8fb9-4497846145a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lazy-loading 'fault' on Instance uuid bffe40dc-5489-4292-b5b3-78bae13951d2 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:32:30.864265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e24cd734-6b11-4254-8fb9-4497846145a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:30.866619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:30.874229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e24cd734-6b11-4254-8fb9-4497846145a4 tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1304 microversion: 2.1 time: 0.107977 Jul 26 18:32:30.874918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 253/509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:30 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:30.891773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0f45b0bc-fcab-4e11-a9fb-f1afab42a0a0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:30.892392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f45b0bc-fcab-4e11-a9fb-f1afab42a0a0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:30.898864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f45b0bc-fcab-4e11-a9fb-f1afab42a0a0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:30.899736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f45b0bc-fcab-4e11-a9fb-f1afab42a0a0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:30.900512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f45b0bc-fcab-4e11-a9fb-f1afab42a0a0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:30.900944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f45b0bc-fcab-4e11-a9fb-f1afab42a0a0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:30.971449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0f45b0bc-fcab-4e11-a9fb-f1afab42a0a0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:30.981288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0f45b0bc-fcab-4e11-a9fb-f1afab42a0a0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1215 microversion: 2.1 time: 0.096012 Jul 26 18:32:30.981856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 257/510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:30 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:31.360798 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-11ca54a4-962e-45ef-b7ff-b5f374b619ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:31.361343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-11ca54a4-962e-45ef-b7ff-b5f374b619ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:31.369175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11ca54a4-962e-45ef-b7ff-b5f374b619ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:31.369616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11ca54a4-962e-45ef-b7ff-b5f374b619ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:31.370407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11ca54a4-962e-45ef-b7ff-b5f374b619ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:31.370833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11ca54a4-962e-45ef-b7ff-b5f374b619ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:31.487256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6da4a9e2-cd00-40e5-93bc-576da8de34ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:31.488186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6da4a9e2-cd00-40e5-93bc-576da8de34ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:31.496144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6da4a9e2-cd00-40e5-93bc-576da8de34ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:31.496534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6da4a9e2-cd00-40e5-93bc-576da8de34ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:31.497592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6da4a9e2-cd00-40e5-93bc-576da8de34ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:31.497774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6da4a9e2-cd00-40e5-93bc-576da8de34ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:31.545610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-11ca54a4-962e-45ef-b7ff-b5f374b619ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:31.554675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-11ca54a4-962e-45ef-b7ff-b5f374b619ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:31.556267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-11ca54a4-962e-45ef-b7ff-b5f374b619ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:31.557460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-11ca54a4-962e-45ef-b7ff-b5f374b619ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.201468 Jul 26 18:32:31.558317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 254/511] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:31.650966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6da4a9e2-cd00-40e5-93bc-576da8de34ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:31.662389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6da4a9e2-cd00-40e5-93bc-576da8de34ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.179192 Jul 26 18:32:31.663342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 258/512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:31 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:31.895900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-85470878-f82a-41b9-b05b-5b997439e10d tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:31.896505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-85470878-f82a-41b9-b05b-5b997439e10d tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:31.904601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85470878-f82a-41b9-b05b-5b997439e10d tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:31.905039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85470878-f82a-41b9-b05b-5b997439e10d tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:31.905881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85470878-f82a-41b9-b05b-5b997439e10d tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:31.906940 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85470878-f82a-41b9-b05b-5b997439e10d tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:31.948444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85470878-f82a-41b9-b05b-5b997439e10d tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:31.948876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85470878-f82a-41b9-b05b-5b997439e10d tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:31.949316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-85470878-f82a-41b9-b05b-5b997439e10d tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lazy-loading 'fault' on Instance uuid bffe40dc-5489-4292-b5b3-78bae13951d2 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:32:32.003859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-225236b0-c2d1-4e74-bb7e-ce4efdf2c8f2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:32.004506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-225236b0-c2d1-4e74-bb7e-ce4efdf2c8f2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:32.004778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-85470878-f82a-41b9-b05b-5b997439e10d tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710de14924c9488284988508cc003332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f5ab1f6ad4eba871884ce60ebd64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:32.011156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-225236b0-c2d1-4e74-bb7e-ce4efdf2c8f2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:32.011594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-225236b0-c2d1-4e74-bb7e-ce4efdf2c8f2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:32.012355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-225236b0-c2d1-4e74-bb7e-ce4efdf2c8f2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:32.012800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-225236b0-c2d1-4e74-bb7e-ce4efdf2c8f2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:32.014170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-85470878-f82a-41b9-b05b-5b997439e10d tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 200 len: 1304 microversion: 2.1 time: 0.122111 Jul 26 18:32:32.014948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 255/513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:31 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:32.084504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-225236b0-c2d1-4e74-bb7e-ce4efdf2c8f2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:32.093705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-225236b0-c2d1-4e74-bb7e-ce4efdf2c8f2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1271 microversion: 2.1 time: 0.093660 Jul 26 18:32:32.094295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 259/514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:31 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:32.581470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1532e48e-b6c6-4fac-be7a-e0ec33986107 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:32.582102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1532e48e-b6c6-4fac-be7a-e0ec33986107 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:32.588531 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1532e48e-b6c6-4fac-be7a-e0ec33986107 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:32.588976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1532e48e-b6c6-4fac-be7a-e0ec33986107 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:32.589737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1532e48e-b6c6-4fac-be7a-e0ec33986107 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:32.590167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1532e48e-b6c6-4fac-be7a-e0ec33986107 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:32.685512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-df2f15c1-bd35-426d-880c-3263307ae6cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:32.686294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-df2f15c1-bd35-426d-880c-3263307ae6cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:32.692618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df2f15c1-bd35-426d-880c-3263307ae6cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:32.693060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df2f15c1-bd35-426d-880c-3263307ae6cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:32.693895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df2f15c1-bd35-426d-880c-3263307ae6cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:32.694559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df2f15c1-bd35-426d-880c-3263307ae6cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:32.730649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1532e48e-b6c6-4fac-be7a-e0ec33986107 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:32.745462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1532e48e-b6c6-4fac-be7a-e0ec33986107 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:32.748520 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1532e48e-b6c6-4fac-be7a-e0ec33986107 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:32.750085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1532e48e-b6c6-4fac-be7a-e0ec33986107 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.172537 Jul 26 18:32:32.751107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 256/515] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:32 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:32.845692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-df2f15c1-bd35-426d-880c-3263307ae6cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:32.856412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-df2f15c1-bd35-426d-880c-3263307ae6cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.174837 Jul 26 18:32:32.857026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 260/516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:33.037188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ae22fdc4-b6fb-4b42-9be8-042fc5269d8b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:33.037818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ae22fdc4-b6fb-4b42-9be8-042fc5269d8b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] [instance: bffe40dc-5489-4292-b5b3-78bae13951d2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:33.045278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae22fdc4-b6fb-4b42-9be8-042fc5269d8b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:33.045880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae22fdc4-b6fb-4b42-9be8-042fc5269d8b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:33.046745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae22fdc4-b6fb-4b42-9be8-042fc5269d8b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:33.047214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae22fdc4-b6fb-4b42-9be8-042fc5269d8b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:33.062078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-ae22fdc4-b6fb-4b42-9be8-042fc5269d8b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] HTTP exception thrown: Instance bffe40dc-5489-4292-b5b3-78bae13951d2 could not be found. Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ae22fdc4-b6fb-4b42-9be8-042fc5269d8b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Request method failure captured: Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 HTTP/1.1 Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Connection: close Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Host: 10.222.0.27 Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.10 Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABi4DLmL6VMqK2H9spc4RV4-aILivadQKeUSf5VadafDvKiibCVYC-jOH7tjolM98BoRfDYspWO25jKbXGwXm2dnbsiG87dc8OqCfqcEqCvk5LLaxv4_Z2h9o1t3eW1B2ObU7BxouLYFI-AiT2ZGc8waScKeBBR1OiMiAHSo_JOSz3dMzo Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Id: 7d2f5ab1f6ad4eba871884ce60ebd64d Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-VolumesActionsTest-1845566747 Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Role: reader,member Jul 26 18:32:33.063933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Roles: reader,member Jul 26 18:32:33.065511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d2f5ab1f6ad4eba871884ce60ebd64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d2f5ab1f6ad4eba871884ce60ebd64d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d2f5ab1f6ad4eba871884ce60ebd64d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d2f5ab1f6ad4eba871884ce60ebd64d"}]}] Jul 26 18:32:33.065511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-VolumesActionsTest-1845566747 Jul 26 18:32:33.065511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 7d2f5ab1f6ad4eba871884ce60ebd64d Jul 26 18:32:33.065511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-VolumesActionsTest-1845566747 Jul 26 18:32:33.065511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User: tempest-VolumesActionsTest-1845566747-project Jul 26 18:32:33.065511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 26 18:32:33.065511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 26 18:32:33.065511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Id: 710de14924c9488284988508cc003332 Jul 26 18:32:33.065511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-VolumesActionsTest-1845566747-project Jul 26 18:32:33.065511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: method: > Jul 26 18:32:33.065511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: exception: Instance bffe40dc-5489-4292-b5b3-78bae13951d2 could not be found. Jul 26 18:32:33.065511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: action_args: {'id': 'bffe40dc-5489-4292-b5b3-78bae13951d2'} Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bffe40dc-5489-4292-b5b3-78bae13951d2 could not be found. Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:32:33.066388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bffe40dc-5489-4292-b5b3-78bae13951d2 could not be found. Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bffe40dc-5489-4292-b5b3-78bae13951d2 could not be found. Jul 26 18:32:33.067934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:32:33.069239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ae22fdc4-b6fb-4b42-9be8-042fc5269d8b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] Returning 404 to user: Instance bffe40dc-5489-4292-b5b3-78bae13951d2 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:32:33.069239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ae22fdc4-b6fb-4b42-9be8-042fc5269d8b tempest-VolumesActionsTest-1845566747 tempest-VolumesActionsTest-1845566747-project] 10.222.0.27 "GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2" status: 404 len: 111 microversion: 2.1 time: 0.032522 Jul 26 18:32:33.069451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 257/517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:33 2022] GET /compute/v2.1/servers/bffe40dc-5489-4292-b5b3-78bae13951d2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 18:32:33.121772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c142da01-b93f-4970-9d6d-fa1699ee1cb9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:33.122525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c142da01-b93f-4970-9d6d-fa1699ee1cb9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:33.131461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c142da01-b93f-4970-9d6d-fa1699ee1cb9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:33.131911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c142da01-b93f-4970-9d6d-fa1699ee1cb9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:33.133405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c142da01-b93f-4970-9d6d-fa1699ee1cb9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:33.134158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c142da01-b93f-4970-9d6d-fa1699ee1cb9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:33.220687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c142da01-b93f-4970-9d6d-fa1699ee1cb9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:33.234557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c142da01-b93f-4970-9d6d-fa1699ee1cb9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1277 microversion: 2.1 time: 0.117441 Jul 26 18:32:33.235128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 261/518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:33 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:33.778594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a5d88cf1-3ee6-4353-b853-be6ed6290fca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:33.779413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a5d88cf1-3ee6-4353-b853-be6ed6290fca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:33.792938 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5d88cf1-3ee6-4353-b853-be6ed6290fca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:33.793375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5d88cf1-3ee6-4353-b853-be6ed6290fca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:33.794144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5d88cf1-3ee6-4353-b853-be6ed6290fca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:33.794568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5d88cf1-3ee6-4353-b853-be6ed6290fca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:33.847898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-75fc14d3-ca71-439d-96d2-3fd0772399f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Action: 'create', calling method: .version_select at 0x7f3909673550>, body: {"keypair": {"name": "tempest-keypair-1814355938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcJc2FPZLbzCx4srOUgw5Gwy08zwyBnbC4Ve7T7mzaMrk2eVCDiMoo3JKaOdVhFRJBwQqfYylmFmXLogHT2GgLSi7mMIeDLVbMcojVuZ9kuiTde1vL9Fcxc3x2roycYPA=="}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:33.868594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-75fc14d3-ca71-439d-96d2-3fd0772399f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for project 765e809e332e4a478e09be17e6b3c385. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:32:33.872571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-75fc14d3-ca71-439d-96d2-3fd0772399f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for user 40f43a6429474c5e96db487ee85bbd84 and project 765e809e332e4a478e09be17e6b3c385. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:32:33.895521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-75fc14d3-ca71-439d-96d2-3fd0772399f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051499 Jul 26 18:32:33.896115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 262/519] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Jul 26 18:32:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:32:33.901080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d4fe2664-b3a9-4f1c-86da-75c7f6e560ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:33.901821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d4fe2664-b3a9-4f1c-86da-75c7f6e560ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:33.909306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4fe2664-b3a9-4f1c-86da-75c7f6e560ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:33.909795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4fe2664-b3a9-4f1c-86da-75c7f6e560ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:33.910557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4fe2664-b3a9-4f1c-86da-75c7f6e560ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:33.911169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4fe2664-b3a9-4f1c-86da-75c7f6e560ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:34.091711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a5d88cf1-3ee6-4353-b853-be6ed6290fca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:34.092331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d4fe2664-b3a9-4f1c-86da-75c7f6e560ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:34.104353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d4fe2664-b3a9-4f1c-86da-75c7f6e560ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.206902 Jul 26 18:32:34.104974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 263/520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:33 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:34.107561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a5d88cf1-3ee6-4353-b853-be6ed6290fca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:34.109655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a5d88cf1-3ee6-4353-b853-be6ed6290fca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:34.110937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a5d88cf1-3ee6-4353-b853-be6ed6290fca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.336642 Jul 26 18:32:34.111835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 258/521] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:32:34.256090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-16578371-228f-4fd2-984c-2aa3fe9362e5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:34.256820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-16578371-228f-4fd2-984c-2aa3fe9362e5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:34.263838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16578371-228f-4fd2-984c-2aa3fe9362e5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:34.264273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16578371-228f-4fd2-984c-2aa3fe9362e5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:34.265044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16578371-228f-4fd2-984c-2aa3fe9362e5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:34.265479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16578371-228f-4fd2-984c-2aa3fe9362e5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:34.418379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-16578371-228f-4fd2-984c-2aa3fe9362e5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:34.427470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-16578371-228f-4fd2-984c-2aa3fe9362e5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.175141 Jul 26 18:32:34.428123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 264/522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:34 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:34.570325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-d2b1046f-866c-4311-8705-d998b223cad1 req-f70f5a9d-fa53-4a6c-8501-4468a4fae7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5fd40dc-ca21-4cab-9e60-49c838116404", "tag": "b4af147f-cc74-47f0-bbf7-ed1a1d0ac8d8"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:34.580959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-d2b1046f-866c-4311-8705-d998b223cad1 req-f70f5a9d-fa53-4a6c-8501-4468a4fae7a3 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:34.581740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-d2b1046f-866c-4311-8705-d998b223cad1 req-f70f5a9d-fa53-4a6c-8501-4468a4fae7a3 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:34.594599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-d2b1046f-866c-4311-8705-d998b223cad1 req-f70f5a9d-fa53-4a6c-8501-4468a4fae7a3 service nova] Creating event network-changed:b4af147f-cc74-47f0-bbf7-ed1a1d0ac8d8 for instance b5fd40dc-ca21-4cab-9e60-49c838116404 on hv-cinder-82549 Jul 26 18:32:34.599492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-d2b1046f-866c-4311-8705-d998b223cad1 req-f70f5a9d-fa53-4a6c-8501-4468a4fae7a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032968 Jul 26 18:32:34.600094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 259/523] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:35.126098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c2e7170b-056c-40b6-a6b2-ef67e6dbfba0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:35.126706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c2e7170b-056c-40b6-a6b2-ef67e6dbfba0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:35.133536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2e7170b-056c-40b6-a6b2-ef67e6dbfba0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:35.134240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2e7170b-056c-40b6-a6b2-ef67e6dbfba0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:35.135085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2e7170b-056c-40b6-a6b2-ef67e6dbfba0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:35.135504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2e7170b-056c-40b6-a6b2-ef67e6dbfba0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:35.136332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cd456536-5d61-4ef9-b167-90c4c585d3b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:35.137610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cd456536-5d61-4ef9-b167-90c4c585d3b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:35.145050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd456536-5d61-4ef9-b167-90c4c585d3b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:35.146228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd456536-5d61-4ef9-b167-90c4c585d3b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:35.147703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd456536-5d61-4ef9-b167-90c4c585d3b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:35.148358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd456536-5d61-4ef9-b167-90c4c585d3b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:35.286460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cd456536-5d61-4ef9-b167-90c4c585d3b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:35.294812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cd456536-5d61-4ef9-b167-90c4c585d3b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:35.296359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cd456536-5d61-4ef9-b167-90c4c585d3b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:35.297524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cd456536-5d61-4ef9-b167-90c4c585d3b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.166224 Jul 26 18:32:35.298060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 260/524] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:35 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:35.330664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c2e7170b-056c-40b6-a6b2-ef67e6dbfba0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:35.339582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c2e7170b-056c-40b6-a6b2-ef67e6dbfba0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.217490 Jul 26 18:32:35.340445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 265/525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:35.448330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a1526b93-14d8-431a-bd3f-8573d9fc9820 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:35.449023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a1526b93-14d8-431a-bd3f-8573d9fc9820 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:35.455358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a1526b93-14d8-431a-bd3f-8573d9fc9820 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:35.455902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a1526b93-14d8-431a-bd3f-8573d9fc9820 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:35.456738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a1526b93-14d8-431a-bd3f-8573d9fc9820 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:35.457257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a1526b93-14d8-431a-bd3f-8573d9fc9820 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:35.497728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-619276951", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3e4e1db-4202-4baf-8f51-705a169c7395"}], "security_groups": [{"name": "tempest-securitygroup--401284604"}], "key_name": "tempest-keypair-1814355938", "user_data": "}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:35.505984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:35.596616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a1526b93-14d8-431a-bd3f-8573d9fc9820 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:35.604411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.network.neutron [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] validate_networks() for [('b3e4e1db-4202-4baf-8f51-705a169c7395', None, None, None, None, None)] {{(pid=117996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:32:35.604876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a1526b93-14d8-431a-bd3f-8573d9fc9820 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.160403 Jul 26 18:32:35.605528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 261/526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:35 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:36.019681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Flavor limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:32:36.020102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Image limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:32:36.020589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Flavor pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:32:36.020990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Image pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:32:36.021395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:32:36.031274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:36.031724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:36.032502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:36.032933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:36.050281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for project 765e809e332e4a478e09be17e6b3c385. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:32:36.054385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for user 40f43a6429474c5e96db487ee85bbd84 and project 765e809e332e4a478e09be17e6b3c385. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:32:36.065697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Going to run 1 instances... {{(pid=117996) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:32:36.068016 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:32:36.115082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-392d1cde-371d-41f5-ab4f-50e79e3aead5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.621671 Jul 26 18:32:36.115979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 266/527] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:32:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 18:32:36.128320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-426e08e1-c104-4066-add8-c43a2b84ec68 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:36.129064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-426e08e1-c104-4066-add8-c43a2b84ec68 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:36.185736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-426e08e1-c104-4066-add8-c43a2b84ec68 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:36.192993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-426e08e1-c104-4066-add8-c43a2b84ec68 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1241 microversion: 2.1 time: 0.069778 Jul 26 18:32:36.193488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 262/528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:36 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:36.322342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3d1cfc1b-ff51-4514-8649-6cb1eebe8918 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:36.322968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3d1cfc1b-ff51-4514-8649-6cb1eebe8918 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:36.330077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d1cfc1b-ff51-4514-8649-6cb1eebe8918 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:36.330561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d1cfc1b-ff51-4514-8649-6cb1eebe8918 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:36.331361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d1cfc1b-ff51-4514-8649-6cb1eebe8918 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:36.331789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d1cfc1b-ff51-4514-8649-6cb1eebe8918 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:36.363049 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-09b2508c-0b40-478f-96a0-175194120dce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:36.364459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-09b2508c-0b40-478f-96a0-175194120dce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:36.375710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09b2508c-0b40-478f-96a0-175194120dce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:36.377200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09b2508c-0b40-478f-96a0-175194120dce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:36.378666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09b2508c-0b40-478f-96a0-175194120dce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:36.379521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09b2508c-0b40-478f-96a0-175194120dce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:36.517733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3d1cfc1b-ff51-4514-8649-6cb1eebe8918 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:36.526995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3d1cfc1b-ff51-4514-8649-6cb1eebe8918 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:36.528491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3d1cfc1b-ff51-4514-8649-6cb1eebe8918 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:36.529725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3d1cfc1b-ff51-4514-8649-6cb1eebe8918 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.212734 Jul 26 18:32:36.543576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 267/529] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:36 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:36.572296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-09b2508c-0b40-478f-96a0-175194120dce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:36.580396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-09b2508c-0b40-478f-96a0-175194120dce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.223243 Jul 26 18:32:36.580969 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 263/530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:36 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:36.627653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a25e24cd-39b5-4701-96c2-f6aeaccc3411 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:36.628524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a25e24cd-39b5-4701-96c2-f6aeaccc3411 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:36.637547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a25e24cd-39b5-4701-96c2-f6aeaccc3411 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:36.638124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a25e24cd-39b5-4701-96c2-f6aeaccc3411 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:36.639300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a25e24cd-39b5-4701-96c2-f6aeaccc3411 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:36.639915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a25e24cd-39b5-4701-96c2-f6aeaccc3411 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:36.775189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a25e24cd-39b5-4701-96c2-f6aeaccc3411 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:36.783142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a25e24cd-39b5-4701-96c2-f6aeaccc3411 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.161181 Jul 26 18:32:36.787073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 268/531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:36 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:37.214101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bf920e56-cab0-4251-bc0e-00c7decb9173 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:37.214744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bf920e56-cab0-4251-bc0e-00c7decb9173 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:37.221557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf920e56-cab0-4251-bc0e-00c7decb9173 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:37.222004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf920e56-cab0-4251-bc0e-00c7decb9173 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:37.222760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf920e56-cab0-4251-bc0e-00c7decb9173 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:37.223230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf920e56-cab0-4251-bc0e-00c7decb9173 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:37.288267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bf920e56-cab0-4251-bc0e-00c7decb9173 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:37.298219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bf920e56-cab0-4251-bc0e-00c7decb9173 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1245 microversion: 2.1 time: 0.088031 Jul 26 18:32:37.298775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 264/532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:37 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:37.553737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7ae9b210-11e8-4260-915c-0167a9f4637f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:37.554335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7ae9b210-11e8-4260-915c-0167a9f4637f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:37.561564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ae9b210-11e8-4260-915c-0167a9f4637f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:37.562009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ae9b210-11e8-4260-915c-0167a9f4637f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:37.562757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ae9b210-11e8-4260-915c-0167a9f4637f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:37.563209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ae9b210-11e8-4260-915c-0167a9f4637f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:37.567145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:37.601877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3b870083-f954-4fec-918f-0127764b3ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:37.602597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3b870083-f954-4fec-918f-0127764b3ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:37.609661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b870083-f954-4fec-918f-0127764b3ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:37.610082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b870083-f954-4fec-918f-0127764b3ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:37.610848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b870083-f954-4fec-918f-0127764b3ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:37.611309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b870083-f954-4fec-918f-0127764b3ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:37.697444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7ae9b210-11e8-4260-915c-0167a9f4637f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:37.705728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7ae9b210-11e8-4260-915c-0167a9f4637f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:37.707338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7ae9b210-11e8-4260-915c-0167a9f4637f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:37.708493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7ae9b210-11e8-4260-915c-0167a9f4637f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.158750 Jul 26 18:32:37.709063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 269/533] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:37.746450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3b870083-f954-4fec-918f-0127764b3ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:37.754583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3b870083-f954-4fec-918f-0127764b3ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.156604 Jul 26 18:32:37.755362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 265/534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:37 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:37.804692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-729e3fc5-90de-47b7-bdfc-5064cbff6e3e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:37.805206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-729e3fc5-90de-47b7-bdfc-5064cbff6e3e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:37.811944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-729e3fc5-90de-47b7-bdfc-5064cbff6e3e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:37.812363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-729e3fc5-90de-47b7-bdfc-5064cbff6e3e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:37.813170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-729e3fc5-90de-47b7-bdfc-5064cbff6e3e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:37.813603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-729e3fc5-90de-47b7-bdfc-5064cbff6e3e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:37.952850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-729e3fc5-90de-47b7-bdfc-5064cbff6e3e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:37.960891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-729e3fc5-90de-47b7-bdfc-5064cbff6e3e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.160152 Jul 26 18:32:37.961509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 270/535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:37 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:38.324602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-98215e1c-8fc9-4561-8405-727754fcd53f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:38.325597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-98215e1c-8fc9-4561-8405-727754fcd53f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:38.336832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98215e1c-8fc9-4561-8405-727754fcd53f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:38.337541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98215e1c-8fc9-4561-8405-727754fcd53f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:38.338818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98215e1c-8fc9-4561-8405-727754fcd53f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:38.339281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98215e1c-8fc9-4561-8405-727754fcd53f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:38.414806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-98215e1c-8fc9-4561-8405-727754fcd53f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:38.424521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-98215e1c-8fc9-4561-8405-727754fcd53f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1245 microversion: 2.1 time: 0.107422 Jul 26 18:32:38.425151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 266/536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:38 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:38.731526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-47932cfd-0b16-4180-970d-1f8fa6fed82d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:38.732151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-47932cfd-0b16-4180-970d-1f8fa6fed82d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:38.738982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47932cfd-0b16-4180-970d-1f8fa6fed82d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:38.739459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47932cfd-0b16-4180-970d-1f8fa6fed82d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:38.740220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47932cfd-0b16-4180-970d-1f8fa6fed82d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:38.740652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47932cfd-0b16-4180-970d-1f8fa6fed82d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:38.788007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e285ce56-a9fc-4458-b2e5-933fd2775579 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:38.788699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e285ce56-a9fc-4458-b2e5-933fd2775579 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:38.795511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e285ce56-a9fc-4458-b2e5-933fd2775579 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:38.796036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e285ce56-a9fc-4458-b2e5-933fd2775579 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:38.796878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e285ce56-a9fc-4458-b2e5-933fd2775579 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:38.797372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e285ce56-a9fc-4458-b2e5-933fd2775579 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:38.910193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-47932cfd-0b16-4180-970d-1f8fa6fed82d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:38.918660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-47932cfd-0b16-4180-970d-1f8fa6fed82d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:38.920312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-47932cfd-0b16-4180-970d-1f8fa6fed82d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:38.921611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-47932cfd-0b16-4180-970d-1f8fa6fed82d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.194187 Jul 26 18:32:38.922420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 271/537] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:32:38.983614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bd541d8e-8f54-4cf2-9422-2d9c8a946fda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:38.984209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bd541d8e-8f54-4cf2-9422-2d9c8a946fda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:38.990724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd541d8e-8f54-4cf2-9422-2d9c8a946fda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:38.991206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd541d8e-8f54-4cf2-9422-2d9c8a946fda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:38.991967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd541d8e-8f54-4cf2-9422-2d9c8a946fda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:38.992368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd541d8e-8f54-4cf2-9422-2d9c8a946fda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:39.007902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e285ce56-a9fc-4458-b2e5-933fd2775579 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:39.016007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e285ce56-a9fc-4458-b2e5-933fd2775579 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.232614 Jul 26 18:32:39.016722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 267/538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:38 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:39.129160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bd541d8e-8f54-4cf2-9422-2d9c8a946fda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:39.137263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bd541d8e-8f54-4cf2-9422-2d9c8a946fda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.157633 Jul 26 18:32:39.137824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 272/539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:38 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:39.446252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1d924e75-0303-4138-b01e-344fc118d7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:39.446840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1d924e75-0303-4138-b01e-344fc118d7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:39.454294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d924e75-0303-4138-b01e-344fc118d7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:39.454743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d924e75-0303-4138-b01e-344fc118d7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:39.455555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d924e75-0303-4138-b01e-344fc118d7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:39.455981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d924e75-0303-4138-b01e-344fc118d7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:39.530035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d924e75-0303-4138-b01e-344fc118d7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:39.542184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1d924e75-0303-4138-b01e-344fc118d7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1311 microversion: 2.1 time: 0.100047 Jul 26 18:32:39.542685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 268/540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:39 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:39.948162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a38adb31-7161-4995-95d2-d6d1096b4996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:39.948739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a38adb31-7161-4995-95d2-d6d1096b4996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:39.957793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a38adb31-7161-4995-95d2-d6d1096b4996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:39.958303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a38adb31-7161-4995-95d2-d6d1096b4996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:39.959444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a38adb31-7161-4995-95d2-d6d1096b4996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:39.960082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a38adb31-7161-4995-95d2-d6d1096b4996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:40.038006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-01683946-ccbc-4268-af2c-d55357ffd4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:40.038604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-01683946-ccbc-4268-af2c-d55357ffd4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:40.040643 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:40.046677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-01683946-ccbc-4268-af2c-d55357ffd4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:40.047222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-01683946-ccbc-4268-af2c-d55357ffd4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:40.048065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-01683946-ccbc-4268-af2c-d55357ffd4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:40.048560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-01683946-ccbc-4268-af2c-d55357ffd4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:40.096196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a38adb31-7161-4995-95d2-d6d1096b4996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:40.104793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a38adb31-7161-4995-95d2-d6d1096b4996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:40.106304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a38adb31-7161-4995-95d2-d6d1096b4996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:40.107842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a38adb31-7161-4995-95d2-d6d1096b4996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.165374 Jul 26 18:32:40.108583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 273/541] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:40.160134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0e382a5b-f2ac-42e9-abb0-bf8ec8416323 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:40.162400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0e382a5b-f2ac-42e9-abb0-bf8ec8416323 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:40.169616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e382a5b-f2ac-42e9-abb0-bf8ec8416323 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:40.170058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e382a5b-f2ac-42e9-abb0-bf8ec8416323 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:40.171012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e382a5b-f2ac-42e9-abb0-bf8ec8416323 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:40.171627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e382a5b-f2ac-42e9-abb0-bf8ec8416323 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:40.202351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-01683946-ccbc-4268-af2c-d55357ffd4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:40.211340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-01683946-ccbc-4268-af2c-d55357ffd4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.177056 Jul 26 18:32:40.211915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 269/542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:40 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:40.325151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0e382a5b-f2ac-42e9-abb0-bf8ec8416323 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:40.333552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0e382a5b-f2ac-42e9-abb0-bf8ec8416323 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.177389 Jul 26 18:32:40.336482 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 274/543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:40 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:40.565814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a697a4a1-a648-4dd9-88ba-d1223909a165 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:40.566669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a697a4a1-a648-4dd9-88ba-d1223909a165 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:40.575588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a697a4a1-a648-4dd9-88ba-d1223909a165 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:40.576101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a697a4a1-a648-4dd9-88ba-d1223909a165 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:40.577198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a697a4a1-a648-4dd9-88ba-d1223909a165 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:40.577888 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a697a4a1-a648-4dd9-88ba-d1223909a165 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:40.648656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a697a4a1-a648-4dd9-88ba-d1223909a165 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:40.657327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a697a4a1-a648-4dd9-88ba-d1223909a165 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1311 microversion: 2.1 time: 0.096814 Jul 26 18:32:40.657935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 270/544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:40 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:41.131710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-93438fb2-09ab-42ba-ba20-f3529ea299d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:41.132598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-93438fb2-09ab-42ba-ba20-f3529ea299d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:41.139744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93438fb2-09ab-42ba-ba20-f3529ea299d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:41.140576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93438fb2-09ab-42ba-ba20-f3529ea299d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:41.141652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93438fb2-09ab-42ba-ba20-f3529ea299d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:41.142241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93438fb2-09ab-42ba-ba20-f3529ea299d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:41.234046 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3cef8f45-6107-4e0c-9038-e78f2bf2b75d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:41.234897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3cef8f45-6107-4e0c-9038-e78f2bf2b75d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:41.241537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cef8f45-6107-4e0c-9038-e78f2bf2b75d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:41.242241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cef8f45-6107-4e0c-9038-e78f2bf2b75d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:41.243214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cef8f45-6107-4e0c-9038-e78f2bf2b75d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:41.243797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cef8f45-6107-4e0c-9038-e78f2bf2b75d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:41.293974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-93438fb2-09ab-42ba-ba20-f3529ea299d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:41.307154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-93438fb2-09ab-42ba-ba20-f3529ea299d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:41.308715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-93438fb2-09ab-42ba-ba20-f3529ea299d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:41.310119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-93438fb2-09ab-42ba-ba20-f3529ea299d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.182802 Jul 26 18:32:41.323077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 275/545] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:41 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:41.357813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f8916b24-f8dd-4c97-96a9-527fa3ecfbef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:41.358475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f8916b24-f8dd-4c97-96a9-527fa3ecfbef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:41.368151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8916b24-f8dd-4c97-96a9-527fa3ecfbef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:41.369098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8916b24-f8dd-4c97-96a9-527fa3ecfbef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:41.369982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8916b24-f8dd-4c97-96a9-527fa3ecfbef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:41.370417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8916b24-f8dd-4c97-96a9-527fa3ecfbef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:41.409099 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3cef8f45-6107-4e0c-9038-e78f2bf2b75d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:41.419058 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3cef8f45-6107-4e0c-9038-e78f2bf2b75d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.189259 Jul 26 18:32:41.421195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 271/546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:41 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:41.525657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f8916b24-f8dd-4c97-96a9-527fa3ecfbef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:41.535152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f8916b24-f8dd-4c97-96a9-527fa3ecfbef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.182314 Jul 26 18:32:41.535937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 276/547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:41 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:41.678175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e3973d06-d7d6-44e6-b5b9-7470f4a00217 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:41.678771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e3973d06-d7d6-44e6-b5b9-7470f4a00217 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:41.691455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3973d06-d7d6-44e6-b5b9-7470f4a00217 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:41.691908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3973d06-d7d6-44e6-b5b9-7470f4a00217 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:41.692683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3973d06-d7d6-44e6-b5b9-7470f4a00217 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:41.693125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3973d06-d7d6-44e6-b5b9-7470f4a00217 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:41.715760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:41.768907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e3973d06-d7d6-44e6-b5b9-7470f4a00217 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:41.777761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e3973d06-d7d6-44e6-b5b9-7470f4a00217 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1311 microversion: 2.1 time: 0.103614 Jul 26 18:32:41.790927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 272/548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:41 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:42.336063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2408c074-f77a-4763-8979-9bb4c95bfb34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:42.337357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2408c074-f77a-4763-8979-9bb4c95bfb34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:42.344800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2408c074-f77a-4763-8979-9bb4c95bfb34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:42.345538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2408c074-f77a-4763-8979-9bb4c95bfb34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:42.346654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2408c074-f77a-4763-8979-9bb4c95bfb34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:42.347082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2408c074-f77a-4763-8979-9bb4c95bfb34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:42.442815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c94e2f7e-e9d5-4734-a414-9603cf9b1ff6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:42.443761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c94e2f7e-e9d5-4734-a414-9603cf9b1ff6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:42.456988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c94e2f7e-e9d5-4734-a414-9603cf9b1ff6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:42.458030 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c94e2f7e-e9d5-4734-a414-9603cf9b1ff6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:42.460744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c94e2f7e-e9d5-4734-a414-9603cf9b1ff6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:42.462962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c94e2f7e-e9d5-4734-a414-9603cf9b1ff6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:42.666497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2408c074-f77a-4763-8979-9bb4c95bfb34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:42.676344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2408c074-f77a-4763-8979-9bb4c95bfb34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:42.678166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2408c074-f77a-4763-8979-9bb4c95bfb34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:42.679574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2408c074-f77a-4763-8979-9bb4c95bfb34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.347558 Jul 26 18:32:42.680495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 277/549] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:42.685740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-41adb295-6cc1-46c1-9e64-f8ccbbf9fa1d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:42.686448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-41adb295-6cc1-46c1-9e64-f8ccbbf9fa1d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:42.694132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41adb295-6cc1-46c1-9e64-f8ccbbf9fa1d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:42.694583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41adb295-6cc1-46c1-9e64-f8ccbbf9fa1d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:42.695461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41adb295-6cc1-46c1-9e64-f8ccbbf9fa1d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:42.695895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41adb295-6cc1-46c1-9e64-f8ccbbf9fa1d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:42.779612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c94e2f7e-e9d5-4734-a414-9603cf9b1ff6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:42.788466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c94e2f7e-e9d5-4734-a414-9603cf9b1ff6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.351518 Jul 26 18:32:42.799906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 273/550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:42 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:42.808805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-59bb418e-28fd-43e6-821d-56394e6ff72c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:42.811581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-59bb418e-28fd-43e6-821d-56394e6ff72c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:42.820697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:42.824800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59bb418e-28fd-43e6-821d-56394e6ff72c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:42.825437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59bb418e-28fd-43e6-821d-56394e6ff72c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:42.826470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59bb418e-28fd-43e6-821d-56394e6ff72c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:42.826905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59bb418e-28fd-43e6-821d-56394e6ff72c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:42.919426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-59bb418e-28fd-43e6-821d-56394e6ff72c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:42.924125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-41adb295-6cc1-46c1-9e64-f8ccbbf9fa1d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:42.930721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-59bb418e-28fd-43e6-821d-56394e6ff72c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1299 microversion: 2.1 time: 0.129172 Jul 26 18:32:42.940890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-41adb295-6cc1-46c1-9e64-f8ccbbf9fa1d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.255554 Jul 26 18:32:42.942600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 278/551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:42 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:42.943961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 274/552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:42 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1299 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:43.706701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5a52c5bc-3cd5-4e66-b072-9c5fa6dacbe4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:43.708159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5a52c5bc-3cd5-4e66-b072-9c5fa6dacbe4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:43.716243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a52c5bc-3cd5-4e66-b072-9c5fa6dacbe4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:43.717123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a52c5bc-3cd5-4e66-b072-9c5fa6dacbe4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:43.718257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a52c5bc-3cd5-4e66-b072-9c5fa6dacbe4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:43.718905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a52c5bc-3cd5-4e66-b072-9c5fa6dacbe4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:43.811630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7baa95d9-ca8a-456f-a8fa-ae7bc380aa49 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:43.812785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7baa95d9-ca8a-456f-a8fa-ae7bc380aa49 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:43.824612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7baa95d9-ca8a-456f-a8fa-ae7bc380aa49 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:43.825061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7baa95d9-ca8a-456f-a8fa-ae7bc380aa49 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:43.831401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7baa95d9-ca8a-456f-a8fa-ae7bc380aa49 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:43.832000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7baa95d9-ca8a-456f-a8fa-ae7bc380aa49 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:44.012387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5a52c5bc-3cd5-4e66-b072-9c5fa6dacbe4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:44.025580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5a52c5bc-3cd5-4e66-b072-9c5fa6dacbe4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:44.028220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5a52c5bc-3cd5-4e66-b072-9c5fa6dacbe4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:44.029654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5a52c5bc-3cd5-4e66-b072-9c5fa6dacbe4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.326833 Jul 26 18:32:44.030574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 279/553] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:44.035456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c015b2fb-98a7-48dd-b76d-f3f4c50f7397 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:44.036115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c015b2fb-98a7-48dd-b76d-f3f4c50f7397 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:44.043506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c015b2fb-98a7-48dd-b76d-f3f4c50f7397 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:44.044039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c015b2fb-98a7-48dd-b76d-f3f4c50f7397 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:44.045239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c015b2fb-98a7-48dd-b76d-f3f4c50f7397 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:44.045834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c015b2fb-98a7-48dd-b76d-f3f4c50f7397 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:44.228824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c015b2fb-98a7-48dd-b76d-f3f4c50f7397 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:44.246468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c015b2fb-98a7-48dd-b76d-f3f4c50f7397 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1366 microversion: 2.1 time: 0.214525 Jul 26 18:32:44.247479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 280/554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:44 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:44.252504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ace81931-fa5a-4215-852b-b08caf2fec3c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:44.253466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ace81931-fa5a-4215-852b-b08caf2fec3c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:44.260171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ace81931-fa5a-4215-852b-b08caf2fec3c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:44.260924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ace81931-fa5a-4215-852b-b08caf2fec3c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:44.261961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ace81931-fa5a-4215-852b-b08caf2fec3c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:44.262615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ace81931-fa5a-4215-852b-b08caf2fec3c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:44.344913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7baa95d9-ca8a-456f-a8fa-ae7bc380aa49 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:44.361464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7baa95d9-ca8a-456f-a8fa-ae7bc380aa49 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.555742 Jul 26 18:32:44.365025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 275/555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:44.436264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ace81931-fa5a-4215-852b-b08caf2fec3c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:44.447481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ace81931-fa5a-4215-852b-b08caf2fec3c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.198534 Jul 26 18:32:44.448102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 281/556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:44 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:44.940023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-3bda4ec7-6131-4208-8b22-5008900879c2 req-e8038fd7-d4c3-441b-95c9-32e2c8248570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54c7ad3-e708-41db-ad30-52ed8fc45183", "tag": "c553e05a-5683-4c59-92d5-79f799e714ba"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:44.964780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-3bda4ec7-6131-4208-8b22-5008900879c2 req-e8038fd7-d4c3-441b-95c9-32e2c8248570 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:44.965714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-3bda4ec7-6131-4208-8b22-5008900879c2 req-e8038fd7-d4c3-441b-95c9-32e2c8248570 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:45.012250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-3bda4ec7-6131-4208-8b22-5008900879c2 req-e8038fd7-d4c3-441b-95c9-32e2c8248570 service nova] Creating event network-changed:c553e05a-5683-4c59-92d5-79f799e714ba for instance d54c7ad3-e708-41db-ad30-52ed8fc45183 on hv-cinder-82549 Jul 26 18:32:45.026091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-3bda4ec7-6131-4208-8b22-5008900879c2 req-e8038fd7-d4c3-441b-95c9-32e2c8248570 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093495 Jul 26 18:32:45.028247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 276/557] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:45.055342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c74adc73-404b-4ce1-9cbc-9e9267d6e053 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:45.056736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c74adc73-404b-4ce1-9cbc-9e9267d6e053 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:45.069584 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c74adc73-404b-4ce1-9cbc-9e9267d6e053 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:45.076851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c74adc73-404b-4ce1-9cbc-9e9267d6e053 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:45.078721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c74adc73-404b-4ce1-9cbc-9e9267d6e053 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:45.080282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c74adc73-404b-4ce1-9cbc-9e9267d6e053 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:45.270457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-127bda61-1792-42f0-ab70-3defc0e08548 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:45.271224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-127bda61-1792-42f0-ab70-3defc0e08548 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:45.274076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c74adc73-404b-4ce1-9cbc-9e9267d6e053 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:45.278817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-127bda61-1792-42f0-ab70-3defc0e08548 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:45.279479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-127bda61-1792-42f0-ab70-3defc0e08548 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:45.280432 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-127bda61-1792-42f0-ab70-3defc0e08548 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:45.281026 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-127bda61-1792-42f0-ab70-3defc0e08548 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:45.283160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c74adc73-404b-4ce1-9cbc-9e9267d6e053 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:45.284957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c74adc73-404b-4ce1-9cbc-9e9267d6e053 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:45.287787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c74adc73-404b-4ce1-9cbc-9e9267d6e053 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.238704 Jul 26 18:32:45.303052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 282/558] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:45.387530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-120d09b5-a564-4d8c-aa87-1655df50017c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:45.388165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-120d09b5-a564-4d8c-aa87-1655df50017c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:45.395359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-120d09b5-a564-4d8c-aa87-1655df50017c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:45.396078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-120d09b5-a564-4d8c-aa87-1655df50017c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:45.397024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-120d09b5-a564-4d8c-aa87-1655df50017c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:45.397627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-120d09b5-a564-4d8c-aa87-1655df50017c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:45.466299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-127bda61-1792-42f0-ab70-3defc0e08548 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:45.481083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-127bda61-1792-42f0-ab70-3defc0e08548 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1366 microversion: 2.1 time: 0.215993 Jul 26 18:32:45.482920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 277/559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:45 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:45.490772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d3911f45-e0af-4196-9307-987854931da9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:45.495012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d3911f45-e0af-4196-9307-987854931da9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:45.506551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3911f45-e0af-4196-9307-987854931da9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:45.509283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3911f45-e0af-4196-9307-987854931da9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:45.510315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3911f45-e0af-4196-9307-987854931da9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:45.510945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3911f45-e0af-4196-9307-987854931da9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:45.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-120d09b5-a564-4d8c-aa87-1655df50017c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:45.587879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-120d09b5-a564-4d8c-aa87-1655df50017c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.204436 Jul 26 18:32:45.588512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 283/560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:45 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:45.866077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d3911f45-e0af-4196-9307-987854931da9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:45.877370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-191585db-8df4-49cf-9151-bc08ab1473d4 req-42b9d527-8136-4cc9-8cbc-82c7b36a6c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fd40dc-ca21-4cab-9e60-49c838116404", "name": "network-vif-plugged", "status": "completed", "tag": "b4af147f-cc74-47f0-bbf7-ed1a1d0ac8d8"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:45.885414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d3911f45-e0af-4196-9307-987854931da9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.400255 Jul 26 18:32:45.888344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 278/561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:45 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:45.906885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-191585db-8df4-49cf-9151-bc08ab1473d4 req-42b9d527-8136-4cc9-8cbc-82c7b36a6c11 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:45.907430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-191585db-8df4-49cf-9151-bc08ab1473d4 req-42b9d527-8136-4cc9-8cbc-82c7b36a6c11 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:45.921377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-191585db-8df4-49cf-9151-bc08ab1473d4 req-42b9d527-8136-4cc9-8cbc-82c7b36a6c11 service nova] Creating event network-vif-plugged:b4af147f-cc74-47f0-bbf7-ed1a1d0ac8d8 for instance b5fd40dc-ca21-4cab-9e60-49c838116404 on hv-cinder-82549 Jul 26 18:32:45.927359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-191585db-8df4-49cf-9151-bc08ab1473d4 req-42b9d527-8136-4cc9-8cbc-82c7b36a6c11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054229 Jul 26 18:32:45.928555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 284/562] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:32:46.316844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f96f14e3-84d3-4b2b-ad43-79e10c0dd35f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:46.318703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f96f14e3-84d3-4b2b-ad43-79e10c0dd35f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:46.326820 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=8 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:46.329518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f96f14e3-84d3-4b2b-ad43-79e10c0dd35f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:46.330242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f96f14e3-84d3-4b2b-ad43-79e10c0dd35f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:46.331393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f96f14e3-84d3-4b2b-ad43-79e10c0dd35f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:46.332002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f96f14e3-84d3-4b2b-ad43-79e10c0dd35f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:46.505284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9550f04b-d86c-449e-9eda-e5cbcf22e686 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:46.506334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9550f04b-d86c-449e-9eda-e5cbcf22e686 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:46.514426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:46.520029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f96f14e3-84d3-4b2b-ad43-79e10c0dd35f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:46.525001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=12 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:46.530209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9550f04b-d86c-449e-9eda-e5cbcf22e686 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:46.534606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f96f14e3-84d3-4b2b-ad43-79e10c0dd35f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:46.536908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f96f14e3-84d3-4b2b-ad43-79e10c0dd35f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:46.538818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f96f14e3-84d3-4b2b-ad43-79e10c0dd35f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.226793 Jul 26 18:32:46.540302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9550f04b-d86c-449e-9eda-e5cbcf22e686 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:46.540583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 279/563] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:32:46.541389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9550f04b-d86c-449e-9eda-e5cbcf22e686 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:46.541921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9550f04b-d86c-449e-9eda-e5cbcf22e686 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:46.613068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-919d9a24-1795-4757-9b90-baf295572db9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:46.614044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-919d9a24-1795-4757-9b90-baf295572db9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:46.620670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-919d9a24-1795-4757-9b90-baf295572db9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:46.621369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-919d9a24-1795-4757-9b90-baf295572db9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:46.622379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-919d9a24-1795-4757-9b90-baf295572db9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:46.622992 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-919d9a24-1795-4757-9b90-baf295572db9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:46.729411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9550f04b-d86c-449e-9eda-e5cbcf22e686 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:46.741683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9550f04b-d86c-449e-9eda-e5cbcf22e686 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1366 microversion: 2.1 time: 0.240923 Jul 26 18:32:46.742440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 285/564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:46 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:46.784893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-919d9a24-1795-4757-9b90-baf295572db9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:46.798098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-919d9a24-1795-4757-9b90-baf295572db9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.188323 Jul 26 18:32:46.803196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 280/565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:46 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:46.909740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5e777daf-54a5-46d0-870e-c60fc4fd0f1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:46.910421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5e777daf-54a5-46d0-870e-c60fc4fd0f1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:46.917026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e777daf-54a5-46d0-870e-c60fc4fd0f1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:46.917466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e777daf-54a5-46d0-870e-c60fc4fd0f1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:46.918222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e777daf-54a5-46d0-870e-c60fc4fd0f1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:46.918651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e777daf-54a5-46d0-870e-c60fc4fd0f1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:46.937103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:47.075135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5e777daf-54a5-46d0-870e-c60fc4fd0f1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:47.083815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5e777daf-54a5-46d0-870e-c60fc4fd0f1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.177757 Jul 26 18:32:47.084469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 286/566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:46 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:47.568206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e43ce111-e849-4094-aa8f-2c660b5a57fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:47.568870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e43ce111-e849-4094-aa8f-2c660b5a57fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:47.575810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e43ce111-e849-4094-aa8f-2c660b5a57fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:47.576248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e43ce111-e849-4094-aa8f-2c660b5a57fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:47.577004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e43ce111-e849-4094-aa8f-2c660b5a57fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:47.577431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e43ce111-e849-4094-aa8f-2c660b5a57fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:47.738117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e43ce111-e849-4094-aa8f-2c660b5a57fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:47.749323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e43ce111-e849-4094-aa8f-2c660b5a57fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:47.751049 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e43ce111-e849-4094-aa8f-2c660b5a57fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:47.752391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e43ce111-e849-4094-aa8f-2c660b5a57fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.188125 Jul 26 18:32:47.758318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 281/567] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:47 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:47.765689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2602815c-22fc-4191-a468-b88b439a997d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:47.766495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2602815c-22fc-4191-a468-b88b439a997d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:47.773490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2602815c-22fc-4191-a468-b88b439a997d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:47.774486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2602815c-22fc-4191-a468-b88b439a997d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:47.776995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2602815c-22fc-4191-a468-b88b439a997d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:47.776995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2602815c-22fc-4191-a468-b88b439a997d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:47.820160 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-95c66b73-8c9c-46f6-9141-75eb292c1d6f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:47.824033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-95c66b73-8c9c-46f6-9141-75eb292c1d6f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:47.837149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95c66b73-8c9c-46f6-9141-75eb292c1d6f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:47.837149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95c66b73-8c9c-46f6-9141-75eb292c1d6f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:47.839806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95c66b73-8c9c-46f6-9141-75eb292c1d6f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:47.842742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95c66b73-8c9c-46f6-9141-75eb292c1d6f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:47.964078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2602815c-22fc-4191-a468-b88b439a997d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:47.983594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2602815c-22fc-4191-a468-b88b439a997d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1366 microversion: 2.1 time: 0.212924 Jul 26 18:32:47.998974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 287/568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:47 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:48.016513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-95c66b73-8c9c-46f6-9141-75eb292c1d6f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:48.028178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-95c66b73-8c9c-46f6-9141-75eb292c1d6f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.211509 Jul 26 18:32:48.029291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 282/569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:47 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:48.105460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7dd41c01-0d46-4132-a748-a02bbe28bfa5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:48.106167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7dd41c01-0d46-4132-a748-a02bbe28bfa5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:48.112762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dd41c01-0d46-4132-a748-a02bbe28bfa5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:48.113225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dd41c01-0d46-4132-a748-a02bbe28bfa5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:48.114196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dd41c01-0d46-4132-a748-a02bbe28bfa5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:48.114807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dd41c01-0d46-4132-a748-a02bbe28bfa5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:48.256690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7dd41c01-0d46-4132-a748-a02bbe28bfa5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:48.264993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7dd41c01-0d46-4132-a748-a02bbe28bfa5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.164171 Jul 26 18:32:48.265763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 288/570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:48 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:48.779503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9124b9e1-4d5a-4f28-b791-1c0bccb83d7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:48.780326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9124b9e1-4d5a-4f28-b791-1c0bccb83d7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:48.789680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9124b9e1-4d5a-4f28-b791-1c0bccb83d7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:48.790304 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9124b9e1-4d5a-4f28-b791-1c0bccb83d7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:48.791408 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9124b9e1-4d5a-4f28-b791-1c0bccb83d7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:48.791942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9124b9e1-4d5a-4f28-b791-1c0bccb83d7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:48.953289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9124b9e1-4d5a-4f28-b791-1c0bccb83d7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:48.964801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9124b9e1-4d5a-4f28-b791-1c0bccb83d7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:48.966450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9124b9e1-4d5a-4f28-b791-1c0bccb83d7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:48.967743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9124b9e1-4d5a-4f28-b791-1c0bccb83d7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.194554 Jul 26 18:32:48.968654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 283/571] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:49.008572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3f8fde4a-0b46-4e04-b0fa-598807e39080 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:49.009162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3f8fde4a-0b46-4e04-b0fa-598807e39080 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:49.015962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f8fde4a-0b46-4e04-b0fa-598807e39080 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:49.016430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f8fde4a-0b46-4e04-b0fa-598807e39080 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:49.017411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f8fde4a-0b46-4e04-b0fa-598807e39080 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:49.017838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f8fde4a-0b46-4e04-b0fa-598807e39080 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:49.055044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2e275545-1277-4ffe-b232-5a2e79d30d11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:49.058800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2e275545-1277-4ffe-b232-5a2e79d30d11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:49.066020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e275545-1277-4ffe-b232-5a2e79d30d11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:49.066608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e275545-1277-4ffe-b232-5a2e79d30d11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:49.067728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e275545-1277-4ffe-b232-5a2e79d30d11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:49.068444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e275545-1277-4ffe-b232-5a2e79d30d11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:49.187203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3f8fde4a-0b46-4e04-b0fa-598807e39080 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:49.199084 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3f8fde4a-0b46-4e04-b0fa-598807e39080 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1366 microversion: 2.1 time: 0.195191 Jul 26 18:32:49.212426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 289/572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:49 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:49.239463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2e275545-1277-4ffe-b232-5a2e79d30d11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:49.249063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2e275545-1277-4ffe-b232-5a2e79d30d11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1719 microversion: 2.1 time: 0.197687 Jul 26 18:32:49.250442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 284/573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:49 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1719 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:49.288707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c3fac7d4-5978-4a78-b354-4a533bcce7db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:49.289492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c3fac7d4-5978-4a78-b354-4a533bcce7db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:49.296724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3fac7d4-5978-4a78-b354-4a533bcce7db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:49.297134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3fac7d4-5978-4a78-b354-4a533bcce7db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:49.297922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3fac7d4-5978-4a78-b354-4a533bcce7db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:49.298350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3fac7d4-5978-4a78-b354-4a533bcce7db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:49.486548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c3fac7d4-5978-4a78-b354-4a533bcce7db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:49.496847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c3fac7d4-5978-4a78-b354-4a533bcce7db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.214497 Jul 26 18:32:49.497739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 290/574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:49 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:49.991121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-605a39e2-cc45-4f1c-8ea5-f9b0c30bd937 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:49.991767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-605a39e2-cc45-4f1c-8ea5-f9b0c30bd937 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:49.998819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-605a39e2-cc45-4f1c-8ea5-f9b0c30bd937 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:49.999322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-605a39e2-cc45-4f1c-8ea5-f9b0c30bd937 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:50.000098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-605a39e2-cc45-4f1c-8ea5-f9b0c30bd937 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:50.000495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-605a39e2-cc45-4f1c-8ea5-f9b0c30bd937 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:50.151616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-605a39e2-cc45-4f1c-8ea5-f9b0c30bd937 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:50.160940 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-605a39e2-cc45-4f1c-8ea5-f9b0c30bd937 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:50.165042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-605a39e2-cc45-4f1c-8ea5-f9b0c30bd937 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:50.165042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-605a39e2-cc45-4f1c-8ea5-f9b0c30bd937 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.177050 Jul 26 18:32:50.165042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 285/575] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:49 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:50.225077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8da1056a-74a4-4468-bf3f-cf5605a8a6e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:50.225930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8da1056a-74a4-4468-bf3f-cf5605a8a6e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:50.234708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8da1056a-74a4-4468-bf3f-cf5605a8a6e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:50.235489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8da1056a-74a4-4468-bf3f-cf5605a8a6e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:50.236452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8da1056a-74a4-4468-bf3f-cf5605a8a6e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:50.236909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8da1056a-74a4-4468-bf3f-cf5605a8a6e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:50.272868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0469f0e7-bc46-4c34-8848-73696db4911d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:50.274395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0469f0e7-bc46-4c34-8848-73696db4911d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:50.297717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0469f0e7-bc46-4c34-8848-73696db4911d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:50.298466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0469f0e7-bc46-4c34-8848-73696db4911d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:50.299406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0469f0e7-bc46-4c34-8848-73696db4911d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:50.305245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0469f0e7-bc46-4c34-8848-73696db4911d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:50.419736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8da1056a-74a4-4468-bf3f-cf5605a8a6e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:50.428911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8da1056a-74a4-4468-bf3f-cf5605a8a6e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1366 microversion: 2.1 time: 0.212893 Jul 26 18:32:50.430192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 291/576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:50 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:50.490297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0469f0e7-bc46-4c34-8848-73696db4911d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:50.499625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0469f0e7-bc46-4c34-8848-73696db4911d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1696 microversion: 2.1 time: 0.230650 Jul 26 18:32:50.500217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 286/577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:50 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1696 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:50.521665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7f500b94-937a-4d6c-918b-19fda26fe68d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:50.522977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7f500b94-937a-4d6c-918b-19fda26fe68d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:50.524096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-419ab9e3-a934-48f8-b14e-76dde11250c4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:50.530699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-419ab9e3-a934-48f8-b14e-76dde11250c4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:50.530927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f500b94-937a-4d6c-918b-19fda26fe68d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:50.531284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-419ab9e3-a934-48f8-b14e-76dde11250c4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:50.531950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f500b94-937a-4d6c-918b-19fda26fe68d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:50.533438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f500b94-937a-4d6c-918b-19fda26fe68d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:50.534152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f500b94-937a-4d6c-918b-19fda26fe68d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:50.596187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-419ab9e3-a934-48f8-b14e-76dde11250c4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Going to try to start instance {{(pid=117997) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 18:32:50.649186 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-419ab9e3-a934-48f8-b14e-76dde11250c4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "POST /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/action" status: 202 len: 0 microversion: 2.1 time: 0.128954 Jul 26 18:32:50.653127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 287/578] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:32:50 2022] POST /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 18:32:50.659288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b38382ad-23cf-4e76-b61e-cffb6eeccb60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:50.659993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b38382ad-23cf-4e76-b61e-cffb6eeccb60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:50.666536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b38382ad-23cf-4e76-b61e-cffb6eeccb60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:50.667508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b38382ad-23cf-4e76-b61e-cffb6eeccb60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:50.667808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b38382ad-23cf-4e76-b61e-cffb6eeccb60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:50.668239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b38382ad-23cf-4e76-b61e-cffb6eeccb60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:50.803746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7f500b94-937a-4d6c-918b-19fda26fe68d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:50.812650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7f500b94-937a-4d6c-918b-19fda26fe68d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.298073 Jul 26 18:32:50.815378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 292/579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:50 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:50.875696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b38382ad-23cf-4e76-b61e-cffb6eeccb60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:50.881604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:50.891048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b38382ad-23cf-4e76-b61e-cffb6eeccb60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1705 microversion: 2.1 time: 0.236519 Jul 26 18:32:50.892897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 288/580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:50 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1705 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:51.186471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-68ee2868-c38d-4788-b305-f1b5f2572f39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:51.187071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-68ee2868-c38d-4788-b305-f1b5f2572f39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:51.193704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68ee2868-c38d-4788-b305-f1b5f2572f39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:51.194137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68ee2868-c38d-4788-b305-f1b5f2572f39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:51.194993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68ee2868-c38d-4788-b305-f1b5f2572f39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:51.195319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68ee2868-c38d-4788-b305-f1b5f2572f39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:51.353254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-68ee2868-c38d-4788-b305-f1b5f2572f39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:51.362469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-68ee2868-c38d-4788-b305-f1b5f2572f39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:51.364059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-68ee2868-c38d-4788-b305-f1b5f2572f39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:51.365559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-68ee2868-c38d-4788-b305-f1b5f2572f39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1722 microversion: 2.20 time: 0.183035 Jul 26 18:32:51.371098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 293/581] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:51.458041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ddbbc6bc-7c38-43ef-b767-a76d04981b72 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:51.458658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ddbbc6bc-7c38-43ef-b767-a76d04981b72 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:51.467614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ddbbc6bc-7c38-43ef-b767-a76d04981b72 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:51.468039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ddbbc6bc-7c38-43ef-b767-a76d04981b72 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:51.468851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ddbbc6bc-7c38-43ef-b767-a76d04981b72 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:51.469280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ddbbc6bc-7c38-43ef-b767-a76d04981b72 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:51.628646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ddbbc6bc-7c38-43ef-b767-a76d04981b72 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:51.639928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ddbbc6bc-7c38-43ef-b767-a76d04981b72 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1366 microversion: 2.1 time: 0.184802 Jul 26 18:32:51.641121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 289/582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:51 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:51.837419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8dafcf87-bbba-4694-b874-d01d0ff236b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:51.838448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8dafcf87-bbba-4694-b874-d01d0ff236b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:51.845361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8dafcf87-bbba-4694-b874-d01d0ff236b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:51.846133 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8dafcf87-bbba-4694-b874-d01d0ff236b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:51.847166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8dafcf87-bbba-4694-b874-d01d0ff236b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:51.847836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8dafcf87-bbba-4694-b874-d01d0ff236b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:51.916298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-29c940f6-9025-4725-94cd-ae3cac59dde0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:51.917450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-29c940f6-9025-4725-94cd-ae3cac59dde0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:51.925626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29c940f6-9025-4725-94cd-ae3cac59dde0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:51.926280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29c940f6-9025-4725-94cd-ae3cac59dde0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:51.927300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29c940f6-9025-4725-94cd-ae3cac59dde0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:51.927879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29c940f6-9025-4725-94cd-ae3cac59dde0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:52.011646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8dafcf87-bbba-4694-b874-d01d0ff236b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:52.020244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8dafcf87-bbba-4694-b874-d01d0ff236b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.186613 Jul 26 18:32:52.022144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 294/583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:51 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:52.119788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-29c940f6-9025-4725-94cd-ae3cac59dde0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:52.128944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-29c940f6-9025-4725-94cd-ae3cac59dde0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1705 microversion: 2.1 time: 0.218497 Jul 26 18:32:52.130153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 290/584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1705 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:52.392784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0f4419dc-08f4-4fb2-b0f7-7d2d1879c7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:52.393513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f4419dc-08f4-4fb2-b0f7-7d2d1879c7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:52.407502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f4419dc-08f4-4fb2-b0f7-7d2d1879c7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:52.407957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f4419dc-08f4-4fb2-b0f7-7d2d1879c7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:52.411762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f4419dc-08f4-4fb2-b0f7-7d2d1879c7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:52.412342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f4419dc-08f4-4fb2-b0f7-7d2d1879c7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:52.622959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0f4419dc-08f4-4fb2-b0f7-7d2d1879c7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:52.632165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0f4419dc-08f4-4fb2-b0f7-7d2d1879c7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:52.634421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0f4419dc-08f4-4fb2-b0f7-7d2d1879c7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:52.635716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0f4419dc-08f4-4fb2-b0f7-7d2d1879c7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1743 microversion: 2.20 time: 0.249665 Jul 26 18:32:52.647826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 295/585] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:52.672028 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f647d338-84fa-407e-a9b3-c3c592ee9d35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:52.672752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f647d338-84fa-407e-a9b3-c3c592ee9d35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:52.679687 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f647d338-84fa-407e-a9b3-c3c592ee9d35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:52.680138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f647d338-84fa-407e-a9b3-c3c592ee9d35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:52.680920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f647d338-84fa-407e-a9b3-c3c592ee9d35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:52.681359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f647d338-84fa-407e-a9b3-c3c592ee9d35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:52.860890 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f647d338-84fa-407e-a9b3-c3c592ee9d35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:52.880704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f647d338-84fa-407e-a9b3-c3c592ee9d35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1366 microversion: 2.1 time: 0.205176 Jul 26 18:32:52.883469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 291/586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:52 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:53.009215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-b7d342ce-62c8-4995-9969-0d3da89a0e44 req-263c8376-ebec-4c29-8f80-6222e684f656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54c7ad3-e708-41db-ad30-52ed8fc45183", "name": "network-vif-plugged", "status": "completed", "tag": "c553e05a-5683-4c59-92d5-79f799e714ba"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:53.021026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-b7d342ce-62c8-4995-9969-0d3da89a0e44 req-263c8376-ebec-4c29-8f80-6222e684f656 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:53.021650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-b7d342ce-62c8-4995-9969-0d3da89a0e44 req-263c8376-ebec-4c29-8f80-6222e684f656 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:53.037024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-b7d342ce-62c8-4995-9969-0d3da89a0e44 req-263c8376-ebec-4c29-8f80-6222e684f656 service nova] Creating event network-vif-plugged:c553e05a-5683-4c59-92d5-79f799e714ba for instance d54c7ad3-e708-41db-ad30-52ed8fc45183 on hv-cinder-82549 Jul 26 18:32:53.040070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-b7d342ce-62c8-4995-9969-0d3da89a0e44 req-263c8376-ebec-4c29-8f80-6222e684f656 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036473 Jul 26 18:32:53.042135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 296/587] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:53.047625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-76fd1789-2403-495e-983b-b363cf2df165 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:53.048510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-76fd1789-2403-495e-983b-b363cf2df165 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:53.055078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76fd1789-2403-495e-983b-b363cf2df165 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:53.055655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76fd1789-2403-495e-983b-b363cf2df165 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:53.056560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76fd1789-2403-495e-983b-b363cf2df165 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:53.057082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76fd1789-2403-495e-983b-b363cf2df165 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:53.161388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-391ade8d-82a8-41a1-b63c-5973f25a169f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:53.162091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-391ade8d-82a8-41a1-b63c-5973f25a169f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:53.169043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-391ade8d-82a8-41a1-b63c-5973f25a169f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:53.169492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-391ade8d-82a8-41a1-b63c-5973f25a169f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:53.170264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-391ade8d-82a8-41a1-b63c-5973f25a169f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:53.170698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-391ade8d-82a8-41a1-b63c-5973f25a169f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:53.238553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-76fd1789-2403-495e-983b-b363cf2df165 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:53.247709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-76fd1789-2403-495e-983b-b363cf2df165 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1319 microversion: 2.1 time: 0.203980 Jul 26 18:32:53.249427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 292/588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:53 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:53.337282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-391ade8d-82a8-41a1-b63c-5973f25a169f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:53.346480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-391ade8d-82a8-41a1-b63c-5973f25a169f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1705 microversion: 2.1 time: 0.189368 Jul 26 18:32:53.347106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 297/589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:53 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1705 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:53.666892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-61f423be-d29a-40aa-a200-2b734ccb4f43 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:53.667779 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-61f423be-d29a-40aa-a200-2b734ccb4f43 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:53.681712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-61f423be-d29a-40aa-a200-2b734ccb4f43 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:53.684488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-61f423be-d29a-40aa-a200-2b734ccb4f43 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:53.685456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-61f423be-d29a-40aa-a200-2b734ccb4f43 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:53.686976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-61f423be-d29a-40aa-a200-2b734ccb4f43 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:53.895555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-00b8ee95-95af-4072-8276-1bebb92bb9d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:53.896163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-00b8ee95-95af-4072-8276-1bebb92bb9d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:53.907189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00b8ee95-95af-4072-8276-1bebb92bb9d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:53.908183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00b8ee95-95af-4072-8276-1bebb92bb9d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:53.909270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00b8ee95-95af-4072-8276-1bebb92bb9d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:53.909922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00b8ee95-95af-4072-8276-1bebb92bb9d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:54.082049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-00b8ee95-95af-4072-8276-1bebb92bb9d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:54.090344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-00b8ee95-95af-4072-8276-1bebb92bb9d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1366 microversion: 2.1 time: 0.198565 Jul 26 18:32:54.090922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 298/590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:53 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:32:54.123280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-61f423be-d29a-40aa-a200-2b734ccb4f43 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:54.138476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-61f423be-d29a-40aa-a200-2b734ccb4f43 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:54.140491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-61f423be-d29a-40aa-a200-2b734ccb4f43 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:54.141916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-61f423be-d29a-40aa-a200-2b734ccb4f43 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1743 microversion: 2.20 time: 0.479647 Jul 26 18:32:54.147129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 293/591] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1743 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:54.269763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-92a16ce0-172c-486e-8e6e-c4e94a22849c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:54.271147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-92a16ce0-172c-486e-8e6e-c4e94a22849c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:54.279117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92a16ce0-172c-486e-8e6e-c4e94a22849c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:54.279917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92a16ce0-172c-486e-8e6e-c4e94a22849c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:54.281107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92a16ce0-172c-486e-8e6e-c4e94a22849c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:54.281757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92a16ce0-172c-486e-8e6e-c4e94a22849c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:54.371483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-09ed0ffa-870a-413c-8bc2-328db9336938 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:54.372087 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-09ed0ffa-870a-413c-8bc2-328db9336938 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:54.386444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09ed0ffa-870a-413c-8bc2-328db9336938 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:54.387316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09ed0ffa-870a-413c-8bc2-328db9336938 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:54.388387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09ed0ffa-870a-413c-8bc2-328db9336938 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:54.389044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09ed0ffa-870a-413c-8bc2-328db9336938 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:54.463996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-92a16ce0-172c-486e-8e6e-c4e94a22849c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:54.480737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-92a16ce0-172c-486e-8e6e-c4e94a22849c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1508 microversion: 2.1 time: 0.214998 Jul 26 18:32:54.483075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 299/592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:54 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:54.618181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-09ed0ffa-870a-413c-8bc2-328db9336938 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:54.627939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-09ed0ffa-870a-413c-8bc2-328db9336938 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1705 microversion: 2.1 time: 0.260369 Jul 26 18:32:54.628948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 294/593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:54 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1705 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:55.121750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8ea0d001-0136-41d2-9890-a55e9c6e4bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:55.124149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8ea0d001-0136-41d2-9890-a55e9c6e4bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:55.138338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ea0d001-0136-41d2-9890-a55e9c6e4bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:55.138792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ea0d001-0136-41d2-9890-a55e9c6e4bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:55.140108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ea0d001-0136-41d2-9890-a55e9c6e4bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:55.140810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ea0d001-0136-41d2-9890-a55e9c6e4bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:55.171236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4621e80c-7a36-4251-802a-c6ed5220b18c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:55.172127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4621e80c-7a36-4251-802a-c6ed5220b18c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:55.190637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4621e80c-7a36-4251-802a-c6ed5220b18c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:55.192848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4621e80c-7a36-4251-802a-c6ed5220b18c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:55.197188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4621e80c-7a36-4251-802a-c6ed5220b18c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:55.198108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4621e80c-7a36-4251-802a-c6ed5220b18c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:55.411139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8ea0d001-0136-41d2-9890-a55e9c6e4bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:55.419868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8ea0d001-0136-41d2-9890-a55e9c6e4bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1366 microversion: 2.1 time: 0.310337 Jul 26 18:32:55.420907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 300/594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:55 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:55.448970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4621e80c-7a36-4251-802a-c6ed5220b18c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:55.462680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4621e80c-7a36-4251-802a-c6ed5220b18c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:55.464259 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4621e80c-7a36-4251-802a-c6ed5220b18c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:55.465434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4621e80c-7a36-4251-802a-c6ed5220b18c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1743 microversion: 2.20 time: 0.299451 Jul 26 18:32:55.466557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 295/595] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:55 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1743 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:55.651400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e166bb51-7a36-4ed6-9b7a-2a8e4ba3a72e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:55.652650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e166bb51-7a36-4ed6-9b7a-2a8e4ba3a72e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:55.661359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e166bb51-7a36-4ed6-9b7a-2a8e4ba3a72e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:55.662183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e166bb51-7a36-4ed6-9b7a-2a8e4ba3a72e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:55.663304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e166bb51-7a36-4ed6-9b7a-2a8e4ba3a72e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:55.664104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e166bb51-7a36-4ed6-9b7a-2a8e4ba3a72e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:55.851054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e166bb51-7a36-4ed6-9b7a-2a8e4ba3a72e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:55.863982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e166bb51-7a36-4ed6-9b7a-2a8e4ba3a72e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1705 microversion: 2.1 time: 0.217610 Jul 26 18:32:55.865039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 301/596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1705 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:56.442905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-956de2ad-362e-4843-948c-17bbc30d673e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:56.443567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-956de2ad-362e-4843-948c-17bbc30d673e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:56.452631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-956de2ad-362e-4843-948c-17bbc30d673e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:56.453382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-956de2ad-362e-4843-948c-17bbc30d673e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:56.454211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-956de2ad-362e-4843-948c-17bbc30d673e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:56.454839 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-956de2ad-362e-4843-948c-17bbc30d673e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:56.506193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f98a0c7f-b439-493b-a345-4f75ff523d78 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:56.507073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f98a0c7f-b439-493b-a345-4f75ff523d78 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:56.513993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f98a0c7f-b439-493b-a345-4f75ff523d78 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:56.514593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f98a0c7f-b439-493b-a345-4f75ff523d78 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:56.515509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f98a0c7f-b439-493b-a345-4f75ff523d78 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:56.516009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f98a0c7f-b439-493b-a345-4f75ff523d78 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:56.722365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f98a0c7f-b439-493b-a345-4f75ff523d78 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:56.734731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f98a0c7f-b439-493b-a345-4f75ff523d78 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:56.737296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f98a0c7f-b439-493b-a345-4f75ff523d78 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:56.739823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f98a0c7f-b439-493b-a345-4f75ff523d78 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1743 microversion: 2.20 time: 0.249999 Jul 26 18:32:56.741467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 302/597] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:56 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:56.744116 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-956de2ad-362e-4843-948c-17bbc30d673e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:56.775238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-956de2ad-362e-4843-948c-17bbc30d673e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1366 microversion: 2.1 time: 0.336473 Jul 26 18:32:56.776512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 296/598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:56 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:56.886192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f5d0d8d4-e646-4b1f-b400-62e0835e09b2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:56.887140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f5d0d8d4-e646-4b1f-b400-62e0835e09b2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:56.905835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5d0d8d4-e646-4b1f-b400-62e0835e09b2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:56.911273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5d0d8d4-e646-4b1f-b400-62e0835e09b2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:56.912426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5d0d8d4-e646-4b1f-b400-62e0835e09b2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:56.913049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5d0d8d4-e646-4b1f-b400-62e0835e09b2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:57.049457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-60057743-50c5-40e7-818b-4f41df7476d2 req-626058de-eb62-46db-a20c-f7ca2a18951d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240d5470-7916-48a4-b90f-910c88d68384", "name": "network-vif-plugged", "status": "completed", "tag": "e225f24a-f0f4-4283-af60-d533e1dd5c9d"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:57.072991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-60057743-50c5-40e7-818b-4f41df7476d2 req-626058de-eb62-46db-a20c-f7ca2a18951d service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:57.078285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-60057743-50c5-40e7-818b-4f41df7476d2 req-626058de-eb62-46db-a20c-f7ca2a18951d service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:57.099067 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-60057743-50c5-40e7-818b-4f41df7476d2 req-626058de-eb62-46db-a20c-f7ca2a18951d service nova] Creating event network-vif-plugged:e225f24a-f0f4-4283-af60-d533e1dd5c9d for instance 240d5470-7916-48a4-b90f-910c88d68384 on hv-cinder-82549 Jul 26 18:32:57.104863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-60057743-50c5-40e7-818b-4f41df7476d2 req-626058de-eb62-46db-a20c-f7ca2a18951d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058989 Jul 26 18:32:57.106777 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 297/599] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:57.128916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f5d0d8d4-e646-4b1f-b400-62e0835e09b2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:57.132786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:32:57.139287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f5d0d8d4-e646-4b1f-b400-62e0835e09b2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1705 microversion: 2.1 time: 0.257192 Jul 26 18:32:57.153432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 303/600] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:56 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1705 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:57.768745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-da62167c-d25d-4008-b5d7-19ebff170945 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:57.769651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-da62167c-d25d-4008-b5d7-19ebff170945 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:57.777445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-da62167c-d25d-4008-b5d7-19ebff170945 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:57.777910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-da62167c-d25d-4008-b5d7-19ebff170945 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:57.778698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-da62167c-d25d-4008-b5d7-19ebff170945 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:57.779159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-da62167c-d25d-4008-b5d7-19ebff170945 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:57.798732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cc956ed8-0dc1-41b3-9a9d-e1f778fb9322 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:57.799454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cc956ed8-0dc1-41b3-9a9d-e1f778fb9322 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:57.807195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc956ed8-0dc1-41b3-9a9d-e1f778fb9322 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:57.807650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc956ed8-0dc1-41b3-9a9d-e1f778fb9322 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:57.808422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc956ed8-0dc1-41b3-9a9d-e1f778fb9322 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:57.808859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc956ed8-0dc1-41b3-9a9d-e1f778fb9322 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:57.969906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-da62167c-d25d-4008-b5d7-19ebff170945 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:57.988393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cc956ed8-0dc1-41b3-9a9d-e1f778fb9322 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:57.991496 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-da62167c-d25d-4008-b5d7-19ebff170945 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:57.993105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-da62167c-d25d-4008-b5d7-19ebff170945 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:57.994395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-da62167c-d25d-4008-b5d7-19ebff170945 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1743 microversion: 2.20 time: 0.230226 Jul 26 18:32:57.994954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 298/601] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:57 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1743 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:32:57.997793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cc956ed8-0dc1-41b3-9a9d-e1f778fb9322 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1556 microversion: 2.1 time: 0.203302 Jul 26 18:32:57.999057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 304/602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:57 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1556 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:58.018235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e9003843-75e9-4355-a454-f110504829b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:58.018722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e9003843-75e9-4355-a454-f110504829b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:58.025145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9003843-75e9-4355-a454-f110504829b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:58.025600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9003843-75e9-4355-a454-f110504829b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:58.026351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9003843-75e9-4355-a454-f110504829b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:58.026772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9003843-75e9-4355-a454-f110504829b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:58.103763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e9003843-75e9-4355-a454-f110504829b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089377 Jul 26 18:32:58.104401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 299/603] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Jul 26 18:32:58 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:32:58.161129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4734d18b-5a28-4010-9f42-8ec70532673a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:58.161732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4734d18b-5a28-4010-9f42-8ec70532673a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:58.168218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4734d18b-5a28-4010-9f42-8ec70532673a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:58.168659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4734d18b-5a28-4010-9f42-8ec70532673a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:58.169415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4734d18b-5a28-4010-9f42-8ec70532673a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:58.169845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4734d18b-5a28-4010-9f42-8ec70532673a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:58.429320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4734d18b-5a28-4010-9f42-8ec70532673a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:58.438217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4734d18b-5a28-4010-9f42-8ec70532673a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1705 microversion: 2.1 time: 0.281029 Jul 26 18:32:58.439298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 305/604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:58 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1705 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:32:59.018134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1697b32d-51b9-4d64-8406-4a38d5581b27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:59.018958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1697b32d-51b9-4d64-8406-4a38d5581b27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:59.027775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1697b32d-51b9-4d64-8406-4a38d5581b27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:59.028222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1697b32d-51b9-4d64-8406-4a38d5581b27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:59.029051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1697b32d-51b9-4d64-8406-4a38d5581b27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:59.029595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1697b32d-51b9-4d64-8406-4a38d5581b27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:59.224447 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1697b32d-51b9-4d64-8406-4a38d5581b27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:59.236512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1697b32d-51b9-4d64-8406-4a38d5581b27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:59.237985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1697b32d-51b9-4d64-8406-4a38d5581b27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:59.239433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1697b32d-51b9-4d64-8406-4a38d5581b27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1743 microversion: 2.20 time: 0.225245 Jul 26 18:32:59.240490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 300/605] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:32:59 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1743 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:32:59.249562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-8e9464ee-2e8f-4531-aa92-0dc8e5425465 req-4182d184-da0d-47a1-be00-f7fbb92ebb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54c7ad3-e708-41db-ad30-52ed8fc45183", "tag": "c553e05a-5683-4c59-92d5-79f799e714ba"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:32:59.259506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-8e9464ee-2e8f-4531-aa92-0dc8e5425465 req-4182d184-da0d-47a1-be00-f7fbb92ebb02 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:59.260249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-8e9464ee-2e8f-4531-aa92-0dc8e5425465 req-4182d184-da0d-47a1-be00-f7fbb92ebb02 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:59.272936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-8e9464ee-2e8f-4531-aa92-0dc8e5425465 req-4182d184-da0d-47a1-be00-f7fbb92ebb02 service nova] Creating event network-changed:c553e05a-5683-4c59-92d5-79f799e714ba for instance d54c7ad3-e708-41db-ad30-52ed8fc45183 on hv-cinder-82549 Jul 26 18:32:59.278725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-8e9464ee-2e8f-4531-aa92-0dc8e5425465 req-4182d184-da0d-47a1-be00-f7fbb92ebb02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037029 Jul 26 18:32:59.279668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 306/606] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:32:59.459965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-60d39011-9eb0-4f87-b883-77d83adccedf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:32:59.460592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-60d39011-9eb0-4f87-b883-77d83adccedf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:32:59.468263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60d39011-9eb0-4f87-b883-77d83adccedf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:59.468714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60d39011-9eb0-4f87-b883-77d83adccedf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:59.469500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60d39011-9eb0-4f87-b883-77d83adccedf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:32:59.469933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60d39011-9eb0-4f87-b883-77d83adccedf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:32:59.630553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-60d39011-9eb0-4f87-b883-77d83adccedf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:32:59.639277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-60d39011-9eb0-4f87-b883-77d83adccedf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1709 microversion: 2.1 time: 0.183118 Jul 26 18:32:59.640277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 301/607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:32:59 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1709 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:33:00.265504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3c621452-9596-49b4-9d48-9eaf1e8ece6d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:00.266408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3c621452-9596-49b4-9d48-9eaf1e8ece6d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:00.275170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c621452-9596-49b4-9d48-9eaf1e8ece6d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:00.275618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c621452-9596-49b4-9d48-9eaf1e8ece6d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:00.276384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c621452-9596-49b4-9d48-9eaf1e8ece6d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:00.276808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c621452-9596-49b4-9d48-9eaf1e8ece6d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:00.458045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3c621452-9596-49b4-9d48-9eaf1e8ece6d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:00.467343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3c621452-9596-49b4-9d48-9eaf1e8ece6d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:00.469133 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3c621452-9596-49b4-9d48-9eaf1e8ece6d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:00.470337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3c621452-9596-49b4-9d48-9eaf1e8ece6d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1743 microversion: 2.20 time: 0.209662 Jul 26 18:33:00.471086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 307/608] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:00 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1743 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:01.495819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fab908dc-21bf-4769-bc90-1b6142b16f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:01.496572 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fab908dc-21bf-4769-bc90-1b6142b16f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:01.503813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fab908dc-21bf-4769-bc90-1b6142b16f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:01.504233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fab908dc-21bf-4769-bc90-1b6142b16f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:01.505463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fab908dc-21bf-4769-bc90-1b6142b16f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:01.505902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fab908dc-21bf-4769-bc90-1b6142b16f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:01.659982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fab908dc-21bf-4769-bc90-1b6142b16f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:01.669296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fab908dc-21bf-4769-bc90-1b6142b16f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:01.670823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fab908dc-21bf-4769-bc90-1b6142b16f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:01.672180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fab908dc-21bf-4769-bc90-1b6142b16f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1743 microversion: 2.20 time: 0.180487 Jul 26 18:33:01.673282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 302/609] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:01 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:02.698048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-314a2534-cd6e-4cd6-8734-2b3f3f91575b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:02.698959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-314a2534-cd6e-4cd6-8734-2b3f3f91575b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:02.705468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:33:02.707409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-314a2534-cd6e-4cd6-8734-2b3f3f91575b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:02.707954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-314a2534-cd6e-4cd6-8734-2b3f3f91575b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:02.709013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-314a2534-cd6e-4cd6-8734-2b3f3f91575b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:02.709453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-314a2534-cd6e-4cd6-8734-2b3f3f91575b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:02.885048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-314a2534-cd6e-4cd6-8734-2b3f3f91575b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:02.894462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-314a2534-cd6e-4cd6-8734-2b3f3f91575b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:02.897599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-314a2534-cd6e-4cd6-8734-2b3f3f91575b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:02.899479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-314a2534-cd6e-4cd6-8734-2b3f3f91575b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1738 microversion: 2.20 time: 0.205865 Jul 26 18:33:02.900363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 308/610] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:02 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:03.943666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2dc8f031-db4d-43d9-a331-6195ed96ffb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:03.944335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2dc8f031-db4d-43d9-a331-6195ed96ffb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:03.952301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2dc8f031-db4d-43d9-a331-6195ed96ffb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:03.953119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2dc8f031-db4d-43d9-a331-6195ed96ffb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:03.954269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2dc8f031-db4d-43d9-a331-6195ed96ffb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:03.956726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2dc8f031-db4d-43d9-a331-6195ed96ffb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:04.129680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2dc8f031-db4d-43d9-a331-6195ed96ffb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:04.140871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2dc8f031-db4d-43d9-a331-6195ed96ffb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:04.142658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2dc8f031-db4d-43d9-a331-6195ed96ffb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:04.143936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2dc8f031-db4d-43d9-a331-6195ed96ffb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1738 microversion: 2.20 time: 0.220821 Jul 26 18:33:04.151065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 303/611] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:03 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:05.170399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8261417c-e935-470e-9d33-c967081d624e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:05.171812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8261417c-e935-470e-9d33-c967081d624e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:05.179360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8261417c-e935-470e-9d33-c967081d624e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:05.180108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8261417c-e935-470e-9d33-c967081d624e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:05.181138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8261417c-e935-470e-9d33-c967081d624e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:05.181640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8261417c-e935-470e-9d33-c967081d624e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:05.327554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8261417c-e935-470e-9d33-c967081d624e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:05.336457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8261417c-e935-470e-9d33-c967081d624e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:05.338081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8261417c-e935-470e-9d33-c967081d624e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:05.339357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8261417c-e935-470e-9d33-c967081d624e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1738 microversion: 2.20 time: 0.175115 Jul 26 18:33:05.339943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 309/612] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:06.362658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5143ad3d-f662-4171-b155-d55825e6f86c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:06.364135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5143ad3d-f662-4171-b155-d55825e6f86c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:06.371903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5143ad3d-f662-4171-b155-d55825e6f86c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:06.372350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5143ad3d-f662-4171-b155-d55825e6f86c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:06.373126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5143ad3d-f662-4171-b155-d55825e6f86c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:06.373551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5143ad3d-f662-4171-b155-d55825e6f86c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:06.521371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5143ad3d-f662-4171-b155-d55825e6f86c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:06.531273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5143ad3d-f662-4171-b155-d55825e6f86c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:06.532822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5143ad3d-f662-4171-b155-d55825e6f86c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:06.534086 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5143ad3d-f662-4171-b155-d55825e6f86c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1738 microversion: 2.20 time: 0.175226 Jul 26 18:33:06.534949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 304/613] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:06 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:07.558577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8c252bec-aaa1-445f-b03f-8c3ed00fa088 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:07.559223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8c252bec-aaa1-445f-b03f-8c3ed00fa088 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:07.566724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c252bec-aaa1-445f-b03f-8c3ed00fa088 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:07.567215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c252bec-aaa1-445f-b03f-8c3ed00fa088 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:07.567972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c252bec-aaa1-445f-b03f-8c3ed00fa088 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:07.568404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c252bec-aaa1-445f-b03f-8c3ed00fa088 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:07.717936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8c252bec-aaa1-445f-b03f-8c3ed00fa088 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:07.726101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8c252bec-aaa1-445f-b03f-8c3ed00fa088 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:07.727642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8c252bec-aaa1-445f-b03f-8c3ed00fa088 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:07.728892 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8c252bec-aaa1-445f-b03f-8c3ed00fa088 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1738 microversion: 2.20 time: 0.174580 Jul 26 18:33:07.729462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 310/614] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:08.755231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3d6e57e6-2342-4736-baa4-577a2df428fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:08.755846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3d6e57e6-2342-4736-baa4-577a2df428fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:08.780505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d6e57e6-2342-4736-baa4-577a2df428fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:08.781081 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d6e57e6-2342-4736-baa4-577a2df428fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:08.790969 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d6e57e6-2342-4736-baa4-577a2df428fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:08.791906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d6e57e6-2342-4736-baa4-577a2df428fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:08.953503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3d6e57e6-2342-4736-baa4-577a2df428fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:08.965678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3d6e57e6-2342-4736-baa4-577a2df428fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:08.965678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3d6e57e6-2342-4736-baa4-577a2df428fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:08.966382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3d6e57e6-2342-4736-baa4-577a2df428fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1738 microversion: 2.20 time: 0.216556 Jul 26 18:33:08.979626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 305/615] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:08 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:09.991271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-17d66586-f111-4567-b439-eeaed04229e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:09.992632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-17d66586-f111-4567-b439-eeaed04229e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:10.001163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17d66586-f111-4567-b439-eeaed04229e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:10.001544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17d66586-f111-4567-b439-eeaed04229e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:10.002320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17d66586-f111-4567-b439-eeaed04229e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:10.002950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17d66586-f111-4567-b439-eeaed04229e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:10.149025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-17d66586-f111-4567-b439-eeaed04229e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:10.159416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-17d66586-f111-4567-b439-eeaed04229e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:10.160930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-17d66586-f111-4567-b439-eeaed04229e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:10.162273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-17d66586-f111-4567-b439-eeaed04229e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1738 microversion: 2.20 time: 0.176035 Jul 26 18:33:10.163007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 311/616] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:09 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:11.189896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cd675f3e-70fc-46ff-a836-4faf5dc8f668 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:11.190782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cd675f3e-70fc-46ff-a836-4faf5dc8f668 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:11.201322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd675f3e-70fc-46ff-a836-4faf5dc8f668 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:11.202070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd675f3e-70fc-46ff-a836-4faf5dc8f668 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:11.203361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd675f3e-70fc-46ff-a836-4faf5dc8f668 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:11.203957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd675f3e-70fc-46ff-a836-4faf5dc8f668 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:11.222075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:33:11.398685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cd675f3e-70fc-46ff-a836-4faf5dc8f668 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:11.416763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cd675f3e-70fc-46ff-a836-4faf5dc8f668 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:11.420587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cd675f3e-70fc-46ff-a836-4faf5dc8f668 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:11.423278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cd675f3e-70fc-46ff-a836-4faf5dc8f668 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1738 microversion: 2.20 time: 0.237024 Jul 26 18:33:11.424870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 306/617] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:12.448170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5247be2e-c701-49d2-b77a-a5bea41d04e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:12.448964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5247be2e-c701-49d2-b77a-a5bea41d04e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:12.455993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5247be2e-c701-49d2-b77a-a5bea41d04e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:12.456760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5247be2e-c701-49d2-b77a-a5bea41d04e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:12.457968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5247be2e-c701-49d2-b77a-a5bea41d04e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:12.459819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5247be2e-c701-49d2-b77a-a5bea41d04e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:12.627332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5247be2e-c701-49d2-b77a-a5bea41d04e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:12.643575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5247be2e-c701-49d2-b77a-a5bea41d04e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:12.645307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5247be2e-c701-49d2-b77a-a5bea41d04e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:12.646493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5247be2e-c701-49d2-b77a-a5bea41d04e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1738 microversion: 2.20 time: 0.202530 Jul 26 18:33:12.647084 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 312/618] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:12 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:13.674007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0e1e3994-edad-4e83-9566-48f57145b620 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:13.674568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0e1e3994-edad-4e83-9566-48f57145b620 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:13.677883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=66 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:33:13.684623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e1e3994-edad-4e83-9566-48f57145b620 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:13.685068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e1e3994-edad-4e83-9566-48f57145b620 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:13.685831 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e1e3994-edad-4e83-9566-48f57145b620 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:13.686261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e1e3994-edad-4e83-9566-48f57145b620 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:13.830314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0e1e3994-edad-4e83-9566-48f57145b620 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:13.841355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0e1e3994-edad-4e83-9566-48f57145b620 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:13.842865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0e1e3994-edad-4e83-9566-48f57145b620 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:13.844046 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0e1e3994-edad-4e83-9566-48f57145b620 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1738 microversion: 2.20 time: 0.176255 Jul 26 18:33:13.844617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 307/619] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:14.867487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4fb886e7-69bf-48b8-ba52-8855e82ccf74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:14.868227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4fb886e7-69bf-48b8-ba52-8855e82ccf74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:14.875990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4fb886e7-69bf-48b8-ba52-8855e82ccf74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:14.876506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4fb886e7-69bf-48b8-ba52-8855e82ccf74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:14.877737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4fb886e7-69bf-48b8-ba52-8855e82ccf74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:14.878792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4fb886e7-69bf-48b8-ba52-8855e82ccf74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:15.035838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4fb886e7-69bf-48b8-ba52-8855e82ccf74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:15.045020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4fb886e7-69bf-48b8-ba52-8855e82ccf74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:15.046513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4fb886e7-69bf-48b8-ba52-8855e82ccf74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:15.047713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4fb886e7-69bf-48b8-ba52-8855e82ccf74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1720 microversion: 2.20 time: 0.184567 Jul 26 18:33:15.048292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 313/620] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:14 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:16.071705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7a95c240-7816-4fa4-8457-dfe9546a373f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:16.072297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7a95c240-7816-4fa4-8457-dfe9546a373f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:16.079694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a95c240-7816-4fa4-8457-dfe9546a373f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:16.080147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a95c240-7816-4fa4-8457-dfe9546a373f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:16.080904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a95c240-7816-4fa4-8457-dfe9546a373f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:16.081336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a95c240-7816-4fa4-8457-dfe9546a373f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:16.220696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a95c240-7816-4fa4-8457-dfe9546a373f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:16.229094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a95c240-7816-4fa4-8457-dfe9546a373f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:16.230595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a95c240-7816-4fa4-8457-dfe9546a373f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:16.231756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7a95c240-7816-4fa4-8457-dfe9546a373f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1720 microversion: 2.20 time: 0.164155 Jul 26 18:33:16.232454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 308/621] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:16 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:17.014958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-051ff9fc-2ce6-4ff1-9a4c-54bb72fb795b req-ada0cdca-f58b-4328-97d5-3dfca25fc5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240d5470-7916-48a4-b90f-910c88d68384", "name": "network-vif-unplugged", "status": "completed", "tag": "e225f24a-f0f4-4283-af60-d533e1dd5c9d"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:33:17.026058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-051ff9fc-2ce6-4ff1-9a4c-54bb72fb795b req-ada0cdca-f58b-4328-97d5-3dfca25fc5e9 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:17.026506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-051ff9fc-2ce6-4ff1-9a4c-54bb72fb795b req-ada0cdca-f58b-4328-97d5-3dfca25fc5e9 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:17.038581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-051ff9fc-2ce6-4ff1-9a4c-54bb72fb795b req-ada0cdca-f58b-4328-97d5-3dfca25fc5e9 service nova] Creating event network-vif-unplugged:e225f24a-f0f4-4283-af60-d533e1dd5c9d for instance 240d5470-7916-48a4-b90f-910c88d68384 on hv-cinder-82549 Jul 26 18:33:17.044286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-051ff9fc-2ce6-4ff1-9a4c-54bb72fb795b req-ada0cdca-f58b-4328-97d5-3dfca25fc5e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033208 Jul 26 18:33:17.044991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 314/622] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:33:17.254729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8fdbe9c4-a204-4d86-8431-5e48384e6f84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:17.255355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8fdbe9c4-a204-4d86-8431-5e48384e6f84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:17.262666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fdbe9c4-a204-4d86-8431-5e48384e6f84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:17.263143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fdbe9c4-a204-4d86-8431-5e48384e6f84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:17.263930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fdbe9c4-a204-4d86-8431-5e48384e6f84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:17.264357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fdbe9c4-a204-4d86-8431-5e48384e6f84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:17.413681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8fdbe9c4-a204-4d86-8431-5e48384e6f84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:17.423179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8fdbe9c4-a204-4d86-8431-5e48384e6f84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:17.424881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8fdbe9c4-a204-4d86-8431-5e48384e6f84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:17.426295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8fdbe9c4-a204-4d86-8431-5e48384e6f84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1720 microversion: 2.20 time: 0.175648 Jul 26 18:33:17.426945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 309/623] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:18.452594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cfe2854d-17fc-4e9d-b66b-8f9d9bc94b11 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:18.453289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cfe2854d-17fc-4e9d-b66b-8f9d9bc94b11 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:18.460613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfe2854d-17fc-4e9d-b66b-8f9d9bc94b11 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:18.461062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfe2854d-17fc-4e9d-b66b-8f9d9bc94b11 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:18.461853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfe2854d-17fc-4e9d-b66b-8f9d9bc94b11 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:18.462290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfe2854d-17fc-4e9d-b66b-8f9d9bc94b11 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:18.599788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cfe2854d-17fc-4e9d-b66b-8f9d9bc94b11 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:18.608277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cfe2854d-17fc-4e9d-b66b-8f9d9bc94b11 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:18.609776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cfe2854d-17fc-4e9d-b66b-8f9d9bc94b11 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:18.610927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cfe2854d-17fc-4e9d-b66b-8f9d9bc94b11 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1663 microversion: 2.20 time: 0.164345 Jul 26 18:33:18.611550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 315/624] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:18 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:18.633939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aa7a095c-68c4-4e22-8fb5-69a9513a339a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e8e58b2-c0ad-452b-ac16-5484b1753079"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:33:18.636413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aa7a095c-68c4-4e22-8fb5-69a9513a339a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:18.645955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa7a095c-68c4-4e22-8fb5-69a9513a339a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:18.646389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa7a095c-68c4-4e22-8fb5-69a9513a339a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:18.647416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa7a095c-68c4-4e22-8fb5-69a9513a339a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:18.647886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa7a095c-68c4-4e22-8fb5-69a9513a339a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:18.975697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aa7a095c-68c4-4e22-8fb5-69a9513a339a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "POST /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.345845 Jul 26 18:33:18.976501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 310/625] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Jul 26 18:33:18 2022] POST /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 188 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:33:19.110603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7ae355ca-829a-491e-8533-20f6a0c74b9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:33:19.111201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7ae355ca-829a-491e-8533-20f6a0c74b9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:19.117445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ae355ca-829a-491e-8533-20f6a0c74b9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:19.117891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ae355ca-829a-491e-8533-20f6a0c74b9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:19.118651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ae355ca-829a-491e-8533-20f6a0c74b9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:19.119119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ae355ca-829a-491e-8533-20f6a0c74b9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:19.229046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7ae355ca-829a-491e-8533-20f6a0c74b9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "POST /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/action" status: 202 len: 0 microversion: 2.20 time: 0.122334 Jul 26 18:33:19.230035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 316/626] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Jul 26 18:33:19 2022] POST /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:33:19.238531 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f664ddd5-f91b-4425-b630-e94798dae90f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:19.239176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f664ddd5-f91b-4425-b630-e94798dae90f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:19.245929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f664ddd5-f91b-4425-b630-e94798dae90f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:19.246374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f664ddd5-f91b-4425-b630-e94798dae90f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:19.247163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f664ddd5-f91b-4425-b630-e94798dae90f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:19.247598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f664ddd5-f91b-4425-b630-e94798dae90f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:19.395011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f664ddd5-f91b-4425-b630-e94798dae90f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:19.407548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f664ddd5-f91b-4425-b630-e94798dae90f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:19.409539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f664ddd5-f91b-4425-b630-e94798dae90f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:19.411060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f664ddd5-f91b-4425-b630-e94798dae90f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1749 microversion: 2.20 time: 0.176514 Jul 26 18:33:19.415589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 311/627] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:19 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:20.442693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-52e664c8-d33a-4ccc-83ea-2a797c87691f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:20.442693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-52e664c8-d33a-4ccc-83ea-2a797c87691f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:20.443388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52e664c8-d33a-4ccc-83ea-2a797c87691f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:20.444582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52e664c8-d33a-4ccc-83ea-2a797c87691f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:20.445586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52e664c8-d33a-4ccc-83ea-2a797c87691f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:20.446012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52e664c8-d33a-4ccc-83ea-2a797c87691f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:20.592324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-52e664c8-d33a-4ccc-83ea-2a797c87691f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:20.601190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-52e664c8-d33a-4ccc-83ea-2a797c87691f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:20.602642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-52e664c8-d33a-4ccc-83ea-2a797c87691f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:20.603824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-52e664c8-d33a-4ccc-83ea-2a797c87691f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1751 microversion: 2.20 time: 0.172276 Jul 26 18:33:20.604389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 317/628] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:21.627976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-35d90a5b-176e-4a71-9c47-d2c193f6ca1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:21.628552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-35d90a5b-176e-4a71-9c47-d2c193f6ca1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:21.635580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35d90a5b-176e-4a71-9c47-d2c193f6ca1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:21.636035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35d90a5b-176e-4a71-9c47-d2c193f6ca1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:21.636797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35d90a5b-176e-4a71-9c47-d2c193f6ca1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:21.637230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35d90a5b-176e-4a71-9c47-d2c193f6ca1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:21.779124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-35d90a5b-176e-4a71-9c47-d2c193f6ca1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:21.788148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-35d90a5b-176e-4a71-9c47-d2c193f6ca1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:21.789631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-35d90a5b-176e-4a71-9c47-d2c193f6ca1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:21.790762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-35d90a5b-176e-4a71-9c47-d2c193f6ca1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.167229 Jul 26 18:33:21.791345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 312/629] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:21 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:22.821359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-40af14b4-bfd8-4566-a5c0-beeef329649b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:22.821939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-40af14b4-bfd8-4566-a5c0-beeef329649b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:22.828906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40af14b4-bfd8-4566-a5c0-beeef329649b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:22.829351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40af14b4-bfd8-4566-a5c0-beeef329649b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:22.830104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40af14b4-bfd8-4566-a5c0-beeef329649b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:22.830530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40af14b4-bfd8-4566-a5c0-beeef329649b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:22.965143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-40af14b4-bfd8-4566-a5c0-beeef329649b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:22.973776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-40af14b4-bfd8-4566-a5c0-beeef329649b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:22.975388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-40af14b4-bfd8-4566-a5c0-beeef329649b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:22.976551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-40af14b4-bfd8-4566-a5c0-beeef329649b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.159308 Jul 26 18:33:22.977467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 318/630] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:22 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:23.999745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2beeda12-d8ed-42c3-bda0-1e3938fd437c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:24.000313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2beeda12-d8ed-42c3-bda0-1e3938fd437c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:24.007486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2beeda12-d8ed-42c3-bda0-1e3938fd437c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:24.007929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2beeda12-d8ed-42c3-bda0-1e3938fd437c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:24.008709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2beeda12-d8ed-42c3-bda0-1e3938fd437c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:24.009133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2beeda12-d8ed-42c3-bda0-1e3938fd437c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:24.146747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2beeda12-d8ed-42c3-bda0-1e3938fd437c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:24.158769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2beeda12-d8ed-42c3-bda0-1e3938fd437c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:24.161063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2beeda12-d8ed-42c3-bda0-1e3938fd437c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:24.162727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2beeda12-d8ed-42c3-bda0-1e3938fd437c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.166753 Jul 26 18:33:24.163459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 313/631] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:23 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:25.192445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f5b4bf1b-59d7-4f11-9578-f5a3f98499fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:25.193051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f5b4bf1b-59d7-4f11-9578-f5a3f98499fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:25.202885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5b4bf1b-59d7-4f11-9578-f5a3f98499fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:25.203601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5b4bf1b-59d7-4f11-9578-f5a3f98499fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:25.204492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5b4bf1b-59d7-4f11-9578-f5a3f98499fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:25.205064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5b4bf1b-59d7-4f11-9578-f5a3f98499fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:25.344669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f5b4bf1b-59d7-4f11-9578-f5a3f98499fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:25.355816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f5b4bf1b-59d7-4f11-9578-f5a3f98499fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:25.357692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f5b4bf1b-59d7-4f11-9578-f5a3f98499fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:25.359350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f5b4bf1b-59d7-4f11-9578-f5a3f98499fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.173294 Jul 26 18:33:25.360043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 319/632] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:26.385029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cb9135b8-286b-4730-a93a-14af8898ab42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:26.385640 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cb9135b8-286b-4730-a93a-14af8898ab42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:26.392623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb9135b8-286b-4730-a93a-14af8898ab42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:26.393076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb9135b8-286b-4730-a93a-14af8898ab42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:26.393836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb9135b8-286b-4730-a93a-14af8898ab42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:26.394266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb9135b8-286b-4730-a93a-14af8898ab42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:26.539146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cb9135b8-286b-4730-a93a-14af8898ab42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:26.549398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cb9135b8-286b-4730-a93a-14af8898ab42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:26.550895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cb9135b8-286b-4730-a93a-14af8898ab42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:26.552219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cb9135b8-286b-4730-a93a-14af8898ab42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.171053 Jul 26 18:33:26.567118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 314/633] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:27.579599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7ae4b1f0-fe85-4d0c-9285-63fe099ee324 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:27.580232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7ae4b1f0-fe85-4d0c-9285-63fe099ee324 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:27.589888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ae4b1f0-fe85-4d0c-9285-63fe099ee324 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:27.590443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ae4b1f0-fe85-4d0c-9285-63fe099ee324 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:27.591599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ae4b1f0-fe85-4d0c-9285-63fe099ee324 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:27.592196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ae4b1f0-fe85-4d0c-9285-63fe099ee324 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:27.596252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:33:27.740507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7ae4b1f0-fe85-4d0c-9285-63fe099ee324 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:27.752232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7ae4b1f0-fe85-4d0c-9285-63fe099ee324 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:27.753769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7ae4b1f0-fe85-4d0c-9285-63fe099ee324 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:27.755036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7ae4b1f0-fe85-4d0c-9285-63fe099ee324 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.181911 Jul 26 18:33:27.755814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 320/634] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:27 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:28.110668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dfbdaad8-f106-45d5-8c2d-dec699464628 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3aaf862e-591f-4da3-ab32-02e49fe0c9ae", "device": "/dev/sdb"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:33:28.113797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dfbdaad8-f106-45d5-8c2d-dec699464628 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:28.120574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dfbdaad8-f106-45d5-8c2d-dec699464628 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:28.121073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dfbdaad8-f106-45d5-8c2d-dec699464628 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:28.121793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dfbdaad8-f106-45d5-8c2d-dec699464628 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:28.122207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dfbdaad8-f106-45d5-8c2d-dec699464628 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:28.778652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cb6c91f9-1541-42c5-9222-f83a15f48cb7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:28.779605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cb6c91f9-1541-42c5-9222-f83a15f48cb7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:28.789417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb6c91f9-1541-42c5-9222-f83a15f48cb7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:28.790452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb6c91f9-1541-42c5-9222-f83a15f48cb7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:28.791756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb6c91f9-1541-42c5-9222-f83a15f48cb7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:28.793331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb6c91f9-1541-42c5-9222-f83a15f48cb7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:28.943484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cb6c91f9-1541-42c5-9222-f83a15f48cb7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:28.953261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cb6c91f9-1541-42c5-9222-f83a15f48cb7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:28.954765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cb6c91f9-1541-42c5-9222-f83a15f48cb7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:28.955984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cb6c91f9-1541-42c5-9222-f83a15f48cb7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.181685 Jul 26 18:33:28.956856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 321/635] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:29.978348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9c6b479f-4240-489f-a882-4677b9239ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:29.979106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9c6b479f-4240-489f-a882-4677b9239ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:29.986181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c6b479f-4240-489f-a882-4677b9239ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:29.986626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c6b479f-4240-489f-a882-4677b9239ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:29.987438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c6b479f-4240-489f-a882-4677b9239ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:29.987876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c6b479f-4240-489f-a882-4677b9239ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:30.136081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9c6b479f-4240-489f-a882-4677b9239ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:30.154703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9c6b479f-4240-489f-a882-4677b9239ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:30.156247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9c6b479f-4240-489f-a882-4677b9239ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:30.157448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9c6b479f-4240-489f-a882-4677b9239ddd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.183083 Jul 26 18:33:30.157993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 322/636] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:31.180847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4d70cf43-ac75-420c-98ef-05435cee8a7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:31.181458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4d70cf43-ac75-420c-98ef-05435cee8a7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:31.192984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d70cf43-ac75-420c-98ef-05435cee8a7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:31.193535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d70cf43-ac75-420c-98ef-05435cee8a7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:31.194666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d70cf43-ac75-420c-98ef-05435cee8a7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:31.195508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d70cf43-ac75-420c-98ef-05435cee8a7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:31.346075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4d70cf43-ac75-420c-98ef-05435cee8a7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:31.356495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4d70cf43-ac75-420c-98ef-05435cee8a7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:31.357928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4d70cf43-ac75-420c-98ef-05435cee8a7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:31.359193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4d70cf43-ac75-420c-98ef-05435cee8a7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.182329 Jul 26 18:33:31.359847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 323/637] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:32.384374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c5e83082-b29f-4857-8398-cafe443b3907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:32.385087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c5e83082-b29f-4857-8398-cafe443b3907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:32.391677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5e83082-b29f-4857-8398-cafe443b3907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:32.392131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5e83082-b29f-4857-8398-cafe443b3907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:32.392904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5e83082-b29f-4857-8398-cafe443b3907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:32.393339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5e83082-b29f-4857-8398-cafe443b3907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:32.546662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c5e83082-b29f-4857-8398-cafe443b3907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:32.557845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c5e83082-b29f-4857-8398-cafe443b3907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:32.559373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c5e83082-b29f-4857-8398-cafe443b3907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:32.560548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c5e83082-b29f-4857-8398-cafe443b3907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.180343 Jul 26 18:33:32.561111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 324/638] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:32 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:33.586024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-eb116463-d5d2-471b-80dd-01428c081d6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:33.586758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-eb116463-d5d2-471b-80dd-01428c081d6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:33.588830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=36 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:33:33.594360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb116463-d5d2-471b-80dd-01428c081d6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:33.594878 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb116463-d5d2-471b-80dd-01428c081d6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:33.595593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb116463-d5d2-471b-80dd-01428c081d6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:33.596006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb116463-d5d2-471b-80dd-01428c081d6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:33.737904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-eb116463-d5d2-471b-80dd-01428c081d6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:33.746619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-eb116463-d5d2-471b-80dd-01428c081d6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:33.748112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-eb116463-d5d2-471b-80dd-01428c081d6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:33.749284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-eb116463-d5d2-471b-80dd-01428c081d6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.167255 Jul 26 18:33:33.749842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 325/639] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:34.773538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-13ab0223-b3a0-4470-ae70-5b55e9d8d6b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:34.774220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-13ab0223-b3a0-4470-ae70-5b55e9d8d6b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:34.780837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-13ab0223-b3a0-4470-ae70-5b55e9d8d6b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:34.781277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-13ab0223-b3a0-4470-ae70-5b55e9d8d6b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:34.782067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-13ab0223-b3a0-4470-ae70-5b55e9d8d6b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:34.782526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-13ab0223-b3a0-4470-ae70-5b55e9d8d6b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:34.921701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-13ab0223-b3a0-4470-ae70-5b55e9d8d6b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:34.931409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-13ab0223-b3a0-4470-ae70-5b55e9d8d6b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:34.933156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-13ab0223-b3a0-4470-ae70-5b55e9d8d6b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:34.934603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-13ab0223-b3a0-4470-ae70-5b55e9d8d6b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.165632 Jul 26 18:33:34.935445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 326/640] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:34 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:35.958039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-41b5ab61-7e72-4eb7-8db8-659ef9f4d525 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:35.958817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-41b5ab61-7e72-4eb7-8db8-659ef9f4d525 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:35.967721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41b5ab61-7e72-4eb7-8db8-659ef9f4d525 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:35.968358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41b5ab61-7e72-4eb7-8db8-659ef9f4d525 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:35.969534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41b5ab61-7e72-4eb7-8db8-659ef9f4d525 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:35.970168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41b5ab61-7e72-4eb7-8db8-659ef9f4d525 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:36.376301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-41b5ab61-7e72-4eb7-8db8-659ef9f4d525 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:36.388716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-41b5ab61-7e72-4eb7-8db8-659ef9f4d525 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:36.390901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-41b5ab61-7e72-4eb7-8db8-659ef9f4d525 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:36.392709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-41b5ab61-7e72-4eb7-8db8-659ef9f4d525 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.438449 Jul 26 18:33:36.393532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 327/641] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:35 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:33:37.417056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-85b66698-806b-4d3b-b547-850591d52f58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:37.417775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-85b66698-806b-4d3b-b547-850591d52f58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:37.426893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-85b66698-806b-4d3b-b547-850591d52f58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:37.427392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-85b66698-806b-4d3b-b547-850591d52f58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:37.428609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-85b66698-806b-4d3b-b547-850591d52f58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:37.428740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-85b66698-806b-4d3b-b547-850591d52f58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:37.574534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-85b66698-806b-4d3b-b547-850591d52f58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:37.586492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-85b66698-806b-4d3b-b547-850591d52f58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:37.588131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-85b66698-806b-4d3b-b547-850591d52f58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:37.589321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-85b66698-806b-4d3b-b547-850591d52f58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.176275 Jul 26 18:33:37.589883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 328/642] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:38.118730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=17 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:33:38.212183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:33:38.613701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-77b01d2b-0151-4b12-b5f7-95b7ba4163c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:38.614387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-77b01d2b-0151-4b12-b5f7-95b7ba4163c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:38.622094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77b01d2b-0151-4b12-b5f7-95b7ba4163c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:38.622533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77b01d2b-0151-4b12-b5f7-95b7ba4163c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:38.623321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77b01d2b-0151-4b12-b5f7-95b7ba4163c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:38.623748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77b01d2b-0151-4b12-b5f7-95b7ba4163c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:38.758302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-77b01d2b-0151-4b12-b5f7-95b7ba4163c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:38.766978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-77b01d2b-0151-4b12-b5f7-95b7ba4163c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:38.768498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-77b01d2b-0151-4b12-b5f7-95b7ba4163c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:38.769649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-77b01d2b-0151-4b12-b5f7-95b7ba4163c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.160917 Jul 26 18:33:38.770178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 329/643] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:39.793230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a2998102-8247-4141-b0a5-cf3be10cc2bf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:39.793898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a2998102-8247-4141-b0a5-cf3be10cc2bf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:39.803820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2998102-8247-4141-b0a5-cf3be10cc2bf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:39.804420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2998102-8247-4141-b0a5-cf3be10cc2bf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:39.805494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2998102-8247-4141-b0a5-cf3be10cc2bf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:39.806003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2998102-8247-4141-b0a5-cf3be10cc2bf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:39.951448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a2998102-8247-4141-b0a5-cf3be10cc2bf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:39.960004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a2998102-8247-4141-b0a5-cf3be10cc2bf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:39.961496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a2998102-8247-4141-b0a5-cf3be10cc2bf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:39.962649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a2998102-8247-4141-b0a5-cf3be10cc2bf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.173543 Jul 26 18:33:39.963481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 330/644] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:40.986146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5942fc46-3572-45f8-bc64-b279aaf5321a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:40.986897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5942fc46-3572-45f8-bc64-b279aaf5321a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:40.996191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5942fc46-3572-45f8-bc64-b279aaf5321a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:40.996631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5942fc46-3572-45f8-bc64-b279aaf5321a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:40.997393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5942fc46-3572-45f8-bc64-b279aaf5321a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:40.997841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5942fc46-3572-45f8-bc64-b279aaf5321a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:41.148926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5942fc46-3572-45f8-bc64-b279aaf5321a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:41.158049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5942fc46-3572-45f8-bc64-b279aaf5321a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:41.159575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5942fc46-3572-45f8-bc64-b279aaf5321a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:41.160734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5942fc46-3572-45f8-bc64-b279aaf5321a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.178671 Jul 26 18:33:41.161291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 331/645] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:40 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:33:42.184028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b4bb0dac-4d93-4c22-8544-3f29a67c5a41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:42.184736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b4bb0dac-4d93-4c22-8544-3f29a67c5a41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:42.191765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4bb0dac-4d93-4c22-8544-3f29a67c5a41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:42.192181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4bb0dac-4d93-4c22-8544-3f29a67c5a41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:42.192967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4bb0dac-4d93-4c22-8544-3f29a67c5a41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:42.193430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4bb0dac-4d93-4c22-8544-3f29a67c5a41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:42.335959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b4bb0dac-4d93-4c22-8544-3f29a67c5a41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:42.348705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b4bb0dac-4d93-4c22-8544-3f29a67c5a41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:42.351130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b4bb0dac-4d93-4c22-8544-3f29a67c5a41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:42.352385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b4bb0dac-4d93-4c22-8544-3f29a67c5a41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.172275 Jul 26 18:33:42.353096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 332/646] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:43.376809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3b7047ef-840e-4da7-870c-fd22912aeafc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:43.377425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3b7047ef-840e-4da7-870c-fd22912aeafc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:43.384489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b7047ef-840e-4da7-870c-fd22912aeafc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:43.385155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b7047ef-840e-4da7-870c-fd22912aeafc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:43.385928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b7047ef-840e-4da7-870c-fd22912aeafc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:43.386358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b7047ef-840e-4da7-870c-fd22912aeafc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:43.583455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3b7047ef-840e-4da7-870c-fd22912aeafc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:43.592656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3b7047ef-840e-4da7-870c-fd22912aeafc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:43.594180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3b7047ef-840e-4da7-870c-fd22912aeafc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:43.595368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3b7047ef-840e-4da7-870c-fd22912aeafc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.222931 Jul 26 18:33:43.595926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 333/647] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:33:44.625988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cbd82d86-5b05-447b-a40a-e5a83d9b2034 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:44.626644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cbd82d86-5b05-447b-a40a-e5a83d9b2034 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:44.634044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbd82d86-5b05-447b-a40a-e5a83d9b2034 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:44.634482 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbd82d86-5b05-447b-a40a-e5a83d9b2034 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:44.635291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbd82d86-5b05-447b-a40a-e5a83d9b2034 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:44.635751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbd82d86-5b05-447b-a40a-e5a83d9b2034 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:44.782561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cbd82d86-5b05-447b-a40a-e5a83d9b2034 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:44.791662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cbd82d86-5b05-447b-a40a-e5a83d9b2034 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:44.793166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cbd82d86-5b05-447b-a40a-e5a83d9b2034 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:44.794317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cbd82d86-5b05-447b-a40a-e5a83d9b2034 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.172885 Jul 26 18:33:44.794907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 334/648] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:44 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:45.822688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6ec4c3aa-9468-46a4-924a-4d2dde14879a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:45.823450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6ec4c3aa-9468-46a4-924a-4d2dde14879a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:45.830584 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ec4c3aa-9468-46a4-924a-4d2dde14879a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:45.831050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ec4c3aa-9468-46a4-924a-4d2dde14879a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:45.831842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ec4c3aa-9468-46a4-924a-4d2dde14879a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:45.832287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ec4c3aa-9468-46a4-924a-4d2dde14879a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:45.974321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6ec4c3aa-9468-46a4-924a-4d2dde14879a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:45.984928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6ec4c3aa-9468-46a4-924a-4d2dde14879a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:45.986441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6ec4c3aa-9468-46a4-924a-4d2dde14879a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:45.987700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6ec4c3aa-9468-46a4-924a-4d2dde14879a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.169075 Jul 26 18:33:45.988281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 335/649] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:47.011504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-931971e3-86d8-4ecb-af7e-3e5e42f36066 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:47.012192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-931971e3-86d8-4ecb-af7e-3e5e42f36066 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:47.019845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-931971e3-86d8-4ecb-af7e-3e5e42f36066 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:47.020318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-931971e3-86d8-4ecb-af7e-3e5e42f36066 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:47.021134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-931971e3-86d8-4ecb-af7e-3e5e42f36066 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:47.021594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-931971e3-86d8-4ecb-af7e-3e5e42f36066 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:47.181045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-931971e3-86d8-4ecb-af7e-3e5e42f36066 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:47.183453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:33:47.191234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-931971e3-86d8-4ecb-af7e-3e5e42f36066 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:47.192744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-931971e3-86d8-4ecb-af7e-3e5e42f36066 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:47.193920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-931971e3-86d8-4ecb-af7e-3e5e42f36066 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.186823 Jul 26 18:33:47.194460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 336/650] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:47 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:48.219496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-df4dc3f5-be61-438e-b002-c85b691b8f6a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:48.220362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-df4dc3f5-be61-438e-b002-c85b691b8f6a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:48.229392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df4dc3f5-be61-438e-b002-c85b691b8f6a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:48.230075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df4dc3f5-be61-438e-b002-c85b691b8f6a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:48.230855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df4dc3f5-be61-438e-b002-c85b691b8f6a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:48.231322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df4dc3f5-be61-438e-b002-c85b691b8f6a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:48.366893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-df4dc3f5-be61-438e-b002-c85b691b8f6a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:48.375854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-df4dc3f5-be61-438e-b002-c85b691b8f6a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:48.377372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-df4dc3f5-be61-438e-b002-c85b691b8f6a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:48.378531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-df4dc3f5-be61-438e-b002-c85b691b8f6a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.164787 Jul 26 18:33:48.379344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 337/651] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:48.568684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dfbdaad8-f106-45d5-8c2d-dec699464628 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "POST /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 20.461879 Jul 26 18:33:48.570568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 315/652] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Jul 26 18:33:28 2022] POST /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404/os-volume_attachments => generated 194 bytes in 20465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:33:49.405786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0ac4766f-2a81-4c34-b93b-81adc604ea7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:49.406586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0ac4766f-2a81-4c34-b93b-81adc604ea7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:49.416210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ac4766f-2a81-4c34-b93b-81adc604ea7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:49.416660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ac4766f-2a81-4c34-b93b-81adc604ea7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:49.417438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ac4766f-2a81-4c34-b93b-81adc604ea7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:49.417868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ac4766f-2a81-4c34-b93b-81adc604ea7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:49.552051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0ac4766f-2a81-4c34-b93b-81adc604ea7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:49.565757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0ac4766f-2a81-4c34-b93b-81adc604ea7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:49.568109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0ac4766f-2a81-4c34-b93b-81adc604ea7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:49.569875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0ac4766f-2a81-4c34-b93b-81adc604ea7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.170283 Jul 26 18:33:49.570761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 338/653] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:49 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:50.597375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9a647d17-6084-467b-8314-bdc2611ab1b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:50.598057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9a647d17-6084-467b-8314-bdc2611ab1b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:50.605860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a647d17-6084-467b-8314-bdc2611ab1b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:50.606334 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a647d17-6084-467b-8314-bdc2611ab1b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:50.607128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a647d17-6084-467b-8314-bdc2611ab1b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:50.607573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a647d17-6084-467b-8314-bdc2611ab1b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:50.749921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9a647d17-6084-467b-8314-bdc2611ab1b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:50.758558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9a647d17-6084-467b-8314-bdc2611ab1b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:50.760119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9a647d17-6084-467b-8314-bdc2611ab1b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:50.761263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9a647d17-6084-467b-8314-bdc2611ab1b0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.169419 Jul 26 18:33:50.761827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 316/654] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:50 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:51.784459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-48c11782-f730-49fb-9b9c-3b00dd94d2df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:51.785098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-48c11782-f730-49fb-9b9c-3b00dd94d2df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:51.791879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48c11782-f730-49fb-9b9c-3b00dd94d2df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:51.792368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48c11782-f730-49fb-9b9c-3b00dd94d2df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:51.793110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48c11782-f730-49fb-9b9c-3b00dd94d2df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:51.793534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48c11782-f730-49fb-9b9c-3b00dd94d2df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:51.933616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-48c11782-f730-49fb-9b9c-3b00dd94d2df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:51.948010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-48c11782-f730-49fb-9b9c-3b00dd94d2df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:51.950465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-48c11782-f730-49fb-9b9c-3b00dd94d2df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:51.952351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-48c11782-f730-49fb-9b9c-3b00dd94d2df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.171648 Jul 26 18:33:51.953221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 339/655] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:52.975269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a799ed12-642d-495d-81a8-7a7a3b1682cf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:52.975866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a799ed12-642d-495d-81a8-7a7a3b1682cf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:52.982773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a799ed12-642d-495d-81a8-7a7a3b1682cf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:52.983260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a799ed12-642d-495d-81a8-7a7a3b1682cf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:52.984029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a799ed12-642d-495d-81a8-7a7a3b1682cf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:52.984460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a799ed12-642d-495d-81a8-7a7a3b1682cf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:53.136998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a799ed12-642d-495d-81a8-7a7a3b1682cf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:53.145889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a799ed12-642d-495d-81a8-7a7a3b1682cf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:53.147444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a799ed12-642d-495d-81a8-7a7a3b1682cf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:53.148987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a799ed12-642d-495d-81a8-7a7a3b1682cf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.177831 Jul 26 18:33:53.149556 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 317/656] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:54.173141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9428e016-ef6d-4ee8-b859-602b3e28c135 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:54.173719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9428e016-ef6d-4ee8-b859-602b3e28c135 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:54.181057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9428e016-ef6d-4ee8-b859-602b3e28c135 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:54.181506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9428e016-ef6d-4ee8-b859-602b3e28c135 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:54.182289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9428e016-ef6d-4ee8-b859-602b3e28c135 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:54.182722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9428e016-ef6d-4ee8-b859-602b3e28c135 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:54.319947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9428e016-ef6d-4ee8-b859-602b3e28c135 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:54.334343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9428e016-ef6d-4ee8-b859-602b3e28c135 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:54.336836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9428e016-ef6d-4ee8-b859-602b3e28c135 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:54.338661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9428e016-ef6d-4ee8-b859-602b3e28c135 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.169463 Jul 26 18:33:54.339578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 340/657] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:54 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:55.363654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0cdf82fa-0995-4b01-90d3-2507be6d975e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:55.364239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0cdf82fa-0995-4b01-90d3-2507be6d975e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:55.371097 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cdf82fa-0995-4b01-90d3-2507be6d975e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:55.371814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cdf82fa-0995-4b01-90d3-2507be6d975e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:55.372577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cdf82fa-0995-4b01-90d3-2507be6d975e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:55.373092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cdf82fa-0995-4b01-90d3-2507be6d975e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:55.520998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0cdf82fa-0995-4b01-90d3-2507be6d975e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:55.530270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0cdf82fa-0995-4b01-90d3-2507be6d975e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:55.531819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0cdf82fa-0995-4b01-90d3-2507be6d975e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:55.532964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0cdf82fa-0995-4b01-90d3-2507be6d975e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.173691 Jul 26 18:33:55.533674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 318/658] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:55 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:56.557286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8e362e89-39a7-4c10-99a0-09e5a005f084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:56.557924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8e362e89-39a7-4c10-99a0-09e5a005f084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:56.565728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e362e89-39a7-4c10-99a0-09e5a005f084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:56.566176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e362e89-39a7-4c10-99a0-09e5a005f084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:56.566958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e362e89-39a7-4c10-99a0-09e5a005f084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:56.567444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e362e89-39a7-4c10-99a0-09e5a005f084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:56.713717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8e362e89-39a7-4c10-99a0-09e5a005f084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:56.724315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8e362e89-39a7-4c10-99a0-09e5a005f084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:56.725786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8e362e89-39a7-4c10-99a0-09e5a005f084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:56.726938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8e362e89-39a7-4c10-99a0-09e5a005f084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.174147 Jul 26 18:33:56.727513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 341/659] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:56 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:57.753559 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5083f2d7-f580-40b0-b7e3-3d736e045ae8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:57.754542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5083f2d7-f580-40b0-b7e3-3d736e045ae8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:57.765781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5083f2d7-f580-40b0-b7e3-3d736e045ae8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:57.766601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5083f2d7-f580-40b0-b7e3-3d736e045ae8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:57.767393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5083f2d7-f580-40b0-b7e3-3d736e045ae8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:57.767817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5083f2d7-f580-40b0-b7e3-3d736e045ae8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:57.921865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5083f2d7-f580-40b0-b7e3-3d736e045ae8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:57.931380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5083f2d7-f580-40b0-b7e3-3d736e045ae8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:57.932941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5083f2d7-f580-40b0-b7e3-3d736e045ae8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:57.934158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5083f2d7-f580-40b0-b7e3-3d736e045ae8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.187016 Jul 26 18:33:57.934731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 319/660] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:57 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:33:58.961621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-49e129f5-d0a8-47b6-abcc-453c998bcdd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:33:58.962205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-49e129f5-d0a8-47b6-abcc-453c998bcdd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:33:58.971754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49e129f5-d0a8-47b6-abcc-453c998bcdd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:58.972191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49e129f5-d0a8-47b6-abcc-453c998bcdd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:58.972947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49e129f5-d0a8-47b6-abcc-453c998bcdd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:33:58.973379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49e129f5-d0a8-47b6-abcc-453c998bcdd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:33:59.106916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-49e129f5-d0a8-47b6-abcc-453c998bcdd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:59.116010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-49e129f5-d0a8-47b6-abcc-453c998bcdd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:59.117503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-49e129f5-d0a8-47b6-abcc-453c998bcdd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:33:59.118650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-49e129f5-d0a8-47b6-abcc-453c998bcdd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.163614 Jul 26 18:33:59.119235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 342/661] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:33:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:00.144248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c2a8a050-f6ea-4318-b2a8-9b4a5c22b28b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:00.144822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c2a8a050-f6ea-4318-b2a8-9b4a5c22b28b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:00.152215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2a8a050-f6ea-4318-b2a8-9b4a5c22b28b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:00.152650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2a8a050-f6ea-4318-b2a8-9b4a5c22b28b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:00.153404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2a8a050-f6ea-4318-b2a8-9b4a5c22b28b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:00.153830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2a8a050-f6ea-4318-b2a8-9b4a5c22b28b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:00.293925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c2a8a050-f6ea-4318-b2a8-9b4a5c22b28b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:00.302771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c2a8a050-f6ea-4318-b2a8-9b4a5c22b28b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:00.304354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c2a8a050-f6ea-4318-b2a8-9b4a5c22b28b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:00.305645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c2a8a050-f6ea-4318-b2a8-9b4a5c22b28b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.165812 Jul 26 18:34:00.306078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 320/662] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:00 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:01.329608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1870a879-19d1-4397-ba0a-fffc575d1c26 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:01.330224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1870a879-19d1-4397-ba0a-fffc575d1c26 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:01.337009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1870a879-19d1-4397-ba0a-fffc575d1c26 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:01.337453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1870a879-19d1-4397-ba0a-fffc575d1c26 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:01.338207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1870a879-19d1-4397-ba0a-fffc575d1c26 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:01.338633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1870a879-19d1-4397-ba0a-fffc575d1c26 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:01.476694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1870a879-19d1-4397-ba0a-fffc575d1c26 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:01.488176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1870a879-19d1-4397-ba0a-fffc575d1c26 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:01.489668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1870a879-19d1-4397-ba0a-fffc575d1c26 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:01.490816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1870a879-19d1-4397-ba0a-fffc575d1c26 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.165617 Jul 26 18:34:01.491414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 343/663] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:01 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:02.776922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1af58ffb-9798-425f-bb3d-50ea68835078 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:02.778070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1af58ffb-9798-425f-bb3d-50ea68835078 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:02.785773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1af58ffb-9798-425f-bb3d-50ea68835078 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:02.786219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1af58ffb-9798-425f-bb3d-50ea68835078 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:02.786979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1af58ffb-9798-425f-bb3d-50ea68835078 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:02.787449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1af58ffb-9798-425f-bb3d-50ea68835078 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:02.927821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1af58ffb-9798-425f-bb3d-50ea68835078 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:02.940172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1af58ffb-9798-425f-bb3d-50ea68835078 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:02.942211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1af58ffb-9798-425f-bb3d-50ea68835078 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:02.944004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1af58ffb-9798-425f-bb3d-50ea68835078 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.433384 Jul 26 18:34:02.944781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 321/664] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:02 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:03.967095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b50f69eb-1fd5-4c53-b1ed-3edae90af9c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:03.967670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b50f69eb-1fd5-4c53-b1ed-3edae90af9c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:03.969932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=38 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:34:03.975565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b50f69eb-1fd5-4c53-b1ed-3edae90af9c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:03.976008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b50f69eb-1fd5-4c53-b1ed-3edae90af9c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:03.976768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b50f69eb-1fd5-4c53-b1ed-3edae90af9c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:03.977196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b50f69eb-1fd5-4c53-b1ed-3edae90af9c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:04.110356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b50f69eb-1fd5-4c53-b1ed-3edae90af9c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:04.123413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b50f69eb-1fd5-4c53-b1ed-3edae90af9c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:04.125680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b50f69eb-1fd5-4c53-b1ed-3edae90af9c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:04.126842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b50f69eb-1fd5-4c53-b1ed-3edae90af9c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.163762 Jul 26 18:34:04.127466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 344/665] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:03 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:05.151959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f272cdd0-f9a9-4aa7-9e62-3269c2c42acd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:05.152671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f272cdd0-f9a9-4aa7-9e62-3269c2c42acd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:05.160516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f272cdd0-f9a9-4aa7-9e62-3269c2c42acd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:05.160966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f272cdd0-f9a9-4aa7-9e62-3269c2c42acd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:05.161866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f272cdd0-f9a9-4aa7-9e62-3269c2c42acd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:05.162452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f272cdd0-f9a9-4aa7-9e62-3269c2c42acd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:05.295166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f272cdd0-f9a9-4aa7-9e62-3269c2c42acd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:05.304894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f272cdd0-f9a9-4aa7-9e62-3269c2c42acd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:05.306395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f272cdd0-f9a9-4aa7-9e62-3269c2c42acd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:05.307608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f272cdd0-f9a9-4aa7-9e62-3269c2c42acd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.161119 Jul 26 18:34:05.308170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 322/666] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:06.333217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0cbf0fc0-be37-479a-a2bf-40b11fd0f3b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:06.333827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0cbf0fc0-be37-479a-a2bf-40b11fd0f3b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:06.342884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0cbf0fc0-be37-479a-a2bf-40b11fd0f3b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:06.343416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0cbf0fc0-be37-479a-a2bf-40b11fd0f3b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:06.344543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0cbf0fc0-be37-479a-a2bf-40b11fd0f3b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:06.344974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0cbf0fc0-be37-479a-a2bf-40b11fd0f3b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:06.490053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0cbf0fc0-be37-479a-a2bf-40b11fd0f3b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:06.499254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0cbf0fc0-be37-479a-a2bf-40b11fd0f3b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:06.501196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0cbf0fc0-be37-479a-a2bf-40b11fd0f3b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:06.503330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0cbf0fc0-be37-479a-a2bf-40b11fd0f3b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.176717 Jul 26 18:34:06.504295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 345/667] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:06 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:07.539975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7a2d080c-7365-467d-8e3e-b0f5cdc69649 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:07.541031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7a2d080c-7365-467d-8e3e-b0f5cdc69649 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:07.553653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a2d080c-7365-467d-8e3e-b0f5cdc69649 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:07.554153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a2d080c-7365-467d-8e3e-b0f5cdc69649 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:07.554946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a2d080c-7365-467d-8e3e-b0f5cdc69649 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:07.555429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a2d080c-7365-467d-8e3e-b0f5cdc69649 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:07.704118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a2d080c-7365-467d-8e3e-b0f5cdc69649 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:07.713917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a2d080c-7365-467d-8e3e-b0f5cdc69649 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:07.715522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a2d080c-7365-467d-8e3e-b0f5cdc69649 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:07.716698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7a2d080c-7365-467d-8e3e-b0f5cdc69649 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.183907 Jul 26 18:34:07.717445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 323/668] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:08.208931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f6ba98c6-961f-42f7-bbb8-ad1e1a1ad699 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:34:08.212318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f6ba98c6-961f-42f7-bbb8-ad1e1a1ad699 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:08.223101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6ba98c6-961f-42f7-bbb8-ad1e1a1ad699 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:08.223803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6ba98c6-961f-42f7-bbb8-ad1e1a1ad699 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:08.225029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6ba98c6-961f-42f7-bbb8-ad1e1a1ad699 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:08.225740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6ba98c6-961f-42f7-bbb8-ad1e1a1ad699 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:08.309414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f6ba98c6-961f-42f7-bbb8-ad1e1a1ad699 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "POST /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/action" status: 202 len: 0 microversion: 2.1 time: 0.104774 Jul 26 18:34:08.310033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 346/669] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:34:08 2022] POST /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:34:08.320123 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aeae57c1-acf2-4c02-ba9a-888f125aa7bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:08.320770 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aeae57c1-acf2-4c02-ba9a-888f125aa7bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:08.329021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aeae57c1-acf2-4c02-ba9a-888f125aa7bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:08.329464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aeae57c1-acf2-4c02-ba9a-888f125aa7bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:08.330224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aeae57c1-acf2-4c02-ba9a-888f125aa7bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:08.330654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aeae57c1-acf2-4c02-ba9a-888f125aa7bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:08.488548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-aeae57c1-acf2-4c02-ba9a-888f125aa7bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:08.497441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aeae57c1-acf2-4c02-ba9a-888f125aa7bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1753 microversion: 2.1 time: 0.181523 Jul 26 18:34:08.498024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 324/670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:08 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:08.741447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4398db6e-46dc-4e2e-8b68-19204b25ccc2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:08.742195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4398db6e-46dc-4e2e-8b68-19204b25ccc2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:08.749494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4398db6e-46dc-4e2e-8b68-19204b25ccc2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:08.749948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4398db6e-46dc-4e2e-8b68-19204b25ccc2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:08.750791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4398db6e-46dc-4e2e-8b68-19204b25ccc2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:08.751255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4398db6e-46dc-4e2e-8b68-19204b25ccc2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:08.898287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4398db6e-46dc-4e2e-8b68-19204b25ccc2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:08.907244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4398db6e-46dc-4e2e-8b68-19204b25ccc2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:08.908746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4398db6e-46dc-4e2e-8b68-19204b25ccc2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:08.910002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4398db6e-46dc-4e2e-8b68-19204b25ccc2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.173192 Jul 26 18:34:08.910583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 347/671] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:08 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:09.520016 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-65e98884-2b72-4bd0-a082-7bd31abafbe3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:09.520698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-65e98884-2b72-4bd0-a082-7bd31abafbe3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:09.528218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65e98884-2b72-4bd0-a082-7bd31abafbe3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:09.528669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65e98884-2b72-4bd0-a082-7bd31abafbe3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:09.529452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65e98884-2b72-4bd0-a082-7bd31abafbe3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:09.529885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65e98884-2b72-4bd0-a082-7bd31abafbe3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:09.698767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-65e98884-2b72-4bd0-a082-7bd31abafbe3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:09.707677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-65e98884-2b72-4bd0-a082-7bd31abafbe3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1753 microversion: 2.1 time: 0.191587 Jul 26 18:34:09.708489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 325/672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:09 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:09.933482 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-582cd9a1-39a2-493a-8dda-36b19fe137be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:09.934109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-582cd9a1-39a2-493a-8dda-36b19fe137be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:09.941227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-582cd9a1-39a2-493a-8dda-36b19fe137be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:09.941674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-582cd9a1-39a2-493a-8dda-36b19fe137be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:09.942444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-582cd9a1-39a2-493a-8dda-36b19fe137be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:09.942880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-582cd9a1-39a2-493a-8dda-36b19fe137be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:10.085624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-582cd9a1-39a2-493a-8dda-36b19fe137be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:10.094603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-582cd9a1-39a2-493a-8dda-36b19fe137be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:10.096256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-582cd9a1-39a2-493a-8dda-36b19fe137be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:10.097429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-582cd9a1-39a2-493a-8dda-36b19fe137be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.167989 Jul 26 18:34:10.097984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 348/673] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:09 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:10.729260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e83f5f94-185c-4856-b5f7-51bfbe3cdeb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:10.730766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e83f5f94-185c-4856-b5f7-51bfbe3cdeb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:10.738290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e83f5f94-185c-4856-b5f7-51bfbe3cdeb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:10.738744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e83f5f94-185c-4856-b5f7-51bfbe3cdeb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:10.739568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e83f5f94-185c-4856-b5f7-51bfbe3cdeb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:10.739992 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e83f5f94-185c-4856-b5f7-51bfbe3cdeb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:10.900792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e83f5f94-185c-4856-b5f7-51bfbe3cdeb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:10.912180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e83f5f94-185c-4856-b5f7-51bfbe3cdeb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1753 microversion: 2.1 time: 0.187009 Jul 26 18:34:10.912828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 326/674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1753 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:11.120687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cab46311-5257-4b98-9e29-eaa5ed908eff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:11.121712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cab46311-5257-4b98-9e29-eaa5ed908eff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:11.130275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cab46311-5257-4b98-9e29-eaa5ed908eff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:11.130756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cab46311-5257-4b98-9e29-eaa5ed908eff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:11.131549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cab46311-5257-4b98-9e29-eaa5ed908eff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:11.132006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cab46311-5257-4b98-9e29-eaa5ed908eff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:11.276103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cab46311-5257-4b98-9e29-eaa5ed908eff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:11.285835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cab46311-5257-4b98-9e29-eaa5ed908eff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:11.287336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cab46311-5257-4b98-9e29-eaa5ed908eff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:11.288609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cab46311-5257-4b98-9e29-eaa5ed908eff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.172159 Jul 26 18:34:11.289173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 349/675] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:11.934250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-272413e9-7e76-43c9-8a71-5156fe248750 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:11.934874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-272413e9-7e76-43c9-8a71-5156fe248750 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:11.942144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-272413e9-7e76-43c9-8a71-5156fe248750 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:11.942591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-272413e9-7e76-43c9-8a71-5156fe248750 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:11.943377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-272413e9-7e76-43c9-8a71-5156fe248750 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:11.943806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-272413e9-7e76-43c9-8a71-5156fe248750 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:12.181807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-272413e9-7e76-43c9-8a71-5156fe248750 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:12.192056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-272413e9-7e76-43c9-8a71-5156fe248750 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1753 microversion: 2.1 time: 0.261938 Jul 26 18:34:12.193191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 327/676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:11 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1753 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:12.311957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-37e6d83c-2ac6-41d4-a9ee-3b7c60f1c451 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:12.312904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-37e6d83c-2ac6-41d4-a9ee-3b7c60f1c451 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:12.322223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37e6d83c-2ac6-41d4-a9ee-3b7c60f1c451 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:12.322771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37e6d83c-2ac6-41d4-a9ee-3b7c60f1c451 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:12.323601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37e6d83c-2ac6-41d4-a9ee-3b7c60f1c451 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:12.324279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37e6d83c-2ac6-41d4-a9ee-3b7c60f1c451 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:12.457096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-37e6d83c-2ac6-41d4-a9ee-3b7c60f1c451 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:12.465814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-37e6d83c-2ac6-41d4-a9ee-3b7c60f1c451 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:12.467390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-37e6d83c-2ac6-41d4-a9ee-3b7c60f1c451 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:12.468576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-37e6d83c-2ac6-41d4-a9ee-3b7c60f1c451 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.160919 Jul 26 18:34:12.469154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 350/677] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:12 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:13.214197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bd2f003f-4db1-4967-9e5a-9ee69c5c74d6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:13.214851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bd2f003f-4db1-4967-9e5a-9ee69c5c74d6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:13.222315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bd2f003f-4db1-4967-9e5a-9ee69c5c74d6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:13.222759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bd2f003f-4db1-4967-9e5a-9ee69c5c74d6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:13.223564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bd2f003f-4db1-4967-9e5a-9ee69c5c74d6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:13.223994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bd2f003f-4db1-4967-9e5a-9ee69c5c74d6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:13.377709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bd2f003f-4db1-4967-9e5a-9ee69c5c74d6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:13.386342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bd2f003f-4db1-4967-9e5a-9ee69c5c74d6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.176284 Jul 26 18:34:13.386928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 328/678] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:13.491698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6af86769-0ad3-43da-a65a-7a1fe4135f7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:13.492287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6af86769-0ad3-43da-a65a-7a1fe4135f7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:13.499194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6af86769-0ad3-43da-a65a-7a1fe4135f7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:13.499646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6af86769-0ad3-43da-a65a-7a1fe4135f7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:13.500401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6af86769-0ad3-43da-a65a-7a1fe4135f7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:13.500831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6af86769-0ad3-43da-a65a-7a1fe4135f7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:13.645655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6af86769-0ad3-43da-a65a-7a1fe4135f7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:13.659136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6af86769-0ad3-43da-a65a-7a1fe4135f7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:13.660632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6af86769-0ad3-43da-a65a-7a1fe4135f7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:13.661790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6af86769-0ad3-43da-a65a-7a1fe4135f7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.174652 Jul 26 18:34:13.662384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 351/679] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:14.409726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b9780596-8dcb-4db0-b44b-c357dd40bf48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:14.410286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b9780596-8dcb-4db0-b44b-c357dd40bf48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:14.417272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9780596-8dcb-4db0-b44b-c357dd40bf48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:14.417719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9780596-8dcb-4db0-b44b-c357dd40bf48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:14.418485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9780596-8dcb-4db0-b44b-c357dd40bf48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:14.418918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9780596-8dcb-4db0-b44b-c357dd40bf48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:14.581869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b9780596-8dcb-4db0-b44b-c357dd40bf48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:14.595222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b9780596-8dcb-4db0-b44b-c357dd40bf48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.189733 Jul 26 18:34:14.596156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 329/680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:14 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:14.684746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bc76a71d-49c3-4c5c-a9df-63334ee65854 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:14.685356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bc76a71d-49c3-4c5c-a9df-63334ee65854 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:14.692711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc76a71d-49c3-4c5c-a9df-63334ee65854 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:14.693253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc76a71d-49c3-4c5c-a9df-63334ee65854 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:14.694055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc76a71d-49c3-4c5c-a9df-63334ee65854 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:14.694493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc76a71d-49c3-4c5c-a9df-63334ee65854 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:14.712594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:34:14.843753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bc76a71d-49c3-4c5c-a9df-63334ee65854 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:14.852594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bc76a71d-49c3-4c5c-a9df-63334ee65854 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:14.854103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bc76a71d-49c3-4c5c-a9df-63334ee65854 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:14.855352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bc76a71d-49c3-4c5c-a9df-63334ee65854 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.174551 Jul 26 18:34:14.855939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 352/681] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:14 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:15.617043 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ca66359e-2176-4641-9023-d3552d78a4fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:15.617713 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ca66359e-2176-4641-9023-d3552d78a4fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:15.624485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca66359e-2176-4641-9023-d3552d78a4fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:15.624926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca66359e-2176-4641-9023-d3552d78a4fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:15.625677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca66359e-2176-4641-9023-d3552d78a4fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:15.626096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca66359e-2176-4641-9023-d3552d78a4fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:15.783655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ca66359e-2176-4641-9023-d3552d78a4fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:15.792434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ca66359e-2176-4641-9023-d3552d78a4fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.179179 Jul 26 18:34:15.793024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 330/682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:15 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:15.879756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-93a56e92-bdb9-4b8c-a5b8-00be5624cd9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:15.880363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-93a56e92-bdb9-4b8c-a5b8-00be5624cd9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:15.887175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93a56e92-bdb9-4b8c-a5b8-00be5624cd9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:15.887623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93a56e92-bdb9-4b8c-a5b8-00be5624cd9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:15.888406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93a56e92-bdb9-4b8c-a5b8-00be5624cd9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:15.888831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93a56e92-bdb9-4b8c-a5b8-00be5624cd9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:16.044613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-93a56e92-bdb9-4b8c-a5b8-00be5624cd9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:16.058184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-93a56e92-bdb9-4b8c-a5b8-00be5624cd9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:16.060602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-93a56e92-bdb9-4b8c-a5b8-00be5624cd9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:16.062385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-93a56e92-bdb9-4b8c-a5b8-00be5624cd9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.186696 Jul 26 18:34:16.063226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 353/683] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:15 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:16.816191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-684c9095-2c0b-4762-adf6-3b51add192b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:16.817074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-684c9095-2c0b-4762-adf6-3b51add192b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:16.824639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-684c9095-2c0b-4762-adf6-3b51add192b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:16.825092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-684c9095-2c0b-4762-adf6-3b51add192b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:16.825841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-684c9095-2c0b-4762-adf6-3b51add192b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:16.826277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-684c9095-2c0b-4762-adf6-3b51add192b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:16.830509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:34:16.983514 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-684c9095-2c0b-4762-adf6-3b51add192b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:16.993041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-684c9095-2c0b-4762-adf6-3b51add192b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.181621 Jul 26 18:34:16.993620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 331/684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:16 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:17.086398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-11995034-62bf-4b9c-b383-3555e2148b13 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:17.086960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-11995034-62bf-4b9c-b383-3555e2148b13 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:17.093991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11995034-62bf-4b9c-b383-3555e2148b13 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:17.094437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11995034-62bf-4b9c-b383-3555e2148b13 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:17.095205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11995034-62bf-4b9c-b383-3555e2148b13 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:17.095669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11995034-62bf-4b9c-b383-3555e2148b13 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:17.234583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-11995034-62bf-4b9c-b383-3555e2148b13 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:17.243378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-11995034-62bf-4b9c-b383-3555e2148b13 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:17.244885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-11995034-62bf-4b9c-b383-3555e2148b13 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:17.246091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-11995034-62bf-4b9c-b383-3555e2148b13 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.163844 Jul 26 18:34:17.246716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 354/685] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:18.017303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a3e529dc-2c13-4fbc-a368-e9fe885527e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:18.017958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a3e529dc-2c13-4fbc-a368-e9fe885527e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:18.025724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a3e529dc-2c13-4fbc-a368-e9fe885527e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:18.026170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a3e529dc-2c13-4fbc-a368-e9fe885527e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:18.026929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a3e529dc-2c13-4fbc-a368-e9fe885527e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:18.027386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a3e529dc-2c13-4fbc-a368-e9fe885527e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:18.175247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a3e529dc-2c13-4fbc-a368-e9fe885527e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:18.183536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a3e529dc-2c13-4fbc-a368-e9fe885527e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.172302 Jul 26 18:34:18.184102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 332/686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:18 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:18.269718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-58a1ba76-d010-4312-a6e6-76dddd4e6ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:18.270278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-58a1ba76-d010-4312-a6e6-76dddd4e6ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:18.277341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-58a1ba76-d010-4312-a6e6-76dddd4e6ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:18.277811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-58a1ba76-d010-4312-a6e6-76dddd4e6ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:18.278544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-58a1ba76-d010-4312-a6e6-76dddd4e6ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:18.278966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-58a1ba76-d010-4312-a6e6-76dddd4e6ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:18.419722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-58a1ba76-d010-4312-a6e6-76dddd4e6ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:18.429233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-58a1ba76-d010-4312-a6e6-76dddd4e6ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:18.432125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-58a1ba76-d010-4312-a6e6-76dddd4e6ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:18.433633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-58a1ba76-d010-4312-a6e6-76dddd4e6ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.167997 Jul 26 18:34:18.434284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 355/687] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:18 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:19.205906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c27bcbba-e21b-452e-8a1c-25a6af505709 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:19.206518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c27bcbba-e21b-452e-8a1c-25a6af505709 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:19.208927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=35 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:34:19.214645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c27bcbba-e21b-452e-8a1c-25a6af505709 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:19.215127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c27bcbba-e21b-452e-8a1c-25a6af505709 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:19.215897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c27bcbba-e21b-452e-8a1c-25a6af505709 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:19.216329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c27bcbba-e21b-452e-8a1c-25a6af505709 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:19.369561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c27bcbba-e21b-452e-8a1c-25a6af505709 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:19.378412 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c27bcbba-e21b-452e-8a1c-25a6af505709 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.176467 Jul 26 18:34:19.378977 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 333/688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:19 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:19.458414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1f7fa244-2d85-4a3e-8e6c-0852d99b3e1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:19.459076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1f7fa244-2d85-4a3e-8e6c-0852d99b3e1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:19.466617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f7fa244-2d85-4a3e-8e6c-0852d99b3e1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:19.467054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f7fa244-2d85-4a3e-8e6c-0852d99b3e1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:19.467877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f7fa244-2d85-4a3e-8e6c-0852d99b3e1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:19.468307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f7fa244-2d85-4a3e-8e6c-0852d99b3e1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:19.617580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1f7fa244-2d85-4a3e-8e6c-0852d99b3e1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:19.626493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1f7fa244-2d85-4a3e-8e6c-0852d99b3e1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:19.628038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1f7fa244-2d85-4a3e-8e6c-0852d99b3e1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:19.629288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1f7fa244-2d85-4a3e-8e6c-0852d99b3e1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.175399 Jul 26 18:34:19.629814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 356/689] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:19 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:20.405783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1dc8c428-509c-4a94-bdd6-17bfa622c5aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:20.406394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1dc8c428-509c-4a94-bdd6-17bfa622c5aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:20.416757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1dc8c428-509c-4a94-bdd6-17bfa622c5aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:20.417867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1dc8c428-509c-4a94-bdd6-17bfa622c5aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:20.419621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1dc8c428-509c-4a94-bdd6-17bfa622c5aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:20.420575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1dc8c428-509c-4a94-bdd6-17bfa622c5aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:20.591688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1dc8c428-509c-4a94-bdd6-17bfa622c5aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:20.601879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1dc8c428-509c-4a94-bdd6-17bfa622c5aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.200024 Jul 26 18:34:20.602453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 334/690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:20.656386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b8472985-1da1-472e-888f-b237802eb99a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:20.657007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b8472985-1da1-472e-888f-b237802eb99a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:20.664883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8472985-1da1-472e-888f-b237802eb99a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:20.665328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8472985-1da1-472e-888f-b237802eb99a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:20.666089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8472985-1da1-472e-888f-b237802eb99a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:20.666519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8472985-1da1-472e-888f-b237802eb99a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:20.806499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b8472985-1da1-472e-888f-b237802eb99a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:20.819111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b8472985-1da1-472e-888f-b237802eb99a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:20.821076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b8472985-1da1-472e-888f-b237802eb99a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:20.822770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b8472985-1da1-472e-888f-b237802eb99a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.171932 Jul 26 18:34:20.823435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 357/691] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:21.623670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ffcac1c8-8450-4cd1-9369-9dd6f66b5214 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:21.624279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ffcac1c8-8450-4cd1-9369-9dd6f66b5214 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:21.631495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffcac1c8-8450-4cd1-9369-9dd6f66b5214 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:21.631991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffcac1c8-8450-4cd1-9369-9dd6f66b5214 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:21.632751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffcac1c8-8450-4cd1-9369-9dd6f66b5214 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:21.633179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffcac1c8-8450-4cd1-9369-9dd6f66b5214 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:21.787351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ffcac1c8-8450-4cd1-9369-9dd6f66b5214 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:21.795585 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ffcac1c8-8450-4cd1-9369-9dd6f66b5214 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.175852 Jul 26 18:34:21.796349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 335/692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:21 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:21.847056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fdeb6b8b-ead9-439d-9018-38aa09ac8cb4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:21.847805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fdeb6b8b-ead9-439d-9018-38aa09ac8cb4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:21.854817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdeb6b8b-ead9-439d-9018-38aa09ac8cb4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:21.855357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdeb6b8b-ead9-439d-9018-38aa09ac8cb4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:21.856104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdeb6b8b-ead9-439d-9018-38aa09ac8cb4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:21.856530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdeb6b8b-ead9-439d-9018-38aa09ac8cb4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:21.992907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fdeb6b8b-ead9-439d-9018-38aa09ac8cb4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:22.005367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fdeb6b8b-ead9-439d-9018-38aa09ac8cb4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:22.006861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fdeb6b8b-ead9-439d-9018-38aa09ac8cb4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:22.008049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fdeb6b8b-ead9-439d-9018-38aa09ac8cb4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.164950 Jul 26 18:34:22.008605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 358/693] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:21 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:22.817535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-458ab865-5cfd-4d83-a2a5-d08fe796df1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:22.818135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-458ab865-5cfd-4d83-a2a5-d08fe796df1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:22.825224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-458ab865-5cfd-4d83-a2a5-d08fe796df1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:22.825736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-458ab865-5cfd-4d83-a2a5-d08fe796df1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:22.826550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-458ab865-5cfd-4d83-a2a5-d08fe796df1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:22.826959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-458ab865-5cfd-4d83-a2a5-d08fe796df1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:22.982082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-458ab865-5cfd-4d83-a2a5-d08fe796df1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:22.992333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-458ab865-5cfd-4d83-a2a5-d08fe796df1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.178797 Jul 26 18:34:22.992934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 336/694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:22 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:23.034302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7e59ec14-816e-4878-9738-20299a0d30e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:23.034870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7e59ec14-816e-4878-9738-20299a0d30e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:23.044573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e59ec14-816e-4878-9738-20299a0d30e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:23.045156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e59ec14-816e-4878-9738-20299a0d30e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:23.046268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e59ec14-816e-4878-9738-20299a0d30e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:23.046911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e59ec14-816e-4878-9738-20299a0d30e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:23.192447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7e59ec14-816e-4878-9738-20299a0d30e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:23.202497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7e59ec14-816e-4878-9738-20299a0d30e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:23.203477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7e59ec14-816e-4878-9738-20299a0d30e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:23.204639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7e59ec14-816e-4878-9738-20299a0d30e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.176523 Jul 26 18:34:23.205170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 359/695] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:23 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:23.972231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-d19c4338-0688-40c1-b008-83ded128c85a req-f5c4a038-f371-4e2e-8242-3f7e1722258e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240d5470-7916-48a4-b90f-910c88d68384", "name": "network-vif-plugged", "status": "completed", "tag": "e225f24a-f0f4-4283-af60-d533e1dd5c9d"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:34:23.983405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-d19c4338-0688-40c1-b008-83ded128c85a req-f5c4a038-f371-4e2e-8242-3f7e1722258e service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:23.983955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-d19c4338-0688-40c1-b008-83ded128c85a req-f5c4a038-f371-4e2e-8242-3f7e1722258e service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:23.996737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-d19c4338-0688-40c1-b008-83ded128c85a req-f5c4a038-f371-4e2e-8242-3f7e1722258e service nova] Creating event network-vif-plugged:e225f24a-f0f4-4283-af60-d533e1dd5c9d for instance 240d5470-7916-48a4-b90f-910c88d68384 on hv-cinder-82549 Jul 26 18:34:24.001985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-d19c4338-0688-40c1-b008-83ded128c85a req-f5c4a038-f371-4e2e-8242-3f7e1722258e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034883 Jul 26 18:34:24.002518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 337/696] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:34:24.013794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-74bc70e7-aa20-432b-80e5-d03c399e1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:24.014248 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-74bc70e7-aa20-432b-80e5-d03c399e1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:24.021097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74bc70e7-aa20-432b-80e5-d03c399e1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:24.021648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74bc70e7-aa20-432b-80e5-d03c399e1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:24.022777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74bc70e7-aa20-432b-80e5-d03c399e1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:24.023253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74bc70e7-aa20-432b-80e5-d03c399e1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:24.180786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-74bc70e7-aa20-432b-80e5-d03c399e1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:24.189164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-74bc70e7-aa20-432b-80e5-d03c399e1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.179202 Jul 26 18:34:24.189710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 360/697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:24 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:24.229273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fba3ec2d-2e17-47f3-b0d9-9ad6c9b59cb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:24.229953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fba3ec2d-2e17-47f3-b0d9-9ad6c9b59cb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:24.236813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fba3ec2d-2e17-47f3-b0d9-9ad6c9b59cb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:24.237260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fba3ec2d-2e17-47f3-b0d9-9ad6c9b59cb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:24.238015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fba3ec2d-2e17-47f3-b0d9-9ad6c9b59cb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:24.238451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fba3ec2d-2e17-47f3-b0d9-9ad6c9b59cb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:24.380020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fba3ec2d-2e17-47f3-b0d9-9ad6c9b59cb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:24.388946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fba3ec2d-2e17-47f3-b0d9-9ad6c9b59cb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:24.390462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fba3ec2d-2e17-47f3-b0d9-9ad6c9b59cb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:24.391665 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fba3ec2d-2e17-47f3-b0d9-9ad6c9b59cb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.166794 Jul 26 18:34:24.392226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 338/698] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:25.213857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0e26049e-2433-4e24-bc49-db93b84edc12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:25.214536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0e26049e-2433-4e24-bc49-db93b84edc12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:25.221880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e26049e-2433-4e24-bc49-db93b84edc12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:25.222321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e26049e-2433-4e24-bc49-db93b84edc12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:25.223113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e26049e-2433-4e24-bc49-db93b84edc12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:25.223544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e26049e-2433-4e24-bc49-db93b84edc12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:25.379745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0e26049e-2433-4e24-bc49-db93b84edc12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:25.388718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0e26049e-2433-4e24-bc49-db93b84edc12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.178809 Jul 26 18:34:25.389303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 361/699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:25 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:25.414619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-abd239e7-c39e-4acc-9e58-a61437420f7d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:25.415260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-abd239e7-c39e-4acc-9e58-a61437420f7d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:25.422413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abd239e7-c39e-4acc-9e58-a61437420f7d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:25.422856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abd239e7-c39e-4acc-9e58-a61437420f7d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:25.423661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abd239e7-c39e-4acc-9e58-a61437420f7d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:25.424093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abd239e7-c39e-4acc-9e58-a61437420f7d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:25.568528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-abd239e7-c39e-4acc-9e58-a61437420f7d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:25.582499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-abd239e7-c39e-4acc-9e58-a61437420f7d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:25.584030 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-abd239e7-c39e-4acc-9e58-a61437420f7d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:25.585189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-abd239e7-c39e-4acc-9e58-a61437420f7d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.174492 Jul 26 18:34:25.585786 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 339/700] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:26.412854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fd9f1008-02e9-4216-b9f6-d60d148c5b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:26.413536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fd9f1008-02e9-4216-b9f6-d60d148c5b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:26.420342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd9f1008-02e9-4216-b9f6-d60d148c5b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:26.420781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd9f1008-02e9-4216-b9f6-d60d148c5b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:26.421541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd9f1008-02e9-4216-b9f6-d60d148c5b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:26.421963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd9f1008-02e9-4216-b9f6-d60d148c5b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:26.563454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fd9f1008-02e9-4216-b9f6-d60d148c5b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:26.572124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fd9f1008-02e9-4216-b9f6-d60d148c5b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.163515 Jul 26 18:34:26.572721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 362/701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:26 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:26.611287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-22d5fd8c-b85d-455e-a364-a2228c9305df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:26.612086 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-22d5fd8c-b85d-455e-a364-a2228c9305df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:26.622860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22d5fd8c-b85d-455e-a364-a2228c9305df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:26.623680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22d5fd8c-b85d-455e-a364-a2228c9305df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:26.624931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22d5fd8c-b85d-455e-a364-a2228c9305df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:26.625632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22d5fd8c-b85d-455e-a364-a2228c9305df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:26.774956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-22d5fd8c-b85d-455e-a364-a2228c9305df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:26.784271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-22d5fd8c-b85d-455e-a364-a2228c9305df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:26.785774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-22d5fd8c-b85d-455e-a364-a2228c9305df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:26.786947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-22d5fd8c-b85d-455e-a364-a2228c9305df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.182067 Jul 26 18:34:26.787508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 340/702] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:27.597501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8aa0ea06-2b8c-4170-a8c6-965bccbd72f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:27.598166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8aa0ea06-2b8c-4170-a8c6-965bccbd72f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:27.608313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8aa0ea06-2b8c-4170-a8c6-965bccbd72f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:27.608915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8aa0ea06-2b8c-4170-a8c6-965bccbd72f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:27.610091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8aa0ea06-2b8c-4170-a8c6-965bccbd72f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:27.610664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8aa0ea06-2b8c-4170-a8c6-965bccbd72f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:27.756479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8aa0ea06-2b8c-4170-a8c6-965bccbd72f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:27.764858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8aa0ea06-2b8c-4170-a8c6-965bccbd72f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.173614 Jul 26 18:34:27.765436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 363/703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:27.816502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-19196c03-def7-4264-ae29-f67f2ae417f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:27.817111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-19196c03-def7-4264-ae29-f67f2ae417f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:27.824451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-19196c03-def7-4264-ae29-f67f2ae417f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:27.824900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-19196c03-def7-4264-ae29-f67f2ae417f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:27.825722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-19196c03-def7-4264-ae29-f67f2ae417f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:27.826180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-19196c03-def7-4264-ae29-f67f2ae417f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:27.965287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-19196c03-def7-4264-ae29-f67f2ae417f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:27.974478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-19196c03-def7-4264-ae29-f67f2ae417f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:27.976024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-19196c03-def7-4264-ae29-f67f2ae417f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:27.977209 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-19196c03-def7-4264-ae29-f67f2ae417f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.166671 Jul 26 18:34:27.977794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 341/704] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:27 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:28.786572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8f8966e8-3b7d-4b1f-af31-92539d791b11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:28.787866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8f8966e8-3b7d-4b1f-af31-92539d791b11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:28.795044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f8966e8-3b7d-4b1f-af31-92539d791b11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:28.795541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f8966e8-3b7d-4b1f-af31-92539d791b11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:28.796334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f8966e8-3b7d-4b1f-af31-92539d791b11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:28.796729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f8966e8-3b7d-4b1f-af31-92539d791b11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:28.966333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8f8966e8-3b7d-4b1f-af31-92539d791b11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:28.979386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8f8966e8-3b7d-4b1f-af31-92539d791b11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.196823 Jul 26 18:34:28.980238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 364/705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:28 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:29.000358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1a38b967-3f9f-490b-aae1-986d205289b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:29.000956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1a38b967-3f9f-490b-aae1-986d205289b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:29.010481 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a38b967-3f9f-490b-aae1-986d205289b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:29.010923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a38b967-3f9f-490b-aae1-986d205289b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:29.011717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a38b967-3f9f-490b-aae1-986d205289b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:29.012140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a38b967-3f9f-490b-aae1-986d205289b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:29.154646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1a38b967-3f9f-490b-aae1-986d205289b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:29.163907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1a38b967-3f9f-490b-aae1-986d205289b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:29.165422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1a38b967-3f9f-490b-aae1-986d205289b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:29.166703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1a38b967-3f9f-490b-aae1-986d205289b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.170257 Jul 26 18:34:29.167279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 342/706] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:30.004858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b84adb26-3dd9-44c5-90a2-22ddcef0ad59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:30.005428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b84adb26-3dd9-44c5-90a2-22ddcef0ad59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:30.012391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b84adb26-3dd9-44c5-90a2-22ddcef0ad59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:30.012832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b84adb26-3dd9-44c5-90a2-22ddcef0ad59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:30.013573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b84adb26-3dd9-44c5-90a2-22ddcef0ad59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:30.014035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b84adb26-3dd9-44c5-90a2-22ddcef0ad59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:30.175003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b84adb26-3dd9-44c5-90a2-22ddcef0ad59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:30.187064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b84adb26-3dd9-44c5-90a2-22ddcef0ad59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.183928 Jul 26 18:34:30.187064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 365/707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:29 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:30.190289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d82e6428-85b7-4526-b14c-520f3f9b81db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:30.191050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d82e6428-85b7-4526-b14c-520f3f9b81db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:30.198064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d82e6428-85b7-4526-b14c-520f3f9b81db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:30.198474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d82e6428-85b7-4526-b14c-520f3f9b81db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:30.199606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d82e6428-85b7-4526-b14c-520f3f9b81db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:30.200044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d82e6428-85b7-4526-b14c-520f3f9b81db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:30.331807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d82e6428-85b7-4526-b14c-520f3f9b81db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:30.340272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d82e6428-85b7-4526-b14c-520f3f9b81db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:30.341780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d82e6428-85b7-4526-b14c-520f3f9b81db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:30.342942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d82e6428-85b7-4526-b14c-520f3f9b81db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.157137 Jul 26 18:34:30.343533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 343/708] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:31.206176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bff017da-042c-4387-a4a7-5bc9ea41c2b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:31.206779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bff017da-042c-4387-a4a7-5bc9ea41c2b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:31.214057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bff017da-042c-4387-a4a7-5bc9ea41c2b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:31.214506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bff017da-042c-4387-a4a7-5bc9ea41c2b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:31.215310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bff017da-042c-4387-a4a7-5bc9ea41c2b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:31.215742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bff017da-042c-4387-a4a7-5bc9ea41c2b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:31.366917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1be9b868-7b9b-46b8-8625-223fe3c74024 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:31.367662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1be9b868-7b9b-46b8-8625-223fe3c74024 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:31.374794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1be9b868-7b9b-46b8-8625-223fe3c74024 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:31.375294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1be9b868-7b9b-46b8-8625-223fe3c74024 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:31.376206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bff017da-042c-4387-a4a7-5bc9ea41c2b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:31.376366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1be9b868-7b9b-46b8-8625-223fe3c74024 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:31.376784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1be9b868-7b9b-46b8-8625-223fe3c74024 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:31.385404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bff017da-042c-4387-a4a7-5bc9ea41c2b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.183139 Jul 26 18:34:31.395096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 366/709] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:31 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:31.523342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1be9b868-7b9b-46b8-8625-223fe3c74024 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:31.532659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1be9b868-7b9b-46b8-8625-223fe3c74024 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:31.534158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1be9b868-7b9b-46b8-8625-223fe3c74024 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:31.535366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1be9b868-7b9b-46b8-8625-223fe3c74024 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.173115 Jul 26 18:34:31.535958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 344/710] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:32.410774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0632af6c-b68c-411a-8151-272d744cd7dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:32.412243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0632af6c-b68c-411a-8151-272d744cd7dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:32.419066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0632af6c-b68c-411a-8151-272d744cd7dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:32.419494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0632af6c-b68c-411a-8151-272d744cd7dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:32.420287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0632af6c-b68c-411a-8151-272d744cd7dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:32.420698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0632af6c-b68c-411a-8151-272d744cd7dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:32.558989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6f20a015-accc-4f13-b483-682306c932fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:32.560578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6f20a015-accc-4f13-b483-682306c932fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:32.567687 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f20a015-accc-4f13-b483-682306c932fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:32.567986 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f20a015-accc-4f13-b483-682306c932fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:32.568768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f20a015-accc-4f13-b483-682306c932fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:32.569268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f20a015-accc-4f13-b483-682306c932fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:32.596851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0632af6c-b68c-411a-8151-272d744cd7dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:32.606435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0632af6c-b68c-411a-8151-272d744cd7dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.199239 Jul 26 18:34:32.607121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 367/711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:32 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:32.714459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6f20a015-accc-4f13-b483-682306c932fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:32.723442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6f20a015-accc-4f13-b483-682306c932fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:32.724959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6f20a015-accc-4f13-b483-682306c932fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:32.726204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6f20a015-accc-4f13-b483-682306c932fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1807 microversion: 2.20 time: 0.172430 Jul 26 18:34:32.726778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 345/712] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:32 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:34:33.566540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-25a44d6e-d3a2-4840-be89-6ad850110080 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:33.567147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-25a44d6e-d3a2-4840-be89-6ad850110080 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:33.575900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25a44d6e-d3a2-4840-be89-6ad850110080 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:33.576646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25a44d6e-d3a2-4840-be89-6ad850110080 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:33.577910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25a44d6e-d3a2-4840-be89-6ad850110080 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:33.578619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25a44d6e-d3a2-4840-be89-6ad850110080 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:33.627583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a6c78eb9-cfb4-4cbd-ae2b-2e53667275a4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:33.628182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a6c78eb9-cfb4-4cbd-ae2b-2e53667275a4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:33.635268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6c78eb9-cfb4-4cbd-ae2b-2e53667275a4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:33.635611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6c78eb9-cfb4-4cbd-ae2b-2e53667275a4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:33.636377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6c78eb9-cfb4-4cbd-ae2b-2e53667275a4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:33.636804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6c78eb9-cfb4-4cbd-ae2b-2e53667275a4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:33.722010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.objects.instance [None req-25a44d6e-d3a2-4840-be89-6ad850110080 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lazy-loading 'services' on Instance uuid b5fd40dc-ca21-4cab-9e60-49c838116404 {{(pid=117996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:34:33.756006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:34:33.786346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a6c78eb9-cfb4-4cbd-ae2b-2e53667275a4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:33.793951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a6c78eb9-cfb4-4cbd-ae2b-2e53667275a4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1758 microversion: 2.1 time: 0.170244 Jul 26 18:34:33.794517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 346/713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:33 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:33.807963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fde16978-cce5-4a86-a095-b73bba1eb545 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:33.808614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fde16978-cce5-4a86-a095-b73bba1eb545 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:33.814640 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fde16978-cce5-4a86-a095-b73bba1eb545 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:33.815112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fde16978-cce5-4a86-a095-b73bba1eb545 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:33.815896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fde16978-cce5-4a86-a095-b73bba1eb545 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:33.816329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fde16978-cce5-4a86-a095-b73bba1eb545 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:33.841816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-25a44d6e-d3a2-4840-be89-6ad850110080 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404/os-volume_attachments/3aaf862e-591f-4da3-ab32-02e49fe0c9ae" status: 202 len: 0 microversion: 2.1 time: 0.279801 Jul 26 18:34:33.842414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 368/714] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Jul 26 18:34:33 2022] DELETE /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404/os-volume_attachments/3aaf862e-591f-4da3-ab32-02e49fe0c9ae => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:34:33.960664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fde16978-cce5-4a86-a095-b73bba1eb545 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:33.969120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fde16978-cce5-4a86-a095-b73bba1eb545 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:33.970630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fde16978-cce5-4a86-a095-b73bba1eb545 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:33.971816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fde16978-cce5-4a86-a095-b73bba1eb545 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1794 microversion: 2.20 time: 0.167750 Jul 26 18:34:33.972378 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 347/715] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:34:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1794 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:34:34.819970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-746c351e-14a0-44e6-bb35-fccc693e7402 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:34.820644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-746c351e-14a0-44e6-bb35-fccc693e7402 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:34.822768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=50 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:34:34.828720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-746c351e-14a0-44e6-bb35-fccc693e7402 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:34.829165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-746c351e-14a0-44e6-bb35-fccc693e7402 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:34.829920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-746c351e-14a0-44e6-bb35-fccc693e7402 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:34.830347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-746c351e-14a0-44e6-bb35-fccc693e7402 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:35.151225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-746c351e-14a0-44e6-bb35-fccc693e7402 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:35.162854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-746c351e-14a0-44e6-bb35-fccc693e7402 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1761 microversion: 2.1 time: 0.349717 Jul 26 18:34:35.163715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 369/716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:34 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1761 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:36.037171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b921bfbf-203b-4300-b2c9-79e25b0c376a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:36.037730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b921bfbf-203b-4300-b2c9-79e25b0c376a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:36.045349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b921bfbf-203b-4300-b2c9-79e25b0c376a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:36.045800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b921bfbf-203b-4300-b2c9-79e25b0c376a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:36.046565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b921bfbf-203b-4300-b2c9-79e25b0c376a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:36.046999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b921bfbf-203b-4300-b2c9-79e25b0c376a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:36.068497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:34:36.076531 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b921bfbf-203b-4300-b2c9-79e25b0c376a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 18:34:36.162376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b921bfbf-203b-4300-b2c9-79e25b0c376a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 204 len: 0 microversion: 2.1 time: 0.128698 Jul 26 18:34:36.163357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 348/717] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 18:34:36 2022] DELETE /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:34:36.171667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-06608506-787b-441a-836d-7227a0edc60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:36.172264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-06608506-787b-441a-836d-7227a0edc60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:36.179005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-06608506-787b-441a-836d-7227a0edc60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:36.179477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-06608506-787b-441a-836d-7227a0edc60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:36.180228 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-06608506-787b-441a-836d-7227a0edc60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:36.180653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-06608506-787b-441a-836d-7227a0edc60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:36.311741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-06608506-787b-441a-836d-7227a0edc60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:36.320306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-06608506-787b-441a-836d-7227a0edc60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1514 microversion: 2.1 time: 0.152577 Jul 26 18:34:36.320871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 370/718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:36 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:37.345681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8a13022c-7240-495b-9c0c-d833724f4782 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:37.346381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8a13022c-7240-495b-9c0c-d833724f4782 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:37.355848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a13022c-7240-495b-9c0c-d833724f4782 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:37.356311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a13022c-7240-495b-9c0c-d833724f4782 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:37.357221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a13022c-7240-495b-9c0c-d833724f4782 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:37.357657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a13022c-7240-495b-9c0c-d833724f4782 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:37.492719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8a13022c-7240-495b-9c0c-d833724f4782 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:37.501020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8a13022c-7240-495b-9c0c-d833724f4782 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1514 microversion: 2.1 time: 0.162107 Jul 26 18:34:37.501597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 349/719] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:37 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:38.523055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2d4ad9e2-db45-4bae-98e8-61886f623102 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:38.523668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2d4ad9e2-db45-4bae-98e8-61886f623102 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:38.530765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d4ad9e2-db45-4bae-98e8-61886f623102 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:38.531259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d4ad9e2-db45-4bae-98e8-61886f623102 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:38.532023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d4ad9e2-db45-4bae-98e8-61886f623102 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:38.532453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d4ad9e2-db45-4bae-98e8-61886f623102 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:38.665747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2d4ad9e2-db45-4bae-98e8-61886f623102 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:38.673563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2d4ad9e2-db45-4bae-98e8-61886f623102 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 200 len: 1514 microversion: 2.1 time: 0.154933 Jul 26 18:34:38.674494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 371/720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:38 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:38.899728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-b7c7acde-b3a8-4686-8b20-5545671d8981 req-08e0e6ac-88cb-4e6d-914c-585c210f5ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5fd40dc-ca21-4cab-9e60-49c838116404", "name": "network-vif-deleted", "tag": "b4af147f-cc74-47f0-bbf7-ed1a1d0ac8d8"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:34:38.910079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-b7c7acde-b3a8-4686-8b20-5545671d8981 req-08e0e6ac-88cb-4e6d-914c-585c210f5ce5 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:38.910532 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-b7c7acde-b3a8-4686-8b20-5545671d8981 req-08e0e6ac-88cb-4e6d-914c-585c210f5ce5 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:38.922397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-b7c7acde-b3a8-4686-8b20-5545671d8981 req-08e0e6ac-88cb-4e6d-914c-585c210f5ce5 service nova] Creating event network-vif-deleted:b4af147f-cc74-47f0-bbf7-ed1a1d0ac8d8 for instance b5fd40dc-ca21-4cab-9e60-49c838116404 on hv-cinder-82549 Jul 26 18:34:38.927441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-b7c7acde-b3a8-4686-8b20-5545671d8981 req-08e0e6ac-88cb-4e6d-914c-585c210f5ce5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099443 Jul 26 18:34:38.928102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 350/721] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:34:39.695144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ff77c15e-9b05-4441-8680-dbabce87f0d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:39.695785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ff77c15e-9b05-4441-8680-dbabce87f0d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: b5fd40dc-ca21-4cab-9e60-49c838116404] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:39.702671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff77c15e-9b05-4441-8680-dbabce87f0d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:39.703135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff77c15e-9b05-4441-8680-dbabce87f0d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:39.703981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff77c15e-9b05-4441-8680-dbabce87f0d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:39.704410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff77c15e-9b05-4441-8680-dbabce87f0d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:39.718426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-ff77c15e-9b05-4441-8680-dbabce87f0d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] HTTP exception thrown: Instance b5fd40dc-ca21-4cab-9e60-49c838116404 could not be found. Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ff77c15e-9b05-4441-8680-dbabce87f0d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Request method failure captured: Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 HTTP/1.1 Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DM7menm9WVfKTjQ1N1kZl1ry0kNsUZ19UDDQbEPdVs8mBk_96k7tQWLs9wuKMROrYCsKNLmllLzZ_px_kQtXRhvkA1428E9bbBafakBSdg4wSzunBVh2QGetV0iZmELIBlc_H3CERZl00zHsvjhIvrkZAvTIe8kZusAvrw0GJ9xjZA Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 4a3a3d4e1a54483ebf824780b87b97e6 Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1183204950 Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 18:34:39.720424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 18:34:39.722017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a3a3d4e1a54483ebf824780b87b97e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a3a3d4e1a54483ebf824780b87b97e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a3a3d4e1a54483ebf824780b87b97e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a3a3d4e1a54483ebf824780b87b97e6"}]}] Jul 26 18:34:39.722017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesSnapshotTestJSON-1183204950 Jul 26 18:34:39.722017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 4a3a3d4e1a54483ebf824780b87b97e6 Jul 26 18:34:39.722017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1183204950 Jul 26 18:34:39.722017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesSnapshotTestJSON-1183204950-project Jul 26 18:34:39.722017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 18:34:39.722017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 18:34:39.722017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: f2b9730f230249638cfc64f7b0ae9014 Jul 26 18:34:39.722017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesSnapshotTestJSON-1183204950-project Jul 26 18:34:39.722017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 18:34:39.722017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance b5fd40dc-ca21-4cab-9e60-49c838116404 could not be found. Jul 26 18:34:39.722017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': 'b5fd40dc-ca21-4cab-9e60-49c838116404'} Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5fd40dc-ca21-4cab-9e60-49c838116404 could not be found. Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:34:39.722953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5fd40dc-ca21-4cab-9e60-49c838116404 could not be found. Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5fd40dc-ca21-4cab-9e60-49c838116404 could not be found. Jul 26 18:34:39.724367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:34:39.725708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ff77c15e-9b05-4441-8680-dbabce87f0d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Returning 404 to user: Instance b5fd40dc-ca21-4cab-9e60-49c838116404 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:34:39.725708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ff77c15e-9b05-4441-8680-dbabce87f0d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404" status: 404 len: 111 microversion: 2.1 time: 0.030694 Jul 26 18:34:39.725708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 372/722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:39 2022] GET /compute/v2.1/servers/b5fd40dc-ca21-4cab-9e60-49c838116404 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 18:34:51.859831 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:34:51.860631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:34:51.864732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1830878276", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "networks": [{"uuid": "9c8b029e-7412-425b-b2f3-f692c581bfae"}]}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:34:51.919930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.network.neutron [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] validate_networks() for [('9c8b029e-7412-425b-b2f3-f692c581bfae', None, None, None, None, None)] {{(pid=117997) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:34:52.323941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Flavor limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:34:52.324524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Image limits 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:34:52.324995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Flavor pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:34:52.325396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Image pref 0:0:0 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:34:52.325799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.virt.hardware [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117997) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:34:52.335956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:52.336391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:52.337167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:52.337593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:52.355330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Getting quotas for project 4a3a3d4e1a54483ebf824780b87b97e6. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:34:52.359960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.quota [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Getting quotas for user f2b9730f230249638cfc64f7b0ae9014 and project 4a3a3d4e1a54483ebf824780b87b97e6. Resources: {'instances', 'ram', 'cores'} {{(pid=117997) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:34:52.371659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Going to run 1 instances... {{(pid=117997) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:34:52.374002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117997) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:34:52.422762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7ec6a2de-bf38-4641-9d92-ebec64a7067a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564699 Jul 26 18:34:52.423456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 351/723] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:34:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 18:34:52.436756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-68416b0d-6bff-4c71-a409-db1ae2741ff6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:52.437366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-68416b0d-6bff-4c71-a409-db1ae2741ff6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:52.440049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=7 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:34:52.440703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:34:52.497678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-68416b0d-6bff-4c71-a409-db1ae2741ff6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:52.504927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-68416b0d-6bff-4c71-a409-db1ae2741ff6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1219 microversion: 2.1 time: 0.073856 Jul 26 18:34:52.505522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 373/724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:52 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:53.530155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e41d44c9-43c0-4241-9807-65f578b967fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:53.530964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e41d44c9-43c0-4241-9807-65f578b967fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:53.539313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e41d44c9-43c0-4241-9807-65f578b967fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:53.539747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e41d44c9-43c0-4241-9807-65f578b967fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:53.540524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e41d44c9-43c0-4241-9807-65f578b967fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:53.540946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e41d44c9-43c0-4241-9807-65f578b967fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:53.606867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e41d44c9-43c0-4241-9807-65f578b967fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:53.614526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e41d44c9-43c0-4241-9807-65f578b967fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1271 microversion: 2.1 time: 0.091338 Jul 26 18:34:53.615139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 352/725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:53 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:54.636181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0eaa5b38-bf2e-403a-8cf9-7ed02958b91d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:54.636734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0eaa5b38-bf2e-403a-8cf9-7ed02958b91d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:54.644680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0eaa5b38-bf2e-403a-8cf9-7ed02958b91d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:54.645126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0eaa5b38-bf2e-403a-8cf9-7ed02958b91d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:54.645913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0eaa5b38-bf2e-403a-8cf9-7ed02958b91d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:54.646347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0eaa5b38-bf2e-403a-8cf9-7ed02958b91d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:54.783693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0eaa5b38-bf2e-403a-8cf9-7ed02958b91d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:54.791845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0eaa5b38-bf2e-403a-8cf9-7ed02958b91d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1319 microversion: 2.1 time: 0.159651 Jul 26 18:34:54.792411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 374/726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:54 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:55.251706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-471e23db-a46d-460e-9b53-b787eaf17886 req-57edf06e-826d-4bca-ad0d-7a8c1f033924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc78286d-d3af-46ed-bc61-506e92fe4a32", "tag": "1c5926b1-929a-4b2c-83f3-7af9008eb43c"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:34:55.262448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-471e23db-a46d-460e-9b53-b787eaf17886 req-57edf06e-826d-4bca-ad0d-7a8c1f033924 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:55.263095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-471e23db-a46d-460e-9b53-b787eaf17886 req-57edf06e-826d-4bca-ad0d-7a8c1f033924 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:55.275775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-471e23db-a46d-460e-9b53-b787eaf17886 req-57edf06e-826d-4bca-ad0d-7a8c1f033924 service nova] Creating event network-changed:1c5926b1-929a-4b2c-83f3-7af9008eb43c for instance fc78286d-d3af-46ed-bc61-506e92fe4a32 on hv-cinder-82549 Jul 26 18:34:55.280569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-471e23db-a46d-460e-9b53-b787eaf17886 req-57edf06e-826d-4bca-ad0d-7a8c1f033924 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032612 Jul 26 18:34:55.281172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 353/727] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:34:55.813541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7786a3ea-c3ee-4992-a158-fe69d4075e4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:55.814317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7786a3ea-c3ee-4992-a158-fe69d4075e4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:55.821758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7786a3ea-c3ee-4992-a158-fe69d4075e4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:55.822212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7786a3ea-c3ee-4992-a158-fe69d4075e4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:55.823062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7786a3ea-c3ee-4992-a158-fe69d4075e4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:55.823479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7786a3ea-c3ee-4992-a158-fe69d4075e4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:55.968001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7786a3ea-c3ee-4992-a158-fe69d4075e4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:55.976025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7786a3ea-c3ee-4992-a158-fe69d4075e4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1319 microversion: 2.1 time: 0.166564 Jul 26 18:34:55.976605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 375/728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:55 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:56.786961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7b13de4d-f310-4d9e-9465-8246c088999e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10218421-3bb4-4126-9d73-6f8dce3b9092"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:34:56.789933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7b13de4d-f310-4d9e-9465-8246c088999e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:56.798882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b13de4d-f310-4d9e-9465-8246c088999e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:56.799477 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b13de4d-f310-4d9e-9465-8246c088999e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:56.800422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b13de4d-f310-4d9e-9465-8246c088999e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:56.800854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b13de4d-f310-4d9e-9465-8246c088999e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:56.996232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-364c2d80-3a86-4ded-b9de-f470b4cc4b6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:56.996839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-364c2d80-3a86-4ded-b9de-f470b4cc4b6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:57.004050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-364c2d80-3a86-4ded-b9de-f470b4cc4b6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:57.004522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-364c2d80-3a86-4ded-b9de-f470b4cc4b6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:57.005284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-364c2d80-3a86-4ded-b9de-f470b4cc4b6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:57.005715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-364c2d80-3a86-4ded-b9de-f470b4cc4b6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:57.145411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-364c2d80-3a86-4ded-b9de-f470b4cc4b6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:57.155529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-364c2d80-3a86-4ded-b9de-f470b4cc4b6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1319 microversion: 2.1 time: 0.163252 Jul 26 18:34:57.156145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 376/729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:56 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:58.176911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9fb34d75-46fe-449c-8164-466a3f59afcf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:58.177582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9fb34d75-46fe-449c-8164-466a3f59afcf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:58.184411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fb34d75-46fe-449c-8164-466a3f59afcf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:58.184856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fb34d75-46fe-449c-8164-466a3f59afcf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:58.185618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fb34d75-46fe-449c-8164-466a3f59afcf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:58.186078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fb34d75-46fe-449c-8164-466a3f59afcf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:58.319841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9fb34d75-46fe-449c-8164-466a3f59afcf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:58.327711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9fb34d75-46fe-449c-8164-466a3f59afcf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1319 microversion: 2.1 time: 0.154850 Jul 26 18:34:58.328269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 377/730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:58 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:34:59.301165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7b13de4d-f310-4d9e-9465-8246c088999e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "POST /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.628647 Jul 26 18:34:59.301952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 354/731] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Jul 26 18:34:56 2022] POST /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 194 bytes in 2631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:34:59.350371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f28d29dc-d06b-412d-9561-1e9a7242823f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:34:59.352123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f28d29dc-d06b-412d-9561-1e9a7242823f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:34:59.368172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f28d29dc-d06b-412d-9561-1e9a7242823f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:59.368611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f28d29dc-d06b-412d-9561-1e9a7242823f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:59.369389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f28d29dc-d06b-412d-9561-1e9a7242823f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:34:59.369806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f28d29dc-d06b-412d-9561-1e9a7242823f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:34:59.514863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f28d29dc-d06b-412d-9561-1e9a7242823f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:34:59.525381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f28d29dc-d06b-412d-9561-1e9a7242823f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1319 microversion: 2.1 time: 0.180615 Jul 26 18:34:59.526042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 378/732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:34:59 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:00.548507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dc6c9594-0c81-476b-9b5c-4ee92509a6b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:00.549232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dc6c9594-0c81-476b-9b5c-4ee92509a6b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:00.556271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc6c9594-0c81-476b-9b5c-4ee92509a6b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:00.556716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc6c9594-0c81-476b-9b5c-4ee92509a6b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:00.557469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc6c9594-0c81-476b-9b5c-4ee92509a6b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:00.557898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc6c9594-0c81-476b-9b5c-4ee92509a6b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:00.706470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dc6c9594-0c81-476b-9b5c-4ee92509a6b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:00.714157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dc6c9594-0c81-476b-9b5c-4ee92509a6b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1319 microversion: 2.1 time: 0.170918 Jul 26 18:35:00.714804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 355/733] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:00 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:01.735853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-86c3b733-ca47-4b37-b9a0-1e4db1fbf9e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:01.736390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-86c3b733-ca47-4b37-b9a0-1e4db1fbf9e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:01.744117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86c3b733-ca47-4b37-b9a0-1e4db1fbf9e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:01.744564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86c3b733-ca47-4b37-b9a0-1e4db1fbf9e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:01.745333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86c3b733-ca47-4b37-b9a0-1e4db1fbf9e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:01.745756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86c3b733-ca47-4b37-b9a0-1e4db1fbf9e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:01.903455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-86c3b733-ca47-4b37-b9a0-1e4db1fbf9e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:01.913396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-86c3b733-ca47-4b37-b9a0-1e4db1fbf9e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1319 microversion: 2.1 time: 0.181523 Jul 26 18:35:01.913953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 379/734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:01 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:02.578238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:35:02.579631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell0:SELECT=6 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:35:02.644357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-a34abdcf-0d4e-4266-963d-6dbbd5942a40 req-3da2c773-bbcd-483a-8494-fce58dc4ebc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc78286d-d3af-46ed-bc61-506e92fe4a32", "name": "network-vif-plugged", "status": "completed", "tag": "1c5926b1-929a-4b2c-83f3-7af9008eb43c"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:35:02.656142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-a34abdcf-0d4e-4266-963d-6dbbd5942a40 req-3da2c773-bbcd-483a-8494-fce58dc4ebc1 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:02.656695 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-a34abdcf-0d4e-4266-963d-6dbbd5942a40 req-3da2c773-bbcd-483a-8494-fce58dc4ebc1 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:02.669183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-a34abdcf-0d4e-4266-963d-6dbbd5942a40 req-3da2c773-bbcd-483a-8494-fce58dc4ebc1 service nova] Creating event network-vif-plugged:1c5926b1-929a-4b2c-83f3-7af9008eb43c for instance fc78286d-d3af-46ed-bc61-506e92fe4a32 on hv-cinder-82549 Jul 26 18:35:02.674645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-a34abdcf-0d4e-4266-963d-6dbbd5942a40 req-3da2c773-bbcd-483a-8494-fce58dc4ebc1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101758 Jul 26 18:35:02.675311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 356/735] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:35:02.935204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-28f1d7a0-6b66-411a-b026-8a1ad8d02686 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:02.935837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-28f1d7a0-6b66-411a-b026-8a1ad8d02686 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:02.938111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:35:02.944026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28f1d7a0-6b66-411a-b026-8a1ad8d02686 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:02.944463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28f1d7a0-6b66-411a-b026-8a1ad8d02686 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:02.945225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28f1d7a0-6b66-411a-b026-8a1ad8d02686 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:02.945649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28f1d7a0-6b66-411a-b026-8a1ad8d02686 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:03.105978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-28f1d7a0-6b66-411a-b026-8a1ad8d02686 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:03.113796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-28f1d7a0-6b66-411a-b026-8a1ad8d02686 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1319 microversion: 2.1 time: 0.183105 Jul 26 18:35:03.114364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 380/736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:02 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:04.138997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-95aabb77-cbef-4596-9317-e960883cc7d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:04.139950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-95aabb77-cbef-4596-9317-e960883cc7d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:04.149672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95aabb77-cbef-4596-9317-e960883cc7d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:04.150339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95aabb77-cbef-4596-9317-e960883cc7d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:04.151295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95aabb77-cbef-4596-9317-e960883cc7d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:04.151783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95aabb77-cbef-4596-9317-e960883cc7d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:04.295887 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-95aabb77-cbef-4596-9317-e960883cc7d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:04.303828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-95aabb77-cbef-4596-9317-e960883cc7d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1319 microversion: 2.1 time: 0.172380 Jul 26 18:35:04.304366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 357/737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:04 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:05.329110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-344ebb0e-45fa-41ea-a011-4aeb14283043 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:05.330234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-344ebb0e-45fa-41ea-a011-4aeb14283043 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:05.341205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-344ebb0e-45fa-41ea-a011-4aeb14283043 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:05.341964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-344ebb0e-45fa-41ea-a011-4aeb14283043 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:05.343234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-344ebb0e-45fa-41ea-a011-4aeb14283043 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:05.343963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-344ebb0e-45fa-41ea-a011-4aeb14283043 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:05.478843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-344ebb0e-45fa-41ea-a011-4aeb14283043 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:05.486750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-344ebb0e-45fa-41ea-a011-4aeb14283043 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1319 microversion: 2.1 time: 0.164217 Jul 26 18:35:05.487381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 381/738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:05 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:06.510908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fbcdfe1c-2185-4c21-a133-64188236f379 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:06.511760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fbcdfe1c-2185-4c21-a133-64188236f379 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:06.521161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbcdfe1c-2185-4c21-a133-64188236f379 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:06.521904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbcdfe1c-2185-4c21-a133-64188236f379 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:06.522681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbcdfe1c-2185-4c21-a133-64188236f379 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:06.523149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbcdfe1c-2185-4c21-a133-64188236f379 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:06.661986 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fbcdfe1c-2185-4c21-a133-64188236f379 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:06.670702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fbcdfe1c-2185-4c21-a133-64188236f379 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1508 microversion: 2.1 time: 0.166124 Jul 26 18:35:06.671290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 358/739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:06 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:06.692050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f5edd609-18fe-4274-a140-2d2eb9f62ed2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "619b2cc9-7b2f-4618-83d0-228f0acc6a9a", "device": "/dev/sdb"}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:35:06.694970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f5edd609-18fe-4274-a140-2d2eb9f62ed2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:06.701921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5edd609-18fe-4274-a140-2d2eb9f62ed2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:06.702367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5edd609-18fe-4274-a140-2d2eb9f62ed2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:06.703151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5edd609-18fe-4274-a140-2d2eb9f62ed2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:06.703589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5edd609-18fe-4274-a140-2d2eb9f62ed2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:07.061564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f5edd609-18fe-4274-a140-2d2eb9f62ed2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "POST /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372978 Jul 26 18:35:07.062337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 382/740] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Jul 26 18:35:06 2022] POST /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:35:07.927275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-47fa1f2f-5f02-4372-8cd6-6467b38b4949 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:35:07.929834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-47fa1f2f-5f02-4372-8cd6-6467b38b4949 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:07.936166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47fa1f2f-5f02-4372-8cd6-6467b38b4949 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:07.936619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47fa1f2f-5f02-4372-8cd6-6467b38b4949 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:07.937379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47fa1f2f-5f02-4372-8cd6-6467b38b4949 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:07.937811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47fa1f2f-5f02-4372-8cd6-6467b38b4949 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:07.961434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-47fa1f2f-5f02-4372-8cd6-6467b38b4949 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lazy-loading 'flavor' on Instance uuid e26b67fc-cc0a-41a7-8568-17f2eed10fb2 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:35:08.096596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-47fa1f2f-5f02-4372-8cd6-6467b38b4949 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "POST /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/action" status: 200 len: 32 microversion: 2.1 time: 0.174124 Jul 26 18:35:08.097444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 359/741] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:35:07 2022] POST /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 18:35:08.110335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1475a326-41fd-4bb1-8872-ca750487d058 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:08.111006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1475a326-41fd-4bb1-8872-ca750487d058 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:08.119985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1475a326-41fd-4bb1-8872-ca750487d058 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:08.120732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1475a326-41fd-4bb1-8872-ca750487d058 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:08.121760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1475a326-41fd-4bb1-8872-ca750487d058 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:08.122380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1475a326-41fd-4bb1-8872-ca750487d058 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:08.258335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1475a326-41fd-4bb1-8872-ca750487d058 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:08.270159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1475a326-41fd-4bb1-8872-ca750487d058 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160989 Jul 26 18:35:08.270159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 383/742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:09.289533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dd2dcdee-321f-40db-af46-c3bbe7eacc4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:09.290231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dd2dcdee-321f-40db-af46-c3bbe7eacc4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:09.297485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd2dcdee-321f-40db-af46-c3bbe7eacc4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:09.297939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd2dcdee-321f-40db-af46-c3bbe7eacc4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:09.298688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd2dcdee-321f-40db-af46-c3bbe7eacc4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:09.299181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd2dcdee-321f-40db-af46-c3bbe7eacc4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:09.446269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dd2dcdee-321f-40db-af46-c3bbe7eacc4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:09.455008 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dd2dcdee-321f-40db-af46-c3bbe7eacc4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.169851 Jul 26 18:35:09.455626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 360/743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:09 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:10.480065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f0981ae8-c888-495b-82ec-27e80c073b33 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:10.480897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f0981ae8-c888-495b-82ec-27e80c073b33 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:10.489720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f0981ae8-c888-495b-82ec-27e80c073b33 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:10.490590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f0981ae8-c888-495b-82ec-27e80c073b33 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:10.490967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f0981ae8-c888-495b-82ec-27e80c073b33 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:10.491432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f0981ae8-c888-495b-82ec-27e80c073b33 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:10.636429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f0981ae8-c888-495b-82ec-27e80c073b33 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:10.648363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f0981ae8-c888-495b-82ec-27e80c073b33 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.174283 Jul 26 18:35:10.649211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 384/744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:10 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:11.673833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-765d2c30-05a8-4346-9042-f898e791830c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:11.674588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-765d2c30-05a8-4346-9042-f898e791830c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:11.686792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-765d2c30-05a8-4346-9042-f898e791830c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:11.687496 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-765d2c30-05a8-4346-9042-f898e791830c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:11.688660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-765d2c30-05a8-4346-9042-f898e791830c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:11.689354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-765d2c30-05a8-4346-9042-f898e791830c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:11.832511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-765d2c30-05a8-4346-9042-f898e791830c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:11.840957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-765d2c30-05a8-4346-9042-f898e791830c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.173890 Jul 26 18:35:11.841573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 361/745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:12.863073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-941c60eb-4ddd-43db-b019-5c0f020ef84a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:12.863705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-941c60eb-4ddd-43db-b019-5c0f020ef84a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:12.870506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-941c60eb-4ddd-43db-b019-5c0f020ef84a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:12.870949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-941c60eb-4ddd-43db-b019-5c0f020ef84a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:12.871765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-941c60eb-4ddd-43db-b019-5c0f020ef84a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:12.872197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-941c60eb-4ddd-43db-b019-5c0f020ef84a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:13.022758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-941c60eb-4ddd-43db-b019-5c0f020ef84a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:13.031378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-941c60eb-4ddd-43db-b019-5c0f020ef84a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.172285 Jul 26 18:35:13.031971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 385/746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:12 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:14.054260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1f4d3e6a-bc7b-4bac-aa7a-3dbe1e337a57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:14.054819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1f4d3e6a-bc7b-4bac-aa7a-3dbe1e337a57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:14.061955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f4d3e6a-bc7b-4bac-aa7a-3dbe1e337a57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:14.062405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f4d3e6a-bc7b-4bac-aa7a-3dbe1e337a57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:14.063207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f4d3e6a-bc7b-4bac-aa7a-3dbe1e337a57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:14.063643 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f4d3e6a-bc7b-4bac-aa7a-3dbe1e337a57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:14.202037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-321ea28c-a213-4279-a113-0146b385e55b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:14.202539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-321ea28c-a213-4279-a113-0146b385e55b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:14.202635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1f4d3e6a-bc7b-4bac-aa7a-3dbe1e337a57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:14.208810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-321ea28c-a213-4279-a113-0146b385e55b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:14.209256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-321ea28c-a213-4279-a113-0146b385e55b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:14.210023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-321ea28c-a213-4279-a113-0146b385e55b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:14.210451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-321ea28c-a213-4279-a113-0146b385e55b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:14.211294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1f4d3e6a-bc7b-4bac-aa7a-3dbe1e337a57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.161043 Jul 26 18:35:14.215078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 362/747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:14 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:14.294787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.objects.instance [None req-321ea28c-a213-4279-a113-0146b385e55b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lazy-loading 'services' on Instance uuid 99df3fd1-46e9-4842-9e60-b69d557d60c2 {{(pid=117996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:35:14.377024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-321ea28c-a213-4279-a113-0146b385e55b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "DELETE /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments/fc626daa-443b-4762-b1a3-a60c2545fc1b" status: 202 len: 0 microversion: 2.1 time: 0.286607 Jul 26 18:35:14.377833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 386/748] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Jul 26 18:35:14 2022] DELETE /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments/fc626daa-443b-4762-b1a3-a60c2545fc1b => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:35:15.236051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-27569d70-b19f-4f55-8f73-3e485451b32a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:15.236714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-27569d70-b19f-4f55-8f73-3e485451b32a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:15.244859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27569d70-b19f-4f55-8f73-3e485451b32a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:15.245404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27569d70-b19f-4f55-8f73-3e485451b32a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:15.246326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27569d70-b19f-4f55-8f73-3e485451b32a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:15.246781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27569d70-b19f-4f55-8f73-3e485451b32a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:15.397078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-27569d70-b19f-4f55-8f73-3e485451b32a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:15.405114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-27569d70-b19f-4f55-8f73-3e485451b32a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.173947 Jul 26 18:35:15.405666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 363/749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:16.430280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-182c310f-7bdf-4d14-8055-a1de767e948c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:16.430968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-182c310f-7bdf-4d14-8055-a1de767e948c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:16.438064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-182c310f-7bdf-4d14-8055-a1de767e948c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:16.438522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-182c310f-7bdf-4d14-8055-a1de767e948c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:16.439337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-182c310f-7bdf-4d14-8055-a1de767e948c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:16.439777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-182c310f-7bdf-4d14-8055-a1de767e948c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:16.575561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-182c310f-7bdf-4d14-8055-a1de767e948c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:16.584705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-182c310f-7bdf-4d14-8055-a1de767e948c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158565 Jul 26 18:35:16.584705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 387/750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:17.605638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-142e895f-4dcb-4565-8baa-e3c1a9d7fff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:17.606234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-142e895f-4dcb-4565-8baa-e3c1a9d7fff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:17.613460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-142e895f-4dcb-4565-8baa-e3c1a9d7fff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:17.613915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-142e895f-4dcb-4565-8baa-e3c1a9d7fff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:17.614679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-142e895f-4dcb-4565-8baa-e3c1a9d7fff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:17.615141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-142e895f-4dcb-4565-8baa-e3c1a9d7fff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:17.746345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-142e895f-4dcb-4565-8baa-e3c1a9d7fff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:17.757731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-142e895f-4dcb-4565-8baa-e3c1a9d7fff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155638 Jul 26 18:35:17.758516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 364/751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:17 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:18.782544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-343580a1-632a-417d-b6ce-9eef513c3a2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:18.783990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-343580a1-632a-417d-b6ce-9eef513c3a2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:18.790891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-343580a1-632a-417d-b6ce-9eef513c3a2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:18.791681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-343580a1-632a-417d-b6ce-9eef513c3a2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:18.792303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-343580a1-632a-417d-b6ce-9eef513c3a2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:18.792777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-343580a1-632a-417d-b6ce-9eef513c3a2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:18.812238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:35:18.944377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-343580a1-632a-417d-b6ce-9eef513c3a2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:18.957124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-343580a1-632a-417d-b6ce-9eef513c3a2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.178551 Jul 26 18:35:18.957873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 388/752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:19.985983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-80bae5ff-9404-42a6-b16f-674deb421347 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:19.987589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-80bae5ff-9404-42a6-b16f-674deb421347 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:19.996513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80bae5ff-9404-42a6-b16f-674deb421347 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:19.997189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80bae5ff-9404-42a6-b16f-674deb421347 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:19.998145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80bae5ff-9404-42a6-b16f-674deb421347 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:19.998869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80bae5ff-9404-42a6-b16f-674deb421347 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:20.135901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80bae5ff-9404-42a6-b16f-674deb421347 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:20.144503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-80bae5ff-9404-42a6-b16f-674deb421347 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163758 Jul 26 18:35:20.145102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 365/753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:19 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:21.169755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-30d6d0b0-ae1c-47da-b77c-e85912b5681b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:21.170434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-30d6d0b0-ae1c-47da-b77c-e85912b5681b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:21.180954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30d6d0b0-ae1c-47da-b77c-e85912b5681b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:21.181611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30d6d0b0-ae1c-47da-b77c-e85912b5681b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:21.182781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30d6d0b0-ae1c-47da-b77c-e85912b5681b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:21.183618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30d6d0b0-ae1c-47da-b77c-e85912b5681b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:21.322048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-30d6d0b0-ae1c-47da-b77c-e85912b5681b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:21.331154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-30d6d0b0-ae1c-47da-b77c-e85912b5681b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167626 Jul 26 18:35:21.331796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 389/754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:22.356985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b8df03c2-0aca-4b2a-b963-6fe6be423fac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:22.357803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b8df03c2-0aca-4b2a-b963-6fe6be423fac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:22.361127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:35:22.367331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b8df03c2-0aca-4b2a-b963-6fe6be423fac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:22.367770 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b8df03c2-0aca-4b2a-b963-6fe6be423fac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:22.368571 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b8df03c2-0aca-4b2a-b963-6fe6be423fac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:22.368996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b8df03c2-0aca-4b2a-b963-6fe6be423fac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:22.372476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:35:22.511258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b8df03c2-0aca-4b2a-b963-6fe6be423fac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:22.519771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b8df03c2-0aca-4b2a-b963-6fe6be423fac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.168611 Jul 26 18:35:22.520314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 366/755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:23.541818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0e4781d2-aa95-4525-8b4e-82b5c3fa6045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:23.542420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0e4781d2-aa95-4525-8b4e-82b5c3fa6045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:23.544896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=37 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:35:23.551002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e4781d2-aa95-4525-8b4e-82b5c3fa6045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:23.551559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e4781d2-aa95-4525-8b4e-82b5c3fa6045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:23.552323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e4781d2-aa95-4525-8b4e-82b5c3fa6045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:23.552759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e4781d2-aa95-4525-8b4e-82b5c3fa6045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:23.696401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0e4781d2-aa95-4525-8b4e-82b5c3fa6045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:23.707881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0e4781d2-aa95-4525-8b4e-82b5c3fa6045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.169984 Jul 26 18:35:23.708425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 390/756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:23 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:24.729600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bc82fde1-7fb8-409d-a8fd-b5875b061777 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:24.730209 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bc82fde1-7fb8-409d-a8fd-b5875b061777 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:24.737338 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc82fde1-7fb8-409d-a8fd-b5875b061777 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:24.737782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc82fde1-7fb8-409d-a8fd-b5875b061777 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:24.738545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc82fde1-7fb8-409d-a8fd-b5875b061777 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:24.738978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc82fde1-7fb8-409d-a8fd-b5875b061777 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:24.887100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bc82fde1-7fb8-409d-a8fd-b5875b061777 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:24.899698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bc82fde1-7fb8-409d-a8fd-b5875b061777 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.173734 Jul 26 18:35:24.900393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 367/757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:24 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:25.924523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-41fbc15a-1170-4333-bb5a-8685f26decb5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:25.925154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-41fbc15a-1170-4333-bb5a-8685f26decb5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:25.933853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41fbc15a-1170-4333-bb5a-8685f26decb5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:25.934318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41fbc15a-1170-4333-bb5a-8685f26decb5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:25.935421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41fbc15a-1170-4333-bb5a-8685f26decb5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:25.935856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41fbc15a-1170-4333-bb5a-8685f26decb5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:26.084462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-41fbc15a-1170-4333-bb5a-8685f26decb5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:26.094240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-41fbc15a-1170-4333-bb5a-8685f26decb5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.175901 Jul 26 18:35:26.095416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 391/758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:25 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:27.116265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-209cc282-8fe1-4466-8f07-ab99f141a1bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:27.116867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-209cc282-8fe1-4466-8f07-ab99f141a1bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:27.123581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-209cc282-8fe1-4466-8f07-ab99f141a1bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:27.124024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-209cc282-8fe1-4466-8f07-ab99f141a1bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:27.124789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-209cc282-8fe1-4466-8f07-ab99f141a1bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:27.125220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-209cc282-8fe1-4466-8f07-ab99f141a1bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:27.256945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-209cc282-8fe1-4466-8f07-ab99f141a1bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:27.265216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-209cc282-8fe1-4466-8f07-ab99f141a1bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152808 Jul 26 18:35:27.265817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 368/759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:27 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:28.289956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-31e31bef-fec9-4616-b587-aa6450667561 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:28.290889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-31e31bef-fec9-4616-b587-aa6450667561 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:28.300956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31e31bef-fec9-4616-b587-aa6450667561 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:28.301402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31e31bef-fec9-4616-b587-aa6450667561 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:28.302160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31e31bef-fec9-4616-b587-aa6450667561 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:28.302593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31e31bef-fec9-4616-b587-aa6450667561 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:28.446303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-31e31bef-fec9-4616-b587-aa6450667561 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:28.454775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-31e31bef-fec9-4616-b587-aa6450667561 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.171048 Jul 26 18:35:28.455376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 392/760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:28 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:29.478155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-68b74dd8-20e6-49aa-ae28-b9f3bfa96f2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:29.478739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-68b74dd8-20e6-49aa-ae28-b9f3bfa96f2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:29.486032 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68b74dd8-20e6-49aa-ae28-b9f3bfa96f2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:29.486475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68b74dd8-20e6-49aa-ae28-b9f3bfa96f2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:29.487420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68b74dd8-20e6-49aa-ae28-b9f3bfa96f2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:29.487848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68b74dd8-20e6-49aa-ae28-b9f3bfa96f2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:29.593688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-250d3636-9092-4579-bd48-92262ecfeacc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:29.594298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-250d3636-9092-4579-bd48-92262ecfeacc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:29.601075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-250d3636-9092-4579-bd48-92262ecfeacc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:29.601530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-250d3636-9092-4579-bd48-92262ecfeacc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:29.602332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-250d3636-9092-4579-bd48-92262ecfeacc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:29.602766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-250d3636-9092-4579-bd48-92262ecfeacc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:29.627980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-250d3636-9092-4579-bd48-92262ecfeacc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183/ips" status: 200 len: 150 microversion: 2.1 time: 0.151424 Jul 26 18:35:29.628740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 393/761] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Jul 26 18:35:29 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183/ips => generated 150 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:35:29.630340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-68b74dd8-20e6-49aa-ae28-b9f3bfa96f2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:29.638794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-68b74dd8-20e6-49aa-ae28-b9f3bfa96f2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.165596 Jul 26 18:35:29.639384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 369/762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:29 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:29.640540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0b8f09df-a072-45fa-87b4-92248f17c7e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e6c66e5-b4d7-4483-886f-8c594e6e7bcb"}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:35:29.643000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0b8f09df-a072-45fa-87b4-92248f17c7e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:29.649472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b8f09df-a072-45fa-87b4-92248f17c7e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:29.649916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b8f09df-a072-45fa-87b4-92248f17c7e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:29.650674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b8f09df-a072-45fa-87b4-92248f17c7e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:29.651128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b8f09df-a072-45fa-87b4-92248f17c7e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:29.742209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-0b8f09df-a072-45fa-87b4-92248f17c7e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] HTTP exception thrown: Invalid volume: volume 7e6c66e5-b4d7-4483-886f-8c594e6e7bcb is already attached to instances: 62ada35c-e092-41a1-a9c4-2177b7e8ae31 Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0b8f09df-a072-45fa-87b4-92248f17c7e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Request method failure captured: Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: POST /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183/os-volume_attachments HTTP/1.1 Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 74 Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJoSQxtv8AwmMak-ApkBvAGOclo4VruA3O1ksriTQ-6wpon0S82Ytovbh7gPvY9VGGxzAgXUWiTbl5QGYG92BM1Znn6HEH2ee4X47ZQi-xr6Z5aM7IRi8fPr5rzuGUs2sNA27Ubz43AnXU59xT2N4VBOhhHlHD4N7kOEcCcjjtSB-I Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 18:35:29.743954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 18:35:29.745595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_765e809e332e4a478e09be17e6b3c385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}] Jul 26 18:35:29.745595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeNegativeTest-201653783 Jul 26 18:35:29.745595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 18:35:29.745595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 18:35:29.745595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 18:35:29.745595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 18:35:29.745595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 18:35:29.745595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 40f43a6429474c5e96db487ee85bbd84 Jul 26 18:35:29.745595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 18:35:29.745595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Jul 26 18:35:29.745595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {"volumeAttachment": {"volumeId": "7e6c66e5-b4d7-4483-886f-8c594e6e7bcb"}} Jul 26 18:35:29.745595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Invalid volume: volume 7e6c66e5-b4d7-4483-886f-8c594e6e7bcb is already attached to instances: 62ada35c-e092-41a1-a9c4-2177b7e8ae31 Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'server_id': 'd54c7ad3-e708-41db-ad30-52ed8fc45183', 'body': {'volumeAttachment': {'volumeId': '7e6c66e5-b4d7-4483-886f-8c594e6e7bcb'}}} Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7e6c66e5-b4d7-4483-886f-8c594e6e7bcb is already attached to instances: 62ada35c-e092-41a1-a9c4-2177b7e8ae31 Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:35:29.746416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7e6c66e5-b4d7-4483-886f-8c594e6e7bcb is already attached to instances: 62ada35c-e092-41a1-a9c4-2177b7e8ae31 Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:35:29.747618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:35:29.749337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:35:29.749337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:35:29.749337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:35:29.749337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7e6c66e5-b4d7-4483-886f-8c594e6e7bcb is already attached to instances: 62ada35c-e092-41a1-a9c4-2177b7e8ae31 Jul 26 18:35:29.749337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:35:29.749337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0b8f09df-a072-45fa-87b4-92248f17c7e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Returning 400 to user: Invalid volume: volume 7e6c66e5-b4d7-4483-886f-8c594e6e7bcb is already attached to instances: 62ada35c-e092-41a1-a9c4-2177b7e8ae31 {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:35:29.749337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0b8f09df-a072-45fa-87b4-92248f17c7e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "POST /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108869 Jul 26 18:35:29.749337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 394/763] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Jul 26 18:35:29 2022] POST /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 18:35:29.754668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-32f231e7-ea95-4d6f-9d2c-6f34fa915a6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:29.755193 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-32f231e7-ea95-4d6f-9d2c-6f34fa915a6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:29.761513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32f231e7-ea95-4d6f-9d2c-6f34fa915a6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:29.761953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32f231e7-ea95-4d6f-9d2c-6f34fa915a6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:29.762704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32f231e7-ea95-4d6f-9d2c-6f34fa915a6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:29.763166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32f231e7-ea95-4d6f-9d2c-6f34fa915a6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:29.788517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-32f231e7-ea95-4d6f-9d2c-6f34fa915a6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 18:35:29.869144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-32f231e7-ea95-4d6f-9d2c-6f34fa915a6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 204 len: 0 microversion: 2.1 time: 0.118047 Jul 26 18:35:29.869885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 370/764] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 18:35:29 2022] DELETE /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:35:29.878698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-65d7bb74-b835-49bc-8677-a72ace1dad6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:29.879317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-65d7bb74-b835-49bc-8677-a72ace1dad6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:29.886290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65d7bb74-b835-49bc-8677-a72ace1dad6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:29.886726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65d7bb74-b835-49bc-8677-a72ace1dad6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:29.887545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65d7bb74-b835-49bc-8677-a72ace1dad6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:29.887985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65d7bb74-b835-49bc-8677-a72ace1dad6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:30.029725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-65d7bb74-b835-49bc-8677-a72ace1dad6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:30.038038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-65d7bb74-b835-49bc-8677-a72ace1dad6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.163418 Jul 26 18:35:30.038599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 395/765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:29 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:35:30.663340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6477b442-8c48-480a-b0e5-edb008406fdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:30.663913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6477b442-8c48-480a-b0e5-edb008406fdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:30.670887 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6477b442-8c48-480a-b0e5-edb008406fdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:30.671369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6477b442-8c48-480a-b0e5-edb008406fdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:30.672130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6477b442-8c48-480a-b0e5-edb008406fdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:30.672562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6477b442-8c48-480a-b0e5-edb008406fdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:30.813975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6477b442-8c48-480a-b0e5-edb008406fdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:30.822449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6477b442-8c48-480a-b0e5-edb008406fdf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.164063 Jul 26 18:35:30.823057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 371/766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:30 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:31.061359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-14c3a6e5-52a8-4fe0-b30a-0342f83259b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:31.061961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-14c3a6e5-52a8-4fe0-b30a-0342f83259b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:31.069118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14c3a6e5-52a8-4fe0-b30a-0342f83259b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:31.069558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14c3a6e5-52a8-4fe0-b30a-0342f83259b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:31.070315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14c3a6e5-52a8-4fe0-b30a-0342f83259b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:31.070743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14c3a6e5-52a8-4fe0-b30a-0342f83259b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:31.210420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-14c3a6e5-52a8-4fe0-b30a-0342f83259b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:31.218594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-14c3a6e5-52a8-4fe0-b30a-0342f83259b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.161216 Jul 26 18:35:31.219207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 396/767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:31 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:31.846549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c255dcd5-cab5-48a8-8bd1-3da20ce5ffce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:31.847144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c255dcd5-cab5-48a8-8bd1-3da20ce5ffce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:31.856630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c255dcd5-cab5-48a8-8bd1-3da20ce5ffce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:31.857197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c255dcd5-cab5-48a8-8bd1-3da20ce5ffce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:31.858172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c255dcd5-cab5-48a8-8bd1-3da20ce5ffce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:31.858784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c255dcd5-cab5-48a8-8bd1-3da20ce5ffce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:32.000244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c255dcd5-cab5-48a8-8bd1-3da20ce5ffce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:32.008607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c255dcd5-cab5-48a8-8bd1-3da20ce5ffce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167830 Jul 26 18:35:32.009161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 372/768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:31 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:35:32.240356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d6f28d31-3d20-4919-8279-06d162d08abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:32.240944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d6f28d31-3d20-4919-8279-06d162d08abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:32.248122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d6f28d31-3d20-4919-8279-06d162d08abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:32.248595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d6f28d31-3d20-4919-8279-06d162d08abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:32.249345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d6f28d31-3d20-4919-8279-06d162d08abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:32.249776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d6f28d31-3d20-4919-8279-06d162d08abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:32.389961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d6f28d31-3d20-4919-8279-06d162d08abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:32.399879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d6f28d31-3d20-4919-8279-06d162d08abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.163373 Jul 26 18:35:32.400452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 397/769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:32 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:33.030849 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ee1f6de6-e969-4169-a461-1022af3051e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:33.031508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ee1f6de6-e969-4169-a461-1022af3051e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:33.038451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee1f6de6-e969-4169-a461-1022af3051e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:33.038903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee1f6de6-e969-4169-a461-1022af3051e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:33.039691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee1f6de6-e969-4169-a461-1022af3051e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:33.040126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee1f6de6-e969-4169-a461-1022af3051e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:33.185208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ee1f6de6-e969-4169-a461-1022af3051e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:33.197674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ee1f6de6-e969-4169-a461-1022af3051e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.170521 Jul 26 18:35:33.198517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 373/770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:33 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:33.424948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d2bb2d14-f2ab-4034-ba35-1c52542fcae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:33.425633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d2bb2d14-f2ab-4034-ba35-1c52542fcae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:33.432603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2bb2d14-f2ab-4034-ba35-1c52542fcae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:33.433046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2bb2d14-f2ab-4034-ba35-1c52542fcae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:33.433809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2bb2d14-f2ab-4034-ba35-1c52542fcae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:33.434235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2bb2d14-f2ab-4034-ba35-1c52542fcae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:33.577294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d2bb2d14-f2ab-4034-ba35-1c52542fcae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:33.585539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d2bb2d14-f2ab-4034-ba35-1c52542fcae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.166893 Jul 26 18:35:33.586107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 398/771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:33 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:34.222489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ffebaa09-277d-46e1-ada6-b117ca7c7ee5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:34.223175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ffebaa09-277d-46e1-ada6-b117ca7c7ee5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:34.230016 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffebaa09-277d-46e1-ada6-b117ca7c7ee5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:34.230461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffebaa09-277d-46e1-ada6-b117ca7c7ee5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:34.231251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffebaa09-277d-46e1-ada6-b117ca7c7ee5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:34.231682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffebaa09-277d-46e1-ada6-b117ca7c7ee5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:34.377145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ffebaa09-277d-46e1-ada6-b117ca7c7ee5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:34.390191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ffebaa09-277d-46e1-ada6-b117ca7c7ee5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.171439 Jul 26 18:35:34.391049 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 374/772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:34 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:34.609910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3046a3ea-c523-4dc6-8163-faffbfb1114a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:34.610576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3046a3ea-c523-4dc6-8163-faffbfb1114a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:34.618852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3046a3ea-c523-4dc6-8163-faffbfb1114a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:34.619282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3046a3ea-c523-4dc6-8163-faffbfb1114a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:34.620081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3046a3ea-c523-4dc6-8163-faffbfb1114a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:34.620510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3046a3ea-c523-4dc6-8163-faffbfb1114a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:34.761331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3046a3ea-c523-4dc6-8163-faffbfb1114a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:34.771885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3046a3ea-c523-4dc6-8163-faffbfb1114a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.166993 Jul 26 18:35:34.772456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 399/773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:34 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:35.420943 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d86cbee6-98e0-4b30-b12c-4d5dde8b56b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:35.421759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d86cbee6-98e0-4b30-b12c-4d5dde8b56b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:35.429539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d86cbee6-98e0-4b30-b12c-4d5dde8b56b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:35.429973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d86cbee6-98e0-4b30-b12c-4d5dde8b56b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:35.430755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d86cbee6-98e0-4b30-b12c-4d5dde8b56b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:35.431214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d86cbee6-98e0-4b30-b12c-4d5dde8b56b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:35.567311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d86cbee6-98e0-4b30-b12c-4d5dde8b56b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:35.575521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d86cbee6-98e0-4b30-b12c-4d5dde8b56b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160862 Jul 26 18:35:35.576109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 375/774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:35 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:35.794088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b006c409-29f6-4c15-a3c4-24ab16dd2435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:35.794689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b006c409-29f6-4c15-a3c4-24ab16dd2435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:35.801775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b006c409-29f6-4c15-a3c4-24ab16dd2435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:35.802220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b006c409-29f6-4c15-a3c4-24ab16dd2435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:35.803013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b006c409-29f6-4c15-a3c4-24ab16dd2435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:35.803464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b006c409-29f6-4c15-a3c4-24ab16dd2435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:35.967275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b006c409-29f6-4c15-a3c4-24ab16dd2435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:35.978022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b006c409-29f6-4c15-a3c4-24ab16dd2435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.187656 Jul 26 18:35:35.978771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 400/775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:35 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:36.598279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1825d218-aff1-4db0-ac4a-8a55b0f7a15a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:36.598893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1825d218-aff1-4db0-ac4a-8a55b0f7a15a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:36.605720 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1825d218-aff1-4db0-ac4a-8a55b0f7a15a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:36.606174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1825d218-aff1-4db0-ac4a-8a55b0f7a15a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:36.606938 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1825d218-aff1-4db0-ac4a-8a55b0f7a15a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:36.607423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1825d218-aff1-4db0-ac4a-8a55b0f7a15a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:36.758661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1825d218-aff1-4db0-ac4a-8a55b0f7a15a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:36.766851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1825d218-aff1-4db0-ac4a-8a55b0f7a15a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.173347 Jul 26 18:35:36.767454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 376/776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:36 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:37.004443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2aa1c375-397c-450a-aebe-bdedf6c841c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:37.005142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2aa1c375-397c-450a-aebe-bdedf6c841c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:37.013868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2aa1c375-397c-450a-aebe-bdedf6c841c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:37.014308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2aa1c375-397c-450a-aebe-bdedf6c841c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:37.015356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2aa1c375-397c-450a-aebe-bdedf6c841c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:37.015785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2aa1c375-397c-450a-aebe-bdedf6c841c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:37.160566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2aa1c375-397c-450a-aebe-bdedf6c841c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:37.169760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2aa1c375-397c-450a-aebe-bdedf6c841c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.170399 Jul 26 18:35:37.170525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 401/777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:36 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:37.790371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d87248dd-55c4-4bb5-82b0-8637de3bf2ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:37.790967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d87248dd-55c4-4bb5-82b0-8637de3bf2ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:37.798835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d87248dd-55c4-4bb5-82b0-8637de3bf2ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:37.799329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d87248dd-55c4-4bb5-82b0-8637de3bf2ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:37.800092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d87248dd-55c4-4bb5-82b0-8637de3bf2ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:37.800523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d87248dd-55c4-4bb5-82b0-8637de3bf2ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:37.931132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d87248dd-55c4-4bb5-82b0-8637de3bf2ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:37.939923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d87248dd-55c4-4bb5-82b0-8637de3bf2ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.153651 Jul 26 18:35:37.940488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 377/778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:37 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:38.200549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c5bb8b04-5129-4df2-ae14-b558ed578424 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:38.201227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c5bb8b04-5129-4df2-ae14-b558ed578424 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:38.209266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5bb8b04-5129-4df2-ae14-b558ed578424 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:38.209710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5bb8b04-5129-4df2-ae14-b558ed578424 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:38.210477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5bb8b04-5129-4df2-ae14-b558ed578424 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:38.210905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5bb8b04-5129-4df2-ae14-b558ed578424 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:38.360309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c5bb8b04-5129-4df2-ae14-b558ed578424 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:38.372304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c5bb8b04-5129-4df2-ae14-b558ed578424 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.177034 Jul 26 18:35:38.372902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 402/779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:38 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:38.964974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-810106b6-1983-45de-b789-d46a518fefc1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:38.965536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-810106b6-1983-45de-b789-d46a518fefc1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:38.974978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-810106b6-1983-45de-b789-d46a518fefc1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:38.978305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-810106b6-1983-45de-b789-d46a518fefc1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:38.979328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-810106b6-1983-45de-b789-d46a518fefc1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:38.979929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-810106b6-1983-45de-b789-d46a518fefc1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:39.125690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-810106b6-1983-45de-b789-d46a518fefc1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:39.138667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-810106b6-1983-45de-b789-d46a518fefc1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.178524 Jul 26 18:35:39.138959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 378/780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:38 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:39.398964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2aa70545-e9e9-4d80-a7ff-edb843a43ef7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:39.399575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2aa70545-e9e9-4d80-a7ff-edb843a43ef7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:39.408897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2aa70545-e9e9-4d80-a7ff-edb843a43ef7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:39.409339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2aa70545-e9e9-4d80-a7ff-edb843a43ef7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:39.410131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2aa70545-e9e9-4d80-a7ff-edb843a43ef7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:39.410561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2aa70545-e9e9-4d80-a7ff-edb843a43ef7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:39.558487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2aa70545-e9e9-4d80-a7ff-edb843a43ef7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:39.566424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2aa70545-e9e9-4d80-a7ff-edb843a43ef7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.174213 Jul 26 18:35:39.566969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 403/781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:39 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:40.163575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f4deefd7-0e60-43d8-affc-58fa8f4c7f5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:40.164439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f4deefd7-0e60-43d8-affc-58fa8f4c7f5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:40.174326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4deefd7-0e60-43d8-affc-58fa8f4c7f5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:40.175078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4deefd7-0e60-43d8-affc-58fa8f4c7f5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:40.176280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4deefd7-0e60-43d8-affc-58fa8f4c7f5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:40.176978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4deefd7-0e60-43d8-affc-58fa8f4c7f5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:40.327204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f4deefd7-0e60-43d8-affc-58fa8f4c7f5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:40.335971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f4deefd7-0e60-43d8-affc-58fa8f4c7f5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.177965 Jul 26 18:35:40.336545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 379/782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:40 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:40.591641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f62131d2-eeb2-4fa3-b5d1-7e25a652e2a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:40.592250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f62131d2-eeb2-4fa3-b5d1-7e25a652e2a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:40.601777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f62131d2-eeb2-4fa3-b5d1-7e25a652e2a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:40.602444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f62131d2-eeb2-4fa3-b5d1-7e25a652e2a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:40.603583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f62131d2-eeb2-4fa3-b5d1-7e25a652e2a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:40.604218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f62131d2-eeb2-4fa3-b5d1-7e25a652e2a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:40.750320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f62131d2-eeb2-4fa3-b5d1-7e25a652e2a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:40.757995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f62131d2-eeb2-4fa3-b5d1-7e25a652e2a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.172692 Jul 26 18:35:40.758554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 404/783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:40 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:41.364899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-59780f4c-14fa-46b0-8857-5b0333763816 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:41.365487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-59780f4c-14fa-46b0-8857-5b0333763816 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:41.372603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59780f4c-14fa-46b0-8857-5b0333763816 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:41.373053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59780f4c-14fa-46b0-8857-5b0333763816 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:41.373813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59780f4c-14fa-46b0-8857-5b0333763816 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:41.374251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59780f4c-14fa-46b0-8857-5b0333763816 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:41.518184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-59780f4c-14fa-46b0-8857-5b0333763816 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:41.530314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-59780f4c-14fa-46b0-8857-5b0333763816 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.169103 Jul 26 18:35:41.531177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 380/784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:41 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:41.780229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d236fd0b-9d95-4bde-be70-4c7529baa7fc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:41.780740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d236fd0b-9d95-4bde-be70-4c7529baa7fc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:41.787885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d236fd0b-9d95-4bde-be70-4c7529baa7fc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:41.788324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d236fd0b-9d95-4bde-be70-4c7529baa7fc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:41.789088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d236fd0b-9d95-4bde-be70-4c7529baa7fc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:41.789513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d236fd0b-9d95-4bde-be70-4c7529baa7fc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:41.807636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:35:41.922518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d236fd0b-9d95-4bde-be70-4c7529baa7fc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:41.930677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d236fd0b-9d95-4bde-be70-4c7529baa7fc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.154450 Jul 26 18:35:41.931262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 405/785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:41 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:42.552997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c3b24bf6-efee-42d8-98ce-6f1e4ea2b766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:42.553572 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c3b24bf6-efee-42d8-98ce-6f1e4ea2b766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:42.560742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3b24bf6-efee-42d8-98ce-6f1e4ea2b766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:42.561189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3b24bf6-efee-42d8-98ce-6f1e4ea2b766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:42.561976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3b24bf6-efee-42d8-98ce-6f1e4ea2b766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:42.562406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3b24bf6-efee-42d8-98ce-6f1e4ea2b766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:42.565126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:35:42.706270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c3b24bf6-efee-42d8-98ce-6f1e4ea2b766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:42.718359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c3b24bf6-efee-42d8-98ce-6f1e4ea2b766 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.168955 Jul 26 18:35:42.719158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 381/786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:42 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:42.955038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2da6fe1a-d4da-431b-ab4d-3deffbd855a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:42.955737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2da6fe1a-d4da-431b-ab4d-3deffbd855a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:42.965427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2da6fe1a-d4da-431b-ab4d-3deffbd855a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:42.965986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2da6fe1a-d4da-431b-ab4d-3deffbd855a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:42.967220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2da6fe1a-d4da-431b-ab4d-3deffbd855a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:42.967870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2da6fe1a-d4da-431b-ab4d-3deffbd855a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:43.114490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2da6fe1a-d4da-431b-ab4d-3deffbd855a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:43.122609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2da6fe1a-d4da-431b-ab4d-3deffbd855a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.173619 Jul 26 18:35:43.123199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 406/787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:42 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:43.746333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-db465aa3-9bd2-4796-ab82-503737b28460 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:43.746918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-db465aa3-9bd2-4796-ab82-503737b28460 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:43.753810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db465aa3-9bd2-4796-ab82-503737b28460 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:43.754254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db465aa3-9bd2-4796-ab82-503737b28460 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:43.755031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db465aa3-9bd2-4796-ab82-503737b28460 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:43.755464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db465aa3-9bd2-4796-ab82-503737b28460 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:43.901494 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-db465aa3-9bd2-4796-ab82-503737b28460 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:43.912227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-db465aa3-9bd2-4796-ab82-503737b28460 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.169813 Jul 26 18:35:43.912789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 382/788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:43 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:44.150753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-68a9729e-ec28-4541-b081-83e888e5f032 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:44.151358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-68a9729e-ec28-4541-b081-83e888e5f032 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:44.161278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68a9729e-ec28-4541-b081-83e888e5f032 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:44.161941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68a9729e-ec28-4541-b081-83e888e5f032 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:44.163078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68a9729e-ec28-4541-b081-83e888e5f032 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:44.163696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68a9729e-ec28-4541-b081-83e888e5f032 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:44.309440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-68a9729e-ec28-4541-b081-83e888e5f032 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:44.322161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-68a9729e-ec28-4541-b081-83e888e5f032 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.177401 Jul 26 18:35:44.323130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 407/789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:44 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:44.944062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e9db4ecc-dd2b-4b4c-9ac7-bac379916872 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:44.944799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e9db4ecc-dd2b-4b4c-9ac7-bac379916872 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:44.954291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9db4ecc-dd2b-4b4c-9ac7-bac379916872 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:44.954768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9db4ecc-dd2b-4b4c-9ac7-bac379916872 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:44.955652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9db4ecc-dd2b-4b4c-9ac7-bac379916872 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:44.956109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9db4ecc-dd2b-4b4c-9ac7-bac379916872 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:45.102237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e9db4ecc-dd2b-4b4c-9ac7-bac379916872 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:45.111054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e9db4ecc-dd2b-4b4c-9ac7-bac379916872 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.173071 Jul 26 18:35:45.111798 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 383/790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:44 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:45.345293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5096a245-0735-433e-93a3-11f23696abc5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:45.345930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5096a245-0735-433e-93a3-11f23696abc5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:45.353731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5096a245-0735-433e-93a3-11f23696abc5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:45.354538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5096a245-0735-433e-93a3-11f23696abc5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:45.355937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5096a245-0735-433e-93a3-11f23696abc5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:45.356722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5096a245-0735-433e-93a3-11f23696abc5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:45.499398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5096a245-0735-433e-93a3-11f23696abc5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:45.506984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5096a245-0735-433e-93a3-11f23696abc5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.165703 Jul 26 18:35:45.507608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 408/791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:45 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:46.133563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9283c13a-9b71-4a06-abf7-9834fe904614 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:46.134124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9283c13a-9b71-4a06-abf7-9834fe904614 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:46.141513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9283c13a-9b71-4a06-abf7-9834fe904614 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:46.141951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9283c13a-9b71-4a06-abf7-9834fe904614 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:46.142730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9283c13a-9b71-4a06-abf7-9834fe904614 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:46.143201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9283c13a-9b71-4a06-abf7-9834fe904614 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:46.277885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9283c13a-9b71-4a06-abf7-9834fe904614 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:46.288229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9283c13a-9b71-4a06-abf7-9834fe904614 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158694 Jul 26 18:35:46.288795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 384/792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:46 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:46.531988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-77d1b703-eeff-4e98-9d76-76b716c673b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:46.532929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-77d1b703-eeff-4e98-9d76-76b716c673b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:46.543079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77d1b703-eeff-4e98-9d76-76b716c673b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:46.543626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77d1b703-eeff-4e98-9d76-76b716c673b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:46.544660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77d1b703-eeff-4e98-9d76-76b716c673b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:46.545274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77d1b703-eeff-4e98-9d76-76b716c673b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:46.683980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-77d1b703-eeff-4e98-9d76-76b716c673b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:46.694109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-77d1b703-eeff-4e98-9d76-76b716c673b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.168609 Jul 26 18:35:46.694676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 409/793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:46 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:47.314953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ba931784-d86b-4f47-98be-e515ebed2edb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:47.316142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ba931784-d86b-4f47-98be-e515ebed2edb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:47.328170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba931784-d86b-4f47-98be-e515ebed2edb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:47.328937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba931784-d86b-4f47-98be-e515ebed2edb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:47.330215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba931784-d86b-4f47-98be-e515ebed2edb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:47.331184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba931784-d86b-4f47-98be-e515ebed2edb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:47.470995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ba931784-d86b-4f47-98be-e515ebed2edb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:47.479853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ba931784-d86b-4f47-98be-e515ebed2edb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.172008 Jul 26 18:35:47.480419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 385/794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:47 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:47.718116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-92b48c05-a966-4071-9cfc-64b07008fb99 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:47.718872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-92b48c05-a966-4071-9cfc-64b07008fb99 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:47.727059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92b48c05-a966-4071-9cfc-64b07008fb99 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:47.727539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92b48c05-a966-4071-9cfc-64b07008fb99 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:47.728406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92b48c05-a966-4071-9cfc-64b07008fb99 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:47.729015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92b48c05-a966-4071-9cfc-64b07008fb99 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:47.863958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-92b48c05-a966-4071-9cfc-64b07008fb99 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:47.872098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-92b48c05-a966-4071-9cfc-64b07008fb99 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.159100 Jul 26 18:35:47.872669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 410/795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:47 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:48.501773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eaaba136-7565-402d-96c5-c1c6badae704 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:48.502358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eaaba136-7565-402d-96c5-c1c6badae704 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:48.510364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eaaba136-7565-402d-96c5-c1c6badae704 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:48.510803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eaaba136-7565-402d-96c5-c1c6badae704 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:48.511931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eaaba136-7565-402d-96c5-c1c6badae704 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:48.512355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eaaba136-7565-402d-96c5-c1c6badae704 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:48.657952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eaaba136-7565-402d-96c5-c1c6badae704 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:48.667354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eaaba136-7565-402d-96c5-c1c6badae704 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.169427 Jul 26 18:35:48.667926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 386/796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:48 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:48.895885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9335f7d9-424d-41be-8474-f88dab62fb37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:48.896806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9335f7d9-424d-41be-8474-f88dab62fb37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:48.903663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9335f7d9-424d-41be-8474-f88dab62fb37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:48.904108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9335f7d9-424d-41be-8474-f88dab62fb37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:48.904868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9335f7d9-424d-41be-8474-f88dab62fb37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:48.905301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9335f7d9-424d-41be-8474-f88dab62fb37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:49.045339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9335f7d9-424d-41be-8474-f88dab62fb37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:49.053005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9335f7d9-424d-41be-8474-f88dab62fb37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.161576 Jul 26 18:35:49.053613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 411/797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:48 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:49.690322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4fefae2e-5dd3-4166-b6ce-99facde7d9e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:49.690948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4fefae2e-5dd3-4166-b6ce-99facde7d9e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:49.699231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4fefae2e-5dd3-4166-b6ce-99facde7d9e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:49.699750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4fefae2e-5dd3-4166-b6ce-99facde7d9e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:49.700719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4fefae2e-5dd3-4166-b6ce-99facde7d9e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:49.701228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4fefae2e-5dd3-4166-b6ce-99facde7d9e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:49.837110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4fefae2e-5dd3-4166-b6ce-99facde7d9e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:49.845218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4fefae2e-5dd3-4166-b6ce-99facde7d9e3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.159535 Jul 26 18:35:49.845795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 387/798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:49 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:50.078051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-76b8440f-7341-404e-b84f-ef803521bbb5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:50.078673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-76b8440f-7341-404e-b84f-ef803521bbb5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:50.087879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76b8440f-7341-404e-b84f-ef803521bbb5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:50.088457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76b8440f-7341-404e-b84f-ef803521bbb5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:50.089460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76b8440f-7341-404e-b84f-ef803521bbb5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:50.090027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76b8440f-7341-404e-b84f-ef803521bbb5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:50.222571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-76b8440f-7341-404e-b84f-ef803521bbb5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:50.230936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-76b8440f-7341-404e-b84f-ef803521bbb5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.158245 Jul 26 18:35:50.231599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 412/799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:50 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:50.865870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-35834ec9-60b4-4db2-a7df-bd0b632a4183 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:50.866497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-35834ec9-60b4-4db2-a7df-bd0b632a4183 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:50.873538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35834ec9-60b4-4db2-a7df-bd0b632a4183 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:50.873988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35834ec9-60b4-4db2-a7df-bd0b632a4183 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:50.874752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35834ec9-60b4-4db2-a7df-bd0b632a4183 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:50.875229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35834ec9-60b4-4db2-a7df-bd0b632a4183 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:51.017561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-35834ec9-60b4-4db2-a7df-bd0b632a4183 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:51.030712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-35834ec9-60b4-4db2-a7df-bd0b632a4183 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.168360 Jul 26 18:35:51.031712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 388/800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:50 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:51.253237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f390375d-b769-444d-a7a2-c22528201d0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:51.253941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f390375d-b769-444d-a7a2-c22528201d0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:51.261670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f390375d-b769-444d-a7a2-c22528201d0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:51.262158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f390375d-b769-444d-a7a2-c22528201d0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:51.262990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f390375d-b769-444d-a7a2-c22528201d0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:51.263552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f390375d-b769-444d-a7a2-c22528201d0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:51.404834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f390375d-b769-444d-a7a2-c22528201d0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:51.412673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f390375d-b769-444d-a7a2-c22528201d0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.163751 Jul 26 18:35:51.413243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 413/801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:51 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:52.061448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1d01479f-f7e8-43dc-b5c7-272c3127e5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:52.062032 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1d01479f-f7e8-43dc-b5c7-272c3127e5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:52.070785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d01479f-f7e8-43dc-b5c7-272c3127e5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:52.071268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d01479f-f7e8-43dc-b5c7-272c3127e5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:52.072035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d01479f-f7e8-43dc-b5c7-272c3127e5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:52.072462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d01479f-f7e8-43dc-b5c7-272c3127e5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:52.218381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d01479f-f7e8-43dc-b5c7-272c3127e5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:52.230616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1d01479f-f7e8-43dc-b5c7-272c3127e5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.173937 Jul 26 18:35:52.231423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 389/802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:52 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:52.440446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bfdd0615-8183-45f6-8d6a-80593d22c613 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:52.441125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bfdd0615-8183-45f6-8d6a-80593d22c613 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:52.448580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfdd0615-8183-45f6-8d6a-80593d22c613 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:52.449026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfdd0615-8183-45f6-8d6a-80593d22c613 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:52.449799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfdd0615-8183-45f6-8d6a-80593d22c613 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:52.450262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfdd0615-8183-45f6-8d6a-80593d22c613 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:52.585974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bfdd0615-8183-45f6-8d6a-80593d22c613 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:52.593673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bfdd0615-8183-45f6-8d6a-80593d22c613 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.158396 Jul 26 18:35:52.594260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 414/803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:52 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:53.257962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6bb62c90-6a08-4027-80ef-abf2f5034a73 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:53.258960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6bb62c90-6a08-4027-80ef-abf2f5034a73 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:53.261747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:35:53.268990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6bb62c90-6a08-4027-80ef-abf2f5034a73 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:53.269429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6bb62c90-6a08-4027-80ef-abf2f5034a73 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:53.270181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6bb62c90-6a08-4027-80ef-abf2f5034a73 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:53.270603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6bb62c90-6a08-4027-80ef-abf2f5034a73 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:53.414360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6bb62c90-6a08-4027-80ef-abf2f5034a73 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:53.426792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6bb62c90-6a08-4027-80ef-abf2f5034a73 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.174668 Jul 26 18:35:53.427406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 390/804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:53 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:53.541565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-94daa649-bbc9-4889-9dcf-d0c580d37048 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:53.542174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-94daa649-bbc9-4889-9dcf-d0c580d37048 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:53.550367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-94daa649-bbc9-4889-9dcf-d0c580d37048 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:53.550889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-94daa649-bbc9-4889-9dcf-d0c580d37048 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:53.551891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-94daa649-bbc9-4889-9dcf-d0c580d37048 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:53.552318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-94daa649-bbc9-4889-9dcf-d0c580d37048 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:53.585156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-94daa649-bbc9-4889-9dcf-d0c580d37048 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments/4e8e58b2-c0ad-452b-ac16-5484b1753079" status: 200 len: 194 microversion: 2.20 time: 0.048909 Jul 26 18:35:53.585732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 415/805] 10.222.0.27 () {60 vars in 1454 bytes} [Tue Jul 26 18:35:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments/4e8e58b2-c0ad-452b-ac16-5484b1753079 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:35:53.615061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bf952d50-4dcc-412a-8246-b5624e0be63b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:53.615658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bf952d50-4dcc-412a-8246-b5624e0be63b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:53.621730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf952d50-4dcc-412a-8246-b5624e0be63b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:53.622179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf952d50-4dcc-412a-8246-b5624e0be63b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:53.622937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf952d50-4dcc-412a-8246-b5624e0be63b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:53.623389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf952d50-4dcc-412a-8246-b5624e0be63b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:53.663359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8fdd9a2c-016a-4c95-ae18-f5a910455353 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:53.663933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8fdd9a2c-016a-4c95-ae18-f5a910455353 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:53.665874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=52 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:35:53.671355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fdd9a2c-016a-4c95-ae18-f5a910455353 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:53.671796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fdd9a2c-016a-4c95-ae18-f5a910455353 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:53.672569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fdd9a2c-016a-4c95-ae18-f5a910455353 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:53.672994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fdd9a2c-016a-4c95-ae18-f5a910455353 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:53.756614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.objects.instance [None req-8fdd9a2c-016a-4c95-ae18-f5a910455353 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lazy-loading 'services' on Instance uuid 240d5470-7916-48a4-b90f-910c88d68384 {{(pid=117996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:35:53.761471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bf952d50-4dcc-412a-8246-b5624e0be63b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:53.781195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bf952d50-4dcc-412a-8246-b5624e0be63b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.169894 Jul 26 18:35:53.781936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 391/806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:53 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:53.843591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8fdd9a2c-016a-4c95-ae18-f5a910455353 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments/4e8e58b2-c0ad-452b-ac16-5484b1753079" status: 202 len: 0 microversion: 2.20 time: 0.183625 Jul 26 18:35:53.844429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 416/807] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Jul 26 18:35:53 2022] DELETE /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments/4e8e58b2-c0ad-452b-ac16-5484b1753079 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:35:53.853501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-06b2bd4e-19f6-47ef-992d-cc6aae57c702 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:53.855962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-06b2bd4e-19f6-47ef-992d-cc6aae57c702 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:53.862289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06b2bd4e-19f6-47ef-992d-cc6aae57c702 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:53.862726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06b2bd4e-19f6-47ef-992d-cc6aae57c702 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:53.863527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06b2bd4e-19f6-47ef-992d-cc6aae57c702 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:53.863989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06b2bd4e-19f6-47ef-992d-cc6aae57c702 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:53.892490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-06b2bd4e-19f6-47ef-992d-cc6aae57c702 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043168 Jul 26 18:35:53.893064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 392/808] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:35:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:35:54.452573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3587a320-ea50-4e6d-b27b-ffc8a831877b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:54.453472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3587a320-ea50-4e6d-b27b-ffc8a831877b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:54.461291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3587a320-ea50-4e6d-b27b-ffc8a831877b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:54.461736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3587a320-ea50-4e6d-b27b-ffc8a831877b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:54.462502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3587a320-ea50-4e6d-b27b-ffc8a831877b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:54.463004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3587a320-ea50-4e6d-b27b-ffc8a831877b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:54.601241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3587a320-ea50-4e6d-b27b-ffc8a831877b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:54.609680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3587a320-ea50-4e6d-b27b-ffc8a831877b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163589 Jul 26 18:35:54.610274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 417/809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:54 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:54.806236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c06711d2-c0dc-4b30-8b7c-ca31ef5a8d7b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:54.807060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c06711d2-c0dc-4b30-8b7c-ca31ef5a8d7b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:54.815891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c06711d2-c0dc-4b30-8b7c-ca31ef5a8d7b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:54.816333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c06711d2-c0dc-4b30-8b7c-ca31ef5a8d7b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:54.817270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c06711d2-c0dc-4b30-8b7c-ca31ef5a8d7b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:54.817691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c06711d2-c0dc-4b30-8b7c-ca31ef5a8d7b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:54.907718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-24604dcb-ea34-4549-9143-d8494a9a0a83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:54.910033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-24604dcb-ea34-4549-9143-d8494a9a0a83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:54.916337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24604dcb-ea34-4549-9143-d8494a9a0a83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:54.916816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24604dcb-ea34-4549-9143-d8494a9a0a83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:54.917548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24604dcb-ea34-4549-9143-d8494a9a0a83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:54.918000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24604dcb-ea34-4549-9143-d8494a9a0a83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:54.948010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-24604dcb-ea34-4549-9143-d8494a9a0a83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044140 Jul 26 18:35:54.948515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 418/810] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:35:54 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 18:35:54.959526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c06711d2-c0dc-4b30-8b7c-ca31ef5a8d7b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:54.968223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c06711d2-c0dc-4b30-8b7c-ca31ef5a8d7b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.168165 Jul 26 18:35:54.968920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 393/811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:54 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:55.296124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-afa51dd6-746a-4337-a5ef-4bd92ebde8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2014500368"}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:35:55.296654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-afa51dd6-746a-4337-a5ef-4bd92ebde8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:55.302946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afa51dd6-746a-4337-a5ef-4bd92ebde8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:55.303423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afa51dd6-746a-4337-a5ef-4bd92ebde8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:55.304180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afa51dd6-746a-4337-a5ef-4bd92ebde8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:55.304608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afa51dd6-746a-4337-a5ef-4bd92ebde8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:55.454092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.network.security_group_api [None req-afa51dd6-746a-4337-a5ef-4bd92ebde8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Removing security group ae472c22-c396-4a84-9eca-8215ad72adca from port 4e31fc31-19bc-4733-a6d9-9e1a584d4781 Jul 26 18:35:55.632273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a3fbe629-5a71-408f-a43d-f5c75b918ac9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:55.632880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a3fbe629-5a71-408f-a43d-f5c75b918ac9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:55.639202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a3fbe629-5a71-408f-a43d-f5c75b918ac9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:55.639652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a3fbe629-5a71-408f-a43d-f5c75b918ac9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:55.640418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a3fbe629-5a71-408f-a43d-f5c75b918ac9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:55.640853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a3fbe629-5a71-408f-a43d-f5c75b918ac9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:55.774202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a3fbe629-5a71-408f-a43d-f5c75b918ac9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:55.782154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a3fbe629-5a71-408f-a43d-f5c75b918ac9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154428 Jul 26 18:35:55.787077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 394/812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:55 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:55.814661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-afa51dd6-746a-4337-a5ef-4bd92ebde8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "POST /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/action" status: 202 len: 0 microversion: 2.1 time: 0.641452 Jul 26 18:35:55.818720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 419/813] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:35:55 2022] POST /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:35:55.906495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-a1453da2-129b-4b42-a8e4-c3833174a67e req-d28cd1ad-c20e-47eb-b905-49d085f11b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9982c007-1157-4c63-93e8-3733712f06e0", "tag": "4e31fc31-19bc-4733-a6d9-9e1a584d4781"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:35:55.918781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-a1453da2-129b-4b42-a8e4-c3833174a67e req-d28cd1ad-c20e-47eb-b905-49d085f11b2e service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:55.920157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-a1453da2-129b-4b42-a8e4-c3833174a67e req-d28cd1ad-c20e-47eb-b905-49d085f11b2e service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:55.937799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-a1453da2-129b-4b42-a8e4-c3833174a67e req-d28cd1ad-c20e-47eb-b905-49d085f11b2e service nova] Creating event network-changed:4e31fc31-19bc-4733-a6d9-9e1a584d4781 for instance 9982c007-1157-4c63-93e8-3733712f06e0 on hv-cinder-82549 Jul 26 18:35:55.943534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-a1453da2-129b-4b42-a8e4-c3833174a67e req-d28cd1ad-c20e-47eb-b905-49d085f11b2e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118950 Jul 26 18:35:55.944749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 395/814] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:35:55.960727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f3f2b6e4-38c1-4bc5-95d8-3fbd674673fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:55.963740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f3f2b6e4-38c1-4bc5-95d8-3fbd674673fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:55.974487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3f2b6e4-38c1-4bc5-95d8-3fbd674673fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:55.974924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3f2b6e4-38c1-4bc5-95d8-3fbd674673fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:55.977870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3f2b6e4-38c1-4bc5-95d8-3fbd674673fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:55.990302 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d4a8a49b-642b-4921-882c-f0e8a85f6c35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:55.991003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d4a8a49b-642b-4921-882c-f0e8a85f6c35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:55.992509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3f2b6e4-38c1-4bc5-95d8-3fbd674673fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:55.998875 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d4a8a49b-642b-4921-882c-f0e8a85f6c35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:55.999774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d4a8a49b-642b-4921-882c-f0e8a85f6c35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:56.000755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d4a8a49b-642b-4921-882c-f0e8a85f6c35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:56.001356 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d4a8a49b-642b-4921-882c-f0e8a85f6c35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:56.063609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f3f2b6e4-38c1-4bc5-95d8-3fbd674673fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107040 Jul 26 18:35:56.064680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 420/815] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:35:55 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:35:56.192227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d4a8a49b-642b-4921-882c-f0e8a85f6c35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:56.200427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d4a8a49b-642b-4921-882c-f0e8a85f6c35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.214371 Jul 26 18:35:56.200998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 396/816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:55 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:56.808467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7f9926c6-30b4-4a2b-9e94-9c90394a37b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:56.809103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7f9926c6-30b4-4a2b-9e94-9c90394a37b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:56.816278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f9926c6-30b4-4a2b-9e94-9c90394a37b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:56.817110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f9926c6-30b4-4a2b-9e94-9c90394a37b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:56.817699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f9926c6-30b4-4a2b-9e94-9c90394a37b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:56.818025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f9926c6-30b4-4a2b-9e94-9c90394a37b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:57.076713 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b9534374-1bb7-46c2-94b1-69a540f28f44 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:57.078949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b9534374-1bb7-46c2-94b1-69a540f28f44 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:57.085773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9534374-1bb7-46c2-94b1-69a540f28f44 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:57.086215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9534374-1bb7-46c2-94b1-69a540f28f44 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:57.086975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9534374-1bb7-46c2-94b1-69a540f28f44 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:57.087430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9534374-1bb7-46c2-94b1-69a540f28f44 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:57.118277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b9534374-1bb7-46c2-94b1-69a540f28f44 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045493 Jul 26 18:35:57.118858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 397/817] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:35:57 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:35:57.176864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7f9926c6-30b4-4a2b-9e94-9c90394a37b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:57.180436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:35:57.185936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7f9926c6-30b4-4a2b-9e94-9c90394a37b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.381405 Jul 26 18:35:57.186500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 421/818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:56 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:57.222642 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f126e7ff-696b-4854-99c2-a10f5d503937 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:57.223280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f126e7ff-696b-4854-99c2-a10f5d503937 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:57.229929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f126e7ff-696b-4854-99c2-a10f5d503937 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:57.230396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f126e7ff-696b-4854-99c2-a10f5d503937 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:57.231171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f126e7ff-696b-4854-99c2-a10f5d503937 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:57.231601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f126e7ff-696b-4854-99c2-a10f5d503937 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:57.246804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:35:57.318332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-01934e3c-ca73-4448-85e0-014f8776ab28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:57.318739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-01934e3c-ca73-4448-85e0-014f8776ab28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:57.326204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01934e3c-ca73-4448-85e0-014f8776ab28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:57.326609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01934e3c-ca73-4448-85e0-014f8776ab28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:57.327422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01934e3c-ca73-4448-85e0-014f8776ab28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:57.327849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01934e3c-ca73-4448-85e0-014f8776ab28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:57.377468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f126e7ff-696b-4854-99c2-a10f5d503937 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:57.386213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f126e7ff-696b-4854-99c2-a10f5d503937 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.167401 Jul 26 18:35:57.386792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 398/819] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:57 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:57.416151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.objects.instance [None req-01934e3c-ca73-4448-85e0-014f8776ab28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lazy-loading 'services' on Instance uuid 9982c007-1157-4c63-93e8-3733712f06e0 {{(pid=117996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:35:57.500298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-01934e3c-ca73-4448-85e0-014f8776ab28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments/d265e72f-c895-4778-91cc-5cbed9088144" status: 202 len: 0 microversion: 2.1 time: 0.186181 Jul 26 18:35:57.500813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 422/820] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Jul 26 18:35:57 2022] DELETE /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments/d265e72f-c895-4778-91cc-5cbed9088144 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 18:35:57.509386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-80edbbc7-6d46-4d6f-9370-579af24fa1e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:57.511687 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-80edbbc7-6d46-4d6f-9370-579af24fa1e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:57.517899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80edbbc7-6d46-4d6f-9370-579af24fa1e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:57.518346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80edbbc7-6d46-4d6f-9370-579af24fa1e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:57.519141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80edbbc7-6d46-4d6f-9370-579af24fa1e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:57.519575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80edbbc7-6d46-4d6f-9370-579af24fa1e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:57.549452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-80edbbc7-6d46-4d6f-9370-579af24fa1e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043986 Jul 26 18:35:57.550005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 399/821] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:35:57 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:35:57.960050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-f4013542-4095-431d-803f-6ddec33194e2 req-e094fa03-5550-4268-913a-b3f8ed6e37de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9982c007-1157-4c63-93e8-3733712f06e0", "tag": "4e31fc31-19bc-4733-a6d9-9e1a584d4781"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:35:57.971464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-f4013542-4095-431d-803f-6ddec33194e2 req-e094fa03-5550-4268-913a-b3f8ed6e37de service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:57.971895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-f4013542-4095-431d-803f-6ddec33194e2 req-e094fa03-5550-4268-913a-b3f8ed6e37de service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:57.985407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-f4013542-4095-431d-803f-6ddec33194e2 req-e094fa03-5550-4268-913a-b3f8ed6e37de service nova] Creating event network-changed:4e31fc31-19bc-4733-a6d9-9e1a584d4781 for instance 9982c007-1157-4c63-93e8-3733712f06e0 on hv-cinder-82549 Jul 26 18:35:57.991119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-f4013542-4095-431d-803f-6ddec33194e2 req-e094fa03-5550-4268-913a-b3f8ed6e37de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035677 Jul 26 18:35:57.991727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 423/822] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:35:58.133098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dd3266fb-4fe7-4f9f-ae16-f4d485ccd6da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:58.135450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dd3266fb-4fe7-4f9f-ae16-f4d485ccd6da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:58.142613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd3266fb-4fe7-4f9f-ae16-f4d485ccd6da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:58.143275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd3266fb-4fe7-4f9f-ae16-f4d485ccd6da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:58.144044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd3266fb-4fe7-4f9f-ae16-f4d485ccd6da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:58.144473 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd3266fb-4fe7-4f9f-ae16-f4d485ccd6da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:58.175672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dd3266fb-4fe7-4f9f-ae16-f4d485ccd6da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046607 Jul 26 18:35:58.176292 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 400/823] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:35:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:35:58.210209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e0d8048f-2a48-495f-abd0-320e2daa0a3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:58.210842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e0d8048f-2a48-495f-abd0-320e2daa0a3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:58.218376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0d8048f-2a48-495f-abd0-320e2daa0a3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:58.218670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0d8048f-2a48-495f-abd0-320e2daa0a3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:58.219481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0d8048f-2a48-495f-abd0-320e2daa0a3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:58.219933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0d8048f-2a48-495f-abd0-320e2daa0a3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:58.359918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e0d8048f-2a48-495f-abd0-320e2daa0a3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:58.368493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e0d8048f-2a48-495f-abd0-320e2daa0a3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163830 Jul 26 18:35:58.369187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 424/824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:58 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:58.409457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f3fc734a-66f6-470f-9a89-af538f180924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:58.410056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f3fc734a-66f6-470f-9a89-af538f180924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:58.416972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3fc734a-66f6-470f-9a89-af538f180924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:58.417416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3fc734a-66f6-470f-9a89-af538f180924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:58.418171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3fc734a-66f6-470f-9a89-af538f180924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:58.418607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3fc734a-66f6-470f-9a89-af538f180924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:58.562130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6f12b9dd-5747-4c97-85fe-3647ee840132 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:58.562465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f3fc734a-66f6-470f-9a89-af538f180924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:58.564408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6f12b9dd-5747-4c97-85fe-3647ee840132 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:58.570372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f3fc734a-66f6-470f-9a89-af538f180924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.164894 Jul 26 18:35:58.570859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f12b9dd-5747-4c97-85fe-3647ee840132 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:58.570973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 401/825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:58 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:58.571345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f12b9dd-5747-4c97-85fe-3647ee840132 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:58.572118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f12b9dd-5747-4c97-85fe-3647ee840132 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:58.572556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f12b9dd-5747-4c97-85fe-3647ee840132 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:58.602616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6f12b9dd-5747-4c97-85fe-3647ee840132 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044404 Jul 26 18:35:58.603205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 425/826] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:35:58 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:35:59.188262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-451ab1a7-1161-4461-8f77-3b2c67773ae9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:59.190493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-451ab1a7-1161-4461-8f77-3b2c67773ae9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:59.197575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-451ab1a7-1161-4461-8f77-3b2c67773ae9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:59.198022 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-451ab1a7-1161-4461-8f77-3b2c67773ae9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:59.198789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-451ab1a7-1161-4461-8f77-3b2c67773ae9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:59.199401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-451ab1a7-1161-4461-8f77-3b2c67773ae9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:59.228490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-451ab1a7-1161-4461-8f77-3b2c67773ae9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044247 Jul 26 18:35:59.229040 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 402/827] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:35:59 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:35:59.391338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c9b01487-0c88-4b4b-be03-ad0826e983a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:59.391881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c9b01487-0c88-4b4b-be03-ad0826e983a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:59.399217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9b01487-0c88-4b4b-be03-ad0826e983a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:59.399665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9b01487-0c88-4b4b-be03-ad0826e983a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:59.400457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9b01487-0c88-4b4b-be03-ad0826e983a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:59.400863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9b01487-0c88-4b4b-be03-ad0826e983a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:59.551376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c9b01487-0c88-4b4b-be03-ad0826e983a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:59.559716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c9b01487-0c88-4b4b-be03-ad0826e983a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.172487 Jul 26 18:35:59.560281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 426/828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:59 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:35:59.594940 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3331c508-9459-4ceb-87f9-2ac6341ffe3f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:59.595633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3331c508-9459-4ceb-87f9-2ac6341ffe3f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:59.604819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3331c508-9459-4ceb-87f9-2ac6341ffe3f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:59.605340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3331c508-9459-4ceb-87f9-2ac6341ffe3f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:59.606321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3331c508-9459-4ceb-87f9-2ac6341ffe3f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:59.606914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3331c508-9459-4ceb-87f9-2ac6341ffe3f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:59.615373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b3df1460-81c9-4d1b-91e9-4ba19c71325e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:35:59.617568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b3df1460-81c9-4d1b-91e9-4ba19c71325e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:35:59.623791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3df1460-81c9-4d1b-91e9-4ba19c71325e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:59.624231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3df1460-81c9-4d1b-91e9-4ba19c71325e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:59.624992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3df1460-81c9-4d1b-91e9-4ba19c71325e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:35:59.625448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3df1460-81c9-4d1b-91e9-4ba19c71325e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:35:59.655660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b3df1460-81c9-4d1b-91e9-4ba19c71325e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 Jul 26 18:35:59.656106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 427/829] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:35:59 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:35:59.737473 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3331c508-9459-4ceb-87f9-2ac6341ffe3f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:35:59.745878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3331c508-9459-4ceb-87f9-2ac6341ffe3f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.157046 Jul 26 18:35:59.746458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 403/830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:35:59 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:00.242124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-43fa8667-ef59-42b0-b1e6-d7838d5e0b46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:00.244301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-43fa8667-ef59-42b0-b1e6-d7838d5e0b46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:00.250642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-43fa8667-ef59-42b0-b1e6-d7838d5e0b46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:00.251081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-43fa8667-ef59-42b0-b1e6-d7838d5e0b46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:00.251867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-43fa8667-ef59-42b0-b1e6-d7838d5e0b46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:00.252291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-43fa8667-ef59-42b0-b1e6-d7838d5e0b46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:00.281810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-43fa8667-ef59-42b0-b1e6-d7838d5e0b46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043668 Jul 26 18:36:00.282272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 428/831] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:00 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:00.581704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bced689c-ea53-4e33-aab4-46c27cd6bcc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:00.582243 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bced689c-ea53-4e33-aab4-46c27cd6bcc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:00.589172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bced689c-ea53-4e33-aab4-46c27cd6bcc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:00.589612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bced689c-ea53-4e33-aab4-46c27cd6bcc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:00.590362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bced689c-ea53-4e33-aab4-46c27cd6bcc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:00.590788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bced689c-ea53-4e33-aab4-46c27cd6bcc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:00.668148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-21bef2b4-bdd4-4600-9979-41e9731f0bdd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:00.670445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-21bef2b4-bdd4-4600-9979-41e9731f0bdd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:00.677743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21bef2b4-bdd4-4600-9979-41e9731f0bdd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:00.678161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21bef2b4-bdd4-4600-9979-41e9731f0bdd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:00.678951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21bef2b4-bdd4-4600-9979-41e9731f0bdd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:00.679410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21bef2b4-bdd4-4600-9979-41e9731f0bdd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:00.709072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-21bef2b4-bdd4-4600-9979-41e9731f0bdd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Jul 26 18:36:00.709640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 429/832] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:00 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:36:00.734669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bced689c-ea53-4e33-aab4-46c27cd6bcc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:00.747446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bced689c-ea53-4e33-aab4-46c27cd6bcc6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.169372 Jul 26 18:36:00.748113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 404/833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:00 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:00.767388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ae331178-b2b2-4bca-84ef-b70b9b80b390 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:00.768075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ae331178-b2b2-4bca-84ef-b70b9b80b390 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:00.775466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae331178-b2b2-4bca-84ef-b70b9b80b390 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:00.775937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae331178-b2b2-4bca-84ef-b70b9b80b390 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:00.776781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae331178-b2b2-4bca-84ef-b70b9b80b390 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:00.777235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae331178-b2b2-4bca-84ef-b70b9b80b390 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:00.934925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ae331178-b2b2-4bca-84ef-b70b9b80b390 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:00.947671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ae331178-b2b2-4bca-84ef-b70b9b80b390 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.184313 Jul 26 18:36:00.948456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 430/834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:00 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:01.294121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-136b505f-5665-4f83-9ba5-979a41e4c774 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:01.296212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-136b505f-5665-4f83-9ba5-979a41e4c774 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:01.303311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-136b505f-5665-4f83-9ba5-979a41e4c774 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:01.303761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-136b505f-5665-4f83-9ba5-979a41e4c774 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:01.304556 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-136b505f-5665-4f83-9ba5-979a41e4c774 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:01.304984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-136b505f-5665-4f83-9ba5-979a41e4c774 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:01.334907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-136b505f-5665-4f83-9ba5-979a41e4c774 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044884 Jul 26 18:36:01.335715 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 405/835] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:01 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:01.725090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-71137213-3059-4df1-934f-963ce73a2a48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:01.727839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-71137213-3059-4df1-934f-963ce73a2a48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:01.737427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71137213-3059-4df1-934f-963ce73a2a48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:01.737940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71137213-3059-4df1-934f-963ce73a2a48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:01.738924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71137213-3059-4df1-934f-963ce73a2a48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:01.739388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71137213-3059-4df1-934f-963ce73a2a48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:01.769082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-71137213-3059-4df1-934f-963ce73a2a48 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050105 Jul 26 18:36:01.769611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 431/836] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:01 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:01.772394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-12dc1836-7e17-4b64-83cb-234009080635 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:01.773061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-12dc1836-7e17-4b64-83cb-234009080635 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:01.780150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12dc1836-7e17-4b64-83cb-234009080635 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:01.780594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12dc1836-7e17-4b64-83cb-234009080635 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:01.781354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12dc1836-7e17-4b64-83cb-234009080635 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:01.781805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12dc1836-7e17-4b64-83cb-234009080635 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:01.912122 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-12dc1836-7e17-4b64-83cb-234009080635 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:01.924475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-12dc1836-7e17-4b64-83cb-234009080635 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156625 Jul 26 18:36:01.925257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 406/837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:01 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:01.972858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4f183ae2-3b70-49b0-a80d-a65763ae3401 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:01.973470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4f183ae2-3b70-49b0-a80d-a65763ae3401 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:01.980156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f183ae2-3b70-49b0-a80d-a65763ae3401 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:01.980527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f183ae2-3b70-49b0-a80d-a65763ae3401 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:01.981283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f183ae2-3b70-49b0-a80d-a65763ae3401 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:01.981716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f183ae2-3b70-49b0-a80d-a65763ae3401 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:02.125419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4f183ae2-3b70-49b0-a80d-a65763ae3401 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:02.133427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4f183ae2-3b70-49b0-a80d-a65763ae3401 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.164444 Jul 26 18:36:02.133977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 432/838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:01 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:02.350335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e98b748e-2c26-42d3-9f2b-4c672dbc37d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:02.352537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e98b748e-2c26-42d3-9f2b-4c672dbc37d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:02.358690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e98b748e-2c26-42d3-9f2b-4c672dbc37d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:02.359181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e98b748e-2c26-42d3-9f2b-4c672dbc37d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:02.359932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e98b748e-2c26-42d3-9f2b-4c672dbc37d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:02.360366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e98b748e-2c26-42d3-9f2b-4c672dbc37d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:02.392741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e98b748e-2c26-42d3-9f2b-4c672dbc37d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047109 Jul 26 18:36:02.393544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 407/839] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:02 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:02.784027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-27089be1-3b71-4785-b538-503fd1b838b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:02.786309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-27089be1-3b71-4785-b538-503fd1b838b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:02.793365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27089be1-3b71-4785-b538-503fd1b838b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:02.793810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27089be1-3b71-4785-b538-503fd1b838b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:02.794585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27089be1-3b71-4785-b538-503fd1b838b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:02.795013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27089be1-3b71-4785-b538-503fd1b838b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:02.831587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-27089be1-3b71-4785-b538-503fd1b838b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052414 Jul 26 18:36:02.832144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 433/840] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:02 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:02.947376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-63ad9b45-ebbe-47ad-ac5e-c04a37f8c7b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:02.947973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-63ad9b45-ebbe-47ad-ac5e-c04a37f8c7b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:02.954867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63ad9b45-ebbe-47ad-ac5e-c04a37f8c7b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:02.955347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63ad9b45-ebbe-47ad-ac5e-c04a37f8c7b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:02.956111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63ad9b45-ebbe-47ad-ac5e-c04a37f8c7b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:02.956545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63ad9b45-ebbe-47ad-ac5e-c04a37f8c7b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:03.108964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-63ad9b45-ebbe-47ad-ac5e-c04a37f8c7b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:03.120953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-63ad9b45-ebbe-47ad-ac5e-c04a37f8c7b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.177264 Jul 26 18:36:03.121641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 408/841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:03.155413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f3655ff5-5a83-497d-b880-ccbde984a33b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:03.156016 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f3655ff5-5a83-497d-b880-ccbde984a33b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:03.162596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3655ff5-5a83-497d-b880-ccbde984a33b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:03.163057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3655ff5-5a83-497d-b880-ccbde984a33b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:03.163817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3655ff5-5a83-497d-b880-ccbde984a33b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:03.164244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3655ff5-5a83-497d-b880-ccbde984a33b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:03.300059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f3655ff5-5a83-497d-b880-ccbde984a33b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:03.308396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f3655ff5-5a83-497d-b880-ccbde984a33b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.156957 Jul 26 18:36:03.308987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 434/842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:03 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:03.406357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-40e37cf1-1905-4418-a34a-5c6473084662 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:03.408589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-40e37cf1-1905-4418-a34a-5c6473084662 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:03.415518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40e37cf1-1905-4418-a34a-5c6473084662 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:03.416018 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40e37cf1-1905-4418-a34a-5c6473084662 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:03.417143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40e37cf1-1905-4418-a34a-5c6473084662 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:03.417742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40e37cf1-1905-4418-a34a-5c6473084662 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:03.449553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-40e37cf1-1905-4418-a34a-5c6473084662 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047111 Jul 26 18:36:03.450111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 409/843] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:03 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:03.844653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-411a9d76-52c2-4aba-956d-a7481c870381 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:03.846848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-411a9d76-52c2-4aba-956d-a7481c870381 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:03.853518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-411a9d76-52c2-4aba-956d-a7481c870381 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:03.853964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-411a9d76-52c2-4aba-956d-a7481c870381 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:03.854728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-411a9d76-52c2-4aba-956d-a7481c870381 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:03.855192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-411a9d76-52c2-4aba-956d-a7481c870381 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:03.884368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-411a9d76-52c2-4aba-956d-a7481c870381 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Jul 26 18:36:03.884918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 435/844] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:03 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:04.142816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-58c38c41-44d0-421c-8144-301e16eccdba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:04.143582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-58c38c41-44d0-421c-8144-301e16eccdba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:04.150864 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58c38c41-44d0-421c-8144-301e16eccdba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:04.151342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58c38c41-44d0-421c-8144-301e16eccdba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:04.152112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58c38c41-44d0-421c-8144-301e16eccdba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:04.152548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58c38c41-44d0-421c-8144-301e16eccdba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:04.312482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-58c38c41-44d0-421c-8144-301e16eccdba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:04.322132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-58c38c41-44d0-421c-8144-301e16eccdba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.183240 Jul 26 18:36:04.322706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 410/845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:04 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:04.329723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-64cd9730-915d-4938-ac1a-4b42914bfbad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:04.330331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-64cd9730-915d-4938-ac1a-4b42914bfbad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:04.337053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-64cd9730-915d-4938-ac1a-4b42914bfbad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:04.337502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-64cd9730-915d-4938-ac1a-4b42914bfbad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:04.338268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-64cd9730-915d-4938-ac1a-4b42914bfbad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:04.338666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-64cd9730-915d-4938-ac1a-4b42914bfbad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:04.463291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-69b5ee98-3987-488b-a143-69e8b52435cc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:04.472255 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-69b5ee98-3987-488b-a143-69e8b52435cc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:04.477522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-64cd9730-915d-4938-ac1a-4b42914bfbad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:04.478707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69b5ee98-3987-488b-a143-69e8b52435cc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:04.479191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69b5ee98-3987-488b-a143-69e8b52435cc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:04.479965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69b5ee98-3987-488b-a143-69e8b52435cc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:04.480423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69b5ee98-3987-488b-a143-69e8b52435cc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:04.485284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-64cd9730-915d-4938-ac1a-4b42914bfbad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.159432 Jul 26 18:36:04.485868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 436/846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:04 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:04.510394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-69b5ee98-3987-488b-a143-69e8b52435cc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052126 Jul 26 18:36:04.510942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 411/847] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:04 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:04.898309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8df7a599-a4a4-4138-932a-c35012da4831 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:04.900538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8df7a599-a4a4-4138-932a-c35012da4831 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:04.907252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8df7a599-a4a4-4138-932a-c35012da4831 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:04.907709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8df7a599-a4a4-4138-932a-c35012da4831 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:04.908476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8df7a599-a4a4-4138-932a-c35012da4831 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:04.908911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8df7a599-a4a4-4138-932a-c35012da4831 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:04.938931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8df7a599-a4a4-4138-932a-c35012da4831 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045049 Jul 26 18:36:04.939527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 437/848] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:04 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:05.346274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-14686d26-a589-4530-a024-b32ad7c474df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:05.346842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-14686d26-a589-4530-a024-b32ad7c474df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:05.354246 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14686d26-a589-4530-a024-b32ad7c474df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:05.354698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14686d26-a589-4530-a024-b32ad7c474df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:05.355510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14686d26-a589-4530-a024-b32ad7c474df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:05.355943 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14686d26-a589-4530-a024-b32ad7c474df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:05.503087 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-14686d26-a589-4530-a024-b32ad7c474df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:05.508373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a8d58521-2cb9-4714-86cd-7f88df6b57bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:05.508944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a8d58521-2cb9-4714-86cd-7f88df6b57bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:05.516415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-14686d26-a589-4530-a024-b32ad7c474df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.174098 Jul 26 18:36:05.523145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8d58521-2cb9-4714-86cd-7f88df6b57bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:05.523871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8d58521-2cb9-4714-86cd-7f88df6b57bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:05.524903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8d58521-2cb9-4714-86cd-7f88df6b57bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:05.525927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8d58521-2cb9-4714-86cd-7f88df6b57bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:05.528512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 412/849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:05 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:05.537641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-567f3224-89ff-4ccf-b490-f74ea9062a8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:05.540748 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-567f3224-89ff-4ccf-b490-f74ea9062a8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:05.550942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-567f3224-89ff-4ccf-b490-f74ea9062a8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:05.550942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-567f3224-89ff-4ccf-b490-f74ea9062a8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:05.551208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:05.551308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-567f3224-89ff-4ccf-b490-f74ea9062a8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:05.551308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-567f3224-89ff-4ccf-b490-f74ea9062a8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:05.595247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-567f3224-89ff-4ccf-b490-f74ea9062a8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065641 Jul 26 18:36:05.595827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 413/850] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:05.708758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a8d58521-2cb9-4714-86cd-7f88df6b57bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:05.716583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a8d58521-2cb9-4714-86cd-7f88df6b57bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.212446 Jul 26 18:36:05.717486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 438/851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:05 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:05.951964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cf6b9b29-0a3a-4200-9d03-ba1ec5562203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:05.954231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cf6b9b29-0a3a-4200-9d03-ba1ec5562203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:05.960791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf6b9b29-0a3a-4200-9d03-ba1ec5562203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:05.961232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf6b9b29-0a3a-4200-9d03-ba1ec5562203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:05.962012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf6b9b29-0a3a-4200-9d03-ba1ec5562203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:05.962452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf6b9b29-0a3a-4200-9d03-ba1ec5562203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:05.993616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cf6b9b29-0a3a-4200-9d03-ba1ec5562203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Jul 26 18:36:05.994171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 414/852] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:05 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:06.541094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7f51f88b-e2de-4961-bcb1-8be5eb1ade2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:06.541750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7f51f88b-e2de-4961-bcb1-8be5eb1ade2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:06.548736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f51f88b-e2de-4961-bcb1-8be5eb1ade2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:06.549180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f51f88b-e2de-4961-bcb1-8be5eb1ade2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:06.549946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f51f88b-e2de-4961-bcb1-8be5eb1ade2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:06.550391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f51f88b-e2de-4961-bcb1-8be5eb1ade2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:06.607727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2c03ec71-5f67-47d3-88fc-ce2a57957260 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:06.609872 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2c03ec71-5f67-47d3-88fc-ce2a57957260 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:06.620320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c03ec71-5f67-47d3-88fc-ce2a57957260 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:06.620838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c03ec71-5f67-47d3-88fc-ce2a57957260 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:06.621856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c03ec71-5f67-47d3-88fc-ce2a57957260 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:06.622468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c03ec71-5f67-47d3-88fc-ce2a57957260 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:06.637084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:06.653983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2c03ec71-5f67-47d3-88fc-ce2a57957260 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050119 Jul 26 18:36:06.654584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 415/853] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:06 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 18:36:06.694840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7f51f88b-e2de-4961-bcb1-8be5eb1ade2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:06.706852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7f51f88b-e2de-4961-bcb1-8be5eb1ade2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.169356 Jul 26 18:36:06.707707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 439/854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:06 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:06.738352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1d76a5ca-044e-4c69-8b12-243e75a2336e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:06.738965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1d76a5ca-044e-4c69-8b12-243e75a2336e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:06.745628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d76a5ca-044e-4c69-8b12-243e75a2336e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:06.746145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d76a5ca-044e-4c69-8b12-243e75a2336e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:06.746842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d76a5ca-044e-4c69-8b12-243e75a2336e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:06.747306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d76a5ca-044e-4c69-8b12-243e75a2336e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:06.886768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d76a5ca-044e-4c69-8b12-243e75a2336e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:06.897900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1d76a5ca-044e-4c69-8b12-243e75a2336e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.163468 Jul 26 18:36:06.898531 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 416/855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:06 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:07.010206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6d2d1c2c-28fb-42fd-b4de-e8e5305c9cb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:07.013704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6d2d1c2c-28fb-42fd-b4de-e8e5305c9cb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:07.022877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d2d1c2c-28fb-42fd-b4de-e8e5305c9cb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:07.023360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d2d1c2c-28fb-42fd-b4de-e8e5305c9cb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:07.024129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d2d1c2c-28fb-42fd-b4de-e8e5305c9cb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:07.024559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d2d1c2c-28fb-42fd-b4de-e8e5305c9cb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:07.054144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6d2d1c2c-28fb-42fd-b4de-e8e5305c9cb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050466 Jul 26 18:36:07.054738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 440/856] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:07 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:07.665947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-deeb793d-9ecc-41e6-bc5c-5547f3dc1a36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:07.668128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-deeb793d-9ecc-41e6-bc5c-5547f3dc1a36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:07.674703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-deeb793d-9ecc-41e6-bc5c-5547f3dc1a36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:07.675183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-deeb793d-9ecc-41e6-bc5c-5547f3dc1a36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:07.676025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-deeb793d-9ecc-41e6-bc5c-5547f3dc1a36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:07.676528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-deeb793d-9ecc-41e6-bc5c-5547f3dc1a36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:07.706492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-deeb793d-9ecc-41e6-bc5c-5547f3dc1a36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044465 Jul 26 18:36:07.707187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 417/857] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:07.737674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5620394b-e3fd-40a2-b6e1-40e1d892cd22 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:07.738656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5620394b-e3fd-40a2-b6e1-40e1d892cd22 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:07.745670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5620394b-e3fd-40a2-b6e1-40e1d892cd22 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:07.746101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5620394b-e3fd-40a2-b6e1-40e1d892cd22 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:07.746867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5620394b-e3fd-40a2-b6e1-40e1d892cd22 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:07.747327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5620394b-e3fd-40a2-b6e1-40e1d892cd22 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:07.888823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5620394b-e3fd-40a2-b6e1-40e1d892cd22 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:07.899050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5620394b-e3fd-40a2-b6e1-40e1d892cd22 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167548 Jul 26 18:36:07.899645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 441/858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:07 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:07.927964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3fccffb8-364d-4bdd-9e95-4d698f54ef92 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:07.928625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3fccffb8-364d-4bdd-9e95-4d698f54ef92 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:07.934990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3fccffb8-364d-4bdd-9e95-4d698f54ef92 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:07.935529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3fccffb8-364d-4bdd-9e95-4d698f54ef92 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:07.936282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3fccffb8-364d-4bdd-9e95-4d698f54ef92 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:07.936839 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3fccffb8-364d-4bdd-9e95-4d698f54ef92 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:08.068079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b6d55f05-a8ff-4dce-94e4-7ff40f0eee3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:08.070255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b6d55f05-a8ff-4dce-94e4-7ff40f0eee3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:08.071974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3fccffb8-364d-4bdd-9e95-4d698f54ef92 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:08.076549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6d55f05-a8ff-4dce-94e4-7ff40f0eee3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:08.076996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6d55f05-a8ff-4dce-94e4-7ff40f0eee3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:08.077772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6d55f05-a8ff-4dce-94e4-7ff40f0eee3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:08.078211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6d55f05-a8ff-4dce-94e4-7ff40f0eee3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:08.079593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3fccffb8-364d-4bdd-9e95-4d698f54ef92 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1681 microversion: 2.1 time: 0.155607 Jul 26 18:36:08.080180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 418/859] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:07 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:08.107979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b6d55f05-a8ff-4dce-94e4-7ff40f0eee3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Jul 26 18:36:08.108541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 442/860] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:08 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:08.719347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a7987a49-56e7-47fd-ad8d-a0e0461bb4f8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:08.721664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a7987a49-56e7-47fd-ad8d-a0e0461bb4f8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:08.728377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7987a49-56e7-47fd-ad8d-a0e0461bb4f8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:08.728822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7987a49-56e7-47fd-ad8d-a0e0461bb4f8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:08.729608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7987a49-56e7-47fd-ad8d-a0e0461bb4f8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:08.729998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7987a49-56e7-47fd-ad8d-a0e0461bb4f8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:08.765409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a7987a49-56e7-47fd-ad8d-a0e0461bb4f8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050023 Jul 26 18:36:08.766150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 419/861] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:08 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:08.928697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c32431ed-1499-4356-be32-99750a1f6b98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:08.929289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c32431ed-1499-4356-be32-99750a1f6b98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:08.936039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c32431ed-1499-4356-be32-99750a1f6b98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:08.936491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c32431ed-1499-4356-be32-99750a1f6b98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:08.937262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c32431ed-1499-4356-be32-99750a1f6b98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:08.937703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c32431ed-1499-4356-be32-99750a1f6b98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:09.101522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5f0bf678-0861-4e2f-93c1-6fbd0ab7d5c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:09.102135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5f0bf678-0861-4e2f-93c1-6fbd0ab7d5c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:09.109488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f0bf678-0861-4e2f-93c1-6fbd0ab7d5c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:09.109811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f0bf678-0861-4e2f-93c1-6fbd0ab7d5c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:09.110937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f0bf678-0861-4e2f-93c1-6fbd0ab7d5c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:09.111553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f0bf678-0861-4e2f-93c1-6fbd0ab7d5c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:09.120914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c32431ed-1499-4356-be32-99750a1f6b98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:09.129860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c32431ed-1499-4356-be32-99750a1f6b98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.205599 Jul 26 18:36:09.148762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 443/862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:09.154483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ade8ca31-c26a-49fd-a888-115fef3e6025 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:09.157968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ade8ca31-c26a-49fd-a888-115fef3e6025 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:09.164940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ade8ca31-c26a-49fd-a888-115fef3e6025 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:09.165391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ade8ca31-c26a-49fd-a888-115fef3e6025 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:09.166189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ade8ca31-c26a-49fd-a888-115fef3e6025 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:09.166913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ade8ca31-c26a-49fd-a888-115fef3e6025 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:09.196541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ade8ca31-c26a-49fd-a888-115fef3e6025 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046325 Jul 26 18:36:09.197116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 444/863] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:09 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:09.236242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5f0bf678-0861-4e2f-93c1-6fbd0ab7d5c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:09.244829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5f0bf678-0861-4e2f-93c1-6fbd0ab7d5c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1614 microversion: 2.1 time: 0.147516 Jul 26 18:36:09.245442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 420/864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:09 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1614 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:36:09.476787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-12df1f19-7d8e-493a-bd6c-8c5afecd4b0f req-fe210953-814d-4abc-b054-5427a4201ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54c7ad3-e708-41db-ad30-52ed8fc45183", "name": "network-vif-deleted", "tag": "c553e05a-5683-4c59-92d5-79f799e714ba"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:36:09.486288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-12df1f19-7d8e-493a-bd6c-8c5afecd4b0f req-fe210953-814d-4abc-b054-5427a4201ffb service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:09.486728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-12df1f19-7d8e-493a-bd6c-8c5afecd4b0f req-fe210953-814d-4abc-b054-5427a4201ffb service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:09.498539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-12df1f19-7d8e-493a-bd6c-8c5afecd4b0f req-fe210953-814d-4abc-b054-5427a4201ffb service nova] Creating event network-vif-deleted:c553e05a-5683-4c59-92d5-79f799e714ba for instance d54c7ad3-e708-41db-ad30-52ed8fc45183 on hv-cinder-82549 Jul 26 18:36:09.503866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-12df1f19-7d8e-493a-bd6c-8c5afecd4b0f req-fe210953-814d-4abc-b054-5427a4201ffb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030897 Jul 26 18:36:09.504668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 445/865] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:09.779061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e79f83f8-ab84-450e-adc6-58c482932677 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:09.781442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e79f83f8-ab84-450e-adc6-58c482932677 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:09.796294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e79f83f8-ab84-450e-adc6-58c482932677 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:09.797110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e79f83f8-ab84-450e-adc6-58c482932677 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:09.798273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e79f83f8-ab84-450e-adc6-58c482932677 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:09.798866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e79f83f8-ab84-450e-adc6-58c482932677 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:09.831372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e79f83f8-ab84-450e-adc6-58c482932677 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057261 Jul 26 18:36:09.832054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 421/866] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:09 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:10.160661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-33992c54-b287-4c6f-84ee-c17ecbf60f4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:10.161835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-33992c54-b287-4c6f-84ee-c17ecbf60f4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:10.169110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33992c54-b287-4c6f-84ee-c17ecbf60f4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:10.169822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33992c54-b287-4c6f-84ee-c17ecbf60f4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:10.170671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33992c54-b287-4c6f-84ee-c17ecbf60f4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:10.171257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33992c54-b287-4c6f-84ee-c17ecbf60f4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:10.209117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d7fba89e-4530-4c66-b5f4-332978e2f844 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:10.211864 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d7fba89e-4530-4c66-b5f4-332978e2f844 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:10.219007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fba89e-4530-4c66-b5f4-332978e2f844 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:10.219428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fba89e-4530-4c66-b5f4-332978e2f844 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:10.220289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fba89e-4530-4c66-b5f4-332978e2f844 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:10.220742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fba89e-4530-4c66-b5f4-332978e2f844 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:10.252587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d7fba89e-4530-4c66-b5f4-332978e2f844 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047677 Jul 26 18:36:10.257091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 422/867] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:10.269174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b87ebf84-846a-4334-8a4a-ab3261daef4a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:10.269984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b87ebf84-846a-4334-8a4a-ab3261daef4a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:10.280588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b87ebf84-846a-4334-8a4a-ab3261daef4a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:10.281136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b87ebf84-846a-4334-8a4a-ab3261daef4a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:10.281994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b87ebf84-846a-4334-8a4a-ab3261daef4a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:10.282490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b87ebf84-846a-4334-8a4a-ab3261daef4a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:10.319291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b87ebf84-846a-4334-8a4a-ab3261daef4a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:10.320036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b87ebf84-846a-4334-8a4a-ab3261daef4a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:10.320695 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-b87ebf84-846a-4334-8a4a-ab3261daef4a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lazy-loading 'fault' on Instance uuid d54c7ad3-e708-41db-ad30-52ed8fc45183 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:36:10.328446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-33992c54-b287-4c6f-84ee-c17ecbf60f4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:10.337318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-33992c54-b287-4c6f-84ee-c17ecbf60f4c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.181399 Jul 26 18:36:10.337896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 446/868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:10 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:10.372408 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b87ebf84-846a-4334-8a4a-ab3261daef4a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:10.380391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b87ebf84-846a-4334-8a4a-ab3261daef4a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1331 microversion: 2.1 time: 0.117903 Jul 26 18:36:10.380984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 423/869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:10 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:10.844123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-de576e41-5985-4f13-983d-3c88658c72a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:10.847253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-de576e41-5985-4f13-983d-3c88658c72a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:10.856752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de576e41-5985-4f13-983d-3c88658c72a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:10.857315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de576e41-5985-4f13-983d-3c88658c72a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:10.858732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de576e41-5985-4f13-983d-3c88658c72a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:10.859643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de576e41-5985-4f13-983d-3c88658c72a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:10.890826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-de576e41-5985-4f13-983d-3c88658c72a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050691 Jul 26 18:36:10.891569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 447/870] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:10 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:11.265792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-78e5aac7-2739-4901-93eb-a2efa0e7a423 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:11.268050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-78e5aac7-2739-4901-93eb-a2efa0e7a423 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:11.276188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78e5aac7-2739-4901-93eb-a2efa0e7a423 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.276629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78e5aac7-2739-4901-93eb-a2efa0e7a423 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.277410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78e5aac7-2739-4901-93eb-a2efa0e7a423 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.277837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78e5aac7-2739-4901-93eb-a2efa0e7a423 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.313918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-78e5aac7-2739-4901-93eb-a2efa0e7a423 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052058 Jul 26 18:36:11.314411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 424/871] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:11 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:11.359660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4674cf12-2875-406f-a398-44482d84b467 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:11.360328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4674cf12-2875-406f-a398-44482d84b467 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:11.367856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4674cf12-2875-406f-a398-44482d84b467 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.368676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4674cf12-2875-406f-a398-44482d84b467 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.369733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4674cf12-2875-406f-a398-44482d84b467 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.370324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4674cf12-2875-406f-a398-44482d84b467 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.405280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-df2ca9b3-e245-480d-86c5-85b2e6a6e9ee tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:11.406288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-df2ca9b3-e245-480d-86c5-85b2e6a6e9ee tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:11.415646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df2ca9b3-e245-480d-86c5-85b2e6a6e9ee tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.416486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df2ca9b3-e245-480d-86c5-85b2e6a6e9ee tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.417771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df2ca9b3-e245-480d-86c5-85b2e6a6e9ee tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.418751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df2ca9b3-e245-480d-86c5-85b2e6a6e9ee tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.467088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df2ca9b3-e245-480d-86c5-85b2e6a6e9ee tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.467536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df2ca9b3-e245-480d-86c5-85b2e6a6e9ee tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.468050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-df2ca9b3-e245-480d-86c5-85b2e6a6e9ee tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lazy-loading 'fault' on Instance uuid d54c7ad3-e708-41db-ad30-52ed8fc45183 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:36:11.519922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-df2ca9b3-e245-480d-86c5-85b2e6a6e9ee tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:11.527769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-df2ca9b3-e245-480d-86c5-85b2e6a6e9ee tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 200 len: 1331 microversion: 2.1 time: 0.128060 Jul 26 18:36:11.528555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 425/872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:11 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:11.549998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4674cf12-2875-406f-a398-44482d84b467 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:11.558336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4674cf12-2875-406f-a398-44482d84b467 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1716 microversion: 2.1 time: 0.202850 Jul 26 18:36:11.559167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 448/873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1716 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:11.621809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6bcfc0c9-f478-4d42-af90-898f3fbed6c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:11.622300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6bcfc0c9-f478-4d42-af90-898f3fbed6c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:11.628474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6bcfc0c9-f478-4d42-af90-898f3fbed6c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.628948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6bcfc0c9-f478-4d42-af90-898f3fbed6c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.629727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6bcfc0c9-f478-4d42-af90-898f3fbed6c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.630159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6bcfc0c9-f478-4d42-af90-898f3fbed6c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.758845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-6bcfc0c9-f478-4d42-af90-898f3fbed6c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] HTTP exception thrown: Cannot 'detach_volume' instance e26b67fc-cc0a-41a7-8568-17f2eed10fb2 while it is in vm_state rescued Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6bcfc0c9-f478-4d42-af90-898f3fbed6c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Request method failure captured: Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: request: DELETE /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments/10218421-3bb4-4126-9d73-6f8dce3b9092 HTTP/1.1 Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Connection: close Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Host: 10.222.0.27 Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.10 Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABi4DJjI9s6qbx1uWj8Nh66RGFe9XimgHtp2LwzuRf32bwhuJGkOcImrFPHTXWz9VlFKeYvhELtnyHFrl8Fiy_hnmeqfO-iBWzE616j4e4cR9PoNFd2DwrMhNI8UyNEmjYxg5IbFeBWPPU2AsHoRn9xmyr-3O8gVOXj23V9PZ_Y1nWusfI Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Id: e9c0885f4de641028b1e194802620fbc Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593014913 Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Role: reader,member Jul 26 18:36:11.760868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Roles: reader,member Jul 26 18:36:11.762393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e9c0885f4de641028b1e194802620fbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e9c0885f4de641028b1e194802620fbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9c0885f4de641028b1e194802620fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9c0885f4de641028b1e194802620fbc"}]}] Jul 26 18:36:11.762393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593014913 Jul 26 18:36:11.762393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant-Id: e9c0885f4de641028b1e194802620fbc Jul 26 18:36:11.762393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593014913 Jul 26 18:36:11.762393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User: tempest-ServerRescueNegativeTestJSON-593014913-project Jul 26 18:36:11.762393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 26 18:36:11.762393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 26 18:36:11.762393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Id: 43205ac588bc432fb8c9628fba37d445 Jul 26 18:36:11.762393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593014913-project Jul 26 18:36:11.762393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: method: > Jul 26 18:36:11.762393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: exception: Cannot 'detach_volume' instance e26b67fc-cc0a-41a7-8568-17f2eed10fb2 while it is in vm_state rescued Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: action_args: {'server_id': 'e26b67fc-cc0a-41a7-8568-17f2eed10fb2', 'id': '10218421-3bb4-4126-9d73-6f8dce3b9092'} Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e26b67fc-cc0a-41a7-8568-17f2eed10fb2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:36:11.763261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e26b67fc-cc0a-41a7-8568-17f2eed10fb2 while it is in vm_state rescued Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e26b67fc-cc0a-41a7-8568-17f2eed10fb2 while it is in vm_state rescued Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:36:11.764808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6bcfc0c9-f478-4d42-af90-898f3fbed6c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Returning 409 to user: Cannot 'detach_volume' instance e26b67fc-cc0a-41a7-8568-17f2eed10fb2 while it is in vm_state rescued {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:36:11.766070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6bcfc0c9-f478-4d42-af90-898f3fbed6c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments/10218421-3bb4-4126-9d73-6f8dce3b9092" status: 409 len: 152 microversion: 2.1 time: 0.144649 Jul 26 18:36:11.766070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 426/874] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Jul 26 18:36:11 2022] DELETE /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments/10218421-3bb4-4126-9d73-6f8dce3b9092 => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 18:36:11.772925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-00941bc1-5147-4018-a677-93e9c2c19cd3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:36:11.773452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-00941bc1-5147-4018-a677-93e9c2c19cd3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:11.779690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00941bc1-5147-4018-a677-93e9c2c19cd3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.780132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00941bc1-5147-4018-a677-93e9c2c19cd3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.780881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00941bc1-5147-4018-a677-93e9c2c19cd3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.781311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00941bc1-5147-4018-a677-93e9c2c19cd3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.851346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-00941bc1-5147-4018-a677-93e9c2c19cd3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "POST /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/action" status: 202 len: 0 microversion: 2.1 time: 0.083103 Jul 26 18:36:11.852719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 449/875] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:36:11 2022] POST /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 18:36:11.860226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e9ad1ad6-797c-4fce-b292-a83a1d6fcdae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:11.860834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e9ad1ad6-797c-4fce-b292-a83a1d6fcdae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:11.867756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9ad1ad6-797c-4fce-b292-a83a1d6fcdae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.868211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9ad1ad6-797c-4fce-b292-a83a1d6fcdae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.868973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9ad1ad6-797c-4fce-b292-a83a1d6fcdae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.869407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9ad1ad6-797c-4fce-b292-a83a1d6fcdae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.904592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f9a05337-62e2-4841-8221-f0f5aea4a7a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:11.906841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f9a05337-62e2-4841-8221-f0f5aea4a7a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:11.913760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9a05337-62e2-4841-8221-f0f5aea4a7a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.914221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9a05337-62e2-4841-8221-f0f5aea4a7a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.915184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9a05337-62e2-4841-8221-f0f5aea4a7a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:11.915595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9a05337-62e2-4841-8221-f0f5aea4a7a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:11.951601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f9a05337-62e2-4841-8221-f0f5aea4a7a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051216 Jul 26 18:36:11.952618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 450/876] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:12.034047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e9ad1ad6-797c-4fce-b292-a83a1d6fcdae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:12.048737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e9ad1ad6-797c-4fce-b292-a83a1d6fcdae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1724 microversion: 2.1 time: 0.192051 Jul 26 18:36:12.049965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 427/877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:12.326800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8f419422-fdc0-42eb-9e4a-6b7da60911f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:12.328908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8f419422-fdc0-42eb-9e4a-6b7da60911f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:12.335632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f419422-fdc0-42eb-9e4a-6b7da60911f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:12.336107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f419422-fdc0-42eb-9e4a-6b7da60911f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:12.337028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f419422-fdc0-42eb-9e4a-6b7da60911f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:12.337568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f419422-fdc0-42eb-9e4a-6b7da60911f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:12.369435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8f419422-fdc0-42eb-9e4a-6b7da60911f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046669 Jul 26 18:36:12.370120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 451/878] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:12 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:12.548767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c1450e97-8191-47de-9b06-6e136588af1c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:12.549355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c1450e97-8191-47de-9b06-6e136588af1c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:12.556613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1450e97-8191-47de-9b06-6e136588af1c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:12.557057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1450e97-8191-47de-9b06-6e136588af1c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:12.557804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1450e97-8191-47de-9b06-6e136588af1c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:12.558237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1450e97-8191-47de-9b06-6e136588af1c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:12.572208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-c1450e97-8191-47de-9b06-6e136588af1c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] HTTP exception thrown: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c1450e97-8191-47de-9b06-6e136588af1c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Request method failure captured: Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: request: GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 HTTP/1.1 Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Connection: close Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Host: 10.222.0.27 Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.10 Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABi4DJoSQxtv8AwmMak-ApkBvAGOclo4VruA3O1ksriTQ-6wpon0S82Ytovbh7gPvY9VGGxzAgXUWiTbl5QGYG92BM1Znn6HEH2ee4X47ZQi-xr6Z5aM7IRi8fPr5rzuGUs2sNA27Ubz43AnXU59xT2N4VBOhhHlHD4N7kOEcCcjjtSB-I Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Role: reader,member Jul 26 18:36:12.573846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Roles: reader,member Jul 26 18:36:12.575336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_765e809e332e4a478e09be17e6b3c385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}] Jul 26 18:36:12.575336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-AttachVolumeNegativeTest-201653783 Jul 26 18:36:12.575336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 18:36:12.575336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 18:36:12.575336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 18:36:12.575336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 26 18:36:12.575336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 26 18:36:12.575336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Id: 40f43a6429474c5e96db487ee85bbd84 Jul 26 18:36:12.575336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 18:36:12.575336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: method: > Jul 26 18:36:12.575336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: exception: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 18:36:12.575336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: action_args: {'id': 'd54c7ad3-e708-41db-ad30-52ed8fc45183'} Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:36:12.576310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 18:36:12.577987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:36:12.579413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c1450e97-8191-47de-9b06-6e136588af1c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Returning 404 to user: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:36:12.579413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c1450e97-8191-47de-9b06-6e136588af1c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 404 len: 111 microversion: 2.1 time: 0.030372 Jul 26 18:36:12.579413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 428/879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:12 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 18:36:12.584298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0137201a-58e7-4730-9cdb-18f4b232e027 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '.version_select at 0x7f39097d9e50>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:12.606450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0137201a-58e7-4730-9cdb-18f4b232e027 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814355938" status: 202 len: 0 microversion: 2.1 time: 0.025764 Jul 26 18:36:12.606903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 452/880] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Jul 26 18:36:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814355938 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:36:12.963581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-47fc60f3-d4cb-41d8-b3c0-73c5460b89ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:12.965816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-47fc60f3-d4cb-41d8-b3c0-73c5460b89ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:12.972405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47fc60f3-d4cb-41d8-b3c0-73c5460b89ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:12.972846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47fc60f3-d4cb-41d8-b3c0-73c5460b89ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:12.973602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47fc60f3-d4cb-41d8-b3c0-73c5460b89ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:12.974019 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47fc60f3-d4cb-41d8-b3c0-73c5460b89ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:13.004708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-47fc60f3-d4cb-41d8-b3c0-73c5460b89ae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045158 Jul 26 18:36:13.009422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 429/881] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:12 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:13.072477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d34e93eb-3479-4369-adb7-7dcb9fff32ba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:13.073212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d34e93eb-3479-4369-adb7-7dcb9fff32ba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:13.079587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d34e93eb-3479-4369-adb7-7dcb9fff32ba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:13.080020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d34e93eb-3479-4369-adb7-7dcb9fff32ba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:13.080770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d34e93eb-3479-4369-adb7-7dcb9fff32ba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:13.081200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d34e93eb-3479-4369-adb7-7dcb9fff32ba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:13.221394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d34e93eb-3479-4369-adb7-7dcb9fff32ba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:13.230545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d34e93eb-3479-4369-adb7-7dcb9fff32ba tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1724 microversion: 2.1 time: 0.162397 Jul 26 18:36:13.231156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 453/882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:13 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:13.298475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-97445ff1-0ef7-4c79-8a43-e59e9497a542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:13.298963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-97445ff1-0ef7-4c79-8a43-e59e9497a542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:13.307527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97445ff1-0ef7-4c79-8a43-e59e9497a542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:13.308054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97445ff1-0ef7-4c79-8a43-e59e9497a542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:13.308840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97445ff1-0ef7-4c79-8a43-e59e9497a542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:13.309490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97445ff1-0ef7-4c79-8a43-e59e9497a542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:13.384646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bc1ec838-6cdc-4114-86dc-8ee8f1ca440c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:13.387053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bc1ec838-6cdc-4114-86dc-8ee8f1ca440c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:13.394835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc1ec838-6cdc-4114-86dc-8ee8f1ca440c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:13.395313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc1ec838-6cdc-4114-86dc-8ee8f1ca440c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:13.396399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc1ec838-6cdc-4114-86dc-8ee8f1ca440c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:13.396819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc1ec838-6cdc-4114-86dc-8ee8f1ca440c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:13.399008 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-97445ff1-0ef7-4c79-8a43-e59e9497a542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lazy-loading 'services' on Instance uuid 62ada35c-e092-41a1-a9c4-2177b7e8ae31 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:36:13.430279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bc1ec838-6cdc-4114-86dc-8ee8f1ca440c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049685 Jul 26 18:36:13.430860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 454/883] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:13.528640 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-97445ff1-0ef7-4c79-8a43-e59e9497a542 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "DELETE /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments/7e6c66e5-b4d7-4483-886f-8c594e6e7bcb" status: 202 len: 0 microversion: 2.1 time: 0.233462 Jul 26 18:36:13.529414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 430/884] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Jul 26 18:36:13 2022] DELETE /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments/7e6c66e5-b4d7-4483-886f-8c594e6e7bcb => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:36:13.540117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-35e113e6-4393-4cb2-aeaf-b0ff8115f19f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:13.543072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-35e113e6-4393-4cb2-aeaf-b0ff8115f19f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:13.550628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35e113e6-4393-4cb2-aeaf-b0ff8115f19f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:13.551112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35e113e6-4393-4cb2-aeaf-b0ff8115f19f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:13.551906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35e113e6-4393-4cb2-aeaf-b0ff8115f19f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:13.552349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35e113e6-4393-4cb2-aeaf-b0ff8115f19f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:13.578043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:13.582593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-35e113e6-4393-4cb2-aeaf-b0ff8115f19f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048492 Jul 26 18:36:13.583174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 455/885] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:13 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:36:14.022380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-09d2a973-d131-4e89-8693-5d2df6eacfb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:14.024705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-09d2a973-d131-4e89-8693-5d2df6eacfb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:14.031656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09d2a973-d131-4e89-8693-5d2df6eacfb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:14.032103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09d2a973-d131-4e89-8693-5d2df6eacfb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:14.032982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09d2a973-d131-4e89-8693-5d2df6eacfb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:14.033253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09d2a973-d131-4e89-8693-5d2df6eacfb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:14.035885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:14.064517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-09d2a973-d131-4e89-8693-5d2df6eacfb1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049755 Jul 26 18:36:14.065420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 431/886] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:14 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:14.252248 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a64c1c15-5c77-46d8-9517-9c8abe83cd0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:14.252850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a64c1c15-5c77-46d8-9517-9c8abe83cd0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:14.260081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a64c1c15-5c77-46d8-9517-9c8abe83cd0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:14.260555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a64c1c15-5c77-46d8-9517-9c8abe83cd0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:14.261289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a64c1c15-5c77-46d8-9517-9c8abe83cd0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:14.261733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a64c1c15-5c77-46d8-9517-9c8abe83cd0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:14.393690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a64c1c15-5c77-46d8-9517-9c8abe83cd0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:14.402269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a64c1c15-5c77-46d8-9517-9c8abe83cd0f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1724 microversion: 2.1 time: 0.154235 Jul 26 18:36:14.402863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 456/887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:14 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:14.442657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b968ede9-52c6-471d-808c-3092a8a4ef6c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:14.444841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b968ede9-52c6-471d-808c-3092a8a4ef6c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:14.451200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b968ede9-52c6-471d-808c-3092a8a4ef6c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:14.451744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b968ede9-52c6-471d-808c-3092a8a4ef6c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:14.452883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b968ede9-52c6-471d-808c-3092a8a4ef6c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:14.453571 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b968ede9-52c6-471d-808c-3092a8a4ef6c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:14.483938 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b968ede9-52c6-471d-808c-3092a8a4ef6c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045331 Jul 26 18:36:14.484512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 432/888] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:14 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:14.595085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-21da4c9e-dad9-410e-8c23-29d0f305af3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:14.597263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-21da4c9e-dad9-410e-8c23-29d0f305af3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:14.604124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21da4c9e-dad9-410e-8c23-29d0f305af3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:14.604573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21da4c9e-dad9-410e-8c23-29d0f305af3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:14.605340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21da4c9e-dad9-410e-8c23-29d0f305af3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:14.605773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21da4c9e-dad9-410e-8c23-29d0f305af3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:14.634716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-21da4c9e-dad9-410e-8c23-29d0f305af3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 Jul 26 18:36:14.635346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 457/889] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:14 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:15.078865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-20c2f5f2-6ba5-4270-a809-5c9fd626432f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:15.081526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-20c2f5f2-6ba5-4270-a809-5c9fd626432f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:15.089825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20c2f5f2-6ba5-4270-a809-5c9fd626432f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:15.090396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20c2f5f2-6ba5-4270-a809-5c9fd626432f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:15.091377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20c2f5f2-6ba5-4270-a809-5c9fd626432f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:15.091889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20c2f5f2-6ba5-4270-a809-5c9fd626432f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:15.123013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-20c2f5f2-6ba5-4270-a809-5c9fd626432f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049212 Jul 26 18:36:15.123622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 433/890] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:15 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:15.424593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-14ad3e1d-7e57-4ad6-928b-f9a8c9676cf9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:15.425235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-14ad3e1d-7e57-4ad6-928b-f9a8c9676cf9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:15.433577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14ad3e1d-7e57-4ad6-928b-f9a8c9676cf9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:15.434026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14ad3e1d-7e57-4ad6-928b-f9a8c9676cf9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:15.434802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14ad3e1d-7e57-4ad6-928b-f9a8c9676cf9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:15.435264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14ad3e1d-7e57-4ad6-928b-f9a8c9676cf9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:15.496663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-33961e2c-a59b-4b40-8c25-6880706646a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:15.498793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-33961e2c-a59b-4b40-8c25-6880706646a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:15.505151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-33961e2c-a59b-4b40-8c25-6880706646a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:15.505590 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-33961e2c-a59b-4b40-8c25-6880706646a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:15.506353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-33961e2c-a59b-4b40-8c25-6880706646a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:15.506776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-33961e2c-a59b-4b40-8c25-6880706646a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:15.537961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-33961e2c-a59b-4b40-8c25-6880706646a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045071 Jul 26 18:36:15.538829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 434/891] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:15 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:15.586246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-14ad3e1d-7e57-4ad6-928b-f9a8c9676cf9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:15.594775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-14ad3e1d-7e57-4ad6-928b-f9a8c9676cf9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1724 microversion: 2.1 time: 0.174699 Jul 26 18:36:15.595375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 458/892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:15.647405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d0daba61-69fd-4a41-802c-e99098394b2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:15.649536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d0daba61-69fd-4a41-802c-e99098394b2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:15.656766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0daba61-69fd-4a41-802c-e99098394b2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:15.657244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0daba61-69fd-4a41-802c-e99098394b2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:15.658017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0daba61-69fd-4a41-802c-e99098394b2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:15.658454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0daba61-69fd-4a41-802c-e99098394b2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:15.688421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d0daba61-69fd-4a41-802c-e99098394b2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045349 Jul 26 18:36:15.688986 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 435/893] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:15 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:16.136279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a1fecef2-e6ed-4147-8f1b-281dcc6cffcf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:16.138323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a1fecef2-e6ed-4147-8f1b-281dcc6cffcf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:16.145250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1fecef2-e6ed-4147-8f1b-281dcc6cffcf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:16.146092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1fecef2-e6ed-4147-8f1b-281dcc6cffcf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:16.146854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1fecef2-e6ed-4147-8f1b-281dcc6cffcf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:16.147315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1fecef2-e6ed-4147-8f1b-281dcc6cffcf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:16.176800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a1fecef2-e6ed-4147-8f1b-281dcc6cffcf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044692 Jul 26 18:36:16.177607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 459/894] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:16 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:16.551129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3b1bbcda-1a14-4bf8-b2cf-f0d6de8958f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:16.553276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3b1bbcda-1a14-4bf8-b2cf-f0d6de8958f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:16.560389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b1bbcda-1a14-4bf8-b2cf-f0d6de8958f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:16.560838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b1bbcda-1a14-4bf8-b2cf-f0d6de8958f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:16.561597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b1bbcda-1a14-4bf8-b2cf-f0d6de8958f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:16.562021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b1bbcda-1a14-4bf8-b2cf-f0d6de8958f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:16.591913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3b1bbcda-1a14-4bf8-b2cf-f0d6de8958f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Jul 26 18:36:16.592456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 436/895] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:16 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:16.619586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-080947ae-54c7-4424-91c1-80085b71a8fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:16.620249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-080947ae-54c7-4424-91c1-80085b71a8fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:16.630242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-080947ae-54c7-4424-91c1-80085b71a8fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:16.630692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-080947ae-54c7-4424-91c1-80085b71a8fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:16.631499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-080947ae-54c7-4424-91c1-80085b71a8fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:16.631928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-080947ae-54c7-4424-91c1-80085b71a8fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:16.700987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-43d31949-1f8f-4641-b124-9abcceca7153 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:16.703169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-43d31949-1f8f-4641-b124-9abcceca7153 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:16.710152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43d31949-1f8f-4641-b124-9abcceca7153 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:16.710604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43d31949-1f8f-4641-b124-9abcceca7153 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:16.711434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43d31949-1f8f-4641-b124-9abcceca7153 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:16.711873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43d31949-1f8f-4641-b124-9abcceca7153 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:16.741500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-43d31949-1f8f-4641-b124-9abcceca7153 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 Jul 26 18:36:16.746041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 437/896] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:16 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:16.770212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-080947ae-54c7-4424-91c1-80085b71a8fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:36:16.778752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-080947ae-54c7-4424-91c1-80085b71a8fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1730 microversion: 2.1 time: 0.165562 Jul 26 18:36:16.779364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 460/897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:36:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:36:16.799777 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4c9b9b1f-34b1-4f72-88cc-6350818e6d7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:16.800257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4c9b9b1f-34b1-4f72-88cc-6350818e6d7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:16.802272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:16.808350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c9b9b1f-34b1-4f72-88cc-6350818e6d7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:16.808795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c9b9b1f-34b1-4f72-88cc-6350818e6d7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:16.809563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c9b9b1f-34b1-4f72-88cc-6350818e6d7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:16.809996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c9b9b1f-34b1-4f72-88cc-6350818e6d7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:16.896328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4c9b9b1f-34b1-4f72-88cc-6350818e6d7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100300 Jul 26 18:36:16.896924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 438/898] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Jul 26 18:36:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:17.190451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-95715e15-b230-482f-b797-94793ef007ac tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:17.192883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-95715e15-b230-482f-b797-94793ef007ac tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:17.199291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95715e15-b230-482f-b797-94793ef007ac tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:17.199739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95715e15-b230-482f-b797-94793ef007ac tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:17.200512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95715e15-b230-482f-b797-94793ef007ac tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:17.200944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95715e15-b230-482f-b797-94793ef007ac tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:17.231876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-95715e15-b230-482f-b797-94793ef007ac tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045527 Jul 26 18:36:17.232674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 461/899] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:17.604819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c85d4300-bfdd-46ac-ac3a-ce000db2a2c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:17.606998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c85d4300-bfdd-46ac-ac3a-ce000db2a2c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:17.613728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c85d4300-bfdd-46ac-ac3a-ce000db2a2c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:17.614170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c85d4300-bfdd-46ac-ac3a-ce000db2a2c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:17.614945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c85d4300-bfdd-46ac-ac3a-ce000db2a2c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:17.615460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c85d4300-bfdd-46ac-ac3a-ce000db2a2c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:17.644922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c85d4300-bfdd-46ac-ac3a-ce000db2a2c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Jul 26 18:36:17.645794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 439/900] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:17 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:17.754305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-91c2376e-37fd-43b1-8143-52426621c7ea tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:17.756612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-91c2376e-37fd-43b1-8143-52426621c7ea tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:17.764028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91c2376e-37fd-43b1-8143-52426621c7ea tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:17.764457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91c2376e-37fd-43b1-8143-52426621c7ea tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:17.765265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91c2376e-37fd-43b1-8143-52426621c7ea tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:17.765697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91c2376e-37fd-43b1-8143-52426621c7ea tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:17.798647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-91c2376e-37fd-43b1-8143-52426621c7ea tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048389 Jul 26 18:36:17.799289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 462/901] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:17 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:18.042902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [req-ad62c073-b088-4f61-81a0-b2057b844aec req-03a3a482-6163-4e97-81ca-9f7a5af7e965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26b67fc-cc0a-41a7-8568-17f2eed10fb2", "tag": "b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2"}]} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:36:18.053518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-ad62c073-b088-4f61-81a0-b2057b844aec req-03a3a482-6163-4e97-81ca-9f7a5af7e965 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:18.054114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [req-ad62c073-b088-4f61-81a0-b2057b844aec req-03a3a482-6163-4e97-81ca-9f7a5af7e965 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:18.066725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.compute.server_external_events [req-ad62c073-b088-4f61-81a0-b2057b844aec req-03a3a482-6163-4e97-81ca-9f7a5af7e965 service nova] Creating event network-changed:b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2 for instance e26b67fc-cc0a-41a7-8568-17f2eed10fb2 on hv-cinder-82549 Jul 26 18:36:18.072782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [req-ad62c073-b088-4f61-81a0-b2057b844aec req-03a3a482-6163-4e97-81ca-9f7a5af7e965 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034034 Jul 26 18:36:18.073971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 440/902] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:18.244928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-355d98dc-fb30-48a8-be4d-3af72bf8516b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:18.247873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-355d98dc-fb30-48a8-be4d-3af72bf8516b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:18.254224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-355d98dc-fb30-48a8-be4d-3af72bf8516b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:18.254641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-355d98dc-fb30-48a8-be4d-3af72bf8516b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:18.255792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-355d98dc-fb30-48a8-be4d-3af72bf8516b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:18.256217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-355d98dc-fb30-48a8-be4d-3af72bf8516b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:18.292146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-355d98dc-fb30-48a8-be4d-3af72bf8516b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051298 Jul 26 18:36:18.293556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 463/903] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:18 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:18.659356 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fe134248-d373-4e17-a8aa-14043f532257 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:18.661742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fe134248-d373-4e17-a8aa-14043f532257 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:18.668116 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe134248-d373-4e17-a8aa-14043f532257 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:18.668556 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe134248-d373-4e17-a8aa-14043f532257 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:18.669318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe134248-d373-4e17-a8aa-14043f532257 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:18.669738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe134248-d373-4e17-a8aa-14043f532257 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:18.701560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fe134248-d373-4e17-a8aa-14043f532257 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047251 Jul 26 18:36:18.702352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 441/904] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:18 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:36:18.810853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-337b205c-95a1-4375-ac7c-1cd71aeb6cbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:18.813092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-337b205c-95a1-4375-ac7c-1cd71aeb6cbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:18.820221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-337b205c-95a1-4375-ac7c-1cd71aeb6cbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:18.820799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-337b205c-95a1-4375-ac7c-1cd71aeb6cbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:18.821725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-337b205c-95a1-4375-ac7c-1cd71aeb6cbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:18.822223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-337b205c-95a1-4375-ac7c-1cd71aeb6cbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:18.854757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-337b205c-95a1-4375-ac7c-1cd71aeb6cbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047895 Jul 26 18:36:18.855494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 464/905] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:18 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:19.304874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-18d5fbc0-5a1e-451f-b5d2-a88ccb721222 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:19.307059 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-18d5fbc0-5a1e-451f-b5d2-a88ccb721222 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:19.313464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-18d5fbc0-5a1e-451f-b5d2-a88ccb721222 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:19.313907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-18d5fbc0-5a1e-451f-b5d2-a88ccb721222 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:19.314732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-18d5fbc0-5a1e-451f-b5d2-a88ccb721222 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:19.315118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-18d5fbc0-5a1e-451f-b5d2-a88ccb721222 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:19.349671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-18d5fbc0-5a1e-451f-b5d2-a88ccb721222 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048784 Jul 26 18:36:19.350239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 442/906] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:19 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:19.713646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7f599319-d02f-4bc8-b45d-0d003ec21063 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:19.715759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7f599319-d02f-4bc8-b45d-0d003ec21063 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:19.717643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:19.724799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f599319-d02f-4bc8-b45d-0d003ec21063 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:19.725328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f599319-d02f-4bc8-b45d-0d003ec21063 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:19.726101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f599319-d02f-4bc8-b45d-0d003ec21063 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:19.726510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f599319-d02f-4bc8-b45d-0d003ec21063 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:19.761571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7f599319-d02f-4bc8-b45d-0d003ec21063 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052109 Jul 26 18:36:19.762140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 465/907] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:19 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:19.868563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-94fe89ce-949b-4991-a279-48b377c7620c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:19.870725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-94fe89ce-949b-4991-a279-48b377c7620c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:19.879465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94fe89ce-949b-4991-a279-48b377c7620c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:19.880028 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94fe89ce-949b-4991-a279-48b377c7620c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:19.881153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94fe89ce-949b-4991-a279-48b377c7620c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:19.881768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94fe89ce-949b-4991-a279-48b377c7620c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:19.915478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-94fe89ce-949b-4991-a279-48b377c7620c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050914 Jul 26 18:36:19.916053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 443/908] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:19 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:20.092041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-b5f657f3-d244-4291-8fe4-38742dfa54d4 req-4a631c7c-ce25-40df-9de6-be89dcc18627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26b67fc-cc0a-41a7-8568-17f2eed10fb2", "tag": "b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:36:20.104029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-b5f657f3-d244-4291-8fe4-38742dfa54d4 req-4a631c7c-ce25-40df-9de6-be89dcc18627 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:20.104468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-b5f657f3-d244-4291-8fe4-38742dfa54d4 req-4a631c7c-ce25-40df-9de6-be89dcc18627 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:20.116111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-b5f657f3-d244-4291-8fe4-38742dfa54d4 req-4a631c7c-ce25-40df-9de6-be89dcc18627 service nova] Creating event network-changed:b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2 for instance e26b67fc-cc0a-41a7-8568-17f2eed10fb2 on hv-cinder-82549 Jul 26 18:36:20.121648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-b5f657f3-d244-4291-8fe4-38742dfa54d4 req-4a631c7c-ce25-40df-9de6-be89dcc18627 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035071 Jul 26 18:36:20.122222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 466/909] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:20.362410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-744aedc0-6827-4bf8-823e-e419899dd921 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:20.364470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-744aedc0-6827-4bf8-823e-e419899dd921 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:20.372178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-744aedc0-6827-4bf8-823e-e419899dd921 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:20.372752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-744aedc0-6827-4bf8-823e-e419899dd921 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:20.373648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-744aedc0-6827-4bf8-823e-e419899dd921 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:20.373976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-744aedc0-6827-4bf8-823e-e419899dd921 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:20.407890 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-744aedc0-6827-4bf8-823e-e419899dd921 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049733 Jul 26 18:36:20.408541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 444/910] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:20.775592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-43e661fa-f73d-4209-97fe-420070dbb658 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:20.777883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-43e661fa-f73d-4209-97fe-420070dbb658 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:20.784647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-43e661fa-f73d-4209-97fe-420070dbb658 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:20.785298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-43e661fa-f73d-4209-97fe-420070dbb658 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:20.786091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-43e661fa-f73d-4209-97fe-420070dbb658 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:20.786517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-43e661fa-f73d-4209-97fe-420070dbb658 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:20.816405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-43e661fa-f73d-4209-97fe-420070dbb658 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Jul 26 18:36:20.816904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 467/911] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:20.929247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-68f2bf20-c3e8-43bc-887f-dd3340ed0738 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:20.931726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-68f2bf20-c3e8-43bc-887f-dd3340ed0738 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:20.940342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68f2bf20-c3e8-43bc-887f-dd3340ed0738 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:20.940875 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68f2bf20-c3e8-43bc-887f-dd3340ed0738 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:20.941754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68f2bf20-c3e8-43bc-887f-dd3340ed0738 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:20.942218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68f2bf20-c3e8-43bc-887f-dd3340ed0738 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:20.975725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-68f2bf20-c3e8-43bc-887f-dd3340ed0738 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051192 Jul 26 18:36:20.976293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 445/912] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:20 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:21.421679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0f7d118a-8f98-4ac7-8d7a-1022c7d018be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:21.424609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f7d118a-8f98-4ac7-8d7a-1022c7d018be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:21.432102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f7d118a-8f98-4ac7-8d7a-1022c7d018be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:21.432546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f7d118a-8f98-4ac7-8d7a-1022c7d018be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:21.433309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f7d118a-8f98-4ac7-8d7a-1022c7d018be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:21.433735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f7d118a-8f98-4ac7-8d7a-1022c7d018be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:21.465331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0f7d118a-8f98-4ac7-8d7a-1022c7d018be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048738 Jul 26 18:36:21.466174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 468/913] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:21 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:21.829088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4559951d-c78c-45c3-a57a-56dc3c0a0337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:21.831252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4559951d-c78c-45c3-a57a-56dc3c0a0337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:21.838003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4559951d-c78c-45c3-a57a-56dc3c0a0337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:21.838434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4559951d-c78c-45c3-a57a-56dc3c0a0337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:21.839241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4559951d-c78c-45c3-a57a-56dc3c0a0337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:21.839668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4559951d-c78c-45c3-a57a-56dc3c0a0337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:21.868574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4559951d-c78c-45c3-a57a-56dc3c0a0337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043344 Jul 26 18:36:21.869039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 446/914] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:21 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:21.989520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-00d03379-1a70-4cdc-9c26-5c4c228d705a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:21.991781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-00d03379-1a70-4cdc-9c26-5c4c228d705a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:21.998318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00d03379-1a70-4cdc-9c26-5c4c228d705a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:21.998760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00d03379-1a70-4cdc-9c26-5c4c228d705a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:21.999565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00d03379-1a70-4cdc-9c26-5c4c228d705a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:21.999999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00d03379-1a70-4cdc-9c26-5c4c228d705a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:22.031823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-00d03379-1a70-4cdc-9c26-5c4c228d705a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046380 Jul 26 18:36:22.032378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 469/915] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:21 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:22.478712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-03214d71-9b71-4a8e-9028-ca709426dcf0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:22.480914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-03214d71-9b71-4a8e-9028-ca709426dcf0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:22.488146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03214d71-9b71-4a8e-9028-ca709426dcf0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:22.488611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03214d71-9b71-4a8e-9028-ca709426dcf0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:22.489388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03214d71-9b71-4a8e-9028-ca709426dcf0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:22.489855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03214d71-9b71-4a8e-9028-ca709426dcf0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:22.524899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-03214d71-9b71-4a8e-9028-ca709426dcf0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050379 Jul 26 18:36:22.525472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 447/916] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:22 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:22.887756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-19ca5c5f-aca1-496f-8722-f697b063a154 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:22.892495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-19ca5c5f-aca1-496f-8722-f697b063a154 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:22.901098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19ca5c5f-aca1-496f-8722-f697b063a154 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:22.901608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19ca5c5f-aca1-496f-8722-f697b063a154 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:22.902522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19ca5c5f-aca1-496f-8722-f697b063a154 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:22.903103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19ca5c5f-aca1-496f-8722-f697b063a154 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:22.934295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-19ca5c5f-aca1-496f-8722-f697b063a154 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053235 Jul 26 18:36:22.934859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 470/917] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:22 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:23.046982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7bfd14c9-5b63-449f-8c19-2a67f6b87656 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:23.049791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7bfd14c9-5b63-449f-8c19-2a67f6b87656 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:23.059793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bfd14c9-5b63-449f-8c19-2a67f6b87656 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:23.060325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bfd14c9-5b63-449f-8c19-2a67f6b87656 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:23.061445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bfd14c9-5b63-449f-8c19-2a67f6b87656 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:23.062029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bfd14c9-5b63-449f-8c19-2a67f6b87656 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:23.088674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:23.095830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7bfd14c9-5b63-449f-8c19-2a67f6b87656 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055035 Jul 26 18:36:23.096392 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 448/918] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:23 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:23.539564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1134089b-0891-456e-99d8-60571df83f18 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:23.542729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1134089b-0891-456e-99d8-60571df83f18 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:23.550822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1134089b-0891-456e-99d8-60571df83f18 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:23.551297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1134089b-0891-456e-99d8-60571df83f18 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:23.552103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1134089b-0891-456e-99d8-60571df83f18 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:23.552541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1134089b-0891-456e-99d8-60571df83f18 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:23.584911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1134089b-0891-456e-99d8-60571df83f18 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050131 Jul 26 18:36:23.585721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 471/919] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:23 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:23.947183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-610999bb-f3df-460b-859d-d3dd820b87cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:23.949347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-610999bb-f3df-460b-859d-d3dd820b87cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:23.956419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-610999bb-f3df-460b-859d-d3dd820b87cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:23.956871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-610999bb-f3df-460b-859d-d3dd820b87cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:23.957611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-610999bb-f3df-460b-859d-d3dd820b87cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:23.958041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-610999bb-f3df-460b-859d-d3dd820b87cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:23.987507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-610999bb-f3df-460b-859d-d3dd820b87cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044321 Jul 26 18:36:23.988063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 449/920] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:23 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:24.108864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-df055627-dbd2-43cf-aeda-fc2362dd9b81 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:24.110963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-df055627-dbd2-43cf-aeda-fc2362dd9b81 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:24.119604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df055627-dbd2-43cf-aeda-fc2362dd9b81 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:24.120056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df055627-dbd2-43cf-aeda-fc2362dd9b81 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:24.120830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df055627-dbd2-43cf-aeda-fc2362dd9b81 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:24.121236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df055627-dbd2-43cf-aeda-fc2362dd9b81 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:24.152273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-df055627-dbd2-43cf-aeda-fc2362dd9b81 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047485 Jul 26 18:36:24.152836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 472/921] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:24 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:24.598274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-340b5e00-ce0f-4c48-aea6-cc9f398c45fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:24.600423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-340b5e00-ce0f-4c48-aea6-cc9f398c45fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:24.607047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-340b5e00-ce0f-4c48-aea6-cc9f398c45fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:24.607492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-340b5e00-ce0f-4c48-aea6-cc9f398c45fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:24.610698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-340b5e00-ce0f-4c48-aea6-cc9f398c45fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:24.611176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-340b5e00-ce0f-4c48-aea6-cc9f398c45fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:24.646937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-340b5e00-ce0f-4c48-aea6-cc9f398c45fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052713 Jul 26 18:36:24.647550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 450/922] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:25.002688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5d77f37a-ad3f-4922-b9b6-42d8618721f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:25.006105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5d77f37a-ad3f-4922-b9b6-42d8618721f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:25.015472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d77f37a-ad3f-4922-b9b6-42d8618721f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:25.016129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d77f37a-ad3f-4922-b9b6-42d8618721f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:25.017317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d77f37a-ad3f-4922-b9b6-42d8618721f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:25.017964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d77f37a-ad3f-4922-b9b6-42d8618721f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:25.022498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:25.049262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5d77f37a-ad3f-4922-b9b6-42d8618721f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052678 Jul 26 18:36:25.049825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 473/923] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:24 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:25.165343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e6ec3cb9-f388-4dbf-b68f-9c0d915e4085 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:25.167541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e6ec3cb9-f388-4dbf-b68f-9c0d915e4085 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:25.174607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6ec3cb9-f388-4dbf-b68f-9c0d915e4085 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:25.175141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6ec3cb9-f388-4dbf-b68f-9c0d915e4085 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:25.175957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6ec3cb9-f388-4dbf-b68f-9c0d915e4085 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:25.176392 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6ec3cb9-f388-4dbf-b68f-9c0d915e4085 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:25.206896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e6ec3cb9-f388-4dbf-b68f-9c0d915e4085 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045777 Jul 26 18:36:25.207490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 451/924] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:25 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:25.663859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1d4f0910-449f-4801-8342-6bc1680804d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:25.667369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1d4f0910-449f-4801-8342-6bc1680804d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:25.677193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d4f0910-449f-4801-8342-6bc1680804d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:25.677637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d4f0910-449f-4801-8342-6bc1680804d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:25.678396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d4f0910-449f-4801-8342-6bc1680804d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:25.678831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d4f0910-449f-4801-8342-6bc1680804d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:25.709486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1d4f0910-449f-4801-8342-6bc1680804d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051912 Jul 26 18:36:25.710214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 474/925] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:26.062894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d8c79bbc-29c1-4f55-97a1-0eedadee6922 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:26.065147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d8c79bbc-29c1-4f55-97a1-0eedadee6922 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:26.071886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8c79bbc-29c1-4f55-97a1-0eedadee6922 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:26.072327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8c79bbc-29c1-4f55-97a1-0eedadee6922 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:26.073076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8c79bbc-29c1-4f55-97a1-0eedadee6922 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:26.073501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8c79bbc-29c1-4f55-97a1-0eedadee6922 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:26.104058 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d8c79bbc-29c1-4f55-97a1-0eedadee6922 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045281 Jul 26 18:36:26.104654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 452/926] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:26 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:26.222496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6236363e-2b9d-41e7-a037-4a72deee68e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:26.224793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6236363e-2b9d-41e7-a037-4a72deee68e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:26.231270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6236363e-2b9d-41e7-a037-4a72deee68e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:26.231716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6236363e-2b9d-41e7-a037-4a72deee68e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:26.232484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6236363e-2b9d-41e7-a037-4a72deee68e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:26.232951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6236363e-2b9d-41e7-a037-4a72deee68e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:26.263201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6236363e-2b9d-41e7-a037-4a72deee68e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046792 Jul 26 18:36:26.263753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 475/927] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:26 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:36:26.722597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-97dc432e-bb54-4371-a32f-be796c0f430d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:26.724804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-97dc432e-bb54-4371-a32f-be796c0f430d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:26.731916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97dc432e-bb54-4371-a32f-be796c0f430d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:26.732365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97dc432e-bb54-4371-a32f-be796c0f430d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:26.733129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97dc432e-bb54-4371-a32f-be796c0f430d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:26.733557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97dc432e-bb54-4371-a32f-be796c0f430d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:26.765241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-97dc432e-bb54-4371-a32f-be796c0f430d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046748 Jul 26 18:36:26.765897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 453/928] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:27.119215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ff0deef9-7cfd-430c-ac08-768c8b80eeae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:27.121330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ff0deef9-7cfd-430c-ac08-768c8b80eeae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:27.128491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff0deef9-7cfd-430c-ac08-768c8b80eeae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:27.128939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff0deef9-7cfd-430c-ac08-768c8b80eeae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:27.129705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff0deef9-7cfd-430c-ac08-768c8b80eeae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:27.130135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff0deef9-7cfd-430c-ac08-768c8b80eeae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:27.159600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ff0deef9-7cfd-430c-ac08-768c8b80eeae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044536 Jul 26 18:36:27.160155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 476/929] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:27.276371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c821a168-00a8-4872-8647-a014d6bf57bf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:27.278504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c821a168-00a8-4872-8647-a014d6bf57bf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:27.285287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c821a168-00a8-4872-8647-a014d6bf57bf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:27.285730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c821a168-00a8-4872-8647-a014d6bf57bf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:27.286476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c821a168-00a8-4872-8647-a014d6bf57bf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:27.286902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c821a168-00a8-4872-8647-a014d6bf57bf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:27.316490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c821a168-00a8-4872-8647-a014d6bf57bf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044077 Jul 26 18:36:27.317036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 454/930] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:27 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:27.778153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d8d8ed0b-ecfe-4b32-bd64-e3a20f88dcb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:27.780412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d8d8ed0b-ecfe-4b32-bd64-e3a20f88dcb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:27.787190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8d8ed0b-ecfe-4b32-bd64-e3a20f88dcb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:27.787634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8d8ed0b-ecfe-4b32-bd64-e3a20f88dcb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:27.788407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8d8ed0b-ecfe-4b32-bd64-e3a20f88dcb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:27.788964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8d8ed0b-ecfe-4b32-bd64-e3a20f88dcb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:27.818822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d8d8ed0b-ecfe-4b32-bd64-e3a20f88dcb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044685 Jul 26 18:36:27.819423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 477/931] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:27 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:28.172314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-83ef42e0-89a8-44b6-8d57-10fad212d16b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:28.174500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-83ef42e0-89a8-44b6-8d57-10fad212d16b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:28.181462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83ef42e0-89a8-44b6-8d57-10fad212d16b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:28.181909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83ef42e0-89a8-44b6-8d57-10fad212d16b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:28.182685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83ef42e0-89a8-44b6-8d57-10fad212d16b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:28.183140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83ef42e0-89a8-44b6-8d57-10fad212d16b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:28.212837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-83ef42e0-89a8-44b6-8d57-10fad212d16b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044499 Jul 26 18:36:28.213390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 455/932] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:28 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:28.332444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6066c732-a863-4f0c-abb5-9b36e8a7f386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:28.335498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6066c732-a863-4f0c-abb5-9b36e8a7f386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:28.345794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6066c732-a863-4f0c-abb5-9b36e8a7f386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:28.346443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6066c732-a863-4f0c-abb5-9b36e8a7f386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:28.347587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6066c732-a863-4f0c-abb5-9b36e8a7f386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:28.348043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6066c732-a863-4f0c-abb5-9b36e8a7f386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:28.378764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6066c732-a863-4f0c-abb5-9b36e8a7f386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052828 Jul 26 18:36:28.379361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 478/933] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:28 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:28.833799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7db8f352-8cfb-47a6-a366-a493924bc5d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:28.835960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7db8f352-8cfb-47a6-a366-a493924bc5d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:28.842809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7db8f352-8cfb-47a6-a366-a493924bc5d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:28.843286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7db8f352-8cfb-47a6-a366-a493924bc5d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:28.844039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7db8f352-8cfb-47a6-a366-a493924bc5d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:28.844458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7db8f352-8cfb-47a6-a366-a493924bc5d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:28.875351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7db8f352-8cfb-47a6-a366-a493924bc5d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046978 Jul 26 18:36:28.875918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 456/934] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:29.226385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1cb1b784-619c-447d-9d1e-5b43bf9880cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:29.228709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1cb1b784-619c-447d-9d1e-5b43bf9880cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:29.235701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1cb1b784-619c-447d-9d1e-5b43bf9880cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:29.236190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1cb1b784-619c-447d-9d1e-5b43bf9880cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:29.237043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1cb1b784-619c-447d-9d1e-5b43bf9880cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:29.237524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1cb1b784-619c-447d-9d1e-5b43bf9880cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:29.268414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1cb1b784-619c-447d-9d1e-5b43bf9880cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046466 Jul 26 18:36:29.270260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 479/935] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:29 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:29.392148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-95009e4f-0ddb-4e70-8ddb-924244308b30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:29.394376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-95009e4f-0ddb-4e70-8ddb-924244308b30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:29.401651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95009e4f-0ddb-4e70-8ddb-924244308b30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:29.401975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95009e4f-0ddb-4e70-8ddb-924244308b30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:29.402725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95009e4f-0ddb-4e70-8ddb-924244308b30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:29.403190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95009e4f-0ddb-4e70-8ddb-924244308b30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:29.433154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-95009e4f-0ddb-4e70-8ddb-924244308b30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044929 Jul 26 18:36:29.433726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 457/936] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:29 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:29.887647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-71ddb732-9b8e-4efb-82f3-411f2aa37b60 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:29.889819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-71ddb732-9b8e-4efb-82f3-411f2aa37b60 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:29.897085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71ddb732-9b8e-4efb-82f3-411f2aa37b60 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:29.897527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71ddb732-9b8e-4efb-82f3-411f2aa37b60 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:29.898284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71ddb732-9b8e-4efb-82f3-411f2aa37b60 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:29.898691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71ddb732-9b8e-4efb-82f3-411f2aa37b60 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:29.928545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-71ddb732-9b8e-4efb-82f3-411f2aa37b60 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044901 Jul 26 18:36:29.929021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 480/937] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:30.282576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0337afc0-0161-40ed-8ac6-c897d931c8c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:30.285143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0337afc0-0161-40ed-8ac6-c897d931c8c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:30.293536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0337afc0-0161-40ed-8ac6-c897d931c8c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:30.294013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0337afc0-0161-40ed-8ac6-c897d931c8c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:30.294935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0337afc0-0161-40ed-8ac6-c897d931c8c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:30.295515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0337afc0-0161-40ed-8ac6-c897d931c8c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:30.326123 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0337afc0-0161-40ed-8ac6-c897d931c8c2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048478 Jul 26 18:36:30.326670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 458/938] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:30 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:30.446624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c4b40da5-eafb-4954-a623-5e7c11bae0fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:30.448848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c4b40da5-eafb-4954-a623-5e7c11bae0fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:30.455155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4b40da5-eafb-4954-a623-5e7c11bae0fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:30.455604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4b40da5-eafb-4954-a623-5e7c11bae0fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:30.456471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4b40da5-eafb-4954-a623-5e7c11bae0fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:30.456903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4b40da5-eafb-4954-a623-5e7c11bae0fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:30.487749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c4b40da5-eafb-4954-a623-5e7c11bae0fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044936 Jul 26 18:36:30.488461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 481/939] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:30 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:30.944103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cf73eed8-f588-4792-b398-52c9e1c5f198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:30.946990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cf73eed8-f588-4792-b398-52c9e1c5f198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:30.956911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf73eed8-f588-4792-b398-52c9e1c5f198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:30.957357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf73eed8-f588-4792-b398-52c9e1c5f198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:30.958116 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf73eed8-f588-4792-b398-52c9e1c5f198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:30.958544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf73eed8-f588-4792-b398-52c9e1c5f198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:30.988626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cf73eed8-f588-4792-b398-52c9e1c5f198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050845 Jul 26 18:36:30.992013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 459/940] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:31.338323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4d22984b-f607-402e-98c0-76b365294cc2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:31.340538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4d22984b-f607-402e-98c0-76b365294cc2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:31.347771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d22984b-f607-402e-98c0-76b365294cc2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:31.348170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d22984b-f607-402e-98c0-76b365294cc2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:31.348990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d22984b-f607-402e-98c0-76b365294cc2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:31.349421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d22984b-f607-402e-98c0-76b365294cc2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:31.379450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4d22984b-f607-402e-98c0-76b365294cc2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045190 Jul 26 18:36:31.380042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 482/941] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:31 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:31.503283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-65f1c0ca-d5ef-4c38-af6f-34c641e63638 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:31.505437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-65f1c0ca-d5ef-4c38-af6f-34c641e63638 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:31.512275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65f1c0ca-d5ef-4c38-af6f-34c641e63638 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:31.512721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65f1c0ca-d5ef-4c38-af6f-34c641e63638 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:31.513483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65f1c0ca-d5ef-4c38-af6f-34c641e63638 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:31.513906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65f1c0ca-d5ef-4c38-af6f-34c641e63638 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:31.552074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-65f1c0ca-d5ef-4c38-af6f-34c641e63638 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054982 Jul 26 18:36:31.552536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 460/942] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:31 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:32.000958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2a08af42-ecbf-4592-acd7-f87aa7cc9527 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:32.003183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2a08af42-ecbf-4592-acd7-f87aa7cc9527 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:32.009630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a08af42-ecbf-4592-acd7-f87aa7cc9527 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:32.010074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a08af42-ecbf-4592-acd7-f87aa7cc9527 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:32.010838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a08af42-ecbf-4592-acd7-f87aa7cc9527 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:32.011306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a08af42-ecbf-4592-acd7-f87aa7cc9527 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:32.042706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2a08af42-ecbf-4592-acd7-f87aa7cc9527 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045729 Jul 26 18:36:32.043150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 483/943] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:32.392563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-53b0900a-679e-4d6f-a304-388f7f2e8eb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:32.394649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-53b0900a-679e-4d6f-a304-388f7f2e8eb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:32.401660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53b0900a-679e-4d6f-a304-388f7f2e8eb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:32.402107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53b0900a-679e-4d6f-a304-388f7f2e8eb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:32.402867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53b0900a-679e-4d6f-a304-388f7f2e8eb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:32.403330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53b0900a-679e-4d6f-a304-388f7f2e8eb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:32.434552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-53b0900a-679e-4d6f-a304-388f7f2e8eb3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 Jul 26 18:36:32.435117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 461/944] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:32 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:32.567858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4abffe4b-5dfa-4d1c-9346-4f4b904dddd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:32.571110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4abffe4b-5dfa-4d1c-9346-4f4b904dddd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:32.581561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4abffe4b-5dfa-4d1c-9346-4f4b904dddd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:32.582003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4abffe4b-5dfa-4d1c-9346-4f4b904dddd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:32.582792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4abffe4b-5dfa-4d1c-9346-4f4b904dddd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:32.583256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4abffe4b-5dfa-4d1c-9346-4f4b904dddd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:32.614287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4abffe4b-5dfa-4d1c-9346-4f4b904dddd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052948 Jul 26 18:36:32.614850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 484/945] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:32 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:33.055419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-30040224-8de8-4bfd-9f78-658add184518 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:33.057507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-30040224-8de8-4bfd-9f78-658add184518 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:33.063766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30040224-8de8-4bfd-9f78-658add184518 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:33.064206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30040224-8de8-4bfd-9f78-658add184518 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:33.064984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30040224-8de8-4bfd-9f78-658add184518 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:33.065427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30040224-8de8-4bfd-9f78-658add184518 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:33.094660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-30040224-8de8-4bfd-9f78-658add184518 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043381 Jul 26 18:36:33.095242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 462/946] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:33.449893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1ffc9fde-e1d7-4756-8f34-a4e8c4e16d58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:33.452615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1ffc9fde-e1d7-4756-8f34-a4e8c4e16d58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:33.460415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ffc9fde-e1d7-4756-8f34-a4e8c4e16d58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:33.460852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ffc9fde-e1d7-4756-8f34-a4e8c4e16d58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:33.461626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ffc9fde-e1d7-4756-8f34-a4e8c4e16d58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:33.462098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ffc9fde-e1d7-4756-8f34-a4e8c4e16d58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:33.491906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1ffc9fde-e1d7-4756-8f34-a4e8c4e16d58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048175 Jul 26 18:36:33.492466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 485/947] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:33 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:33.627748 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-132b48f3-b445-4f47-8d47-b11cad0c075b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:33.630020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-132b48f3-b445-4f47-8d47-b11cad0c075b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:33.636601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-132b48f3-b445-4f47-8d47-b11cad0c075b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:33.637054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-132b48f3-b445-4f47-8d47-b11cad0c075b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:33.637824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-132b48f3-b445-4f47-8d47-b11cad0c075b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:33.638260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-132b48f3-b445-4f47-8d47-b11cad0c075b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:33.667731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-132b48f3-b445-4f47-8d47-b11cad0c075b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044838 Jul 26 18:36:33.668329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 463/948] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:33 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:34.109169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-01b4adee-c65a-4c8e-a154-6073a61618fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:34.111374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-01b4adee-c65a-4c8e-a154-6073a61618fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:34.118113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01b4adee-c65a-4c8e-a154-6073a61618fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:34.118557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01b4adee-c65a-4c8e-a154-6073a61618fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:34.119350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01b4adee-c65a-4c8e-a154-6073a61618fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:34.119780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01b4adee-c65a-4c8e-a154-6073a61618fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:34.150883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-01b4adee-c65a-4c8e-a154-6073a61618fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046013 Jul 26 18:36:34.151480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 486/949] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:34 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:34.504598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9169f6ed-7bb3-4b56-874a-54d6a14560bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:34.507059 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9169f6ed-7bb3-4b56-874a-54d6a14560bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:34.517419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9169f6ed-7bb3-4b56-874a-54d6a14560bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:34.518066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9169f6ed-7bb3-4b56-874a-54d6a14560bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:34.519051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9169f6ed-7bb3-4b56-874a-54d6a14560bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:34.519539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9169f6ed-7bb3-4b56-874a-54d6a14560bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:34.561558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9169f6ed-7bb3-4b56-874a-54d6a14560bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060617 Jul 26 18:36:34.562295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 464/950] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:34 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:34.683382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2621b9a0-a9d2-4443-bf9f-8d02658280af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:34.686305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2621b9a0-a9d2-4443-bf9f-8d02658280af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:34.694421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2621b9a0-a9d2-4443-bf9f-8d02658280af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:34.695083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2621b9a0-a9d2-4443-bf9f-8d02658280af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:34.696198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2621b9a0-a9d2-4443-bf9f-8d02658280af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:34.696862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2621b9a0-a9d2-4443-bf9f-8d02658280af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:34.729090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2621b9a0-a9d2-4443-bf9f-8d02658280af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051389 Jul 26 18:36:34.729640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 487/951] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:34 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:35.164519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4bb0a3d5-56d5-4a25-9329-f51d25cb9172 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:35.166749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4bb0a3d5-56d5-4a25-9329-f51d25cb9172 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:35.173975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bb0a3d5-56d5-4a25-9329-f51d25cb9172 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:35.174439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bb0a3d5-56d5-4a25-9329-f51d25cb9172 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:35.175293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bb0a3d5-56d5-4a25-9329-f51d25cb9172 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:35.175746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bb0a3d5-56d5-4a25-9329-f51d25cb9172 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:35.190954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:35.207964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4bb0a3d5-56d5-4a25-9329-f51d25cb9172 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047790 Jul 26 18:36:35.208515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 465/952] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:35 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:35.578476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b1a09fa6-3a5c-43a1-898c-3380f2165f3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:35.581381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b1a09fa6-3a5c-43a1-898c-3380f2165f3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:35.588107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1a09fa6-3a5c-43a1-898c-3380f2165f3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:35.588550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1a09fa6-3a5c-43a1-898c-3380f2165f3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:35.589296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1a09fa6-3a5c-43a1-898c-3380f2165f3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:35.589725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1a09fa6-3a5c-43a1-898c-3380f2165f3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:35.619174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b1a09fa6-3a5c-43a1-898c-3380f2165f3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047062 Jul 26 18:36:35.619727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 488/953] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:35 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:35.742827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-833586ba-7d37-405c-a094-3f3837606a56 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:35.745119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-833586ba-7d37-405c-a094-3f3837606a56 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:35.752154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-833586ba-7d37-405c-a094-3f3837606a56 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:35.752584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-833586ba-7d37-405c-a094-3f3837606a56 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:35.753361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-833586ba-7d37-405c-a094-3f3837606a56 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:35.753788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-833586ba-7d37-405c-a094-3f3837606a56 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:35.785066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-833586ba-7d37-405c-a094-3f3837606a56 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046235 Jul 26 18:36:35.785855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 466/954] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:35 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:36.221250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ef0d74f2-a98e-4e52-b8d2-c3b0b01b4bad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:36.223482 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ef0d74f2-a98e-4e52-b8d2-c3b0b01b4bad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:36.231175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef0d74f2-a98e-4e52-b8d2-c3b0b01b4bad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:36.231618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef0d74f2-a98e-4e52-b8d2-c3b0b01b4bad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:36.232382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef0d74f2-a98e-4e52-b8d2-c3b0b01b4bad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:36.232814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef0d74f2-a98e-4e52-b8d2-c3b0b01b4bad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:36.262189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:36.268184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ef0d74f2-a98e-4e52-b8d2-c3b0b01b4bad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051109 Jul 26 18:36:36.268827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 489/955] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:36 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:36.634729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-27ab010f-f8f9-41e0-861e-5d4d8a2bdfe8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:36.636788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-27ab010f-f8f9-41e0-861e-5d4d8a2bdfe8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:36.643491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27ab010f-f8f9-41e0-861e-5d4d8a2bdfe8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:36.643932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27ab010f-f8f9-41e0-861e-5d4d8a2bdfe8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:36.644692 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27ab010f-f8f9-41e0-861e-5d4d8a2bdfe8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:36.645126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27ab010f-f8f9-41e0-861e-5d4d8a2bdfe8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:36.675205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-27ab010f-f8f9-41e0-861e-5d4d8a2bdfe8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044593 Jul 26 18:36:36.675764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 467/956] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:36 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:36.799599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f2c5f788-a580-435d-a11a-0ac28e339f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:36.801745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f2c5f788-a580-435d-a11a-0ac28e339f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:36.808324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f2c5f788-a580-435d-a11a-0ac28e339f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:36.808765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f2c5f788-a580-435d-a11a-0ac28e339f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:36.809520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f2c5f788-a580-435d-a11a-0ac28e339f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:36.809945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f2c5f788-a580-435d-a11a-0ac28e339f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:36.840007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f2c5f788-a580-435d-a11a-0ac28e339f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045601 Jul 26 18:36:36.840563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 490/957] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:36 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:37.284757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-28f20788-cea2-4d1e-a3c7-dcf6a7a77d84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:37.286930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-28f20788-cea2-4d1e-a3c7-dcf6a7a77d84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:37.294343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-28f20788-cea2-4d1e-a3c7-dcf6a7a77d84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:37.294792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-28f20788-cea2-4d1e-a3c7-dcf6a7a77d84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:37.295603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-28f20788-cea2-4d1e-a3c7-dcf6a7a77d84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:37.296033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-28f20788-cea2-4d1e-a3c7-dcf6a7a77d84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:37.326879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-28f20788-cea2-4d1e-a3c7-dcf6a7a77d84 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046916 Jul 26 18:36:37.327471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 468/958] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:37.690063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0b4669b0-55a7-4545-8390-7d852a3a5f9b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:37.692855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0b4669b0-55a7-4545-8390-7d852a3a5f9b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:37.701822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b4669b0-55a7-4545-8390-7d852a3a5f9b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:37.702392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b4669b0-55a7-4545-8390-7d852a3a5f9b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:37.703441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b4669b0-55a7-4545-8390-7d852a3a5f9b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:37.703998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b4669b0-55a7-4545-8390-7d852a3a5f9b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:37.733744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0b4669b0-55a7-4545-8390-7d852a3a5f9b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048846 Jul 26 18:36:37.734292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 491/959] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:37 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:37.852927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d0eb8a34-402b-4dd2-ab4a-11795de6f7b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:37.855139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d0eb8a34-402b-4dd2-ab4a-11795de6f7b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:37.861938 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0eb8a34-402b-4dd2-ab4a-11795de6f7b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:37.862435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0eb8a34-402b-4dd2-ab4a-11795de6f7b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:37.863240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0eb8a34-402b-4dd2-ab4a-11795de6f7b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:37.863671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0eb8a34-402b-4dd2-ab4a-11795de6f7b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:37.894216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d0eb8a34-402b-4dd2-ab4a-11795de6f7b8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045279 Jul 26 18:36:37.894738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 469/960] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:37 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:38.340908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-54c05c36-166f-45f4-b588-08e74e7c2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:38.343308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-54c05c36-166f-45f4-b588-08e74e7c2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:38.350211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54c05c36-166f-45f4-b588-08e74e7c2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:38.350652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54c05c36-166f-45f4-b588-08e74e7c2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:38.351444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54c05c36-166f-45f4-b588-08e74e7c2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:38.351872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54c05c36-166f-45f4-b588-08e74e7c2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:38.382274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-54c05c36-166f-45f4-b588-08e74e7c2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045649 Jul 26 18:36:38.382862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 492/961] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:38.749897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d7618688-2302-4274-9157-5f9710e2dd76 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:38.752944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d7618688-2302-4274-9157-5f9710e2dd76 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:38.762867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7618688-2302-4274-9157-5f9710e2dd76 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:38.763616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7618688-2302-4274-9157-5f9710e2dd76 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:38.764751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7618688-2302-4274-9157-5f9710e2dd76 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:38.765414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7618688-2302-4274-9157-5f9710e2dd76 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:38.796059 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d7618688-2302-4274-9157-5f9710e2dd76 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051583 Jul 26 18:36:38.797239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 470/962] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:38 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:38.910314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-79aea6ea-52d1-4c3a-8c0a-c1bfea47bc27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:38.912515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-79aea6ea-52d1-4c3a-8c0a-c1bfea47bc27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:38.919362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79aea6ea-52d1-4c3a-8c0a-c1bfea47bc27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:38.919800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79aea6ea-52d1-4c3a-8c0a-c1bfea47bc27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:38.920528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79aea6ea-52d1-4c3a-8c0a-c1bfea47bc27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:38.920963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79aea6ea-52d1-4c3a-8c0a-c1bfea47bc27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:38.950187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-79aea6ea-52d1-4c3a-8c0a-c1bfea47bc27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045861 Jul 26 18:36:38.950734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 493/963] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:38 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:39.396719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e1c2ed0f-9ecc-42c0-8e26-df9d612ee9b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:39.398819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e1c2ed0f-9ecc-42c0-8e26-df9d612ee9b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:39.405140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1c2ed0f-9ecc-42c0-8e26-df9d612ee9b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:39.405582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1c2ed0f-9ecc-42c0-8e26-df9d612ee9b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:39.406330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1c2ed0f-9ecc-42c0-8e26-df9d612ee9b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:39.406759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1c2ed0f-9ecc-42c0-8e26-df9d612ee9b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:39.438127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e1c2ed0f-9ecc-42c0-8e26-df9d612ee9b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046556 Jul 26 18:36:39.438699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 471/964] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:39.808452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0187b49d-d28b-4da3-9220-70b30ff417e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:39.810534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0187b49d-d28b-4da3-9220-70b30ff417e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:39.817380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0187b49d-d28b-4da3-9220-70b30ff417e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:39.817830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0187b49d-d28b-4da3-9220-70b30ff417e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:39.818588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0187b49d-d28b-4da3-9220-70b30ff417e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:39.819038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0187b49d-d28b-4da3-9220-70b30ff417e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:39.854668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0187b49d-d28b-4da3-9220-70b30ff417e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050014 Jul 26 18:36:39.855342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 494/965] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:39 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:39.964791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1b1e5e4b-7fb3-4cf9-b518-17a7a2cd0be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:39.967783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1b1e5e4b-7fb3-4cf9-b518-17a7a2cd0be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:39.977240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b1e5e4b-7fb3-4cf9-b518-17a7a2cd0be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:39.977830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b1e5e4b-7fb3-4cf9-b518-17a7a2cd0be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:39.978893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b1e5e4b-7fb3-4cf9-b518-17a7a2cd0be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:39.979546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b1e5e4b-7fb3-4cf9-b518-17a7a2cd0be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:40.011070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1b1e5e4b-7fb3-4cf9-b518-17a7a2cd0be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051873 Jul 26 18:36:40.011660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 472/966] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:39 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:40.450306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9cd7c995-63b8-4317-842d-29d31a0cc675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:40.452565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9cd7c995-63b8-4317-842d-29d31a0cc675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:40.459296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9cd7c995-63b8-4317-842d-29d31a0cc675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:40.459740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9cd7c995-63b8-4317-842d-29d31a0cc675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:40.460527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9cd7c995-63b8-4317-842d-29d31a0cc675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:40.460960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9cd7c995-63b8-4317-842d-29d31a0cc675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:40.492539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9cd7c995-63b8-4317-842d-29d31a0cc675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046227 Jul 26 18:36:40.493462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 495/967] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:40 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:40.873762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6b670492-b9c8-49ec-bdd2-e4208a2f5d1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:40.876433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6b670492-b9c8-49ec-bdd2-e4208a2f5d1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:40.885920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b670492-b9c8-49ec-bdd2-e4208a2f5d1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:40.886368 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b670492-b9c8-49ec-bdd2-e4208a2f5d1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:40.887540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b670492-b9c8-49ec-bdd2-e4208a2f5d1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:40.888118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b670492-b9c8-49ec-bdd2-e4208a2f5d1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:40.927806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6b670492-b9c8-49ec-bdd2-e4208a2f5d1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060901 Jul 26 18:36:40.928363 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 473/968] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:40 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:41.025082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d8c0631d-389c-4ebd-968f-2864b8319c1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:41.027577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d8c0631d-389c-4ebd-968f-2864b8319c1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:41.034725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8c0631d-389c-4ebd-968f-2864b8319c1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:41.035203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8c0631d-389c-4ebd-968f-2864b8319c1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:41.035959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8c0631d-389c-4ebd-968f-2864b8319c1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:41.036389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8c0631d-389c-4ebd-968f-2864b8319c1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:41.067136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d8c0631d-389c-4ebd-968f-2864b8319c1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046882 Jul 26 18:36:41.067681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 496/969] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:41 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:41.504606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ffbff55c-99ff-48e8-94ae-d8abfc67ebe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:41.506743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ffbff55c-99ff-48e8-94ae-d8abfc67ebe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:41.513683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffbff55c-99ff-48e8-94ae-d8abfc67ebe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:41.514128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffbff55c-99ff-48e8-94ae-d8abfc67ebe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:41.514899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffbff55c-99ff-48e8-94ae-d8abfc67ebe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:41.515369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffbff55c-99ff-48e8-94ae-d8abfc67ebe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:41.545365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ffbff55c-99ff-48e8-94ae-d8abfc67ebe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044661 Jul 26 18:36:41.545965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 474/970] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:41 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:41.941457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2f8c66fa-f6d3-4fbd-945e-3e265d2caac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:41.943659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2f8c66fa-f6d3-4fbd-945e-3e265d2caac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:41.950811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f8c66fa-f6d3-4fbd-945e-3e265d2caac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:41.951316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f8c66fa-f6d3-4fbd-945e-3e265d2caac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:41.952122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f8c66fa-f6d3-4fbd-945e-3e265d2caac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:41.952574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f8c66fa-f6d3-4fbd-945e-3e265d2caac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:41.983492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2f8c66fa-f6d3-4fbd-945e-3e265d2caac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046351 Jul 26 18:36:41.984058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 497/971] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:41 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:42.080032 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ed78586e-76b9-41fc-a9fa-6da9806f9d03 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:42.082468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ed78586e-76b9-41fc-a9fa-6da9806f9d03 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:42.090250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed78586e-76b9-41fc-a9fa-6da9806f9d03 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:42.090737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed78586e-76b9-41fc-a9fa-6da9806f9d03 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:42.091608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed78586e-76b9-41fc-a9fa-6da9806f9d03 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:42.092077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed78586e-76b9-41fc-a9fa-6da9806f9d03 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:42.121967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ed78586e-76b9-41fc-a9fa-6da9806f9d03 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046466 Jul 26 18:36:42.122522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 475/972] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:42 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:42.558808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-941fcc82-b260-426f-a915-eb470caf3cd0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:42.561704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-941fcc82-b260-426f-a915-eb470caf3cd0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:42.568072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-941fcc82-b260-426f-a915-eb470caf3cd0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:42.568515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-941fcc82-b260-426f-a915-eb470caf3cd0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:42.569267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-941fcc82-b260-426f-a915-eb470caf3cd0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:42.569694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-941fcc82-b260-426f-a915-eb470caf3cd0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:42.599518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-941fcc82-b260-426f-a915-eb470caf3cd0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044722 Jul 26 18:36:42.600101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 498/973] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:42.996296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d9f8c360-0638-4f92-bf66-1bd7d4dadf3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:42.998437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d9f8c360-0638-4f92-bf66-1bd7d4dadf3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:43.005420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9f8c360-0638-4f92-bf66-1bd7d4dadf3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:43.005875 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9f8c360-0638-4f92-bf66-1bd7d4dadf3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:43.006638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9f8c360-0638-4f92-bf66-1bd7d4dadf3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:43.007103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9f8c360-0638-4f92-bf66-1bd7d4dadf3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:43.037150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d9f8c360-0638-4f92-bf66-1bd7d4dadf3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Jul 26 18:36:43.037712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 476/974] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:42 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:43.134930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a84224db-f059-4b43-bba6-a396a4aa0eed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:43.137509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a84224db-f059-4b43-bba6-a396a4aa0eed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:43.145598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a84224db-f059-4b43-bba6-a396a4aa0eed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:43.146069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a84224db-f059-4b43-bba6-a396a4aa0eed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:43.146846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a84224db-f059-4b43-bba6-a396a4aa0eed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:43.147312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a84224db-f059-4b43-bba6-a396a4aa0eed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:43.182694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a84224db-f059-4b43-bba6-a396a4aa0eed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052455 Jul 26 18:36:43.183633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 499/975] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:43 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:43.616402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-caa361a0-feda-4f24-b253-57d048714f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:43.618494 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-caa361a0-feda-4f24-b253-57d048714f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:43.628458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-caa361a0-feda-4f24-b253-57d048714f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:43.628949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-caa361a0-feda-4f24-b253-57d048714f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:43.629734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-caa361a0-feda-4f24-b253-57d048714f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:43.630165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-caa361a0-feda-4f24-b253-57d048714f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:43.662587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-caa361a0-feda-4f24-b253-57d048714f42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051559 Jul 26 18:36:43.663163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 477/976] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:44.052362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b1dc437c-0ecd-498a-a2a7-378260efff17 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:44.055359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b1dc437c-0ecd-498a-a2a7-378260efff17 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:44.064170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1dc437c-0ecd-498a-a2a7-378260efff17 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:44.064766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1dc437c-0ecd-498a-a2a7-378260efff17 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:44.065872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1dc437c-0ecd-498a-a2a7-378260efff17 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:44.066481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1dc437c-0ecd-498a-a2a7-378260efff17 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:44.096528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b1dc437c-0ecd-498a-a2a7-378260efff17 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050192 Jul 26 18:36:44.098386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 500/977] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:44 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:44.195782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b26354e0-83ff-4285-8971-bc1c2099cff3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:44.197950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b26354e0-83ff-4285-8971-bc1c2099cff3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:44.204803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b26354e0-83ff-4285-8971-bc1c2099cff3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:44.205248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b26354e0-83ff-4285-8971-bc1c2099cff3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:44.206001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b26354e0-83ff-4285-8971-bc1c2099cff3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:44.206427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b26354e0-83ff-4285-8971-bc1c2099cff3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:44.239067 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b26354e0-83ff-4285-8971-bc1c2099cff3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046850 Jul 26 18:36:44.239891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 478/978] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:44 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:44.675487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-25eeb700-ac5c-4d3c-890b-68e76084d688 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:44.677827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-25eeb700-ac5c-4d3c-890b-68e76084d688 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:44.685314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25eeb700-ac5c-4d3c-890b-68e76084d688 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:44.685753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25eeb700-ac5c-4d3c-890b-68e76084d688 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:44.686515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25eeb700-ac5c-4d3c-890b-68e76084d688 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:44.686926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25eeb700-ac5c-4d3c-890b-68e76084d688 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:44.717867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-25eeb700-ac5c-4d3c-890b-68e76084d688 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046572 Jul 26 18:36:44.718427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 501/979] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:44 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:45.110330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2d4ad981-eb8e-4907-984b-90086953062e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:45.112612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2d4ad981-eb8e-4907-984b-90086953062e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:45.120723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d4ad981-eb8e-4907-984b-90086953062e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:45.121217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d4ad981-eb8e-4907-984b-90086953062e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:45.122027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d4ad981-eb8e-4907-984b-90086953062e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:45.122468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d4ad981-eb8e-4907-984b-90086953062e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:45.152764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2d4ad981-eb8e-4907-984b-90086953062e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046599 Jul 26 18:36:45.153303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 479/980] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:45 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:45.252135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7371839d-cce0-41cc-965b-3b947bfca8cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:45.254335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7371839d-cce0-41cc-965b-3b947bfca8cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:45.260871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7371839d-cce0-41cc-965b-3b947bfca8cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:45.261317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7371839d-cce0-41cc-965b-3b947bfca8cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:45.262095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7371839d-cce0-41cc-965b-3b947bfca8cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:45.262525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7371839d-cce0-41cc-965b-3b947bfca8cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:45.292486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7371839d-cce0-41cc-965b-3b947bfca8cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044494 Jul 26 18:36:45.293125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 502/981] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:45 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:45.731790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-62af8a34-546a-4858-93ce-c24b413e9348 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:45.734452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-62af8a34-546a-4858-93ce-c24b413e9348 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:45.742753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62af8a34-546a-4858-93ce-c24b413e9348 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:45.743350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62af8a34-546a-4858-93ce-c24b413e9348 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:45.744322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62af8a34-546a-4858-93ce-c24b413e9348 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:45.744868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62af8a34-546a-4858-93ce-c24b413e9348 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:45.776834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-62af8a34-546a-4858-93ce-c24b413e9348 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049998 Jul 26 18:36:45.777716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 480/982] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:46.166047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1680a628-0baa-4b09-895d-db9a5c9ab9e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:46.168272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1680a628-0baa-4b09-895d-db9a5c9ab9e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:46.176063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1680a628-0baa-4b09-895d-db9a5c9ab9e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:46.176507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1680a628-0baa-4b09-895d-db9a5c9ab9e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:46.177263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1680a628-0baa-4b09-895d-db9a5c9ab9e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:46.177693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1680a628-0baa-4b09-895d-db9a5c9ab9e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:46.207845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1680a628-0baa-4b09-895d-db9a5c9ab9e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046117 Jul 26 18:36:46.208439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 503/983] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:46 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:46.307433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6dc0b9c8-8250-4ccd-8e5c-5258e70bbfd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:46.310310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6dc0b9c8-8250-4ccd-8e5c-5258e70bbfd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:46.318566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6dc0b9c8-8250-4ccd-8e5c-5258e70bbfd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:46.319006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6dc0b9c8-8250-4ccd-8e5c-5258e70bbfd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:46.319789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6dc0b9c8-8250-4ccd-8e5c-5258e70bbfd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:46.320216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6dc0b9c8-8250-4ccd-8e5c-5258e70bbfd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:46.352958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6dc0b9c8-8250-4ccd-8e5c-5258e70bbfd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050740 Jul 26 18:36:46.353538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 481/984] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:46 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:46.792630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8743d59c-4ff1-405d-8517-f5a2710bd6d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:46.795491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8743d59c-4ff1-405d-8517-f5a2710bd6d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:46.803692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8743d59c-4ff1-405d-8517-f5a2710bd6d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:46.804138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8743d59c-4ff1-405d-8517-f5a2710bd6d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:46.804904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8743d59c-4ff1-405d-8517-f5a2710bd6d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:46.805338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8743d59c-4ff1-405d-8517-f5a2710bd6d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:46.836168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8743d59c-4ff1-405d-8517-f5a2710bd6d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048801 Jul 26 18:36:46.836730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 504/985] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:47.223050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d0f84bc1-c03e-4bed-91fd-28e4ac8e8038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:47.225212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d0f84bc1-c03e-4bed-91fd-28e4ac8e8038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:47.227544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=88 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:47.233784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0f84bc1-c03e-4bed-91fd-28e4ac8e8038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:47.234227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0f84bc1-c03e-4bed-91fd-28e4ac8e8038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:47.234990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0f84bc1-c03e-4bed-91fd-28e4ac8e8038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:47.235585 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0f84bc1-c03e-4bed-91fd-28e4ac8e8038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:47.238128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:47.265996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d0f84bc1-c03e-4bed-91fd-28e4ac8e8038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049092 Jul 26 18:36:47.266444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 482/986] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:47 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:47.365652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2bca40f6-d0f3-4b42-96ed-9f2bd70ca6e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:47.367887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2bca40f6-d0f3-4b42-96ed-9f2bd70ca6e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:47.375123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bca40f6-d0f3-4b42-96ed-9f2bd70ca6e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:47.375565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bca40f6-d0f3-4b42-96ed-9f2bd70ca6e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:47.376358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bca40f6-d0f3-4b42-96ed-9f2bd70ca6e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:47.376788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bca40f6-d0f3-4b42-96ed-9f2bd70ca6e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:47.407542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2bca40f6-d0f3-4b42-96ed-9f2bd70ca6e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046145 Jul 26 18:36:47.408100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 505/987] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:47 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:47.849377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9e804ed8-7cf2-4345-aaf0-eedab5103168 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:47.851584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9e804ed8-7cf2-4345-aaf0-eedab5103168 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:47.858176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e804ed8-7cf2-4345-aaf0-eedab5103168 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:47.858623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e804ed8-7cf2-4345-aaf0-eedab5103168 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:47.859443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e804ed8-7cf2-4345-aaf0-eedab5103168 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:47.859875 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e804ed8-7cf2-4345-aaf0-eedab5103168 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:47.889341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9e804ed8-7cf2-4345-aaf0-eedab5103168 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044353 Jul 26 18:36:47.890222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 483/988] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:47 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:48.279844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-49bbd92d-d20b-44f6-8e07-8a7afc0d3cbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:48.281911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-49bbd92d-d20b-44f6-8e07-8a7afc0d3cbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:48.288803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49bbd92d-d20b-44f6-8e07-8a7afc0d3cbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:48.289243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49bbd92d-d20b-44f6-8e07-8a7afc0d3cbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:48.289996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49bbd92d-d20b-44f6-8e07-8a7afc0d3cbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:48.290420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49bbd92d-d20b-44f6-8e07-8a7afc0d3cbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:48.307226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:48.320723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-49bbd92d-d20b-44f6-8e07-8a7afc0d3cbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045142 Jul 26 18:36:48.321308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 506/989] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:48 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:48.422003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1d450374-5093-4afe-bc7f-1952cf50e1d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:48.425443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1d450374-5093-4afe-bc7f-1952cf50e1d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:48.432562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d450374-5093-4afe-bc7f-1952cf50e1d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:48.433002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d450374-5093-4afe-bc7f-1952cf50e1d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:48.433751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d450374-5093-4afe-bc7f-1952cf50e1d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:48.434174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d450374-5093-4afe-bc7f-1952cf50e1d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:48.463656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1d450374-5093-4afe-bc7f-1952cf50e1d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046964 Jul 26 18:36:48.464204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 484/990] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:48 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:48.905220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a4e7ae11-a18c-49ce-b4e4-65575ea09fef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:48.908484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a4e7ae11-a18c-49ce-b4e4-65575ea09fef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:48.918751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4e7ae11-a18c-49ce-b4e4-65575ea09fef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:48.919437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4e7ae11-a18c-49ce-b4e4-65575ea09fef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:48.920642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4e7ae11-a18c-49ce-b4e4-65575ea09fef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:48.921200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4e7ae11-a18c-49ce-b4e4-65575ea09fef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:48.952389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a4e7ae11-a18c-49ce-b4e4-65575ea09fef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053508 Jul 26 18:36:48.952937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 507/991] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:49.336344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-da8823be-5d97-4da6-b75d-160d2d3ea2a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:49.339472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-da8823be-5d97-4da6-b75d-160d2d3ea2a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:49.348569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-da8823be-5d97-4da6-b75d-160d2d3ea2a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:49.349204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-da8823be-5d97-4da6-b75d-160d2d3ea2a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:49.350295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-da8823be-5d97-4da6-b75d-160d2d3ea2a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:49.350731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-da8823be-5d97-4da6-b75d-160d2d3ea2a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:49.387554 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-da8823be-5d97-4da6-b75d-160d2d3ea2a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056866 Jul 26 18:36:49.388180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 485/992] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:49 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:49.477288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-930e036a-434c-46ab-9919-bc6716a4f5aa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:49.479554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-930e036a-434c-46ab-9919-bc6716a4f5aa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:49.486418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-930e036a-434c-46ab-9919-bc6716a4f5aa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:49.486864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-930e036a-434c-46ab-9919-bc6716a4f5aa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:49.487656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-930e036a-434c-46ab-9919-bc6716a4f5aa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:49.488090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-930e036a-434c-46ab-9919-bc6716a4f5aa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:49.518852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-930e036a-434c-46ab-9919-bc6716a4f5aa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045709 Jul 26 18:36:49.519464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 508/993] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:49 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:49.968853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5df77842-ba76-4559-bbab-b5f34be0af74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:49.971874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5df77842-ba76-4559-bbab-b5f34be0af74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:49.982124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5df77842-ba76-4559-bbab-b5f34be0af74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:49.982716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5df77842-ba76-4559-bbab-b5f34be0af74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:49.983830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5df77842-ba76-4559-bbab-b5f34be0af74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:49.984430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5df77842-ba76-4559-bbab-b5f34be0af74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:50.022651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5df77842-ba76-4559-bbab-b5f34be0af74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059640 Jul 26 18:36:50.023261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 486/994] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:49 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:50.400322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dd1e22b2-6643-4fd4-82f1-cbf0386f42b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:50.402415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dd1e22b2-6643-4fd4-82f1-cbf0386f42b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:50.405021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=88 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:50.410770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd1e22b2-6643-4fd4-82f1-cbf0386f42b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:50.411256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd1e22b2-6643-4fd4-82f1-cbf0386f42b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:50.412033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd1e22b2-6643-4fd4-82f1-cbf0386f42b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:50.412447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd1e22b2-6643-4fd4-82f1-cbf0386f42b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:50.443209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dd1e22b2-6643-4fd4-82f1-cbf0386f42b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046854 Jul 26 18:36:50.443743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 509/995] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:50 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:50.532928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9a426a06-0675-41f0-9080-4303b91ccbbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:50.535114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9a426a06-0675-41f0-9080-4303b91ccbbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:50.541314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a426a06-0675-41f0-9080-4303b91ccbbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:50.541752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a426a06-0675-41f0-9080-4303b91ccbbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:50.542507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a426a06-0675-41f0-9080-4303b91ccbbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:50.542933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a426a06-0675-41f0-9080-4303b91ccbbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:50.572593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9a426a06-0675-41f0-9080-4303b91ccbbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043584 Jul 26 18:36:50.573130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 487/996] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:50 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:51.037309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-18deac41-7210-4998-8812-7af8f64f4300 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:51.040574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-18deac41-7210-4998-8812-7af8f64f4300 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:51.048688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18deac41-7210-4998-8812-7af8f64f4300 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:51.049135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18deac41-7210-4998-8812-7af8f64f4300 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:51.049905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18deac41-7210-4998-8812-7af8f64f4300 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:51.050553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18deac41-7210-4998-8812-7af8f64f4300 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:51.085019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-18deac41-7210-4998-8812-7af8f64f4300 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051855 Jul 26 18:36:51.085556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 510/997] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:51.455944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c04ec218-ea29-420b-9c2b-beaca5033916 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:51.458165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c04ec218-ea29-420b-9c2b-beaca5033916 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:51.465208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c04ec218-ea29-420b-9c2b-beaca5033916 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:51.465652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c04ec218-ea29-420b-9c2b-beaca5033916 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:51.466479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c04ec218-ea29-420b-9c2b-beaca5033916 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:51.466906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c04ec218-ea29-420b-9c2b-beaca5033916 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:51.496753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c04ec218-ea29-420b-9c2b-beaca5033916 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044715 Jul 26 18:36:51.497231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 488/998] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:51 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:51.587740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-da44167d-d8bc-4d6e-a6a1-b7310e8db2cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:51.590873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-da44167d-d8bc-4d6e-a6a1-b7310e8db2cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:51.600124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da44167d-d8bc-4d6e-a6a1-b7310e8db2cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:51.601229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da44167d-d8bc-4d6e-a6a1-b7310e8db2cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:51.602024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da44167d-d8bc-4d6e-a6a1-b7310e8db2cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:51.602464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da44167d-d8bc-4d6e-a6a1-b7310e8db2cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:51.632961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-da44167d-d8bc-4d6e-a6a1-b7310e8db2cb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050794 Jul 26 18:36:51.633538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 511/999] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:51 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:52.100780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-20e1d4b6-f845-4f32-b4c7-e5ac4c53f465 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:52.103802 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-20e1d4b6-f845-4f32-b4c7-e5ac4c53f465 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:52.113576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20e1d4b6-f845-4f32-b4c7-e5ac4c53f465 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:52.114021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20e1d4b6-f845-4f32-b4c7-e5ac4c53f465 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:52.114785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20e1d4b6-f845-4f32-b4c7-e5ac4c53f465 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:52.115252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20e1d4b6-f845-4f32-b4c7-e5ac4c53f465 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:52.146784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-20e1d4b6-f845-4f32-b4c7-e5ac4c53f465 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052423 Jul 26 18:36:52.147387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 489/1000] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:52.509730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-38c85d3b-5ded-44f8-b624-880e700cb33a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:52.511973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-38c85d3b-5ded-44f8-b624-880e700cb33a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:52.518628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-38c85d3b-5ded-44f8-b624-880e700cb33a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:52.519049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-38c85d3b-5ded-44f8-b624-880e700cb33a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:52.519846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-38c85d3b-5ded-44f8-b624-880e700cb33a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:52.520623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-38c85d3b-5ded-44f8-b624-880e700cb33a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:52.557858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-38c85d3b-5ded-44f8-b624-880e700cb33a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051904 Jul 26 18:36:52.558772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 512/1001] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:52 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:52.649338 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7b2d9992-f073-46ec-b0fe-501d43d822a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:52.651412 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7b2d9992-f073-46ec-b0fe-501d43d822a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:52.658234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b2d9992-f073-46ec-b0fe-501d43d822a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:52.658679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b2d9992-f073-46ec-b0fe-501d43d822a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:52.659479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b2d9992-f073-46ec-b0fe-501d43d822a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:52.659895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b2d9992-f073-46ec-b0fe-501d43d822a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:52.690597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7b2d9992-f073-46ec-b0fe-501d43d822a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045975 Jul 26 18:36:52.691103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 490/1002] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:52 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:53.159173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9e5d5153-097b-4070-b753-ed47be026997 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:53.161412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9e5d5153-097b-4070-b753-ed47be026997 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:53.168310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e5d5153-097b-4070-b753-ed47be026997 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:53.168755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e5d5153-097b-4070-b753-ed47be026997 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:53.169507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e5d5153-097b-4070-b753-ed47be026997 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:53.169925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e5d5153-097b-4070-b753-ed47be026997 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:53.201755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9e5d5153-097b-4070-b753-ed47be026997 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046612 Jul 26 18:36:53.202332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 513/1003] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:53.570791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2e758c19-8a93-4a05-a997-214df9dd1e8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:53.573174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2e758c19-8a93-4a05-a997-214df9dd1e8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:53.580067 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e758c19-8a93-4a05-a997-214df9dd1e8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:53.580538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e758c19-8a93-4a05-a997-214df9dd1e8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:53.581335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e758c19-8a93-4a05-a997-214df9dd1e8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:53.581776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e758c19-8a93-4a05-a997-214df9dd1e8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:53.611361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2e758c19-8a93-4a05-a997-214df9dd1e8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Jul 26 18:36:53.611914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 491/1004] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:53 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:53.707424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f19590a0-9764-4e89-be13-42d58e47f320 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:53.709625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f19590a0-9764-4e89-be13-42d58e47f320 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:53.716031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f19590a0-9764-4e89-be13-42d58e47f320 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:53.716478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f19590a0-9764-4e89-be13-42d58e47f320 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:53.717247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f19590a0-9764-4e89-be13-42d58e47f320 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:53.717673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f19590a0-9764-4e89-be13-42d58e47f320 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:53.748549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f19590a0-9764-4e89-be13-42d58e47f320 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047102 Jul 26 18:36:53.748849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 514/1005] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:53 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:54.215951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f4c44f4b-9671-4109-8a21-d7783dba6eef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:54.218483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f4c44f4b-9671-4109-8a21-d7783dba6eef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:54.226242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4c44f4b-9671-4109-8a21-d7783dba6eef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:54.226770 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4c44f4b-9671-4109-8a21-d7783dba6eef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:54.227729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4c44f4b-9671-4109-8a21-d7783dba6eef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:54.228227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4c44f4b-9671-4109-8a21-d7783dba6eef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:54.260367 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f4c44f4b-9671-4109-8a21-d7783dba6eef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049134 Jul 26 18:36:54.261082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 492/1006] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:54 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:54.627147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e817fa5d-cfff-40db-a9c6-40bfcf7c20a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:54.629849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e817fa5d-cfff-40db-a9c6-40bfcf7c20a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:54.636746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e817fa5d-cfff-40db-a9c6-40bfcf7c20a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:54.637186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e817fa5d-cfff-40db-a9c6-40bfcf7c20a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:54.637941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e817fa5d-cfff-40db-a9c6-40bfcf7c20a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:54.638358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e817fa5d-cfff-40db-a9c6-40bfcf7c20a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:54.667916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e817fa5d-cfff-40db-a9c6-40bfcf7c20a3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046646 Jul 26 18:36:54.668467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 515/1007] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:54.761556 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aa1ed97e-e60a-4ce9-addb-188d978d74e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:54.763769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aa1ed97e-e60a-4ce9-addb-188d978d74e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:54.770507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa1ed97e-e60a-4ce9-addb-188d978d74e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:54.770953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa1ed97e-e60a-4ce9-addb-188d978d74e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:54.771760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa1ed97e-e60a-4ce9-addb-188d978d74e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:54.772191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa1ed97e-e60a-4ce9-addb-188d978d74e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:54.809890 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aa1ed97e-e60a-4ce9-addb-188d978d74e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052236 Jul 26 18:36:54.810639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 493/1008] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:54 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:55.277409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dbd696be-71e8-4d9a-93cd-528088ebb7c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:55.280330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dbd696be-71e8-4d9a-93cd-528088ebb7c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:55.288447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dbd696be-71e8-4d9a-93cd-528088ebb7c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:55.288898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dbd696be-71e8-4d9a-93cd-528088ebb7c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:55.289667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dbd696be-71e8-4d9a-93cd-528088ebb7c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:55.290098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dbd696be-71e8-4d9a-93cd-528088ebb7c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:55.321522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dbd696be-71e8-4d9a-93cd-528088ebb7c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051550 Jul 26 18:36:55.322082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 516/1009] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:55 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:55.683223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f2f031ac-5bab-44ae-b3ad-484db87e77ae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:55.686042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f2f031ac-5bab-44ae-b3ad-484db87e77ae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:55.694611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2f031ac-5bab-44ae-b3ad-484db87e77ae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:55.695255 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2f031ac-5bab-44ae-b3ad-484db87e77ae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:55.696320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2f031ac-5bab-44ae-b3ad-484db87e77ae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:55.696912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2f031ac-5bab-44ae-b3ad-484db87e77ae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:55.729183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f2f031ac-5bab-44ae-b3ad-484db87e77ae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051372 Jul 26 18:36:55.729741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 494/1010] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:55 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:55.824716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a92b2e89-f5a6-4922-9ac3-2b5bbf4f5e30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:55.827007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a92b2e89-f5a6-4922-9ac3-2b5bbf4f5e30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:55.836254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a92b2e89-f5a6-4922-9ac3-2b5bbf4f5e30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:55.836694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a92b2e89-f5a6-4922-9ac3-2b5bbf4f5e30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:55.837462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a92b2e89-f5a6-4922-9ac3-2b5bbf4f5e30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:55.837888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a92b2e89-f5a6-4922-9ac3-2b5bbf4f5e30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:55.875979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a92b2e89-f5a6-4922-9ac3-2b5bbf4f5e30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056775 Jul 26 18:36:55.876543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 517/1011] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:55 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:56.338545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ac31dd44-0b1f-48f1-b622-6645d4aeb862 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:56.341303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ac31dd44-0b1f-48f1-b622-6645d4aeb862 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:56.348481 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac31dd44-0b1f-48f1-b622-6645d4aeb862 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:56.348930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac31dd44-0b1f-48f1-b622-6645d4aeb862 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:56.349684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac31dd44-0b1f-48f1-b622-6645d4aeb862 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:56.350137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac31dd44-0b1f-48f1-b622-6645d4aeb862 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:56.379333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ac31dd44-0b1f-48f1-b622-6645d4aeb862 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046961 Jul 26 18:36:56.379895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 495/1012] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:56 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:56.749431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4436b715-f78f-4558-8481-271c6f20abfc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:56.752491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4436b715-f78f-4558-8481-271c6f20abfc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:56.760331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4436b715-f78f-4558-8481-271c6f20abfc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:56.760777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4436b715-f78f-4558-8481-271c6f20abfc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:56.761549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4436b715-f78f-4558-8481-271c6f20abfc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:56.761966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4436b715-f78f-4558-8481-271c6f20abfc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:56.793349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4436b715-f78f-4558-8481-271c6f20abfc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052128 Jul 26 18:36:56.793914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 518/1013] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:56 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:56.888772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fe9d68f8-2118-4f85-9e32-c642764d8969 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:56.890836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fe9d68f8-2118-4f85-9e32-c642764d8969 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:56.898080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe9d68f8-2118-4f85-9e32-c642764d8969 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:56.898525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe9d68f8-2118-4f85-9e32-c642764d8969 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:56.899320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe9d68f8-2118-4f85-9e32-c642764d8969 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:56.899747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe9d68f8-2118-4f85-9e32-c642764d8969 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:56.930069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fe9d68f8-2118-4f85-9e32-c642764d8969 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045145 Jul 26 18:36:56.934262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 496/1014] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:56 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:57.392665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0fa85dbe-53fd-4b27-a340-f0ebc86f9169 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:57.394846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0fa85dbe-53fd-4b27-a340-f0ebc86f9169 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:57.402306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0fa85dbe-53fd-4b27-a340-f0ebc86f9169 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:57.402769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0fa85dbe-53fd-4b27-a340-f0ebc86f9169 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:57.403561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0fa85dbe-53fd-4b27-a340-f0ebc86f9169 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:57.403990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0fa85dbe-53fd-4b27-a340-f0ebc86f9169 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:57.435473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0fa85dbe-53fd-4b27-a340-f0ebc86f9169 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046844 Jul 26 18:36:57.436054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 519/1015] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:57 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:57.807200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-86040bc5-ef39-4084-b6d6-3fe6cd11e6ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:57.809365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-86040bc5-ef39-4084-b6d6-3fe6cd11e6ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:57.816109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86040bc5-ef39-4084-b6d6-3fe6cd11e6ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:57.816558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86040bc5-ef39-4084-b6d6-3fe6cd11e6ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:57.817339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86040bc5-ef39-4084-b6d6-3fe6cd11e6ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:57.817918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86040bc5-ef39-4084-b6d6-3fe6cd11e6ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:57.847500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-86040bc5-ef39-4084-b6d6-3fe6cd11e6ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045263 Jul 26 18:36:57.848055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 497/1016] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:57 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:57.946189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9840f05b-0421-4a98-960c-aa751e7f8a1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:57.949188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9840f05b-0421-4a98-960c-aa751e7f8a1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:57.957812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9840f05b-0421-4a98-960c-aa751e7f8a1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:57.958609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9840f05b-0421-4a98-960c-aa751e7f8a1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:57.959406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9840f05b-0421-4a98-960c-aa751e7f8a1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:57.959834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9840f05b-0421-4a98-960c-aa751e7f8a1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:57.991321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9840f05b-0421-4a98-960c-aa751e7f8a1f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050871 Jul 26 18:36:57.991883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 520/1017] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:57 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:58.452202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-487cc697-ddbd-4426-99d6-449ed79b06c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:58.454983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-487cc697-ddbd-4426-99d6-449ed79b06c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:58.464193 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-487cc697-ddbd-4426-99d6-449ed79b06c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:58.464904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-487cc697-ddbd-4426-99d6-449ed79b06c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:58.466285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-487cc697-ddbd-4426-99d6-449ed79b06c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:58.466739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-487cc697-ddbd-4426-99d6-449ed79b06c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:58.501686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:36:58.509292 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-487cc697-ddbd-4426-99d6-449ed79b06c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063943 Jul 26 18:36:58.509861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 498/1018] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:58.860734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bc81d69e-b3f9-4b79-880e-4613c287aa06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:58.862965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bc81d69e-b3f9-4b79-880e-4613c287aa06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:58.869977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc81d69e-b3f9-4b79-880e-4613c287aa06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:58.870423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc81d69e-b3f9-4b79-880e-4613c287aa06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:58.871222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc81d69e-b3f9-4b79-880e-4613c287aa06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:58.871652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc81d69e-b3f9-4b79-880e-4613c287aa06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:58.905322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bc81d69e-b3f9-4b79-880e-4613c287aa06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048110 Jul 26 18:36:58.906545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 521/1019] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:58 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:59.008940 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d88c8b08-435a-40d2-a10f-480b93e57065 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:59.011994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d88c8b08-435a-40d2-a10f-480b93e57065 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:59.022517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d88c8b08-435a-40d2-a10f-480b93e57065 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:59.022967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d88c8b08-435a-40d2-a10f-480b93e57065 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:59.023737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d88c8b08-435a-40d2-a10f-480b93e57065 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:59.024203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d88c8b08-435a-40d2-a10f-480b93e57065 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:59.053360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d88c8b08-435a-40d2-a10f-480b93e57065 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050638 Jul 26 18:36:59.054017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 499/1020] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:59 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:36:59.523069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b1f9a81a-c342-45f3-abaf-ebd17273c51e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:59.525479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b1f9a81a-c342-45f3-abaf-ebd17273c51e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:59.535453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1f9a81a-c342-45f3-abaf-ebd17273c51e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:59.536012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1f9a81a-c342-45f3-abaf-ebd17273c51e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:59.537291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1f9a81a-c342-45f3-abaf-ebd17273c51e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:59.537979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1f9a81a-c342-45f3-abaf-ebd17273c51e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:59.568013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b1f9a81a-c342-45f3-abaf-ebd17273c51e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050089 Jul 26 18:36:59.568544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 522/1021] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:36:59 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:36:59.920923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e15006b0-8900-4eb0-b1fa-8082e3ace80c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:36:59.923064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e15006b0-8900-4eb0-b1fa-8082e3ace80c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:36:59.929628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e15006b0-8900-4eb0-b1fa-8082e3ace80c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:59.930069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e15006b0-8900-4eb0-b1fa-8082e3ace80c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:59.930822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e15006b0-8900-4eb0-b1fa-8082e3ace80c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:36:59.931283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e15006b0-8900-4eb0-b1fa-8082e3ace80c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:36:59.961185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e15006b0-8900-4eb0-b1fa-8082e3ace80c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Jul 26 18:36:59.961730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 500/1022] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:36:59 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:00.067451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-25439f04-251b-4266-a8de-d04bd00672a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:00.069820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-25439f04-251b-4266-a8de-d04bd00672a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:00.077015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25439f04-251b-4266-a8de-d04bd00672a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:00.077465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25439f04-251b-4266-a8de-d04bd00672a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:00.078236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25439f04-251b-4266-a8de-d04bd00672a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:00.078676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25439f04-251b-4266-a8de-d04bd00672a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:00.082410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:00.109279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-25439f04-251b-4266-a8de-d04bd00672a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046768 Jul 26 18:37:00.109847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 523/1023] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:00 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:00.583745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ce0ddf47-1e4e-4adc-bb10-cdbb7bd40cba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:00.586705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ce0ddf47-1e4e-4adc-bb10-cdbb7bd40cba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:00.596607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce0ddf47-1e4e-4adc-bb10-cdbb7bd40cba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:00.597239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce0ddf47-1e4e-4adc-bb10-cdbb7bd40cba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:00.598333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce0ddf47-1e4e-4adc-bb10-cdbb7bd40cba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:00.598950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce0ddf47-1e4e-4adc-bb10-cdbb7bd40cba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:00.630915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ce0ddf47-1e4e-4adc-bb10-cdbb7bd40cba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053044 Jul 26 18:37:00.631609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 501/1024] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:00 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:00.977507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a9738257-1509-48a1-a287-8c2d0632f273 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:00.980969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a9738257-1509-48a1-a287-8c2d0632f273 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:00.990396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9738257-1509-48a1-a287-8c2d0632f273 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:00.990999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9738257-1509-48a1-a287-8c2d0632f273 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:00.992403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9738257-1509-48a1-a287-8c2d0632f273 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:00.992853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9738257-1509-48a1-a287-8c2d0632f273 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:01.023547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a9738257-1509-48a1-a287-8c2d0632f273 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052435 Jul 26 18:37:01.024128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 524/1025] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:00 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:01.124092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-23c31ec5-4e5b-4fac-9d99-46877e574f37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:01.126950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-23c31ec5-4e5b-4fac-9d99-46877e574f37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:01.133531 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23c31ec5-4e5b-4fac-9d99-46877e574f37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:01.133966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23c31ec5-4e5b-4fac-9d99-46877e574f37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:01.134720 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23c31ec5-4e5b-4fac-9d99-46877e574f37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:01.135177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23c31ec5-4e5b-4fac-9d99-46877e574f37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:01.166167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-23c31ec5-4e5b-4fac-9d99-46877e574f37 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047992 Jul 26 18:37:01.166732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 502/1026] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:01 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:01.649084 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a3c48b25-bfe0-4581-829f-e1b9d0a10bd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:01.651303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a3c48b25-bfe0-4581-829f-e1b9d0a10bd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:01.658277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3c48b25-bfe0-4581-829f-e1b9d0a10bd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:01.658721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3c48b25-bfe0-4581-829f-e1b9d0a10bd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:01.659528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3c48b25-bfe0-4581-829f-e1b9d0a10bd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:01.659956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3c48b25-bfe0-4581-829f-e1b9d0a10bd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:01.689119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a3c48b25-bfe0-4581-829f-e1b9d0a10bd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046672 Jul 26 18:37:01.689660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 525/1027] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:01 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:02.036956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e91bca19-2a45-4b26-a580-ee3e4f8e7b97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:02.039139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e91bca19-2a45-4b26-a580-ee3e4f8e7b97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:02.046158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e91bca19-2a45-4b26-a580-ee3e4f8e7b97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:02.046579 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e91bca19-2a45-4b26-a580-ee3e4f8e7b97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:02.047466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e91bca19-2a45-4b26-a580-ee3e4f8e7b97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:02.048087 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e91bca19-2a45-4b26-a580-ee3e4f8e7b97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:02.077607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e91bca19-2a45-4b26-a580-ee3e4f8e7b97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044616 Jul 26 18:37:02.078182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 503/1028] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:02 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:02.179081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bc2008b1-208d-4ece-a10d-84da9a690abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:02.181185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bc2008b1-208d-4ece-a10d-84da9a690abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:02.187821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc2008b1-208d-4ece-a10d-84da9a690abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:02.188259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc2008b1-208d-4ece-a10d-84da9a690abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:02.188998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc2008b1-208d-4ece-a10d-84da9a690abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:02.189420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc2008b1-208d-4ece-a10d-84da9a690abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:02.219844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bc2008b1-208d-4ece-a10d-84da9a690abd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044910 Jul 26 18:37:02.220391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 526/1029] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:02 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:02.702689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f3d15b69-e40b-4795-956e-1694000a106e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:02.704986 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f3d15b69-e40b-4795-956e-1694000a106e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:02.711808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3d15b69-e40b-4795-956e-1694000a106e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:02.712253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3d15b69-e40b-4795-956e-1694000a106e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:02.713017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3d15b69-e40b-4795-956e-1694000a106e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:02.713446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3d15b69-e40b-4795-956e-1694000a106e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:02.743730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f3d15b69-e40b-4795-956e-1694000a106e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045467 Jul 26 18:37:02.744300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 504/1030] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:02 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:03.090674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cfa499ba-0722-419a-97de-1f6a117f13ca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:03.092865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cfa499ba-0722-419a-97de-1f6a117f13ca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:03.099287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfa499ba-0722-419a-97de-1f6a117f13ca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:03.099747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfa499ba-0722-419a-97de-1f6a117f13ca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:03.100489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfa499ba-0722-419a-97de-1f6a117f13ca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:03.100914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfa499ba-0722-419a-97de-1f6a117f13ca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:03.130017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cfa499ba-0722-419a-97de-1f6a117f13ca tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Jul 26 18:37:03.130566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 527/1031] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:03 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:03.233274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8fa6aefc-e6e8-4832-b078-126346332fc9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:03.235462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8fa6aefc-e6e8-4832-b078-126346332fc9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:03.242423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fa6aefc-e6e8-4832-b078-126346332fc9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:03.242850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fa6aefc-e6e8-4832-b078-126346332fc9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:03.243718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fa6aefc-e6e8-4832-b078-126346332fc9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:03.244138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fa6aefc-e6e8-4832-b078-126346332fc9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:03.276174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8fa6aefc-e6e8-4832-b078-126346332fc9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046859 Jul 26 18:37:03.276749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 505/1032] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:03 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:03.760038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5096d291-3e30-467c-aaf6-c142bbd073df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:03.762284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5096d291-3e30-467c-aaf6-c142bbd073df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:03.768819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5096d291-3e30-467c-aaf6-c142bbd073df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:03.769261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5096d291-3e30-467c-aaf6-c142bbd073df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:03.770340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5096d291-3e30-467c-aaf6-c142bbd073df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:03.770791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5096d291-3e30-467c-aaf6-c142bbd073df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:03.801349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5096d291-3e30-467c-aaf6-c142bbd073df tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047790 Jul 26 18:37:03.801907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 528/1033] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:03 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:04.141819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-10eeb28d-b26e-4ca7-b97f-258ab24b5032 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:04.144031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-10eeb28d-b26e-4ca7-b97f-258ab24b5032 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:04.150998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10eeb28d-b26e-4ca7-b97f-258ab24b5032 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:04.151493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10eeb28d-b26e-4ca7-b97f-258ab24b5032 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:04.152252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10eeb28d-b26e-4ca7-b97f-258ab24b5032 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:04.152675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10eeb28d-b26e-4ca7-b97f-258ab24b5032 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:04.182313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-10eeb28d-b26e-4ca7-b97f-258ab24b5032 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044448 Jul 26 18:37:04.182868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 506/1034] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:04 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:04.290493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fa2546c4-4f07-41d2-8dd8-e727b4566744 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:04.292724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fa2546c4-4f07-41d2-8dd8-e727b4566744 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:04.299819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa2546c4-4f07-41d2-8dd8-e727b4566744 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:04.300259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa2546c4-4f07-41d2-8dd8-e727b4566744 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:04.301022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa2546c4-4f07-41d2-8dd8-e727b4566744 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:04.301447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa2546c4-4f07-41d2-8dd8-e727b4566744 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:04.332427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fa2546c4-4f07-41d2-8dd8-e727b4566744 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046433 Jul 26 18:37:04.332983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 529/1035] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:04 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:04.814616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d824165c-2fd0-4237-bb17-430f6b2a40ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:04.816906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d824165c-2fd0-4237-bb17-430f6b2a40ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:04.824164 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d824165c-2fd0-4237-bb17-430f6b2a40ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:04.824610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d824165c-2fd0-4237-bb17-430f6b2a40ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:04.825471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d824165c-2fd0-4237-bb17-430f6b2a40ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:04.825800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d824165c-2fd0-4237-bb17-430f6b2a40ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:04.856571 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d824165c-2fd0-4237-bb17-430f6b2a40ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046185 Jul 26 18:37:04.857125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 507/1036] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:04 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:05.195139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9c538372-68b0-41db-8a2a-d93b33fbb24b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:05.197328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9c538372-68b0-41db-8a2a-d93b33fbb24b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:05.204128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c538372-68b0-41db-8a2a-d93b33fbb24b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:05.204575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c538372-68b0-41db-8a2a-d93b33fbb24b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:05.205341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c538372-68b0-41db-8a2a-d93b33fbb24b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:05.205766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c538372-68b0-41db-8a2a-d93b33fbb24b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:05.235605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9c538372-68b0-41db-8a2a-d93b33fbb24b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Jul 26 18:37:05.236179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 530/1037] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:05 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:05.348792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a4e89b0a-2a26-47ff-82cf-c8aa81973da0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:05.351891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a4e89b0a-2a26-47ff-82cf-c8aa81973da0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:05.361178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4e89b0a-2a26-47ff-82cf-c8aa81973da0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:05.361811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4e89b0a-2a26-47ff-82cf-c8aa81973da0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:05.362898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4e89b0a-2a26-47ff-82cf-c8aa81973da0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:05.363555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4e89b0a-2a26-47ff-82cf-c8aa81973da0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:05.396549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a4e89b0a-2a26-47ff-82cf-c8aa81973da0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054450 Jul 26 18:37:05.397098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 508/1038] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:05 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:05.870642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9ba4986c-a86a-4373-a08b-f67c188d648e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:05.872867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9ba4986c-a86a-4373-a08b-f67c188d648e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:05.880606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ba4986c-a86a-4373-a08b-f67c188d648e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:05.881058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ba4986c-a86a-4373-a08b-f67c188d648e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:05.881814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ba4986c-a86a-4373-a08b-f67c188d648e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:05.882243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ba4986c-a86a-4373-a08b-f67c188d648e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:05.914475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9ba4986c-a86a-4373-a08b-f67c188d648e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047951 Jul 26 18:37:05.915052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 531/1039] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:06.251889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a4e90021-4899-4ccc-bcb0-d74650dbfc07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:06.254180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a4e90021-4899-4ccc-bcb0-d74650dbfc07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:06.262301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4e90021-4899-4ccc-bcb0-d74650dbfc07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:06.262797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4e90021-4899-4ccc-bcb0-d74650dbfc07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:06.263689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4e90021-4899-4ccc-bcb0-d74650dbfc07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:06.264206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4e90021-4899-4ccc-bcb0-d74650dbfc07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:06.303127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a4e90021-4899-4ccc-bcb0-d74650dbfc07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055850 Jul 26 18:37:06.303691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 509/1040] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:06 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:06.410400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-874e8d0e-1e30-445a-9b71-4755f180f10c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:06.412588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-874e8d0e-1e30-445a-9b71-4755f180f10c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:06.419613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-874e8d0e-1e30-445a-9b71-4755f180f10c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:06.420070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-874e8d0e-1e30-445a-9b71-4755f180f10c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:06.421174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-874e8d0e-1e30-445a-9b71-4755f180f10c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:06.421725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-874e8d0e-1e30-445a-9b71-4755f180f10c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:06.455510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-874e8d0e-1e30-445a-9b71-4755f180f10c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049265 Jul 26 18:37:06.456083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 532/1041] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:06 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:06.930505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-965cd288-2b08-4c8b-8155-9b1529584164 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:06.932816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-965cd288-2b08-4c8b-8155-9b1529584164 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:06.939735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-965cd288-2b08-4c8b-8155-9b1529584164 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:06.940205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-965cd288-2b08-4c8b-8155-9b1529584164 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:06.941012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-965cd288-2b08-4c8b-8155-9b1529584164 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:06.941472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-965cd288-2b08-4c8b-8155-9b1529584164 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:06.975718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-965cd288-2b08-4c8b-8155-9b1529584164 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049052 Jul 26 18:37:06.976538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 510/1042] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:06 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:07.318108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-28450181-9806-49f2-ac50-7e227543e9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:07.321191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-28450181-9806-49f2-ac50-7e227543e9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:07.330942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28450181-9806-49f2-ac50-7e227543e9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:07.331440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28450181-9806-49f2-ac50-7e227543e9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:07.332554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28450181-9806-49f2-ac50-7e227543e9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:07.333045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28450181-9806-49f2-ac50-7e227543e9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:07.367104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-28450181-9806-49f2-ac50-7e227543e9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055142 Jul 26 18:37:07.367663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 533/1043] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:07 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:07.471247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a9ddccfa-9815-44bf-bbc6-dceb4a68dc17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:07.474313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a9ddccfa-9815-44bf-bbc6-dceb4a68dc17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:07.484234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a9ddccfa-9815-44bf-bbc6-dceb4a68dc17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:07.484687 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a9ddccfa-9815-44bf-bbc6-dceb4a68dc17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:07.485462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a9ddccfa-9815-44bf-bbc6-dceb4a68dc17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:07.485893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a9ddccfa-9815-44bf-bbc6-dceb4a68dc17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:07.517513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a9ddccfa-9815-44bf-bbc6-dceb4a68dc17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052603 Jul 26 18:37:07.518087 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 511/1044] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:07 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:07.994407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b7882ef7-84cd-4306-89d4-e37d5c8ade9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:07.997904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b7882ef7-84cd-4306-89d4-e37d5c8ade9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:08.004908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7882ef7-84cd-4306-89d4-e37d5c8ade9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:08.005281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7882ef7-84cd-4306-89d4-e37d5c8ade9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:08.006037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7882ef7-84cd-4306-89d4-e37d5c8ade9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:08.006462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7882ef7-84cd-4306-89d4-e37d5c8ade9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:08.037677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b7882ef7-84cd-4306-89d4-e37d5c8ade9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050249 Jul 26 18:37:08.038239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 534/1045] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:08.383627 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8ab47774-9e2e-4780-a7f9-905a680dc109 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:08.386714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8ab47774-9e2e-4780-a7f9-905a680dc109 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:08.394182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ab47774-9e2e-4780-a7f9-905a680dc109 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:08.394626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ab47774-9e2e-4780-a7f9-905a680dc109 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:08.395776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ab47774-9e2e-4780-a7f9-905a680dc109 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:08.396198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ab47774-9e2e-4780-a7f9-905a680dc109 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:08.426014 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8ab47774-9e2e-4780-a7f9-905a680dc109 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048161 Jul 26 18:37:08.426562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 512/1046] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:08 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:08.533583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-899e8a58-2737-4ade-9e88-93cb5be491be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:08.535789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-899e8a58-2737-4ade-9e88-93cb5be491be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:08.543108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-899e8a58-2737-4ade-9e88-93cb5be491be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:08.543588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-899e8a58-2737-4ade-9e88-93cb5be491be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:08.544362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-899e8a58-2737-4ade-9e88-93cb5be491be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:08.544792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-899e8a58-2737-4ade-9e88-93cb5be491be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:08.580481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-899e8a58-2737-4ade-9e88-93cb5be491be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052727 Jul 26 18:37:08.581294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 535/1047] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:08 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:09.051140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-39f7ce09-bb49-4636-a225-8f8d8c5b9010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:09.053285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-39f7ce09-bb49-4636-a225-8f8d8c5b9010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:09.060397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39f7ce09-bb49-4636-a225-8f8d8c5b9010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:09.060768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39f7ce09-bb49-4636-a225-8f8d8c5b9010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:09.061523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39f7ce09-bb49-4636-a225-8f8d8c5b9010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:09.061949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39f7ce09-bb49-4636-a225-8f8d8c5b9010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:09.091680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-39f7ce09-bb49-4636-a225-8f8d8c5b9010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044584 Jul 26 18:37:09.092490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 513/1048] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:09 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:09.440476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d031d7bf-2682-4be9-8e7b-f7a7753d8976 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:09.442659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d031d7bf-2682-4be9-8e7b-f7a7753d8976 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:09.449227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d031d7bf-2682-4be9-8e7b-f7a7753d8976 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:09.449663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d031d7bf-2682-4be9-8e7b-f7a7753d8976 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:09.450419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d031d7bf-2682-4be9-8e7b-f7a7753d8976 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:09.450843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d031d7bf-2682-4be9-8e7b-f7a7753d8976 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:09.481011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d031d7bf-2682-4be9-8e7b-f7a7753d8976 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045381 Jul 26 18:37:09.481578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 536/1049] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:09 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:09.596260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2ff3dfa4-3b5c-45ef-9bdb-6a8f7058cc2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:09.598289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2ff3dfa4-3b5c-45ef-9bdb-6a8f7058cc2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:09.605101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2ff3dfa4-3b5c-45ef-9bdb-6a8f7058cc2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:09.605643 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2ff3dfa4-3b5c-45ef-9bdb-6a8f7058cc2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:09.606439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2ff3dfa4-3b5c-45ef-9bdb-6a8f7058cc2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:09.606883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2ff3dfa4-3b5c-45ef-9bdb-6a8f7058cc2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:09.636772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2ff3dfa4-3b5c-45ef-9bdb-6a8f7058cc2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044718 Jul 26 18:37:09.637335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 514/1050] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:09 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:10.104764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-39238c2e-ac48-46b2-a3f8-742c44c74de0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:10.106948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-39238c2e-ac48-46b2-a3f8-742c44c74de0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:10.114416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39238c2e-ac48-46b2-a3f8-742c44c74de0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:10.114840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39238c2e-ac48-46b2-a3f8-742c44c74de0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:10.115626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39238c2e-ac48-46b2-a3f8-742c44c74de0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:10.116056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39238c2e-ac48-46b2-a3f8-742c44c74de0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:10.148340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-39238c2e-ac48-46b2-a3f8-742c44c74de0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047651 Jul 26 18:37:10.148894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 537/1051] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:10 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:10.494387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b41502a5-cf8b-4ca3-abc2-cd2f4f3cc54f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:10.496624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b41502a5-cf8b-4ca3-abc2-cd2f4f3cc54f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:10.503657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b41502a5-cf8b-4ca3-abc2-cd2f4f3cc54f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:10.504096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b41502a5-cf8b-4ca3-abc2-cd2f4f3cc54f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:10.504848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b41502a5-cf8b-4ca3-abc2-cd2f4f3cc54f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:10.505297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b41502a5-cf8b-4ca3-abc2-cd2f4f3cc54f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:10.519416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:10.537034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b41502a5-cf8b-4ca3-abc2-cd2f4f3cc54f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046608 Jul 26 18:37:10.537614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 515/1052] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:10.650196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-adaeead6-ad88-4084-a342-cd9762f34f51 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:10.652420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-adaeead6-ad88-4084-a342-cd9762f34f51 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:10.658966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-adaeead6-ad88-4084-a342-cd9762f34f51 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:10.659448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-adaeead6-ad88-4084-a342-cd9762f34f51 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:10.660212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-adaeead6-ad88-4084-a342-cd9762f34f51 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:10.660670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-adaeead6-ad88-4084-a342-cd9762f34f51 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:10.691584 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-adaeead6-ad88-4084-a342-cd9762f34f51 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045474 Jul 26 18:37:10.692158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 538/1053] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:10 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:11.165284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d2ef82ef-28ca-4179-9184-2659065861ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:11.168856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d2ef82ef-28ca-4179-9184-2659065861ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:11.178041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2ef82ef-28ca-4179-9184-2659065861ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:11.178489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2ef82ef-28ca-4179-9184-2659065861ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:11.179298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2ef82ef-28ca-4179-9184-2659065861ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:11.180166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2ef82ef-28ca-4179-9184-2659065861ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:11.214498 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d2ef82ef-28ca-4179-9184-2659065861ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055915 Jul 26 18:37:11.215063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 516/1054] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:11.549716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8d2b3675-ade5-4f01-a922-15ce19832254 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:11.551966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8d2b3675-ade5-4f01-a922-15ce19832254 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:11.559225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d2b3675-ade5-4f01-a922-15ce19832254 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:11.559666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d2b3675-ade5-4f01-a922-15ce19832254 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:11.560450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d2b3675-ade5-4f01-a922-15ce19832254 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:11.560877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d2b3675-ade5-4f01-a922-15ce19832254 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:11.592818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:11.597787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8d2b3675-ade5-4f01-a922-15ce19832254 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052220 Jul 26 18:37:11.598350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 539/1055] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:11 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:11.709221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a7ed45c4-2c21-4885-b025-4c3061953bf9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:11.712040 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a7ed45c4-2c21-4885-b025-4c3061953bf9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:11.722427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7ed45c4-2c21-4885-b025-4c3061953bf9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:11.722879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7ed45c4-2c21-4885-b025-4c3061953bf9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:11.723687 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7ed45c4-2c21-4885-b025-4c3061953bf9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:11.724152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7ed45c4-2c21-4885-b025-4c3061953bf9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:11.755221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a7ed45c4-2c21-4885-b025-4c3061953bf9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052467 Jul 26 18:37:11.755792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 517/1056] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:11 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:12.234671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8f4b3993-e996-4a35-8a81-2b67adde9c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:12.237032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8f4b3993-e996-4a35-8a81-2b67adde9c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:12.244196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f4b3993-e996-4a35-8a81-2b67adde9c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:12.244635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f4b3993-e996-4a35-8a81-2b67adde9c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:12.245422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f4b3993-e996-4a35-8a81-2b67adde9c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:12.245849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f4b3993-e996-4a35-8a81-2b67adde9c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:12.280257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8f4b3993-e996-4a35-8a81-2b67adde9c36 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053033 Jul 26 18:37:12.280898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 540/1057] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:12 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:12.614565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f5b2d8a2-d63f-410d-8e61-91eec1b116a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:12.619166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f5b2d8a2-d63f-410d-8e61-91eec1b116a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:12.627782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5b2d8a2-d63f-410d-8e61-91eec1b116a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:12.628231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5b2d8a2-d63f-410d-8e61-91eec1b116a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:12.628989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5b2d8a2-d63f-410d-8e61-91eec1b116a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:12.629422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5b2d8a2-d63f-410d-8e61-91eec1b116a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:12.664974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f5b2d8a2-d63f-410d-8e61-91eec1b116a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057829 Jul 26 18:37:12.665536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 518/1058] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:12 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:12.770842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3f977fc9-491a-4865-8a73-f2e26626030f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:12.774145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3f977fc9-491a-4865-8a73-f2e26626030f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:12.783653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f977fc9-491a-4865-8a73-f2e26626030f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:12.784108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f977fc9-491a-4865-8a73-f2e26626030f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:12.785013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f977fc9-491a-4865-8a73-f2e26626030f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:12.785456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f977fc9-491a-4865-8a73-f2e26626030f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:12.819127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3f977fc9-491a-4865-8a73-f2e26626030f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053891 Jul 26 18:37:12.819708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 541/1059] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:12 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:13.296234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5888d0e1-b652-4211-aaee-d1b0228a514f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:13.299267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5888d0e1-b652-4211-aaee-d1b0228a514f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:13.309017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5888d0e1-b652-4211-aaee-d1b0228a514f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:13.309542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5888d0e1-b652-4211-aaee-d1b0228a514f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:13.310630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5888d0e1-b652-4211-aaee-d1b0228a514f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:13.311174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5888d0e1-b652-4211-aaee-d1b0228a514f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:13.345047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5888d0e1-b652-4211-aaee-d1b0228a514f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055095 Jul 26 18:37:13.345637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 519/1060] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:13.681344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c0580ec9-fb4c-4b00-9acd-366ae623dcf2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:13.684814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c0580ec9-fb4c-4b00-9acd-366ae623dcf2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:13.695376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c0580ec9-fb4c-4b00-9acd-366ae623dcf2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:13.696111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c0580ec9-fb4c-4b00-9acd-366ae623dcf2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:13.697324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c0580ec9-fb4c-4b00-9acd-366ae623dcf2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:13.697983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c0580ec9-fb4c-4b00-9acd-366ae623dcf2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:13.731443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c0580ec9-fb4c-4b00-9acd-366ae623dcf2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056717 Jul 26 18:37:13.731996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 542/1061] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:13.832266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-358b0389-c6a5-4e01-ab2f-c6b68cc98274 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:13.834448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-358b0389-c6a5-4e01-ab2f-c6b68cc98274 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:13.841295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-358b0389-c6a5-4e01-ab2f-c6b68cc98274 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:13.841744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-358b0389-c6a5-4e01-ab2f-c6b68cc98274 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:13.842511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-358b0389-c6a5-4e01-ab2f-c6b68cc98274 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:13.842939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-358b0389-c6a5-4e01-ab2f-c6b68cc98274 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:13.873218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-358b0389-c6a5-4e01-ab2f-c6b68cc98274 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045005 Jul 26 18:37:13.873782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 520/1062] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:13 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:14.292020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:37:14.292215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:37:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:37:14.358556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-eb3121f5-f983-4e49-8299-9740e3d4352d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:14.360754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-eb3121f5-f983-4e49-8299-9740e3d4352d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:14.367630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb3121f5-f983-4e49-8299-9740e3d4352d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:14.368088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb3121f5-f983-4e49-8299-9740e3d4352d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:14.368846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb3121f5-f983-4e49-8299-9740e3d4352d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:14.369274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb3121f5-f983-4e49-8299-9740e3d4352d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:14.400010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-eb3121f5-f983-4e49-8299-9740e3d4352d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045745 Jul 26 18:37:14.400559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 543/1063] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:14 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:14.750110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bda6ac79-6053-48a5-942b-6dbc1a17c599 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:14.753271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bda6ac79-6053-48a5-942b-6dbc1a17c599 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:14.761275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bda6ac79-6053-48a5-942b-6dbc1a17c599 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:14.761723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bda6ac79-6053-48a5-942b-6dbc1a17c599 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:14.762493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bda6ac79-6053-48a5-942b-6dbc1a17c599 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:14.762932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bda6ac79-6053-48a5-942b-6dbc1a17c599 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:14.793532 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bda6ac79-6053-48a5-942b-6dbc1a17c599 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051437 Jul 26 18:37:14.794364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 521/1064] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:14 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:14.888986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-77bdcb6d-13e9-4f43-906b-efcb4cf85f12 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:14.891607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-77bdcb6d-13e9-4f43-906b-efcb4cf85f12 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:14.898804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77bdcb6d-13e9-4f43-906b-efcb4cf85f12 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:14.899300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77bdcb6d-13e9-4f43-906b-efcb4cf85f12 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:14.900060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77bdcb6d-13e9-4f43-906b-efcb4cf85f12 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:14.900540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77bdcb6d-13e9-4f43-906b-efcb4cf85f12 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:14.930850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-77bdcb6d-13e9-4f43-906b-efcb4cf85f12 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047781 Jul 26 18:37:14.931435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 544/1065] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:14 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:15.412216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d40524ba-0cb3-47e2-af62-b3d1fb072b16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:15.414424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d40524ba-0cb3-47e2-af62-b3d1fb072b16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:15.421741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d40524ba-0cb3-47e2-af62-b3d1fb072b16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:15.422182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d40524ba-0cb3-47e2-af62-b3d1fb072b16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:15.423005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d40524ba-0cb3-47e2-af62-b3d1fb072b16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:15.423510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d40524ba-0cb3-47e2-af62-b3d1fb072b16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:15.457445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d40524ba-0cb3-47e2-af62-b3d1fb072b16 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049394 Jul 26 18:37:15.458017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 522/1066] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:15 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:15.810619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-57479a72-cf53-472e-a8fb-b8e790a43ec8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:15.813955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-57479a72-cf53-472e-a8fb-b8e790a43ec8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:15.823014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57479a72-cf53-472e-a8fb-b8e790a43ec8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:15.823489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57479a72-cf53-472e-a8fb-b8e790a43ec8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:15.824263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57479a72-cf53-472e-a8fb-b8e790a43ec8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:15.824697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57479a72-cf53-472e-a8fb-b8e790a43ec8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:15.856947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-57479a72-cf53-472e-a8fb-b8e790a43ec8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052181 Jul 26 18:37:15.857526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 545/1067] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:15 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:15.944646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c07ec386-6378-4a96-8a14-a56becb202c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:15.946882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c07ec386-6378-4a96-8a14-a56becb202c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:15.953646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c07ec386-6378-4a96-8a14-a56becb202c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:15.954098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c07ec386-6378-4a96-8a14-a56becb202c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:15.954886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c07ec386-6378-4a96-8a14-a56becb202c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:15.955343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c07ec386-6378-4a96-8a14-a56becb202c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:15.986852 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c07ec386-6378-4a96-8a14-a56becb202c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046542 Jul 26 18:37:15.987492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 523/1068] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:15 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:37:16.472382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ae981a6b-fde5-419d-baeb-b17b714da672 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:16.475347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ae981a6b-fde5-419d-baeb-b17b714da672 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:16.484562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae981a6b-fde5-419d-baeb-b17b714da672 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:16.485109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae981a6b-fde5-419d-baeb-b17b714da672 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:16.486171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae981a6b-fde5-419d-baeb-b17b714da672 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:16.486694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae981a6b-fde5-419d-baeb-b17b714da672 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:16.516630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ae981a6b-fde5-419d-baeb-b17b714da672 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050823 Jul 26 18:37:16.517189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 546/1069] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:16 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:16.869960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3aba6ec3-7f32-4e33-b348-7699d0c2fd60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:16.872542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3aba6ec3-7f32-4e33-b348-7699d0c2fd60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:16.879704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3aba6ec3-7f32-4e33-b348-7699d0c2fd60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:16.880198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3aba6ec3-7f32-4e33-b348-7699d0c2fd60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:16.881050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3aba6ec3-7f32-4e33-b348-7699d0c2fd60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:16.881597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3aba6ec3-7f32-4e33-b348-7699d0c2fd60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:16.912464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3aba6ec3-7f32-4e33-b348-7699d0c2fd60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046536 Jul 26 18:37:16.913021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 524/1070] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:16 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:17.000615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-61e12e70-40d4-4aa0-a520-74504907d965 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:17.002886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-61e12e70-40d4-4aa0-a520-74504907d965 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:17.010250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61e12e70-40d4-4aa0-a520-74504907d965 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:17.010714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61e12e70-40d4-4aa0-a520-74504907d965 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:17.011577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61e12e70-40d4-4aa0-a520-74504907d965 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:17.011994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61e12e70-40d4-4aa0-a520-74504907d965 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:17.043433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-61e12e70-40d4-4aa0-a520-74504907d965 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047030 Jul 26 18:37:17.043999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 547/1071] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:16 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:17.534551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3f05743f-919c-4c03-af29-3b9b84204448 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:17.537972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3f05743f-919c-4c03-af29-3b9b84204448 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:17.540911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=86 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:17.546970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3f05743f-919c-4c03-af29-3b9b84204448 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:17.547427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3f05743f-919c-4c03-af29-3b9b84204448 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:17.548190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3f05743f-919c-4c03-af29-3b9b84204448 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:17.548617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3f05743f-919c-4c03-af29-3b9b84204448 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:17.732208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3f05743f-919c-4c03-af29-3b9b84204448 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.204697 Jul 26 18:37:17.732772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 525/1072] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:17.926584 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4e7ea6df-9cac-4567-b14d-bf88bfad9338 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:17.929223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4e7ea6df-9cac-4567-b14d-bf88bfad9338 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:17.936403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4e7ea6df-9cac-4567-b14d-bf88bfad9338 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:17.936852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4e7ea6df-9cac-4567-b14d-bf88bfad9338 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:17.937613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4e7ea6df-9cac-4567-b14d-bf88bfad9338 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:17.938040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4e7ea6df-9cac-4567-b14d-bf88bfad9338 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:17.968163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4e7ea6df-9cac-4567-b14d-bf88bfad9338 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046271 Jul 26 18:37:17.968969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 548/1073] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:17 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:18.057515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-86d64440-d78c-4e86-a040-2f4c95228a6c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:18.060644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-86d64440-d78c-4e86-a040-2f4c95228a6c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:18.069450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86d64440-d78c-4e86-a040-2f4c95228a6c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:18.070024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86d64440-d78c-4e86-a040-2f4c95228a6c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:18.071056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86d64440-d78c-4e86-a040-2f4c95228a6c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:18.071510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86d64440-d78c-4e86-a040-2f4c95228a6c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:18.101614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-86d64440-d78c-4e86-a040-2f4c95228a6c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050263 Jul 26 18:37:18.102178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 526/1074] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:18 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:18.746485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4f02aa76-b403-4758-b628-7b4d73bf8566 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:18.749008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4f02aa76-b403-4758-b628-7b4d73bf8566 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:18.755688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f02aa76-b403-4758-b628-7b4d73bf8566 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:18.756144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f02aa76-b403-4758-b628-7b4d73bf8566 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:18.756886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f02aa76-b403-4758-b628-7b4d73bf8566 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:18.757311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f02aa76-b403-4758-b628-7b4d73bf8566 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:18.789306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4f02aa76-b403-4758-b628-7b4d73bf8566 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047034 Jul 26 18:37:18.790012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 549/1075] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:18 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:18.983245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4b86858a-2b51-40ff-87ca-eb205419d2f4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:18.985438 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4b86858a-2b51-40ff-87ca-eb205419d2f4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:18.992764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b86858a-2b51-40ff-87ca-eb205419d2f4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:18.993260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b86858a-2b51-40ff-87ca-eb205419d2f4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:18.994025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b86858a-2b51-40ff-87ca-eb205419d2f4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:18.994448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4b86858a-2b51-40ff-87ca-eb205419d2f4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:19.034724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4b86858a-2b51-40ff-87ca-eb205419d2f4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056030 Jul 26 18:37:19.035443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 527/1076] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:18 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:19.118128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5816691f-a388-492a-b733-424959be1688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:19.120334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5816691f-a388-492a-b733-424959be1688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:19.126806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5816691f-a388-492a-b733-424959be1688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:19.127259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5816691f-a388-492a-b733-424959be1688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:19.128065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5816691f-a388-492a-b733-424959be1688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:19.128490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5816691f-a388-492a-b733-424959be1688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:19.164610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5816691f-a388-492a-b733-424959be1688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051295 Jul 26 18:37:19.165167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 550/1077] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:19 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:19.802250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-87ce2b55-b865-4408-b116-e90098f35eea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:19.804479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-87ce2b55-b865-4408-b116-e90098f35eea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:19.811313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-87ce2b55-b865-4408-b116-e90098f35eea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:19.811759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-87ce2b55-b865-4408-b116-e90098f35eea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:19.812533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-87ce2b55-b865-4408-b116-e90098f35eea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:19.812987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-87ce2b55-b865-4408-b116-e90098f35eea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:19.843234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-87ce2b55-b865-4408-b116-e90098f35eea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045066 Jul 26 18:37:19.843842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 528/1078] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:19 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:20.047938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a7965078-0f2b-4c44-bfe0-4539f3e108b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:20.050081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a7965078-0f2b-4c44-bfe0-4539f3e108b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:20.057091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7965078-0f2b-4c44-bfe0-4539f3e108b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:20.057539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7965078-0f2b-4c44-bfe0-4539f3e108b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:20.058306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7965078-0f2b-4c44-bfe0-4539f3e108b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:20.058736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7965078-0f2b-4c44-bfe0-4539f3e108b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:20.088318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a7965078-0f2b-4c44-bfe0-4539f3e108b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 Jul 26 18:37:20.089123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 551/1079] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:20.179461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-26845fdf-a5b6-4f3c-ac17-5373744daf83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:20.181651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-26845fdf-a5b6-4f3c-ac17-5373744daf83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:20.188492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26845fdf-a5b6-4f3c-ac17-5373744daf83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:20.188931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26845fdf-a5b6-4f3c-ac17-5373744daf83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:20.189685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26845fdf-a5b6-4f3c-ac17-5373744daf83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:20.190109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26845fdf-a5b6-4f3c-ac17-5373744daf83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:20.219700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-26845fdf-a5b6-4f3c-ac17-5373744daf83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044419 Jul 26 18:37:20.220241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 529/1080] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:20 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:20.856536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fd840277-41d2-463d-a08e-cfd0504bfe5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:20.858749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fd840277-41d2-463d-a08e-cfd0504bfe5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:20.860790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=86 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:20.867999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd840277-41d2-463d-a08e-cfd0504bfe5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:20.868451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd840277-41d2-463d-a08e-cfd0504bfe5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:20.869290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd840277-41d2-463d-a08e-cfd0504bfe5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:20.869726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd840277-41d2-463d-a08e-cfd0504bfe5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:20.901482 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fd840277-41d2-463d-a08e-cfd0504bfe5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049082 Jul 26 18:37:20.902072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 552/1081] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:21.103742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4db6b824-f05b-43b4-afca-09316d6fe038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:21.106308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4db6b824-f05b-43b4-afca-09316d6fe038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:21.113617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4db6b824-f05b-43b4-afca-09316d6fe038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:21.114076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4db6b824-f05b-43b4-afca-09316d6fe038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:21.115207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4db6b824-f05b-43b4-afca-09316d6fe038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:21.115830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4db6b824-f05b-43b4-afca-09316d6fe038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:21.151984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4db6b824-f05b-43b4-afca-09316d6fe038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054394 Jul 26 18:37:21.152560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 530/1082] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:21 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:21.232897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e4cc3ccb-19bb-4afa-87fa-dc7439cbe174 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:21.235153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e4cc3ccb-19bb-4afa-87fa-dc7439cbe174 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:21.242037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e4cc3ccb-19bb-4afa-87fa-dc7439cbe174 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:21.242462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e4cc3ccb-19bb-4afa-87fa-dc7439cbe174 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:21.243257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e4cc3ccb-19bb-4afa-87fa-dc7439cbe174 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:21.243685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e4cc3ccb-19bb-4afa-87fa-dc7439cbe174 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:21.274709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e4cc3ccb-19bb-4afa-87fa-dc7439cbe174 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046085 Jul 26 18:37:21.275209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 553/1083] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:21 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:21.917297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-82d21f83-2913-4ef3-a4cc-e20adb4779c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:21.919536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-82d21f83-2913-4ef3-a4cc-e20adb4779c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:21.926563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-82d21f83-2913-4ef3-a4cc-e20adb4779c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:21.927002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-82d21f83-2913-4ef3-a4cc-e20adb4779c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:21.927787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-82d21f83-2913-4ef3-a4cc-e20adb4779c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:21.928213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-82d21f83-2913-4ef3-a4cc-e20adb4779c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:21.958857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-82d21f83-2913-4ef3-a4cc-e20adb4779c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047607 Jul 26 18:37:21.959433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 531/1084] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:21 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:22.165367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-427c123d-1c3f-4a8f-924f-9faa87a82d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:22.167610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-427c123d-1c3f-4a8f-924f-9faa87a82d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:22.175857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-427c123d-1c3f-4a8f-924f-9faa87a82d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:22.176318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-427c123d-1c3f-4a8f-924f-9faa87a82d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:22.177411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-427c123d-1c3f-4a8f-924f-9faa87a82d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:22.177925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-427c123d-1c3f-4a8f-924f-9faa87a82d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:22.208187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-427c123d-1c3f-4a8f-924f-9faa87a82d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046807 Jul 26 18:37:22.208760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 554/1085] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:22 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:22.288009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fe05ba52-4f03-4971-acbd-9b426af536be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:22.290353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fe05ba52-4f03-4971-acbd-9b426af536be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:22.297906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe05ba52-4f03-4971-acbd-9b426af536be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:22.298299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe05ba52-4f03-4971-acbd-9b426af536be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:22.299181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe05ba52-4f03-4971-acbd-9b426af536be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:22.299660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe05ba52-4f03-4971-acbd-9b426af536be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:22.302547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:22.334373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fe05ba52-4f03-4971-acbd-9b426af536be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050707 Jul 26 18:37:22.334945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 532/1086] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:22 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:22.416427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:37:22.416716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:37:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:37:22.544791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-205838bd-7542-473b-a697-768b48a78996 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:22.545282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-205838bd-7542-473b-a697-768b48a78996 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:22.552314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-205838bd-7542-473b-a697-768b48a78996 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:22.552687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-205838bd-7542-473b-a697-768b48a78996 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:22.553439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-205838bd-7542-473b-a697-768b48a78996 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:22.553871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-205838bd-7542-473b-a697-768b48a78996 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:22.639989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.objects.instance [None req-205838bd-7542-473b-a697-768b48a78996 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lazy-loading 'services' on Instance uuid e26b67fc-cc0a-41a7-8568-17f2eed10fb2 {{(pid=117996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:37:22.703782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:22.716747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-205838bd-7542-473b-a697-768b48a78996 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments/10218421-3bb4-4126-9d73-6f8dce3b9092" status: 202 len: 0 microversion: 2.1 time: 0.177288 Jul 26 18:37:22.717332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 555/1087] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Jul 26 18:37:22 2022] DELETE /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments/10218421-3bb4-4126-9d73-6f8dce3b9092 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:37:22.726325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4d3c54c7-5b9b-45d2-a77b-5fa637ca7ab4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:22.728541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4d3c54c7-5b9b-45d2-a77b-5fa637ca7ab4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:22.735063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d3c54c7-5b9b-45d2-a77b-5fa637ca7ab4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:22.735527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d3c54c7-5b9b-45d2-a77b-5fa637ca7ab4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:22.736339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d3c54c7-5b9b-45d2-a77b-5fa637ca7ab4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:22.736751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d3c54c7-5b9b-45d2-a77b-5fa637ca7ab4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:22.767629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4d3c54c7-5b9b-45d2-a77b-5fa637ca7ab4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045530 Jul 26 18:37:22.768190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 533/1088] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:22.972427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-13780d93-e7ae-4b81-97ca-f04f59e3d377 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:22.974782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-13780d93-e7ae-4b81-97ca-f04f59e3d377 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:22.981669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-13780d93-e7ae-4b81-97ca-f04f59e3d377 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:22.982108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-13780d93-e7ae-4b81-97ca-f04f59e3d377 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:22.982904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-13780d93-e7ae-4b81-97ca-f04f59e3d377 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:22.983360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-13780d93-e7ae-4b81-97ca-f04f59e3d377 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:23.015866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-13780d93-e7ae-4b81-97ca-f04f59e3d377 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047352 Jul 26 18:37:23.016499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 556/1089] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:22 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:23.224549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b7246431-382e-4264-8178-d5f93ea4988d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:23.227884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b7246431-382e-4264-8178-d5f93ea4988d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:23.236272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7246431-382e-4264-8178-d5f93ea4988d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:23.236897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7246431-382e-4264-8178-d5f93ea4988d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:23.237969 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7246431-382e-4264-8178-d5f93ea4988d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:23.238547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7246431-382e-4264-8178-d5f93ea4988d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:23.269008 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b7246431-382e-4264-8178-d5f93ea4988d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050847 Jul 26 18:37:23.269563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 534/1090] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:23 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:23.348339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0d2f65cc-306c-4245-88c4-0ea270c851b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:23.350591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0d2f65cc-306c-4245-88c4-0ea270c851b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:23.357183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d2f65cc-306c-4245-88c4-0ea270c851b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:23.357567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d2f65cc-306c-4245-88c4-0ea270c851b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:23.358318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d2f65cc-306c-4245-88c4-0ea270c851b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:23.358748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d2f65cc-306c-4245-88c4-0ea270c851b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:23.387989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0d2f65cc-306c-4245-88c4-0ea270c851b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Jul 26 18:37:23.388558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 557/1091] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:23 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:23.781182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bf02cb87-e6da-452b-921e-df7834181501 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:23.783428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bf02cb87-e6da-452b-921e-df7834181501 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:23.790143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf02cb87-e6da-452b-921e-df7834181501 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:23.790588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf02cb87-e6da-452b-921e-df7834181501 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:23.791422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf02cb87-e6da-452b-921e-df7834181501 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:23.791853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bf02cb87-e6da-452b-921e-df7834181501 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:23.823480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bf02cb87-e6da-452b-921e-df7834181501 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046436 Jul 26 18:37:23.824037 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 535/1092] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:23 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:24.032197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-863a8443-0d6a-4e38-9265-ba3818fddc9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:24.034748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-863a8443-0d6a-4e38-9265-ba3818fddc9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:24.043314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-863a8443-0d6a-4e38-9265-ba3818fddc9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:24.043756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-863a8443-0d6a-4e38-9265-ba3818fddc9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:24.044520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-863a8443-0d6a-4e38-9265-ba3818fddc9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:24.044948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-863a8443-0d6a-4e38-9265-ba3818fddc9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:24.074055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-863a8443-0d6a-4e38-9265-ba3818fddc9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046980 Jul 26 18:37:24.074706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 558/1093] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:24.282859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6df3139a-722a-4013-abe3-cf19869951aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:24.284970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6df3139a-722a-4013-abe3-cf19869951aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:24.292054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6df3139a-722a-4013-abe3-cf19869951aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:24.292503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6df3139a-722a-4013-abe3-cf19869951aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:24.293303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6df3139a-722a-4013-abe3-cf19869951aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:24.293752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6df3139a-722a-4013-abe3-cf19869951aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:24.322742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6df3139a-722a-4013-abe3-cf19869951aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Jul 26 18:37:24.323317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 536/1094] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:24 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:24.404145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5f32d79f-dbb6-4d17-b0fc-05afae896ab3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:24.406367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5f32d79f-dbb6-4d17-b0fc-05afae896ab3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:24.413062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f32d79f-dbb6-4d17-b0fc-05afae896ab3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:24.413511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f32d79f-dbb6-4d17-b0fc-05afae896ab3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:24.414283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f32d79f-dbb6-4d17-b0fc-05afae896ab3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:24.414721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f32d79f-dbb6-4d17-b0fc-05afae896ab3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:24.445316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5f32d79f-dbb6-4d17-b0fc-05afae896ab3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046571 Jul 26 18:37:24.445877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 559/1095] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:24 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:24.838609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9b8f77a4-4e24-4667-ac73-f5253ce50be7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:24.841184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9b8f77a4-4e24-4667-ac73-f5253ce50be7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:24.848480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b8f77a4-4e24-4667-ac73-f5253ce50be7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:24.848996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b8f77a4-4e24-4667-ac73-f5253ce50be7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:24.849912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b8f77a4-4e24-4667-ac73-f5253ce50be7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:24.850196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b8f77a4-4e24-4667-ac73-f5253ce50be7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:24.883204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9b8f77a4-4e24-4667-ac73-f5253ce50be7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049081 Jul 26 18:37:24.883749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 537/1096] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:24 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:25.089293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9f696530-c707-49b5-a950-8de7c6a5fa89 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:25.091637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9f696530-c707-49b5-a950-8de7c6a5fa89 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:25.098548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9f696530-c707-49b5-a950-8de7c6a5fa89 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:25.098989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9f696530-c707-49b5-a950-8de7c6a5fa89 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:25.099776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9f696530-c707-49b5-a950-8de7c6a5fa89 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:25.100207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9f696530-c707-49b5-a950-8de7c6a5fa89 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:25.131100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9f696530-c707-49b5-a950-8de7c6a5fa89 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047419 Jul 26 18:37:25.131658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 560/1097] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:25.334662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f33cbdce-ddf9-4b41-be3f-79e12ea82148 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:25.336839 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f33cbdce-ddf9-4b41-be3f-79e12ea82148 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:25.343897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f33cbdce-ddf9-4b41-be3f-79e12ea82148 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:25.344257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f33cbdce-ddf9-4b41-be3f-79e12ea82148 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:25.345012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f33cbdce-ddf9-4b41-be3f-79e12ea82148 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:25.345541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f33cbdce-ddf9-4b41-be3f-79e12ea82148 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:25.376240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f33cbdce-ddf9-4b41-be3f-79e12ea82148 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045540 Jul 26 18:37:25.376812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 538/1098] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:25 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:25.462635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1a0b591b-a8db-4744-b86b-ea8328fab466 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:25.465369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1a0b591b-a8db-4744-b86b-ea8328fab466 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:25.473362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a0b591b-a8db-4744-b86b-ea8328fab466 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:25.473810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a0b591b-a8db-4744-b86b-ea8328fab466 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:25.474792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a0b591b-a8db-4744-b86b-ea8328fab466 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:25.475356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a0b591b-a8db-4744-b86b-ea8328fab466 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:25.506316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1a0b591b-a8db-4744-b86b-ea8328fab466 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049869 Jul 26 18:37:25.506874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 561/1099] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:25 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:25.902985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-914ccc53-ea59-45ba-8e13-efbae0fcb21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:25.905155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-914ccc53-ea59-45ba-8e13-efbae0fcb21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:25.912054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-914ccc53-ea59-45ba-8e13-efbae0fcb21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:25.912503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-914ccc53-ea59-45ba-8e13-efbae0fcb21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:25.913264 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-914ccc53-ea59-45ba-8e13-efbae0fcb21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:25.913691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-914ccc53-ea59-45ba-8e13-efbae0fcb21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:25.952758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-914ccc53-ea59-45ba-8e13-efbae0fcb21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055500 Jul 26 18:37:25.953509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 539/1100] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:25 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:26.147763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0e2f0309-db7b-489e-94d3-f186c3bc317c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:26.150838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0e2f0309-db7b-489e-94d3-f186c3bc317c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:26.158358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e2f0309-db7b-489e-94d3-f186c3bc317c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:26.158803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e2f0309-db7b-489e-94d3-f186c3bc317c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:26.159602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e2f0309-db7b-489e-94d3-f186c3bc317c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:26.160036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e2f0309-db7b-489e-94d3-f186c3bc317c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:26.191904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0e2f0309-db7b-489e-94d3-f186c3bc317c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050993 Jul 26 18:37:26.192467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 562/1101] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:26.388487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b08853ce-6d05-4c56-af47-8956929bcb41 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:26.390630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b08853ce-6d05-4c56-af47-8956929bcb41 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:26.399676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b08853ce-6d05-4c56-af47-8956929bcb41 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:26.400224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b08853ce-6d05-4c56-af47-8956929bcb41 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:26.401392 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b08853ce-6d05-4c56-af47-8956929bcb41 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:26.402065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b08853ce-6d05-4c56-af47-8956929bcb41 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:26.437819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b08853ce-6d05-4c56-af47-8956929bcb41 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053212 Jul 26 18:37:26.438376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 540/1102] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:26 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:26.522742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-028814a1-a5a8-4178-9b13-377b3bec0c86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:26.526172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-028814a1-a5a8-4178-9b13-377b3bec0c86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:26.536965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-028814a1-a5a8-4178-9b13-377b3bec0c86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:26.537696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-028814a1-a5a8-4178-9b13-377b3bec0c86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:26.538872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-028814a1-a5a8-4178-9b13-377b3bec0c86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:26.539640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-028814a1-a5a8-4178-9b13-377b3bec0c86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:26.570875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-028814a1-a5a8-4178-9b13-377b3bec0c86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055039 Jul 26 18:37:26.571472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 563/1103] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:26 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:26.968901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3b6a0122-5fea-4436-9e65-ae1668da3c60 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:26.972349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3b6a0122-5fea-4436-9e65-ae1668da3c60 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:26.981857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b6a0122-5fea-4436-9e65-ae1668da3c60 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:26.982300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b6a0122-5fea-4436-9e65-ae1668da3c60 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:26.983067 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b6a0122-5fea-4436-9e65-ae1668da3c60 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:26.983519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b6a0122-5fea-4436-9e65-ae1668da3c60 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:27.013860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3b6a0122-5fea-4436-9e65-ae1668da3c60 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051460 Jul 26 18:37:27.014328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 541/1104] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:26 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:27.204829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9095255a-ae81-4889-ac2e-e90e3c788f08 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:27.206989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9095255a-ae81-4889-ac2e-e90e3c788f08 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:27.214482 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9095255a-ae81-4889-ac2e-e90e3c788f08 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:27.214931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9095255a-ae81-4889-ac2e-e90e3c788f08 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:27.215730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9095255a-ae81-4889-ac2e-e90e3c788f08 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:27.216163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9095255a-ae81-4889-ac2e-e90e3c788f08 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:27.246526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9095255a-ae81-4889-ac2e-e90e3c788f08 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045781 Jul 26 18:37:27.247088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 564/1105] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:27 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:27.450135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-95aba17f-f91b-4898-a069-25ffb39bcb50 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:27.452413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-95aba17f-f91b-4898-a069-25ffb39bcb50 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:27.458691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95aba17f-f91b-4898-a069-25ffb39bcb50 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:27.459167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95aba17f-f91b-4898-a069-25ffb39bcb50 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:27.459934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95aba17f-f91b-4898-a069-25ffb39bcb50 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:27.460367 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95aba17f-f91b-4898-a069-25ffb39bcb50 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:27.488927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-95aba17f-f91b-4898-a069-25ffb39bcb50 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042774 Jul 26 18:37:27.489481 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 542/1106] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:27.583776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4a15bfb2-bc3c-407b-8499-2f0e759b9958 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:27.585951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4a15bfb2-bc3c-407b-8499-2f0e759b9958 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:27.592442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a15bfb2-bc3c-407b-8499-2f0e759b9958 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:27.592912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a15bfb2-bc3c-407b-8499-2f0e759b9958 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:27.593667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a15bfb2-bc3c-407b-8499-2f0e759b9958 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:27.594102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a15bfb2-bc3c-407b-8499-2f0e759b9958 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:27.623640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4a15bfb2-bc3c-407b-8499-2f0e759b9958 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043690 Jul 26 18:37:27.624104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 565/1107] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:27 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:28.026442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-633e0acc-e648-41e4-ac16-e8e81a4182ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:28.028678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-633e0acc-e648-41e4-ac16-e8e81a4182ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:28.035351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-633e0acc-e648-41e4-ac16-e8e81a4182ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:28.035791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-633e0acc-e648-41e4-ac16-e8e81a4182ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:28.036546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-633e0acc-e648-41e4-ac16-e8e81a4182ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:28.036971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-633e0acc-e648-41e4-ac16-e8e81a4182ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:28.067044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-633e0acc-e648-41e4-ac16-e8e81a4182ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 Jul 26 18:37:28.067597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 543/1108] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:28 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:28.261758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a4ed8415-ad4c-4845-ab65-2055f73961a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:28.265128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a4ed8415-ad4c-4845-ab65-2055f73961a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:28.275857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4ed8415-ad4c-4845-ab65-2055f73961a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:28.276547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4ed8415-ad4c-4845-ab65-2055f73961a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:28.277647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4ed8415-ad4c-4845-ab65-2055f73961a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:28.278109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4ed8415-ad4c-4845-ab65-2055f73961a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:28.309810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a4ed8415-ad4c-4845-ab65-2055f73961a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054675 Jul 26 18:37:28.310353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 566/1109] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:28.501475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1afe9950-48ba-4067-abd2-849de607e5ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:28.503667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1afe9950-48ba-4067-abd2-849de607e5ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:28.510289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1afe9950-48ba-4067-abd2-849de607e5ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:28.510734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1afe9950-48ba-4067-abd2-849de607e5ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:28.511528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1afe9950-48ba-4067-abd2-849de607e5ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:28.511998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1afe9950-48ba-4067-abd2-849de607e5ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:28.549333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1afe9950-48ba-4067-abd2-849de607e5ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051657 Jul 26 18:37:28.550216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 544/1110] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:28 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:28.638751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-30ea50d9-9710-4298-817b-21b671133c4f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:28.640967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-30ea50d9-9710-4298-817b-21b671133c4f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:28.647938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30ea50d9-9710-4298-817b-21b671133c4f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:28.648385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30ea50d9-9710-4298-817b-21b671133c4f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:28.649154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30ea50d9-9710-4298-817b-21b671133c4f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:28.649587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30ea50d9-9710-4298-817b-21b671133c4f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:28.679473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-30ea50d9-9710-4298-817b-21b671133c4f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045857 Jul 26 18:37:28.680033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 567/1111] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:28 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:29.082600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7235b27b-4c72-442f-8b0b-f004508c73fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:29.085913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7235b27b-4c72-442f-8b0b-f004508c73fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:29.093856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7235b27b-4c72-442f-8b0b-f004508c73fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:29.094304 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7235b27b-4c72-442f-8b0b-f004508c73fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:29.095104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7235b27b-4c72-442f-8b0b-f004508c73fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:29.095537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7235b27b-4c72-442f-8b0b-f004508c73fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:29.124995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7235b27b-4c72-442f-8b0b-f004508c73fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048736 Jul 26 18:37:29.125541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 545/1112] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:29 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:29.324396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fcd41ec9-423d-46e3-b235-4a91fc8ad963 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:29.326585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fcd41ec9-423d-46e3-b235-4a91fc8ad963 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:29.333806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fcd41ec9-423d-46e3-b235-4a91fc8ad963 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:29.334191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fcd41ec9-423d-46e3-b235-4a91fc8ad963 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:29.334951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fcd41ec9-423d-46e3-b235-4a91fc8ad963 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:29.335429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fcd41ec9-423d-46e3-b235-4a91fc8ad963 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:29.365736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fcd41ec9-423d-46e3-b235-4a91fc8ad963 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046534 Jul 26 18:37:29.366326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 568/1113] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:29.567784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f1590108-f7f9-43f7-b6ef-3c39bef3b333 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:29.571015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f1590108-f7f9-43f7-b6ef-3c39bef3b333 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:29.578981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1590108-f7f9-43f7-b6ef-3c39bef3b333 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:29.579467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1590108-f7f9-43f7-b6ef-3c39bef3b333 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:29.580230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1590108-f7f9-43f7-b6ef-3c39bef3b333 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:29.580665 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1590108-f7f9-43f7-b6ef-3c39bef3b333 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:29.610631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f1590108-f7f9-43f7-b6ef-3c39bef3b333 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049200 Jul 26 18:37:29.611126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 546/1114] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:29 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:29.695523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b4f4c5ea-3421-45f1-b2bb-e38173189be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:29.698914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b4f4c5ea-3421-45f1-b2bb-e38173189be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:29.708712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4f4c5ea-3421-45f1-b2bb-e38173189be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:29.709405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4f4c5ea-3421-45f1-b2bb-e38173189be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:29.710621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4f4c5ea-3421-45f1-b2bb-e38173189be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:29.711251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4f4c5ea-3421-45f1-b2bb-e38173189be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:29.742783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b4f4c5ea-3421-45f1-b2bb-e38173189be7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053759 Jul 26 18:37:29.743396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 569/1115] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:29 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:30.138022 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c67c7fda-0fb8-4b63-aef2-bf140ccdfead tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:30.140200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c67c7fda-0fb8-4b63-aef2-bf140ccdfead tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:30.147148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c67c7fda-0fb8-4b63-aef2-bf140ccdfead tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:30.147602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c67c7fda-0fb8-4b63-aef2-bf140ccdfead tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:30.148366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c67c7fda-0fb8-4b63-aef2-bf140ccdfead tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:30.148797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c67c7fda-0fb8-4b63-aef2-bf140ccdfead tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:30.180031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c67c7fda-0fb8-4b63-aef2-bf140ccdfead tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046144 Jul 26 18:37:30.180596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 547/1116] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:30 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:30.385931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bea2ef99-9f4b-40f9-af2b-db4a851ee87c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:30.389069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bea2ef99-9f4b-40f9-af2b-db4a851ee87c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:30.399202 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bea2ef99-9f4b-40f9-af2b-db4a851ee87c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:30.399859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bea2ef99-9f4b-40f9-af2b-db4a851ee87c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:30.400993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bea2ef99-9f4b-40f9-af2b-db4a851ee87c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:30.401575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bea2ef99-9f4b-40f9-af2b-db4a851ee87c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:30.440646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bea2ef99-9f4b-40f9-af2b-db4a851ee87c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061139 Jul 26 18:37:30.441209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 570/1117] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:30.623261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-39885b72-a7d7-47ab-8085-4faf1811060b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:30.625456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-39885b72-a7d7-47ab-8085-4faf1811060b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:30.632613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39885b72-a7d7-47ab-8085-4faf1811060b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:30.633056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39885b72-a7d7-47ab-8085-4faf1811060b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:30.633814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39885b72-a7d7-47ab-8085-4faf1811060b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:30.634239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39885b72-a7d7-47ab-8085-4faf1811060b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:30.659265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:30.665791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-39885b72-a7d7-47ab-8085-4faf1811060b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046728 Jul 26 18:37:30.666380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 548/1118] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:30 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:30.756548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aa851818-fabf-492d-9629-5f1780c118af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:30.758806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aa851818-fabf-492d-9629-5f1780c118af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:30.765438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa851818-fabf-492d-9629-5f1780c118af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:30.765891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa851818-fabf-492d-9629-5f1780c118af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:30.766661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa851818-fabf-492d-9629-5f1780c118af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:30.767129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa851818-fabf-492d-9629-5f1780c118af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:30.798258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aa851818-fabf-492d-9629-5f1780c118af tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045653 Jul 26 18:37:30.798826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 571/1119] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:30 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:31.194914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-92365d6e-abf6-421f-9012-35308b8e150a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:31.197920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-92365d6e-abf6-421f-9012-35308b8e150a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:31.206596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92365d6e-abf6-421f-9012-35308b8e150a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:31.207261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92365d6e-abf6-421f-9012-35308b8e150a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:31.208298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92365d6e-abf6-421f-9012-35308b8e150a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:31.208912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92365d6e-abf6-421f-9012-35308b8e150a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:31.239853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-92365d6e-abf6-421f-9012-35308b8e150a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050995 Jul 26 18:37:31.240410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 549/1120] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:31 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:31.453698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-57993e6e-135a-4720-880c-f27689441b9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:31.455824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-57993e6e-135a-4720-880c-f27689441b9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:31.462702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57993e6e-135a-4720-880c-f27689441b9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:31.463186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57993e6e-135a-4720-880c-f27689441b9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:31.463956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57993e6e-135a-4720-880c-f27689441b9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:31.464397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57993e6e-135a-4720-880c-f27689441b9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:31.482381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:31.496117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-57993e6e-135a-4720-880c-f27689441b9b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046736 Jul 26 18:37:31.496683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 572/1121] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:31.678670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cf8818aa-0c30-4db4-a2a0-061e94f79e86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:31.680979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cf8818aa-0c30-4db4-a2a0-061e94f79e86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:31.688054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf8818aa-0c30-4db4-a2a0-061e94f79e86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:31.688475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf8818aa-0c30-4db4-a2a0-061e94f79e86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:31.689267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf8818aa-0c30-4db4-a2a0-061e94f79e86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:31.689696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf8818aa-0c30-4db4-a2a0-061e94f79e86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:31.718717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cf8818aa-0c30-4db4-a2a0-061e94f79e86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Jul 26 18:37:31.719595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 550/1122] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:31 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:31.811202 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-285e0965-9a86-4770-8a9d-6bfd39aa695a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:31.813390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-285e0965-9a86-4770-8a9d-6bfd39aa695a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:31.819966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-285e0965-9a86-4770-8a9d-6bfd39aa695a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:31.820413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-285e0965-9a86-4770-8a9d-6bfd39aa695a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:31.821149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-285e0965-9a86-4770-8a9d-6bfd39aa695a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:31.821614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-285e0965-9a86-4770-8a9d-6bfd39aa695a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:31.852655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-285e0965-9a86-4770-8a9d-6bfd39aa695a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045412 Jul 26 18:37:31.853190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 573/1123] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:31 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:32.253903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d3baa77d-de25-4f82-9a7b-332097e62c5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:32.256528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d3baa77d-de25-4f82-9a7b-332097e62c5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:32.263973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3baa77d-de25-4f82-9a7b-332097e62c5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:32.264418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3baa77d-de25-4f82-9a7b-332097e62c5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:32.265183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3baa77d-de25-4f82-9a7b-332097e62c5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:32.265616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3baa77d-de25-4f82-9a7b-332097e62c5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:32.295322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d3baa77d-de25-4f82-9a7b-332097e62c5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046070 Jul 26 18:37:32.295901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 551/1124] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:32 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:32.512767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5cec22bd-24af-4736-b338-fb68262435fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:32.514884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5cec22bd-24af-4736-b338-fb68262435fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:32.522307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cec22bd-24af-4736-b338-fb68262435fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:32.522759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cec22bd-24af-4736-b338-fb68262435fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:32.523552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cec22bd-24af-4736-b338-fb68262435fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:32.523987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cec22bd-24af-4736-b338-fb68262435fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:32.556046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5cec22bd-24af-4736-b338-fb68262435fd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048970 Jul 26 18:37:32.556615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 574/1125] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:32 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:32.730906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bb0849de-44ed-420f-b869-8c5864d8f8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:32.733322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bb0849de-44ed-420f-b869-8c5864d8f8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:32.740039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb0849de-44ed-420f-b869-8c5864d8f8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:32.740476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb0849de-44ed-420f-b869-8c5864d8f8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:32.741232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb0849de-44ed-420f-b869-8c5864d8f8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:32.741658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb0849de-44ed-420f-b869-8c5864d8f8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:32.773182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bb0849de-44ed-420f-b869-8c5864d8f8b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046121 Jul 26 18:37:32.773664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 552/1126] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:32 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:32.866704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-534f214b-6fc0-4528-a197-12e74403a909 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:32.869131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-534f214b-6fc0-4528-a197-12e74403a909 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:32.875860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-534f214b-6fc0-4528-a197-12e74403a909 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:32.876330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-534f214b-6fc0-4528-a197-12e74403a909 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:32.877089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-534f214b-6fc0-4528-a197-12e74403a909 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:32.877518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-534f214b-6fc0-4528-a197-12e74403a909 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:32.909889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-534f214b-6fc0-4528-a197-12e74403a909 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047517 Jul 26 18:37:32.910423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 575/1127] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:32 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:33.307681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3cb6c9a4-dc5a-4541-93fb-215e6ec04084 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:33.309981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3cb6c9a4-dc5a-4541-93fb-215e6ec04084 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:33.316530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cb6c9a4-dc5a-4541-93fb-215e6ec04084 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:33.316979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cb6c9a4-dc5a-4541-93fb-215e6ec04084 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:33.317737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cb6c9a4-dc5a-4541-93fb-215e6ec04084 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:33.318214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cb6c9a4-dc5a-4541-93fb-215e6ec04084 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:33.350125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3cb6c9a4-dc5a-4541-93fb-215e6ec04084 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046442 Jul 26 18:37:33.350694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 553/1128] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:33 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:33.571385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-056c21d0-8a95-4ace-bb0a-c53eb6c88d1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:33.574417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-056c21d0-8a95-4ace-bb0a-c53eb6c88d1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:33.583968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-056c21d0-8a95-4ace-bb0a-c53eb6c88d1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:33.584477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-056c21d0-8a95-4ace-bb0a-c53eb6c88d1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:33.585452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-056c21d0-8a95-4ace-bb0a-c53eb6c88d1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:33.585890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-056c21d0-8a95-4ace-bb0a-c53eb6c88d1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:33.616929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-056c21d0-8a95-4ace-bb0a-c53eb6c88d1a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052100 Jul 26 18:37:33.617496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 576/1129] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:33.784791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f8279a8c-cc15-48dd-9e73-344c7203307a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:33.787132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f8279a8c-cc15-48dd-9e73-344c7203307a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:33.794399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8279a8c-cc15-48dd-9e73-344c7203307a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:33.794818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8279a8c-cc15-48dd-9e73-344c7203307a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:33.795660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8279a8c-cc15-48dd-9e73-344c7203307a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:33.796224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8279a8c-cc15-48dd-9e73-344c7203307a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:33.825912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f8279a8c-cc15-48dd-9e73-344c7203307a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045172 Jul 26 18:37:33.826511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 554/1130] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:33 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:33.924609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5ab57693-cf62-44ce-9445-42068deb29e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:33.926855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5ab57693-cf62-44ce-9445-42068deb29e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:33.933494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ab57693-cf62-44ce-9445-42068deb29e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:33.933943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ab57693-cf62-44ce-9445-42068deb29e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:33.934705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ab57693-cf62-44ce-9445-42068deb29e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:33.935172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ab57693-cf62-44ce-9445-42068deb29e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:33.969053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5ab57693-cf62-44ce-9445-42068deb29e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048444 Jul 26 18:37:33.969612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 577/1131] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:33 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:34.364684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6431e69f-f43b-4c59-a112-d02eb005ff92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:34.367682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6431e69f-f43b-4c59-a112-d02eb005ff92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:34.375740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6431e69f-f43b-4c59-a112-d02eb005ff92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:34.376182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6431e69f-f43b-4c59-a112-d02eb005ff92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:34.377089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6431e69f-f43b-4c59-a112-d02eb005ff92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:34.377559 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6431e69f-f43b-4c59-a112-d02eb005ff92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:34.409342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6431e69f-f43b-4c59-a112-d02eb005ff92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050362 Jul 26 18:37:34.409940 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 555/1132] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:34 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:34.629995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-342e4f65-7dba-44ab-a656-f6d9bd8d43a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:34.632190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-342e4f65-7dba-44ab-a656-f6d9bd8d43a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:34.639437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-342e4f65-7dba-44ab-a656-f6d9bd8d43a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:34.639868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-342e4f65-7dba-44ab-a656-f6d9bd8d43a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:34.640623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-342e4f65-7dba-44ab-a656-f6d9bd8d43a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:34.641052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-342e4f65-7dba-44ab-a656-f6d9bd8d43a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:34.671507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-342e4f65-7dba-44ab-a656-f6d9bd8d43a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045533 Jul 26 18:37:34.672060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 578/1133] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:34 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:34.838508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b9464756-2097-4db9-bd20-e9ba51f56e82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:34.841485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b9464756-2097-4db9-bd20-e9ba51f56e82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:34.848535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9464756-2097-4db9-bd20-e9ba51f56e82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:34.848962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9464756-2097-4db9-bd20-e9ba51f56e82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:34.850384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9464756-2097-4db9-bd20-e9ba51f56e82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:34.850898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9464756-2097-4db9-bd20-e9ba51f56e82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:34.883902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b9464756-2097-4db9-bd20-e9ba51f56e82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049811 Jul 26 18:37:34.884422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 556/1134] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:34 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:34.986071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8bb6d1bd-3f2e-412c-b294-74b3348744c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:34.989409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8bb6d1bd-3f2e-412c-b294-74b3348744c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:34.997559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8bb6d1bd-3f2e-412c-b294-74b3348744c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:34.998037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8bb6d1bd-3f2e-412c-b294-74b3348744c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:34.998814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8bb6d1bd-3f2e-412c-b294-74b3348744c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:34.999293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8bb6d1bd-3f2e-412c-b294-74b3348744c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:35.030574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8bb6d1bd-3f2e-412c-b294-74b3348744c4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050024 Jul 26 18:37:35.031162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 579/1135] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:34 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:35.422731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fcd53ef1-f027-450a-a506-225ac556b08e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:35.425093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fcd53ef1-f027-450a-a506-225ac556b08e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:35.431772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fcd53ef1-f027-450a-a506-225ac556b08e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:35.432327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fcd53ef1-f027-450a-a506-225ac556b08e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:35.433207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fcd53ef1-f027-450a-a506-225ac556b08e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:35.433655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fcd53ef1-f027-450a-a506-225ac556b08e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:35.467215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fcd53ef1-f027-450a-a506-225ac556b08e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048560 Jul 26 18:37:35.467770 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 557/1136] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:35 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:35.683889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-14b69ec6-b8a8-4e51-a7e4-fb1b35bb0ef4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:35.686169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-14b69ec6-b8a8-4e51-a7e4-fb1b35bb0ef4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:35.693339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14b69ec6-b8a8-4e51-a7e4-fb1b35bb0ef4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:35.693820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14b69ec6-b8a8-4e51-a7e4-fb1b35bb0ef4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:35.694623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14b69ec6-b8a8-4e51-a7e4-fb1b35bb0ef4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:35.695121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14b69ec6-b8a8-4e51-a7e4-fb1b35bb0ef4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:35.725818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-14b69ec6-b8a8-4e51-a7e4-fb1b35bb0ef4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046327 Jul 26 18:37:35.726374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 580/1137] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:35 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:35.896689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-83cd8a69-69c8-4126-9e1d-f3d1b7b85a63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:35.898828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-83cd8a69-69c8-4126-9e1d-f3d1b7b85a63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:35.907293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83cd8a69-69c8-4126-9e1d-f3d1b7b85a63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:35.907732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83cd8a69-69c8-4126-9e1d-f3d1b7b85a63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:35.908500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83cd8a69-69c8-4126-9e1d-f3d1b7b85a63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:35.908927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83cd8a69-69c8-4126-9e1d-f3d1b7b85a63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:35.945223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-83cd8a69-69c8-4126-9e1d-f3d1b7b85a63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052837 Jul 26 18:37:35.945784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 558/1138] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:35 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:36.042711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-622bc113-e663-4345-841d-810f7b4fd9a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:36.045188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-622bc113-e663-4345-841d-810f7b4fd9a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:36.051770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-622bc113-e663-4345-841d-810f7b4fd9a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:36.052244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-622bc113-e663-4345-841d-810f7b4fd9a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:36.053041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-622bc113-e663-4345-841d-810f7b4fd9a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:36.053501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-622bc113-e663-4345-841d-810f7b4fd9a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:36.082847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-622bc113-e663-4345-841d-810f7b4fd9a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044214 Jul 26 18:37:36.083444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 581/1139] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:36 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:36.482894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ce3c1172-1e50-40e9-b815-b49bbf931012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:36.485923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ce3c1172-1e50-40e9-b815-b49bbf931012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:36.494971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce3c1172-1e50-40e9-b815-b49bbf931012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:36.495415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce3c1172-1e50-40e9-b815-b49bbf931012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:36.496616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce3c1172-1e50-40e9-b815-b49bbf931012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:36.497374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce3c1172-1e50-40e9-b815-b49bbf931012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:36.531197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ce3c1172-1e50-40e9-b815-b49bbf931012 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054867 Jul 26 18:37:36.531744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 559/1140] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:36 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:36.738819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-decc6cdd-c286-4565-8034-5f7cf7a51a8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:36.740989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-decc6cdd-c286-4565-8034-5f7cf7a51a8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:36.748227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-decc6cdd-c286-4565-8034-5f7cf7a51a8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:36.748674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-decc6cdd-c286-4565-8034-5f7cf7a51a8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:36.749452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-decc6cdd-c286-4565-8034-5f7cf7a51a8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:36.749885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-decc6cdd-c286-4565-8034-5f7cf7a51a8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:36.781006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-decc6cdd-c286-4565-8034-5f7cf7a51a8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046354 Jul 26 18:37:36.781539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 582/1141] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:36 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:36.958997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4c6be273-9a1c-4700-912d-257e994439a2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:36.961250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4c6be273-9a1c-4700-912d-257e994439a2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:36.968118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c6be273-9a1c-4700-912d-257e994439a2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:36.968565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c6be273-9a1c-4700-912d-257e994439a2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:36.969302 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c6be273-9a1c-4700-912d-257e994439a2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:36.970189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c6be273-9a1c-4700-912d-257e994439a2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:37.005871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4c6be273-9a1c-4700-912d-257e994439a2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051487 Jul 26 18:37:37.006467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 560/1142] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:36 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:37.098646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-17cb83a8-0a32-4cad-ac18-63318db335c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:37.101645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-17cb83a8-0a32-4cad-ac18-63318db335c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:37.110718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17cb83a8-0a32-4cad-ac18-63318db335c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:37.111192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17cb83a8-0a32-4cad-ac18-63318db335c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:37.112338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17cb83a8-0a32-4cad-ac18-63318db335c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:37.112975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17cb83a8-0a32-4cad-ac18-63318db335c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:37.148194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-17cb83a8-0a32-4cad-ac18-63318db335c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055706 Jul 26 18:37:37.148758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 583/1143] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:37 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:37.546797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7ca1c167-374c-43bd-86de-b6ae83d9167d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:37.549018 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7ca1c167-374c-43bd-86de-b6ae83d9167d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:37.555773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ca1c167-374c-43bd-86de-b6ae83d9167d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:37.556204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ca1c167-374c-43bd-86de-b6ae83d9167d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:37.556972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ca1c167-374c-43bd-86de-b6ae83d9167d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:37.557403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ca1c167-374c-43bd-86de-b6ae83d9167d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:37.586741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7ca1c167-374c-43bd-86de-b6ae83d9167d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044214 Jul 26 18:37:37.587340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 561/1144] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:37 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:37.795606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-640deffe-4867-460d-a31c-16a3883cc790 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:37.797799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-640deffe-4867-460d-a31c-16a3883cc790 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:37.804915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-640deffe-4867-460d-a31c-16a3883cc790 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:37.805366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-640deffe-4867-460d-a31c-16a3883cc790 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:37.806132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-640deffe-4867-460d-a31c-16a3883cc790 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:37.806560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-640deffe-4867-460d-a31c-16a3883cc790 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:37.836905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-640deffe-4867-460d-a31c-16a3883cc790 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045455 Jul 26 18:37:37.837466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 584/1145] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:38.018124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f4caa921-d5ed-474f-b9d6-ddefd8f41f7c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:38.020623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f4caa921-d5ed-474f-b9d6-ddefd8f41f7c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:38.027652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4caa921-d5ed-474f-b9d6-ddefd8f41f7c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:38.028095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4caa921-d5ed-474f-b9d6-ddefd8f41f7c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:38.028887 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4caa921-d5ed-474f-b9d6-ddefd8f41f7c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:38.029315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f4caa921-d5ed-474f-b9d6-ddefd8f41f7c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:38.073674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f4caa921-d5ed-474f-b9d6-ddefd8f41f7c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059601 Jul 26 18:37:38.074240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 562/1146] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:38 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:38.161020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-02b6f75b-1820-47af-96c8-e496d97ac61d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:38.163205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-02b6f75b-1820-47af-96c8-e496d97ac61d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:38.169689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-02b6f75b-1820-47af-96c8-e496d97ac61d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:38.170136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-02b6f75b-1820-47af-96c8-e496d97ac61d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:38.170937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-02b6f75b-1820-47af-96c8-e496d97ac61d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:38.171408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-02b6f75b-1820-47af-96c8-e496d97ac61d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:38.201693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-02b6f75b-1820-47af-96c8-e496d97ac61d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044588 Jul 26 18:37:38.202249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 585/1147] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:38 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:38.603699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-91866031-9089-4fc9-895b-7543142df336 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:38.606951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-91866031-9089-4fc9-895b-7543142df336 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:38.616563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91866031-9089-4fc9-895b-7543142df336 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:38.617253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91866031-9089-4fc9-895b-7543142df336 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:38.618407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91866031-9089-4fc9-895b-7543142df336 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:38.619091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91866031-9089-4fc9-895b-7543142df336 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:38.651042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-91866031-9089-4fc9-895b-7543142df336 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053494 Jul 26 18:37:38.651607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 563/1148] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:38 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:38.849782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-855a3fb7-4553-4b24-8590-a7a601717c70 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:38.852706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-855a3fb7-4553-4b24-8590-a7a601717c70 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:38.860222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-855a3fb7-4553-4b24-8590-a7a601717c70 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:38.860598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-855a3fb7-4553-4b24-8590-a7a601717c70 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:38.861376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-855a3fb7-4553-4b24-8590-a7a601717c70 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:38.861818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-855a3fb7-4553-4b24-8590-a7a601717c70 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:38.892056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-855a3fb7-4553-4b24-8590-a7a601717c70 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046348 Jul 26 18:37:38.892654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 586/1149] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:39.085893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-81853d6e-a81c-481a-bf2d-4879a834c3bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:39.088226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-81853d6e-a81c-481a-bf2d-4879a834c3bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:39.094859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-81853d6e-a81c-481a-bf2d-4879a834c3bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:39.095979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-81853d6e-a81c-481a-bf2d-4879a834c3bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:39.096785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-81853d6e-a81c-481a-bf2d-4879a834c3bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:39.097216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-81853d6e-a81c-481a-bf2d-4879a834c3bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:39.136859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-81853d6e-a81c-481a-bf2d-4879a834c3bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054833 Jul 26 18:37:39.137775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 564/1150] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:39 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:39.218465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-adb142bd-cdfe-4022-ba2f-6033bc55c991 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:39.221506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-adb142bd-cdfe-4022-ba2f-6033bc55c991 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:39.230526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-adb142bd-cdfe-4022-ba2f-6033bc55c991 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:39.230969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-adb142bd-cdfe-4022-ba2f-6033bc55c991 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:39.231758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-adb142bd-cdfe-4022-ba2f-6033bc55c991 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:39.232194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-adb142bd-cdfe-4022-ba2f-6033bc55c991 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:39.262562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-adb142bd-cdfe-4022-ba2f-6033bc55c991 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050037 Jul 26 18:37:39.263130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 587/1151] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:39 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:39.667337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-73991e62-c71f-4de4-b23d-d3695e07b253 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:39.670528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-73991e62-c71f-4de4-b23d-d3695e07b253 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:39.679807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73991e62-c71f-4de4-b23d-d3695e07b253 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:39.680346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73991e62-c71f-4de4-b23d-d3695e07b253 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:39.681546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73991e62-c71f-4de4-b23d-d3695e07b253 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:39.682128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73991e62-c71f-4de4-b23d-d3695e07b253 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:39.696663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:39.713073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-73991e62-c71f-4de4-b23d-d3695e07b253 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052001 Jul 26 18:37:39.713633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 565/1152] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:39 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:39.905501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e869dc34-0313-459e-8e35-a25107202051 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:39.907706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e869dc34-0313-459e-8e35-a25107202051 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:39.914610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e869dc34-0313-459e-8e35-a25107202051 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:39.915060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e869dc34-0313-459e-8e35-a25107202051 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:39.915841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e869dc34-0313-459e-8e35-a25107202051 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:39.916270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e869dc34-0313-459e-8e35-a25107202051 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:39.946391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e869dc34-0313-459e-8e35-a25107202051 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044936 Jul 26 18:37:39.946886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 588/1153] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:40.149865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ae3e454c-adc7-4ce5-b290-b91774f99cc3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:40.152113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ae3e454c-adc7-4ce5-b290-b91774f99cc3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:40.159051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae3e454c-adc7-4ce5-b290-b91774f99cc3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:40.159492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae3e454c-adc7-4ce5-b290-b91774f99cc3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:40.160273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae3e454c-adc7-4ce5-b290-b91774f99cc3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:40.160700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae3e454c-adc7-4ce5-b290-b91774f99cc3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:40.191455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ae3e454c-adc7-4ce5-b290-b91774f99cc3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045837 Jul 26 18:37:40.192017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 566/1154] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:40 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:40.279390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-86a0bc2f-152b-4a6d-a91a-f649076fd61c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:40.281562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-86a0bc2f-152b-4a6d-a91a-f649076fd61c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:40.288132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86a0bc2f-152b-4a6d-a91a-f649076fd61c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:40.288578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86a0bc2f-152b-4a6d-a91a-f649076fd61c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:40.289331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86a0bc2f-152b-4a6d-a91a-f649076fd61c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:40.289759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86a0bc2f-152b-4a6d-a91a-f649076fd61c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:40.293368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:40.319636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-86a0bc2f-152b-4a6d-a91a-f649076fd61c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Jul 26 18:37:40.320180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 589/1155] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:40 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:40.727732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-20386f12-a43a-489b-b96b-d93e2eb7e4a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:40.729903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-20386f12-a43a-489b-b96b-d93e2eb7e4a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:40.736297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20386f12-a43a-489b-b96b-d93e2eb7e4a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:40.736743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20386f12-a43a-489b-b96b-d93e2eb7e4a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:40.737583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20386f12-a43a-489b-b96b-d93e2eb7e4a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:40.738016 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20386f12-a43a-489b-b96b-d93e2eb7e4a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:40.772309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-20386f12-a43a-489b-b96b-d93e2eb7e4a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048553 Jul 26 18:37:40.772906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 567/1156] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:40 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:40.960442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9d2c3f18-20d3-4ed3-b3cc-82a9694e121f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:40.962497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9d2c3f18-20d3-4ed3-b3cc-82a9694e121f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:40.969619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d2c3f18-20d3-4ed3-b3cc-82a9694e121f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:40.970061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d2c3f18-20d3-4ed3-b3cc-82a9694e121f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:40.970821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d2c3f18-20d3-4ed3-b3cc-82a9694e121f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:40.971281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d2c3f18-20d3-4ed3-b3cc-82a9694e121f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:41.001512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9d2c3f18-20d3-4ed3-b3cc-82a9694e121f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045192 Jul 26 18:37:41.002047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 590/1157] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:40 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:41.203456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ff76383b-4007-4a36-b536-7c360a6c751f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:41.205783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ff76383b-4007-4a36-b536-7c360a6c751f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:41.212702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff76383b-4007-4a36-b536-7c360a6c751f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:41.213155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff76383b-4007-4a36-b536-7c360a6c751f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:41.213911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff76383b-4007-4a36-b536-7c360a6c751f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:41.214336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff76383b-4007-4a36-b536-7c360a6c751f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:41.255753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ff76383b-4007-4a36-b536-7c360a6c751f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056367 Jul 26 18:37:41.256342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 568/1158] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:41 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:41.331896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b06ea76d-aed6-45ff-be7b-5681420cf4eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:41.334061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b06ea76d-aed6-45ff-be7b-5681420cf4eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:41.340222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b06ea76d-aed6-45ff-be7b-5681420cf4eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:41.340671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b06ea76d-aed6-45ff-be7b-5681420cf4eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:41.341430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b06ea76d-aed6-45ff-be7b-5681420cf4eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:41.341864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b06ea76d-aed6-45ff-be7b-5681420cf4eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:41.371913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b06ea76d-aed6-45ff-be7b-5681420cf4eb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044036 Jul 26 18:37:41.372483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 591/1159] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:41 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:41.785555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0af4e5b4-09e1-4003-8f19-78550ff1e7c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:41.787896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0af4e5b4-09e1-4003-8f19-78550ff1e7c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:41.795179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0af4e5b4-09e1-4003-8f19-78550ff1e7c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:41.795649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0af4e5b4-09e1-4003-8f19-78550ff1e7c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:41.796579 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0af4e5b4-09e1-4003-8f19-78550ff1e7c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:41.797036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0af4e5b4-09e1-4003-8f19-78550ff1e7c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:41.830398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0af4e5b4-09e1-4003-8f19-78550ff1e7c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048933 Jul 26 18:37:41.831473 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 569/1160] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:41 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:42.015640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a7d97901-5c33-4c14-8913-ca2e3e106d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:42.017720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a7d97901-5c33-4c14-8913-ca2e3e106d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:42.025031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7d97901-5c33-4c14-8913-ca2e3e106d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:42.025476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7d97901-5c33-4c14-8913-ca2e3e106d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:42.026242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7d97901-5c33-4c14-8913-ca2e3e106d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:42.026675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7d97901-5c33-4c14-8913-ca2e3e106d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:42.056213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a7d97901-5c33-4c14-8913-ca2e3e106d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045139 Jul 26 18:37:42.056766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 592/1161] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:42.268096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ee3bf331-2481-492f-99a7-519425e4da87 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:42.270478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ee3bf331-2481-492f-99a7-519425e4da87 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:42.277273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee3bf331-2481-492f-99a7-519425e4da87 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:42.277711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee3bf331-2481-492f-99a7-519425e4da87 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:42.278485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee3bf331-2481-492f-99a7-519425e4da87 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:42.278925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee3bf331-2481-492f-99a7-519425e4da87 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:42.311522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ee3bf331-2481-492f-99a7-519425e4da87 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047394 Jul 26 18:37:42.312102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 570/1162] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:42 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:42.388333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-101530bb-19cb-4955-8f06-c00ec5dae859 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:42.391614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-101530bb-19cb-4955-8f06-c00ec5dae859 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:42.401424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-101530bb-19cb-4955-8f06-c00ec5dae859 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:42.401918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-101530bb-19cb-4955-8f06-c00ec5dae859 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:42.402782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-101530bb-19cb-4955-8f06-c00ec5dae859 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:42.403239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-101530bb-19cb-4955-8f06-c00ec5dae859 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:42.433126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-101530bb-19cb-4955-8f06-c00ec5dae859 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051934 Jul 26 18:37:42.433761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 593/1163] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:42 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:42.844093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aa9b75ff-b6b5-4feb-9833-7d7573fecb3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:42.846240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aa9b75ff-b6b5-4feb-9833-7d7573fecb3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:42.852815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa9b75ff-b6b5-4feb-9833-7d7573fecb3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:42.853260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa9b75ff-b6b5-4feb-9833-7d7573fecb3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:42.854014 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa9b75ff-b6b5-4feb-9833-7d7573fecb3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:42.854442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa9b75ff-b6b5-4feb-9833-7d7573fecb3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:42.887406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aa9b75ff-b6b5-4feb-9833-7d7573fecb3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047297 Jul 26 18:37:42.887967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 571/1164] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:42 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:43.071513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9a0ad454-8e5f-4e31-a881-e6358fae6b0f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:43.073602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9a0ad454-8e5f-4e31-a881-e6358fae6b0f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:43.080686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a0ad454-8e5f-4e31-a881-e6358fae6b0f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:43.081126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a0ad454-8e5f-4e31-a881-e6358fae6b0f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:43.081886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a0ad454-8e5f-4e31-a881-e6358fae6b0f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:43.082314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a0ad454-8e5f-4e31-a881-e6358fae6b0f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:43.112569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9a0ad454-8e5f-4e31-a881-e6358fae6b0f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045216 Jul 26 18:37:43.113118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 594/1165] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:43.324553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-48c9ddd8-aaed-433b-9c06-ec50135db3f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:43.326756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-48c9ddd8-aaed-433b-9c06-ec50135db3f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:43.334016 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-48c9ddd8-aaed-433b-9c06-ec50135db3f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:43.334539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-48c9ddd8-aaed-433b-9c06-ec50135db3f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:43.335373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-48c9ddd8-aaed-433b-9c06-ec50135db3f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:43.335823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-48c9ddd8-aaed-433b-9c06-ec50135db3f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:43.370098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-48c9ddd8-aaed-433b-9c06-ec50135db3f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049719 Jul 26 18:37:43.371005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 572/1166] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:43 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:43.446308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ccca589a-2f42-4df7-84bf-ee0ee6e5d7ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:43.448619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ccca589a-2f42-4df7-84bf-ee0ee6e5d7ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:43.455051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccca589a-2f42-4df7-84bf-ee0ee6e5d7ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:43.455523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccca589a-2f42-4df7-84bf-ee0ee6e5d7ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:43.456300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccca589a-2f42-4df7-84bf-ee0ee6e5d7ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:43.456726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccca589a-2f42-4df7-84bf-ee0ee6e5d7ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:43.485873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ccca589a-2f42-4df7-84bf-ee0ee6e5d7ad tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Jul 26 18:37:43.486417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 595/1167] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:43 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:43.903334 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8a41aead-4c58-4dfb-818b-af015b3c5ce6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:43.905497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8a41aead-4c58-4dfb-818b-af015b3c5ce6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:43.912158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a41aead-4c58-4dfb-818b-af015b3c5ce6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:43.912611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a41aead-4c58-4dfb-818b-af015b3c5ce6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:43.913371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a41aead-4c58-4dfb-818b-af015b3c5ce6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:43.913832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a41aead-4c58-4dfb-818b-af015b3c5ce6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:43.952730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8a41aead-4c58-4dfb-818b-af015b3c5ce6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055226 Jul 26 18:37:43.953300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 573/1168] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:43 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:44.126669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-913f2a5b-320e-4ced-a3b3-a9ee4da13cf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:44.128789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-913f2a5b-320e-4ced-a3b3-a9ee4da13cf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:44.135930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-913f2a5b-320e-4ced-a3b3-a9ee4da13cf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:44.136379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-913f2a5b-320e-4ced-a3b3-a9ee4da13cf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:44.137182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-913f2a5b-320e-4ced-a3b3-a9ee4da13cf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:44.137623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-913f2a5b-320e-4ced-a3b3-a9ee4da13cf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:44.169216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-913f2a5b-320e-4ced-a3b3-a9ee4da13cf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046754 Jul 26 18:37:44.169780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 596/1169] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:44 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:44.381687 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fceafd73-9653-42cd-8b88-813d9ae74920 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:44.383915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fceafd73-9653-42cd-8b88-813d9ae74920 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:44.390310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fceafd73-9653-42cd-8b88-813d9ae74920 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:44.390757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fceafd73-9653-42cd-8b88-813d9ae74920 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:44.391563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fceafd73-9653-42cd-8b88-813d9ae74920 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:44.391990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fceafd73-9653-42cd-8b88-813d9ae74920 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:44.422796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fceafd73-9653-42cd-8b88-813d9ae74920 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044888 Jul 26 18:37:44.423704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 574/1170] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:44 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:44.500942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b2f21ab1-d253-4b9d-8394-40ad88c00388 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:44.504254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b2f21ab1-d253-4b9d-8394-40ad88c00388 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:44.513101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2f21ab1-d253-4b9d-8394-40ad88c00388 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:44.513544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2f21ab1-d253-4b9d-8394-40ad88c00388 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:44.514311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2f21ab1-d253-4b9d-8394-40ad88c00388 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:44.514743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2f21ab1-d253-4b9d-8394-40ad88c00388 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:44.545052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b2f21ab1-d253-4b9d-8394-40ad88c00388 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050396 Jul 26 18:37:44.545604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 597/1171] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:44 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:44.971414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2fb16b06-32a2-406f-ab6b-c8ac4596a768 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:44.976518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2fb16b06-32a2-406f-ab6b-c8ac4596a768 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:44.980763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:44.986650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2fb16b06-32a2-406f-ab6b-c8ac4596a768 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:44.987119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2fb16b06-32a2-406f-ab6b-c8ac4596a768 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:44.987907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2fb16b06-32a2-406f-ab6b-c8ac4596a768 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:44.988341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2fb16b06-32a2-406f-ab6b-c8ac4596a768 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:45.019111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2fb16b06-32a2-406f-ab6b-c8ac4596a768 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056291 Jul 26 18:37:45.019558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 575/1172] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:44 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:45.184915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-216217ea-baea-466f-aa57-38b3f65f6b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:45.187382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-216217ea-baea-466f-aa57-38b3f65f6b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:45.195235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-216217ea-baea-466f-aa57-38b3f65f6b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:45.195752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-216217ea-baea-466f-aa57-38b3f65f6b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:45.196639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-216217ea-baea-466f-aa57-38b3f65f6b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:45.197158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-216217ea-baea-466f-aa57-38b3f65f6b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:45.226567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-216217ea-baea-466f-aa57-38b3f65f6b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046446 Jul 26 18:37:45.227143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 598/1173] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:45.437662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1db6d8c4-d768-4d77-a2c6-cd2f5b783c2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:45.440285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1db6d8c4-d768-4d77-a2c6-cd2f5b783c2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:45.446632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1db6d8c4-d768-4d77-a2c6-cd2f5b783c2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:45.447153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1db6d8c4-d768-4d77-a2c6-cd2f5b783c2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:45.449178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1db6d8c4-d768-4d77-a2c6-cd2f5b783c2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:45.449634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1db6d8c4-d768-4d77-a2c6-cd2f5b783c2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:45.481154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1db6d8c4-d768-4d77-a2c6-cd2f5b783c2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048868 Jul 26 18:37:45.481785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 576/1174] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:45 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:45.559773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-956f2bea-93db-49b0-be51-5d7edcc1bba4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:45.561957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-956f2bea-93db-49b0-be51-5d7edcc1bba4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:45.568642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-956f2bea-93db-49b0-be51-5d7edcc1bba4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:45.569765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-956f2bea-93db-49b0-be51-5d7edcc1bba4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:45.570731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-956f2bea-93db-49b0-be51-5d7edcc1bba4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:45.571199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-956f2bea-93db-49b0-be51-5d7edcc1bba4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:45.601023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-956f2bea-93db-49b0-be51-5d7edcc1bba4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047302 Jul 26 18:37:45.601582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 599/1175] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:45 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:46.032282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-22b89aed-610a-48ab-ab0d-9dacb1f501b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:46.034353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-22b89aed-610a-48ab-ab0d-9dacb1f501b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:46.040840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22b89aed-610a-48ab-ab0d-9dacb1f501b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:46.041287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22b89aed-610a-48ab-ab0d-9dacb1f501b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:46.042078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22b89aed-610a-48ab-ab0d-9dacb1f501b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:46.042491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22b89aed-610a-48ab-ab0d-9dacb1f501b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:46.073258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-22b89aed-610a-48ab-ab0d-9dacb1f501b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Jul 26 18:37:46.073819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 577/1176] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:46 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:46.240557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1786bd98-8b50-44d3-be51-eab2ce505b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:46.242943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1786bd98-8b50-44d3-be51-eab2ce505b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:46.250071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1786bd98-8b50-44d3-be51-eab2ce505b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:46.250515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1786bd98-8b50-44d3-be51-eab2ce505b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:46.251294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1786bd98-8b50-44d3-be51-eab2ce505b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:46.251746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1786bd98-8b50-44d3-be51-eab2ce505b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:46.282410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1786bd98-8b50-44d3-be51-eab2ce505b5c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046093 Jul 26 18:37:46.282856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 600/1177] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:46.494654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-44b87502-6fe3-4ea7-b420-a3cffcfe0d42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:46.496175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-44b87502-6fe3-4ea7-b420-a3cffcfe0d42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:46.503476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44b87502-6fe3-4ea7-b420-a3cffcfe0d42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:46.503983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44b87502-6fe3-4ea7-b420-a3cffcfe0d42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:46.504760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44b87502-6fe3-4ea7-b420-a3cffcfe0d42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:46.505161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44b87502-6fe3-4ea7-b420-a3cffcfe0d42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:46.537563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-44b87502-6fe3-4ea7-b420-a3cffcfe0d42 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047635 Jul 26 18:37:46.538316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 578/1178] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:46 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:46.616557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-26c0ea5c-60e0-4a06-a375-2469e036184c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:46.619573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-26c0ea5c-60e0-4a06-a375-2469e036184c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:46.628446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26c0ea5c-60e0-4a06-a375-2469e036184c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:46.629020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26c0ea5c-60e0-4a06-a375-2469e036184c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:46.630153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26c0ea5c-60e0-4a06-a375-2469e036184c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:46.630593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26c0ea5c-60e0-4a06-a375-2469e036184c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:46.661791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-26c0ea5c-60e0-4a06-a375-2469e036184c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051290 Jul 26 18:37:46.662348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 601/1179] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:46 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:47.090000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e41f09df-86e5-4480-b135-faf2ad4ad3dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:47.092184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e41f09df-86e5-4480-b135-faf2ad4ad3dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:47.098875 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e41f09df-86e5-4480-b135-faf2ad4ad3dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:47.099354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e41f09df-86e5-4480-b135-faf2ad4ad3dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:47.100128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e41f09df-86e5-4480-b135-faf2ad4ad3dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:47.100565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e41f09df-86e5-4480-b135-faf2ad4ad3dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:47.131268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e41f09df-86e5-4480-b135-faf2ad4ad3dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047877 Jul 26 18:37:47.131801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 579/1180] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:47 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:47.296106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b5ae477c-4f2b-4a88-acc2-9ba246666ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:47.298322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b5ae477c-4f2b-4a88-acc2-9ba246666ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:47.300702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:47.306453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5ae477c-4f2b-4a88-acc2-9ba246666ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:47.306903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5ae477c-4f2b-4a88-acc2-9ba246666ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:47.307704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5ae477c-4f2b-4a88-acc2-9ba246666ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:47.308126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5ae477c-4f2b-4a88-acc2-9ba246666ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:47.338520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b5ae477c-4f2b-4a88-acc2-9ba246666ab2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046973 Jul 26 18:37:47.339078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 602/1181] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:47 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:47.554198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-814c1eff-bef6-447b-9451-b8a7a0aa833e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:47.557780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-814c1eff-bef6-447b-9451-b8a7a0aa833e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:47.571056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-814c1eff-bef6-447b-9451-b8a7a0aa833e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:47.572282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-814c1eff-bef6-447b-9451-b8a7a0aa833e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:47.574248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-814c1eff-bef6-447b-9451-b8a7a0aa833e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:47.574690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-814c1eff-bef6-447b-9451-b8a7a0aa833e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:47.604841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-814c1eff-bef6-447b-9451-b8a7a0aa833e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057301 Jul 26 18:37:47.609487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 580/1182] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:47 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:47.674561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-afdd6e3f-6b4c-4df5-97d5-089768d1b4c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:47.676856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-afdd6e3f-6b4c-4df5-97d5-089768d1b4c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:47.683465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afdd6e3f-6b4c-4df5-97d5-089768d1b4c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:47.683845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afdd6e3f-6b4c-4df5-97d5-089768d1b4c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:47.684602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afdd6e3f-6b4c-4df5-97d5-089768d1b4c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:47.685026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afdd6e3f-6b4c-4df5-97d5-089768d1b4c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:47.715766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-afdd6e3f-6b4c-4df5-97d5-089768d1b4c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045177 Jul 26 18:37:47.716317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 603/1183] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:47 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:48.147242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dab6341c-8a33-42a5-a984-10be491ca6f9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:48.150209 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dab6341c-8a33-42a5-a984-10be491ca6f9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:48.158862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dab6341c-8a33-42a5-a984-10be491ca6f9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:48.159522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dab6341c-8a33-42a5-a984-10be491ca6f9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:48.160684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dab6341c-8a33-42a5-a984-10be491ca6f9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:48.161303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dab6341c-8a33-42a5-a984-10be491ca6f9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:48.193230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dab6341c-8a33-42a5-a984-10be491ca6f9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052227 Jul 26 18:37:48.193782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 581/1184] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:48 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:48.355633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6b8d1c2a-3ce6-408d-a2c7-a2a522490876 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:48.359123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6b8d1c2a-3ce6-408d-a2c7-a2a522490876 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:48.369839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b8d1c2a-3ce6-408d-a2c7-a2a522490876 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:48.370535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b8d1c2a-3ce6-408d-a2c7-a2a522490876 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:48.371571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b8d1c2a-3ce6-408d-a2c7-a2a522490876 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:48.371998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b8d1c2a-3ce6-408d-a2c7-a2a522490876 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:48.402520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6b8d1c2a-3ce6-408d-a2c7-a2a522490876 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054194 Jul 26 18:37:48.402996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 604/1185] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:48.618056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7f97379d-355c-47cf-94d4-4a957cb68a77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:48.620376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7f97379d-355c-47cf-94d4-4a957cb68a77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:48.627704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f97379d-355c-47cf-94d4-4a957cb68a77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:48.628147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f97379d-355c-47cf-94d4-4a957cb68a77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:48.628911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f97379d-355c-47cf-94d4-4a957cb68a77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:48.629337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f97379d-355c-47cf-94d4-4a957cb68a77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:48.631819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:48.660299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7f97379d-355c-47cf-94d4-4a957cb68a77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046226 Jul 26 18:37:48.661234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 582/1186] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:48 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:48.730053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ddb60ea5-f971-4491-bbc5-0f09d9113f53 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:48.732311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ddb60ea5-f971-4491-bbc5-0f09d9113f53 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:48.738743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ddb60ea5-f971-4491-bbc5-0f09d9113f53 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:48.739220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ddb60ea5-f971-4491-bbc5-0f09d9113f53 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:48.740238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ddb60ea5-f971-4491-bbc5-0f09d9113f53 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:48.740669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ddb60ea5-f971-4491-bbc5-0f09d9113f53 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:48.766404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:48.772424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ddb60ea5-f971-4491-bbc5-0f09d9113f53 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046469 Jul 26 18:37:48.773003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 605/1187] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:48 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:49.210157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-60b4dc95-6f41-4b0e-93d3-f1bffbd498d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:49.213364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-60b4dc95-6f41-4b0e-93d3-f1bffbd498d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:49.220289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60b4dc95-6f41-4b0e-93d3-f1bffbd498d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:49.220745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60b4dc95-6f41-4b0e-93d3-f1bffbd498d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:49.221509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60b4dc95-6f41-4b0e-93d3-f1bffbd498d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:49.221942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60b4dc95-6f41-4b0e-93d3-f1bffbd498d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:49.251377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-60b4dc95-6f41-4b0e-93d3-f1bffbd498d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047113 Jul 26 18:37:49.251960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 583/1188] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:49 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:49.417916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f22498c0-2084-4ac3-9e9a-7ff7127527b6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:49.420169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f22498c0-2084-4ac3-9e9a-7ff7127527b6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:49.428565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f22498c0-2084-4ac3-9e9a-7ff7127527b6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:49.429103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f22498c0-2084-4ac3-9e9a-7ff7127527b6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:49.430009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f22498c0-2084-4ac3-9e9a-7ff7127527b6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:49.430503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f22498c0-2084-4ac3-9e9a-7ff7127527b6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:49.462050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f22498c0-2084-4ac3-9e9a-7ff7127527b6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048692 Jul 26 18:37:49.462530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 606/1189] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:49 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:49.675869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-343df2ad-9352-4388-893b-c621d3c40fe2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:49.678935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-343df2ad-9352-4388-893b-c621d3c40fe2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:49.688446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-343df2ad-9352-4388-893b-c621d3c40fe2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:49.688955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-343df2ad-9352-4388-893b-c621d3c40fe2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:49.690081 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-343df2ad-9352-4388-893b-c621d3c40fe2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:49.690708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-343df2ad-9352-4388-893b-c621d3c40fe2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:49.722784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-343df2ad-9352-4388-893b-c621d3c40fe2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052554 Jul 26 18:37:49.723392 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 584/1190] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:49 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:49.784854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9676a50c-0983-460e-9118-f79b4038af06 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:49.787233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9676a50c-0983-460e-9118-f79b4038af06 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:49.793496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9676a50c-0983-460e-9118-f79b4038af06 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:49.793936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9676a50c-0983-460e-9118-f79b4038af06 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:49.794698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9676a50c-0983-460e-9118-f79b4038af06 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:49.795176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9676a50c-0983-460e-9118-f79b4038af06 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:49.824259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9676a50c-0983-460e-9118-f79b4038af06 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 Jul 26 18:37:49.824820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 607/1191] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:49 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:50.266302 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bef07659-9e30-4f7d-8fea-1ba1086e2ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:50.268541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bef07659-9e30-4f7d-8fea-1ba1086e2ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:50.275655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bef07659-9e30-4f7d-8fea-1ba1086e2ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:50.276099 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bef07659-9e30-4f7d-8fea-1ba1086e2ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:50.276873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bef07659-9e30-4f7d-8fea-1ba1086e2ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:50.277301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bef07659-9e30-4f7d-8fea-1ba1086e2ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:50.306583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bef07659-9e30-4f7d-8fea-1ba1086e2ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Jul 26 18:37:50.307153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 585/1192] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:50 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:50.474234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cbcb9dc1-91af-4603-9131-7fa6496fd0b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:50.476457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cbcb9dc1-91af-4603-9131-7fa6496fd0b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:50.483407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbcb9dc1-91af-4603-9131-7fa6496fd0b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:50.483860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbcb9dc1-91af-4603-9131-7fa6496fd0b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:50.484632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbcb9dc1-91af-4603-9131-7fa6496fd0b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:50.485067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbcb9dc1-91af-4603-9131-7fa6496fd0b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:50.518598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cbcb9dc1-91af-4603-9131-7fa6496fd0b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048239 Jul 26 18:37:50.519334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 608/1193] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:50 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:50.735685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b3732e6f-3ff3-40c7-a8f0-7f0d644093e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:50.737983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b3732e6f-3ff3-40c7-a8f0-7f0d644093e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:50.748334 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3732e6f-3ff3-40c7-a8f0-7f0d644093e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:50.748334 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3732e6f-3ff3-40c7-a8f0-7f0d644093e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:50.749014 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3732e6f-3ff3-40c7-a8f0-7f0d644093e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:50.749426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3732e6f-3ff3-40c7-a8f0-7f0d644093e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:50.786650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b3732e6f-3ff3-40c7-a8f0-7f0d644093e2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055025 Jul 26 18:37:50.791405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 586/1194] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:50 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:50.835914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3a09f04b-df82-4a42-baab-05c66a280447 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:50.838068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3a09f04b-df82-4a42-baab-05c66a280447 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:50.844313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a09f04b-df82-4a42-baab-05c66a280447 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:50.844749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a09f04b-df82-4a42-baab-05c66a280447 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:50.845505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a09f04b-df82-4a42-baab-05c66a280447 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:50.845927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a09f04b-df82-4a42-baab-05c66a280447 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:50.875772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3a09f04b-df82-4a42-baab-05c66a280447 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Jul 26 18:37:50.880367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 609/1195] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:50 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:51.321527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ff31e683-f211-43de-b153-3ec6859145a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:51.324458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ff31e683-f211-43de-b153-3ec6859145a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:51.330835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff31e683-f211-43de-b153-3ec6859145a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:51.331303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff31e683-f211-43de-b153-3ec6859145a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:51.332069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff31e683-f211-43de-b153-3ec6859145a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:51.332500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff31e683-f211-43de-b153-3ec6859145a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:51.363358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ff31e683-f211-43de-b153-3ec6859145a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047216 Jul 26 18:37:51.363917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 587/1196] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:51 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:51.531544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a9ce9609-5568-49ec-afea-a7d0eaf677ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:51.533715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a9ce9609-5568-49ec-afea-a7d0eaf677ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:51.540244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9ce9609-5568-49ec-afea-a7d0eaf677ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:51.540684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9ce9609-5568-49ec-afea-a7d0eaf677ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:51.541616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9ce9609-5568-49ec-afea-a7d0eaf677ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:51.542044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9ce9609-5568-49ec-afea-a7d0eaf677ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:51.571679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a9ce9609-5568-49ec-afea-a7d0eaf677ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044157 Jul 26 18:37:51.572148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 610/1197] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 18:37:51.799106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dfe8dca4-3de8-47b7-a225-ef6fa0943964 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:51.801328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dfe8dca4-3de8-47b7-a225-ef6fa0943964 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:51.808665 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dfe8dca4-3de8-47b7-a225-ef6fa0943964 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:51.808784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dfe8dca4-3de8-47b7-a225-ef6fa0943964 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:51.809503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dfe8dca4-3de8-47b7-a225-ef6fa0943964 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:51.809932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dfe8dca4-3de8-47b7-a225-ef6fa0943964 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:51.840390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dfe8dca4-3de8-47b7-a225-ef6fa0943964 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045197 Jul 26 18:37:51.840897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 588/1198] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:51 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:51.888575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c530ce09-de63-4da1-8e6f-dedfd4432e8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:51.890760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c530ce09-de63-4da1-8e6f-dedfd4432e8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:51.897458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c530ce09-de63-4da1-8e6f-dedfd4432e8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:51.897904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c530ce09-de63-4da1-8e6f-dedfd4432e8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:51.898674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c530ce09-de63-4da1-8e6f-dedfd4432e8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:51.899146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c530ce09-de63-4da1-8e6f-dedfd4432e8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:51.930172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c530ce09-de63-4da1-8e6f-dedfd4432e8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045650 Jul 26 18:37:51.930721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 611/1199] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:51 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:52.375459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a695abac-54f2-4703-a381-254660e8d510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:52.377734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a695abac-54f2-4703-a381-254660e8d510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:52.384488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a695abac-54f2-4703-a381-254660e8d510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:52.384927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a695abac-54f2-4703-a381-254660e8d510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:52.385683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a695abac-54f2-4703-a381-254660e8d510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:52.386114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a695abac-54f2-4703-a381-254660e8d510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:52.415882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a695abac-54f2-4703-a381-254660e8d510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Jul 26 18:37:52.416455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 589/1200] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:52 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:52.586856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-65eaeab8-f2ef-43a8-96de-0a22274bdacc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:52.589855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-65eaeab8-f2ef-43a8-96de-0a22274bdacc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:52.599617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65eaeab8-f2ef-43a8-96de-0a22274bdacc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:52.600171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65eaeab8-f2ef-43a8-96de-0a22274bdacc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:52.601236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65eaeab8-f2ef-43a8-96de-0a22274bdacc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:52.601829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65eaeab8-f2ef-43a8-96de-0a22274bdacc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:52.632934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-65eaeab8-f2ef-43a8-96de-0a22274bdacc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051726 Jul 26 18:37:52.633425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 612/1201] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:52.855719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7397c3b8-4877-4ce4-8b2a-474b0b38f9c3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:52.858636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7397c3b8-4877-4ce4-8b2a-474b0b38f9c3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:52.867829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7397c3b8-4877-4ce4-8b2a-474b0b38f9c3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:52.868401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7397c3b8-4877-4ce4-8b2a-474b0b38f9c3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:52.869505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7397c3b8-4877-4ce4-8b2a-474b0b38f9c3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:52.870075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7397c3b8-4877-4ce4-8b2a-474b0b38f9c3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:52.900672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7397c3b8-4877-4ce4-8b2a-474b0b38f9c3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050477 Jul 26 18:37:52.901236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 590/1202] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:52 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:52.944440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f1a1797d-27d5-49c3-8c79-76dc57859007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:52.947597 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f1a1797d-27d5-49c3-8c79-76dc57859007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:52.956681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1a1797d-27d5-49c3-8c79-76dc57859007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:52.957320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1a1797d-27d5-49c3-8c79-76dc57859007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:52.958475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1a1797d-27d5-49c3-8c79-76dc57859007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:52.959119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1a1797d-27d5-49c3-8c79-76dc57859007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:52.990966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f1a1797d-27d5-49c3-8c79-76dc57859007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052603 Jul 26 18:37:52.991586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 613/1203] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:52 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:53.431349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5856aab7-2928-450c-aa75-abf86256c4cc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:53.433469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5856aab7-2928-450c-aa75-abf86256c4cc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:53.440007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5856aab7-2928-450c-aa75-abf86256c4cc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:53.440452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5856aab7-2928-450c-aa75-abf86256c4cc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:53.441203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5856aab7-2928-450c-aa75-abf86256c4cc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:53.441639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5856aab7-2928-450c-aa75-abf86256c4cc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:53.474092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5856aab7-2928-450c-aa75-abf86256c4cc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046943 Jul 26 18:37:53.474654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 591/1204] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:53 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:53.647637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ad4d9881-c232-498b-98e7-a061d4590ef3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:53.650121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ad4d9881-c232-498b-98e7-a061d4590ef3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:53.657670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad4d9881-c232-498b-98e7-a061d4590ef3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:53.658112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad4d9881-c232-498b-98e7-a061d4590ef3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:53.658866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad4d9881-c232-498b-98e7-a061d4590ef3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:53.659320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad4d9881-c232-498b-98e7-a061d4590ef3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:53.690487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ad4d9881-c232-498b-98e7-a061d4590ef3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048083 Jul 26 18:37:53.690956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 614/1205] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:53.914013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c6595c91-b23a-41da-b7a8-a2a6857c433c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:53.916223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c6595c91-b23a-41da-b7a8-a2a6857c433c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:53.923180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c6595c91-b23a-41da-b7a8-a2a6857c433c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:53.923634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c6595c91-b23a-41da-b7a8-a2a6857c433c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:53.924398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c6595c91-b23a-41da-b7a8-a2a6857c433c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:53.924829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c6595c91-b23a-41da-b7a8-a2a6857c433c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:53.954405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c6595c91-b23a-41da-b7a8-a2a6857c433c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Jul 26 18:37:53.954998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 592/1206] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:53 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:54.004670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a1a0b3da-3f92-471b-9963-d7a1c13539bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:54.006870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a1a0b3da-3f92-471b-9963-d7a1c13539bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:54.013190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1a0b3da-3f92-471b-9963-d7a1c13539bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:54.013634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1a0b3da-3f92-471b-9963-d7a1c13539bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:54.014394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1a0b3da-3f92-471b-9963-d7a1c13539bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:54.014828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1a0b3da-3f92-471b-9963-d7a1c13539bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:54.045472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a1a0b3da-3f92-471b-9963-d7a1c13539bd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Jul 26 18:37:54.046020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 615/1207] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:53 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:54.487581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-950d0c2f-6443-4ede-8319-f532b4012241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:54.489766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-950d0c2f-6443-4ede-8319-f532b4012241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:54.496360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-950d0c2f-6443-4ede-8319-f532b4012241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:54.496817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-950d0c2f-6443-4ede-8319-f532b4012241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:54.497578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-950d0c2f-6443-4ede-8319-f532b4012241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:54.498009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-950d0c2f-6443-4ede-8319-f532b4012241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:54.527474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-950d0c2f-6443-4ede-8319-f532b4012241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043801 Jul 26 18:37:54.528028 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 593/1208] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:54 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:54.705776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-44ec43b8-bc18-489d-87d2-e174368059d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:54.708012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-44ec43b8-bc18-489d-87d2-e174368059d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:54.715495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44ec43b8-bc18-489d-87d2-e174368059d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:54.716024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44ec43b8-bc18-489d-87d2-e174368059d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:54.716783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44ec43b8-bc18-489d-87d2-e174368059d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:54.717276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44ec43b8-bc18-489d-87d2-e174368059d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:54.749162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-44ec43b8-bc18-489d-87d2-e174368059d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047109 Jul 26 18:37:54.749342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 616/1209] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:54 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:54.967180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-57404624-2d3c-4b14-b00f-3120580b5a43 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:54.969334 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-57404624-2d3c-4b14-b00f-3120580b5a43 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:54.976177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-57404624-2d3c-4b14-b00f-3120580b5a43 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:54.976616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-57404624-2d3c-4b14-b00f-3120580b5a43 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:54.977372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-57404624-2d3c-4b14-b00f-3120580b5a43 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:54.977801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-57404624-2d3c-4b14-b00f-3120580b5a43 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:55.010968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-57404624-2d3c-4b14-b00f-3120580b5a43 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047674 Jul 26 18:37:55.011508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 594/1210] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:55.061259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0c459f24-8985-43f9-9830-57038092b7b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:55.064435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0c459f24-8985-43f9-9830-57038092b7b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:55.073492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c459f24-8985-43f9-9830-57038092b7b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:55.074208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c459f24-8985-43f9-9830-57038092b7b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:55.074983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c459f24-8985-43f9-9830-57038092b7b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:55.075457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c459f24-8985-43f9-9830-57038092b7b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:55.106171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0c459f24-8985-43f9-9830-57038092b7b1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050897 Jul 26 18:37:55.106758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 617/1211] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:55 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:55.543571 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-945121e5-5ead-4517-ac99-c3fdb86a6b37 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:55.545753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-945121e5-5ead-4517-ac99-c3fdb86a6b37 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:55.552286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-945121e5-5ead-4517-ac99-c3fdb86a6b37 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:55.552735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-945121e5-5ead-4517-ac99-c3fdb86a6b37 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:55.553497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-945121e5-5ead-4517-ac99-c3fdb86a6b37 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:55.553933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-945121e5-5ead-4517-ac99-c3fdb86a6b37 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:55.583430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-945121e5-5ead-4517-ac99-c3fdb86a6b37 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045169 Jul 26 18:37:55.583950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 595/1212] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:55 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:55.762680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-362ddf1c-765e-4789-a6b1-fd960963b5c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:55.764902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-362ddf1c-765e-4789-a6b1-fd960963b5c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:55.772212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-362ddf1c-765e-4789-a6b1-fd960963b5c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:55.772657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-362ddf1c-765e-4789-a6b1-fd960963b5c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:55.773420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-362ddf1c-765e-4789-a6b1-fd960963b5c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:55.773853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-362ddf1c-765e-4789-a6b1-fd960963b5c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:55.804234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-362ddf1c-765e-4789-a6b1-fd960963b5c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046268 Jul 26 18:37:55.804795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 618/1213] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:55 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:56.023879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0ec4b38e-93d1-4bc8-a823-b7af8dd54bae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:56.025965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0ec4b38e-93d1-4bc8-a823-b7af8dd54bae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:56.032998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ec4b38e-93d1-4bc8-a823-b7af8dd54bae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:56.033444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ec4b38e-93d1-4bc8-a823-b7af8dd54bae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:56.034239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ec4b38e-93d1-4bc8-a823-b7af8dd54bae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:56.034672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ec4b38e-93d1-4bc8-a823-b7af8dd54bae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:56.064122 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0ec4b38e-93d1-4bc8-a823-b7af8dd54bae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044690 Jul 26 18:37:56.064712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 596/1214] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:56 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:56.120315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b5cc0302-b310-4c86-829e-68eb1c85c431 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:56.122620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b5cc0302-b310-4c86-829e-68eb1c85c431 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:56.128947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5cc0302-b310-4c86-829e-68eb1c85c431 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:56.129390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5cc0302-b310-4c86-829e-68eb1c85c431 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:56.130163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5cc0302-b310-4c86-829e-68eb1c85c431 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:56.130591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5cc0302-b310-4c86-829e-68eb1c85c431 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:56.160776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b5cc0302-b310-4c86-829e-68eb1c85c431 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Jul 26 18:37:56.161324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 619/1215] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:56 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:56.597462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b44f7f99-3c1e-47d3-8955-5539250fc694 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:56.600021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b44f7f99-3c1e-47d3-8955-5539250fc694 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:56.607462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b44f7f99-3c1e-47d3-8955-5539250fc694 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:56.607988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b44f7f99-3c1e-47d3-8955-5539250fc694 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:56.608882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b44f7f99-3c1e-47d3-8955-5539250fc694 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:56.609420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b44f7f99-3c1e-47d3-8955-5539250fc694 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:56.641137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b44f7f99-3c1e-47d3-8955-5539250fc694 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048327 Jul 26 18:37:56.641693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 597/1216] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:56 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:56.817429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e09a9f17-0451-4fa8-b794-606cc8b46f80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:56.819671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e09a9f17-0451-4fa8-b794-606cc8b46f80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:56.826935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e09a9f17-0451-4fa8-b794-606cc8b46f80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:56.827415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e09a9f17-0451-4fa8-b794-606cc8b46f80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:56.828176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e09a9f17-0451-4fa8-b794-606cc8b46f80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:56.828592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e09a9f17-0451-4fa8-b794-606cc8b46f80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:56.858979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e09a9f17-0451-4fa8-b794-606cc8b46f80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045493 Jul 26 18:37:56.859482 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 620/1217] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:56 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:57.080911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-07051bfb-dd2d-4e0c-b1d9-6a3bcaf3bece tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:57.083482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-07051bfb-dd2d-4e0c-b1d9-6a3bcaf3bece tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:57.091703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07051bfb-dd2d-4e0c-b1d9-6a3bcaf3bece tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:57.092208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07051bfb-dd2d-4e0c-b1d9-6a3bcaf3bece tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:57.093067 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07051bfb-dd2d-4e0c-b1d9-6a3bcaf3bece tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:57.093545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07051bfb-dd2d-4e0c-b1d9-6a3bcaf3bece tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:57.122063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:57.134000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-07051bfb-dd2d-4e0c-b1d9-6a3bcaf3bece tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057658 Jul 26 18:37:57.138621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 598/1218] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:57 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:57.173426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4c8ed7f9-61ac-4e38-9376-b5b041083b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:57.175969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4c8ed7f9-61ac-4e38-9376-b5b041083b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:57.183130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c8ed7f9-61ac-4e38-9376-b5b041083b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:57.183925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c8ed7f9-61ac-4e38-9376-b5b041083b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:57.185228 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c8ed7f9-61ac-4e38-9376-b5b041083b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:57.185763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c8ed7f9-61ac-4e38-9376-b5b041083b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:57.219303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4c8ed7f9-61ac-4e38-9376-b5b041083b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050091 Jul 26 18:37:57.219869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 621/1219] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:57 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:57.655441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d7fb16e1-d2b4-483b-b7d3-756e871400d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:57.658279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d7fb16e1-d2b4-483b-b7d3-756e871400d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:57.664828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fb16e1-d2b4-483b-b7d3-756e871400d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:57.665279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fb16e1-d2b4-483b-b7d3-756e871400d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:57.666029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fb16e1-d2b4-483b-b7d3-756e871400d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:57.666467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7fb16e1-d2b4-483b-b7d3-756e871400d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:57.696794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d7fb16e1-d2b4-483b-b7d3-756e871400d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045861 Jul 26 18:37:57.697265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 599/1220] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:57 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:57.875313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-412d885b-dfcb-47bc-ac9a-d94afe0d52d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:57.878676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-412d885b-dfcb-47bc-ac9a-d94afe0d52d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:57.888341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-412d885b-dfcb-47bc-ac9a-d94afe0d52d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:57.888785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-412d885b-dfcb-47bc-ac9a-d94afe0d52d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:57.889557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-412d885b-dfcb-47bc-ac9a-d94afe0d52d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:57.889997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-412d885b-dfcb-47bc-ac9a-d94afe0d52d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:57.907701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:37:57.921410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-412d885b-dfcb-47bc-ac9a-d94afe0d52d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052666 Jul 26 18:37:57.921967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 622/1221] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:57 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:58.147969 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8962abeb-2fc9-4b9c-af6c-fcfbb249ad7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:58.150165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8962abeb-2fc9-4b9c-af6c-fcfbb249ad7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:58.157361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8962abeb-2fc9-4b9c-af6c-fcfbb249ad7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:58.157815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8962abeb-2fc9-4b9c-af6c-fcfbb249ad7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:58.158585 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8962abeb-2fc9-4b9c-af6c-fcfbb249ad7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:58.159039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8962abeb-2fc9-4b9c-af6c-fcfbb249ad7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:58.189394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8962abeb-2fc9-4b9c-af6c-fcfbb249ad7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Jul 26 18:37:58.190019 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 600/1222] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:58 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:58.235126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-033e7866-05fc-4516-b8ab-dd0caf53f8c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:58.237395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-033e7866-05fc-4516-b8ab-dd0caf53f8c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:58.244144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-033e7866-05fc-4516-b8ab-dd0caf53f8c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:58.244739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-033e7866-05fc-4516-b8ab-dd0caf53f8c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:58.246039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-033e7866-05fc-4516-b8ab-dd0caf53f8c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:58.246500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-033e7866-05fc-4516-b8ab-dd0caf53f8c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:58.275637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-033e7866-05fc-4516-b8ab-dd0caf53f8c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Jul 26 18:37:58.276188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 623/1223] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:58 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:58.712697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-56fe894d-b1be-4996-9d15-4457ae629d5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:58.716687 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-56fe894d-b1be-4996-9d15-4457ae629d5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:58.726863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56fe894d-b1be-4996-9d15-4457ae629d5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:58.727698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56fe894d-b1be-4996-9d15-4457ae629d5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:58.728914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56fe894d-b1be-4996-9d15-4457ae629d5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:58.729621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56fe894d-b1be-4996-9d15-4457ae629d5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:58.759408 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-56fe894d-b1be-4996-9d15-4457ae629d5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053282 Jul 26 18:37:58.759958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 601/1224] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:58 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:58.933855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5bcd5093-a0ac-40f7-819a-5af01f02e8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:58.936055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5bcd5093-a0ac-40f7-819a-5af01f02e8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:58.942935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5bcd5093-a0ac-40f7-819a-5af01f02e8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:58.943425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5bcd5093-a0ac-40f7-819a-5af01f02e8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:58.944188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5bcd5093-a0ac-40f7-819a-5af01f02e8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:58.944622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5bcd5093-a0ac-40f7-819a-5af01f02e8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:58.974719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5bcd5093-a0ac-40f7-819a-5af01f02e8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045036 Jul 26 18:37:58.975314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 624/1225] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:37:59.203495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4d1c07e1-9996-4c58-ab76-add135f5844b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:59.205680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4d1c07e1-9996-4c58-ab76-add135f5844b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:59.212764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d1c07e1-9996-4c58-ab76-add135f5844b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:59.213203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d1c07e1-9996-4c58-ab76-add135f5844b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:59.213949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d1c07e1-9996-4c58-ab76-add135f5844b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:59.214705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d1c07e1-9996-4c58-ab76-add135f5844b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:59.244409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4d1c07e1-9996-4c58-ab76-add135f5844b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 Jul 26 18:37:59.245187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 602/1226] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:59 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:59.288146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7ee8ca1e-c3a3-45b0-a4d5-235795795ae0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:59.290322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7ee8ca1e-c3a3-45b0-a4d5-235795795ae0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:59.296806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ee8ca1e-c3a3-45b0-a4d5-235795795ae0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:59.297259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ee8ca1e-c3a3-45b0-a4d5-235795795ae0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:59.298150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ee8ca1e-c3a3-45b0-a4d5-235795795ae0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:59.298510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ee8ca1e-c3a3-45b0-a4d5-235795795ae0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:59.328418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7ee8ca1e-c3a3-45b0-a4d5-235795795ae0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044122 Jul 26 18:37:59.328994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 625/1227] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:59 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:59.772310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4ecfae09-e402-4dda-a58f-c26217c7f6bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:59.774486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4ecfae09-e402-4dda-a58f-c26217c7f6bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:37:59.780946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ecfae09-e402-4dda-a58f-c26217c7f6bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:59.781404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ecfae09-e402-4dda-a58f-c26217c7f6bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:59.782196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ecfae09-e402-4dda-a58f-c26217c7f6bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:37:59.782638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ecfae09-e402-4dda-a58f-c26217c7f6bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:37:59.816795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4ecfae09-e402-4dda-a58f-c26217c7f6bd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049011 Jul 26 18:37:59.817345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 603/1228] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:37:59 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:37:59.989037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fcc95945-e3e9-46c7-8e8b-ead7782055d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:37:59.991795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fcc95945-e3e9-46c7-8e8b-ead7782055d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:00.000556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fcc95945-e3e9-46c7-8e8b-ead7782055d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:00.001039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fcc95945-e3e9-46c7-8e8b-ead7782055d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:00.001989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fcc95945-e3e9-46c7-8e8b-ead7782055d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:00.002525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fcc95945-e3e9-46c7-8e8b-ead7782055d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:00.034902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fcc95945-e3e9-46c7-8e8b-ead7782055d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050846 Jul 26 18:38:00.035472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 626/1229] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:37:59 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:00.257756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f6cc872a-d7de-464c-8d5c-5d100e59b407 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:00.259892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f6cc872a-d7de-464c-8d5c-5d100e59b407 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:00.267345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f6cc872a-d7de-464c-8d5c-5d100e59b407 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:00.267788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f6cc872a-d7de-464c-8d5c-5d100e59b407 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:00.268554 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f6cc872a-d7de-464c-8d5c-5d100e59b407 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:00.268979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f6cc872a-d7de-464c-8d5c-5d100e59b407 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:00.300232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f6cc872a-d7de-464c-8d5c-5d100e59b407 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046669 Jul 26 18:38:00.300800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 604/1230] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:00 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:00.341321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-539e49b1-57de-496d-a96d-0080df36621a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:00.343383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-539e49b1-57de-496d-a96d-0080df36621a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:00.349638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-539e49b1-57de-496d-a96d-0080df36621a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:00.350171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-539e49b1-57de-496d-a96d-0080df36621a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:00.351051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-539e49b1-57de-496d-a96d-0080df36621a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:00.351675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-539e49b1-57de-496d-a96d-0080df36621a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:00.382271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-539e49b1-57de-496d-a96d-0080df36621a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 Jul 26 18:38:00.382837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 627/1231] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:00 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:00.829589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8d81741a-480f-4066-b371-d9764240022b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:00.831785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8d81741a-480f-4066-b371-d9764240022b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:00.838216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d81741a-480f-4066-b371-d9764240022b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:00.838662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d81741a-480f-4066-b371-d9764240022b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:00.839485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d81741a-480f-4066-b371-d9764240022b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:00.839974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d81741a-480f-4066-b371-d9764240022b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:00.870045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8d81741a-480f-4066-b371-d9764240022b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Jul 26 18:38:00.870737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 605/1232] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:00 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:01.048569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d52f6052-a753-488c-931c-12fbfbbfa214 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:01.050728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d52f6052-a753-488c-931c-12fbfbbfa214 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:01.058032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d52f6052-a753-488c-931c-12fbfbbfa214 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:01.058500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d52f6052-a753-488c-931c-12fbfbbfa214 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:01.059343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d52f6052-a753-488c-931c-12fbfbbfa214 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:01.059796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d52f6052-a753-488c-931c-12fbfbbfa214 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:01.090519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d52f6052-a753-488c-931c-12fbfbbfa214 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046307 Jul 26 18:38:01.091087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 628/1233] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:01 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:01.313902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-df2f52a5-c5c4-4f97-9a01-30bcf357d923 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:01.316010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-df2f52a5-c5c4-4f97-9a01-30bcf357d923 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:01.323299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df2f52a5-c5c4-4f97-9a01-30bcf357d923 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:01.323783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df2f52a5-c5c4-4f97-9a01-30bcf357d923 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:01.324540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df2f52a5-c5c4-4f97-9a01-30bcf357d923 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:01.325001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df2f52a5-c5c4-4f97-9a01-30bcf357d923 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:01.354912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-df2f52a5-c5c4-4f97-9a01-30bcf357d923 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 Jul 26 18:38:01.355588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 606/1234] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:01 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:01.394539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d68fe1ba-bcf6-40ae-9a7e-e208e4e3cb8c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:01.397118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d68fe1ba-bcf6-40ae-9a7e-e208e4e3cb8c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:01.403229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d68fe1ba-bcf6-40ae-9a7e-e208e4e3cb8c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:01.403610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d68fe1ba-bcf6-40ae-9a7e-e208e4e3cb8c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:01.404413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d68fe1ba-bcf6-40ae-9a7e-e208e4e3cb8c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:01.404887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d68fe1ba-bcf6-40ae-9a7e-e208e4e3cb8c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:01.436258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d68fe1ba-bcf6-40ae-9a7e-e208e4e3cb8c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 Jul 26 18:38:01.437011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 629/1235] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:01 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:01.884651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1789a2e5-bb0a-4db3-914a-d0cead717240 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:01.887462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1789a2e5-bb0a-4db3-914a-d0cead717240 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:01.895778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1789a2e5-bb0a-4db3-914a-d0cead717240 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:01.896365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1789a2e5-bb0a-4db3-914a-d0cead717240 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:01.897327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1789a2e5-bb0a-4db3-914a-d0cead717240 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:01.897865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1789a2e5-bb0a-4db3-914a-d0cead717240 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:01.928650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1789a2e5-bb0a-4db3-914a-d0cead717240 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048982 Jul 26 18:38:01.929219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 607/1236] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:01 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:02.105634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aa923e64-6cbe-4782-b69b-125c21e37743 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:02.108586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aa923e64-6cbe-4782-b69b-125c21e37743 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:02.121220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa923e64-6cbe-4782-b69b-125c21e37743 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:02.121652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa923e64-6cbe-4782-b69b-125c21e37743 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:02.122418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa923e64-6cbe-4782-b69b-125c21e37743 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:02.122865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa923e64-6cbe-4782-b69b-125c21e37743 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:02.152890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aa923e64-6cbe-4782-b69b-125c21e37743 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053198 Jul 26 18:38:02.153463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 630/1237] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:02 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:02.368401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bb940847-15d6-4d13-a55e-4273cc83868b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:02.370484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bb940847-15d6-4d13-a55e-4273cc83868b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:02.377506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb940847-15d6-4d13-a55e-4273cc83868b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:02.377955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb940847-15d6-4d13-a55e-4273cc83868b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:02.378692 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb940847-15d6-4d13-a55e-4273cc83868b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:02.379183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb940847-15d6-4d13-a55e-4273cc83868b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:02.409285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bb940847-15d6-4d13-a55e-4273cc83868b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045050 Jul 26 18:38:02.409844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 608/1238] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:02 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:02.448799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7e91a74b-779d-4cd9-8326-0dd401748649 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:02.451132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7e91a74b-779d-4cd9-8326-0dd401748649 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:02.457412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e91a74b-779d-4cd9-8326-0dd401748649 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:02.457906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e91a74b-779d-4cd9-8326-0dd401748649 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:02.458676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e91a74b-779d-4cd9-8326-0dd401748649 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:02.459476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e91a74b-779d-4cd9-8326-0dd401748649 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:02.490076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7e91a74b-779d-4cd9-8326-0dd401748649 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045246 Jul 26 18:38:02.490643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 631/1239] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:02 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:02.943917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9e63742d-c382-493f-b565-6e267416aadd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:02.947003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9e63742d-c382-493f-b565-6e267416aadd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:02.954176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e63742d-c382-493f-b565-6e267416aadd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:02.954623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e63742d-c382-493f-b565-6e267416aadd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:02.955425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e63742d-c382-493f-b565-6e267416aadd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:02.955858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e63742d-c382-493f-b565-6e267416aadd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:02.985114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9e63742d-c382-493f-b565-6e267416aadd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047376 Jul 26 18:38:02.985663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 609/1240] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:03.168667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2c50b695-e8e5-4b83-a230-1bad76666127 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:03.170727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2c50b695-e8e5-4b83-a230-1bad76666127 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:03.177470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2c50b695-e8e5-4b83-a230-1bad76666127 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:03.177896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2c50b695-e8e5-4b83-a230-1bad76666127 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:03.178650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2c50b695-e8e5-4b83-a230-1bad76666127 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:03.179081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2c50b695-e8e5-4b83-a230-1bad76666127 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:03.208922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2c50b695-e8e5-4b83-a230-1bad76666127 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046218 Jul 26 18:38:03.209486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 632/1241] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:03 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:03.422345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ad836511-9b2a-415d-90da-f14719a44beb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:03.424458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ad836511-9b2a-415d-90da-f14719a44beb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:03.431384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad836511-9b2a-415d-90da-f14719a44beb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:03.431832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad836511-9b2a-415d-90da-f14719a44beb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:03.432603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad836511-9b2a-415d-90da-f14719a44beb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:03.433037 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad836511-9b2a-415d-90da-f14719a44beb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:03.462791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ad836511-9b2a-415d-90da-f14719a44beb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044646 Jul 26 18:38:03.463367 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 610/1242] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:03 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:03.502601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f4e598e9-81a2-4600-8fe8-b8f711f696e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:03.504795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f4e598e9-81a2-4600-8fe8-b8f711f696e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:03.510948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4e598e9-81a2-4600-8fe8-b8f711f696e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:03.511458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4e598e9-81a2-4600-8fe8-b8f711f696e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:03.512236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4e598e9-81a2-4600-8fe8-b8f711f696e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:03.512638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4e598e9-81a2-4600-8fe8-b8f711f696e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:03.542660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f4e598e9-81a2-4600-8fe8-b8f711f696e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044228 Jul 26 18:38:03.543271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 633/1243] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:03 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:04.001693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-488a0d5d-6003-4028-94b6-3b6cf8b9957f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:04.005485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-488a0d5d-6003-4028-94b6-3b6cf8b9957f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:04.014217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-488a0d5d-6003-4028-94b6-3b6cf8b9957f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:04.014664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-488a0d5d-6003-4028-94b6-3b6cf8b9957f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:04.015465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-488a0d5d-6003-4028-94b6-3b6cf8b9957f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:04.015907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-488a0d5d-6003-4028-94b6-3b6cf8b9957f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:04.045775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-488a0d5d-6003-4028-94b6-3b6cf8b9957f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050840 Jul 26 18:38:04.046336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 611/1244] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:03 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:04.225471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8d7b4d96-85d8-4cf0-b1aa-da207e496058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:04.228872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8d7b4d96-85d8-4cf0-b1aa-da207e496058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:04.238329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d7b4d96-85d8-4cf0-b1aa-da207e496058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:04.238839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d7b4d96-85d8-4cf0-b1aa-da207e496058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:04.239788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d7b4d96-85d8-4cf0-b1aa-da207e496058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:04.240321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d7b4d96-85d8-4cf0-b1aa-da207e496058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:04.272549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8d7b4d96-85d8-4cf0-b1aa-da207e496058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053557 Jul 26 18:38:04.273025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 634/1245] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:04 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:04.478290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-17bfa047-ce2b-4197-b7f7-dfe7d496378e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:04.481220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-17bfa047-ce2b-4197-b7f7-dfe7d496378e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:04.488322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17bfa047-ce2b-4197-b7f7-dfe7d496378e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:04.488767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17bfa047-ce2b-4197-b7f7-dfe7d496378e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:04.489525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17bfa047-ce2b-4197-b7f7-dfe7d496378e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:04.489953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17bfa047-ce2b-4197-b7f7-dfe7d496378e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:04.531169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-17bfa047-ce2b-4197-b7f7-dfe7d496378e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058538 Jul 26 18:38:04.531769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 612/1246] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:04 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:04.555042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4d7530da-938f-49f1-8120-27dfb1b0ea5a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:04.557245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4d7530da-938f-49f1-8120-27dfb1b0ea5a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:04.563779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d7530da-938f-49f1-8120-27dfb1b0ea5a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:04.564228 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d7530da-938f-49f1-8120-27dfb1b0ea5a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:04.565005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d7530da-938f-49f1-8120-27dfb1b0ea5a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:04.565441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d7530da-938f-49f1-8120-27dfb1b0ea5a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:04.595728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4d7530da-938f-49f1-8120-27dfb1b0ea5a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044620 Jul 26 18:38:04.596324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 635/1247] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:04 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:05.061861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-351065fe-ea51-430e-b5d0-fc30cc0b1882 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:05.064142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-351065fe-ea51-430e-b5d0-fc30cc0b1882 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:05.070529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-351065fe-ea51-430e-b5d0-fc30cc0b1882 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:05.070970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-351065fe-ea51-430e-b5d0-fc30cc0b1882 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:05.071756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-351065fe-ea51-430e-b5d0-fc30cc0b1882 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:05.072185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-351065fe-ea51-430e-b5d0-fc30cc0b1882 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:05.102483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-351065fe-ea51-430e-b5d0-fc30cc0b1882 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045073 Jul 26 18:38:05.103053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 613/1248] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:05 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:05.285425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1b7a5b60-9b89-4aa8-bdc0-27b486743da2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:05.287680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1b7a5b60-9b89-4aa8-bdc0-27b486743da2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:05.294863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b7a5b60-9b89-4aa8-bdc0-27b486743da2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:05.295329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b7a5b60-9b89-4aa8-bdc0-27b486743da2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:05.296085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b7a5b60-9b89-4aa8-bdc0-27b486743da2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:05.296510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b7a5b60-9b89-4aa8-bdc0-27b486743da2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:05.328909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1b7a5b60-9b89-4aa8-bdc0-27b486743da2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047046 Jul 26 18:38:05.329642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 636/1249] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:05.545567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e1b16013-fff3-4fab-8a19-b953fc0bf482 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:05.547764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e1b16013-fff3-4fab-8a19-b953fc0bf482 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:05.554841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1b16013-fff3-4fab-8a19-b953fc0bf482 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:05.555300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1b16013-fff3-4fab-8a19-b953fc0bf482 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:05.556095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1b16013-fff3-4fab-8a19-b953fc0bf482 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:05.556524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1b16013-fff3-4fab-8a19-b953fc0bf482 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:05.586217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e1b16013-fff3-4fab-8a19-b953fc0bf482 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044660 Jul 26 18:38:05.586694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 614/1250] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:05 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:05.608581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-176d898f-e733-4ec7-b49e-121f8d5f0e9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:05.610792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-176d898f-e733-4ec7-b49e-121f8d5f0e9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:05.619355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-176d898f-e733-4ec7-b49e-121f8d5f0e9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:05.619355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-176d898f-e733-4ec7-b49e-121f8d5f0e9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:05.619355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-176d898f-e733-4ec7-b49e-121f8d5f0e9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:05.619680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-176d898f-e733-4ec7-b49e-121f8d5f0e9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:05.650049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-176d898f-e733-4ec7-b49e-121f8d5f0e9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045486 Jul 26 18:38:05.650784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 637/1251] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:05 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:06.116189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3d67e85c-b9f1-41e7-963a-0c105591789a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:06.118350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3d67e85c-b9f1-41e7-963a-0c105591789a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:06.124759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d67e85c-b9f1-41e7-963a-0c105591789a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:06.125155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d67e85c-b9f1-41e7-963a-0c105591789a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:06.126228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d67e85c-b9f1-41e7-963a-0c105591789a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:06.126726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d67e85c-b9f1-41e7-963a-0c105591789a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:06.141408 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:06.158242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3d67e85c-b9f1-41e7-963a-0c105591789a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046085 Jul 26 18:38:06.158806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 615/1252] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:06 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:06.344588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e14013b9-6141-4c88-969f-108190256f95 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:06.346786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e14013b9-6141-4c88-969f-108190256f95 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:06.354030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e14013b9-6141-4c88-969f-108190256f95 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:06.354491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e14013b9-6141-4c88-969f-108190256f95 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:06.355307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e14013b9-6141-4c88-969f-108190256f95 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:06.355729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e14013b9-6141-4c88-969f-108190256f95 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:06.387349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e14013b9-6141-4c88-969f-108190256f95 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046793 Jul 26 18:38:06.387915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 638/1253] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:06 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:06.599558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8bc16cf8-480e-4173-a325-fd91b9052d54 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:06.601631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8bc16cf8-480e-4173-a325-fd91b9052d54 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:06.608141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8bc16cf8-480e-4173-a325-fd91b9052d54 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:06.608582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8bc16cf8-480e-4173-a325-fd91b9052d54 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:06.609347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8bc16cf8-480e-4173-a325-fd91b9052d54 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:06.609772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8bc16cf8-480e-4173-a325-fd91b9052d54 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:06.640399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8bc16cf8-480e-4173-a325-fd91b9052d54 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Jul 26 18:38:06.640954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 616/1254] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:06 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:06.661989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e5786b7a-7f11-4bdf-ace6-ca1eba485a6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:06.664308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e5786b7a-7f11-4bdf-ace6-ca1eba485a6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:06.670606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5786b7a-7f11-4bdf-ace6-ca1eba485a6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:06.671164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5786b7a-7f11-4bdf-ace6-ca1eba485a6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:06.671930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5786b7a-7f11-4bdf-ace6-ca1eba485a6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:06.672407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5786b7a-7f11-4bdf-ace6-ca1eba485a6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:06.676764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:06.703267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e5786b7a-7f11-4bdf-ace6-ca1eba485a6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045202 Jul 26 18:38:06.704055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 639/1255] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:06 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:07.171350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6f8ae6c7-4410-4909-91b6-66c16705fb09 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:07.173942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6f8ae6c7-4410-4909-91b6-66c16705fb09 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:07.181489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f8ae6c7-4410-4909-91b6-66c16705fb09 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:07.182004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f8ae6c7-4410-4909-91b6-66c16705fb09 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:07.182894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f8ae6c7-4410-4909-91b6-66c16705fb09 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:07.183511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f8ae6c7-4410-4909-91b6-66c16705fb09 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:07.213268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6f8ae6c7-4410-4909-91b6-66c16705fb09 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046850 Jul 26 18:38:07.213831 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 617/1256] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:07 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:07.400733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2b9f6b0a-7d34-4c48-a65a-b0f5b2039e37 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:07.402985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2b9f6b0a-7d34-4c48-a65a-b0f5b2039e37 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:07.409900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b9f6b0a-7d34-4c48-a65a-b0f5b2039e37 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:07.410342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b9f6b0a-7d34-4c48-a65a-b0f5b2039e37 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:07.411123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b9f6b0a-7d34-4c48-a65a-b0f5b2039e37 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:07.411550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b9f6b0a-7d34-4c48-a65a-b0f5b2039e37 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:07.448145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2b9f6b0a-7d34-4c48-a65a-b0f5b2039e37 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051410 Jul 26 18:38:07.449500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 640/1257] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:07.656728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3c8b9753-41ee-4d3c-a49c-caaa4084a4db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:07.659936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3c8b9753-41ee-4d3c-a49c-caaa4084a4db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:07.669126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c8b9753-41ee-4d3c-a49c-caaa4084a4db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:07.669576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c8b9753-41ee-4d3c-a49c-caaa4084a4db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:07.670341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c8b9753-41ee-4d3c-a49c-caaa4084a4db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:07.670774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c8b9753-41ee-4d3c-a49c-caaa4084a4db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:07.700142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3c8b9753-41ee-4d3c-a49c-caaa4084a4db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049851 Jul 26 18:38:07.700617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 618/1258] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:07 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:07.718054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f256fad5-03b3-461a-9539-c430a71a9a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:07.721165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f256fad5-03b3-461a-9539-c430a71a9a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:07.728341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f256fad5-03b3-461a-9539-c430a71a9a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:07.728789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f256fad5-03b3-461a-9539-c430a71a9a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:07.729552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f256fad5-03b3-461a-9539-c430a71a9a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:07.730027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f256fad5-03b3-461a-9539-c430a71a9a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:07.760019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f256fad5-03b3-461a-9539-c430a71a9a77 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047795 Jul 26 18:38:07.760590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 641/1259] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:07 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:08.227332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-828d335d-3c8a-4df0-b52a-c850ff1eb96d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:08.229530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-828d335d-3c8a-4df0-b52a-c850ff1eb96d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:08.236240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-828d335d-3c8a-4df0-b52a-c850ff1eb96d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:08.236691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-828d335d-3c8a-4df0-b52a-c850ff1eb96d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:08.237455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-828d335d-3c8a-4df0-b52a-c850ff1eb96d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:08.237877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-828d335d-3c8a-4df0-b52a-c850ff1eb96d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:08.267813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-828d335d-3c8a-4df0-b52a-c850ff1eb96d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Jul 26 18:38:08.268370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 619/1260] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:08.462550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-95ba14db-2931-45ca-bcea-dcf5f2e16fa3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:08.464735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-95ba14db-2931-45ca-bcea-dcf5f2e16fa3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:08.471946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95ba14db-2931-45ca-bcea-dcf5f2e16fa3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:08.472392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95ba14db-2931-45ca-bcea-dcf5f2e16fa3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:08.473156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95ba14db-2931-45ca-bcea-dcf5f2e16fa3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:08.473592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95ba14db-2931-45ca-bcea-dcf5f2e16fa3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:08.504400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-95ba14db-2931-45ca-bcea-dcf5f2e16fa3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045853 Jul 26 18:38:08.504899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 642/1261] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:08 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:08.712906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a2174713-d807-40a0-899e-d6d4ad99b5a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:08.715216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a2174713-d807-40a0-899e-d6d4ad99b5a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:08.722205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2174713-d807-40a0-899e-d6d4ad99b5a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:08.722676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2174713-d807-40a0-899e-d6d4ad99b5a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:08.723491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2174713-d807-40a0-899e-d6d4ad99b5a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:08.723921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2174713-d807-40a0-899e-d6d4ad99b5a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:08.754373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a2174713-d807-40a0-899e-d6d4ad99b5a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045460 Jul 26 18:38:08.755044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 620/1262] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:08 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:08.773843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-302efc09-d2c3-41e1-8830-ddbff9d01bdd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:08.776068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-302efc09-d2c3-41e1-8830-ddbff9d01bdd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:08.782836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-302efc09-d2c3-41e1-8830-ddbff9d01bdd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:08.783314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-302efc09-d2c3-41e1-8830-ddbff9d01bdd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:08.784108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-302efc09-d2c3-41e1-8830-ddbff9d01bdd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:08.784536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-302efc09-d2c3-41e1-8830-ddbff9d01bdd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:08.819434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-302efc09-d2c3-41e1-8830-ddbff9d01bdd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049926 Jul 26 18:38:08.820024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 643/1263] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:08 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:38:09.280132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-02a77f12-2882-418d-9bd0-669ac5f6a61a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:09.282570 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-02a77f12-2882-418d-9bd0-669ac5f6a61a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:09.288856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02a77f12-2882-418d-9bd0-669ac5f6a61a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:09.289299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02a77f12-2882-418d-9bd0-669ac5f6a61a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:09.290064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02a77f12-2882-418d-9bd0-669ac5f6a61a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:09.290488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02a77f12-2882-418d-9bd0-669ac5f6a61a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:09.321945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-02a77f12-2882-418d-9bd0-669ac5f6a61a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045742 Jul 26 18:38:09.322485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 621/1264] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:09 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:09.517311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1564939b-6c41-453d-9f42-c5fb1ec4a6c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:09.519552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1564939b-6c41-453d-9f42-c5fb1ec4a6c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:09.527387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1564939b-6c41-453d-9f42-c5fb1ec4a6c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:09.527851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1564939b-6c41-453d-9f42-c5fb1ec4a6c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:09.528643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1564939b-6c41-453d-9f42-c5fb1ec4a6c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:09.529080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1564939b-6c41-453d-9f42-c5fb1ec4a6c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:09.563976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1564939b-6c41-453d-9f42-c5fb1ec4a6c6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050598 Jul 26 18:38:09.564435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 644/1265] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:09 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:09.766940 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8094e99e-f722-4b9f-b873-72ccbc3ebcf8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:09.769530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8094e99e-f722-4b9f-b873-72ccbc3ebcf8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:09.777790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8094e99e-f722-4b9f-b873-72ccbc3ebcf8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:09.778228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8094e99e-f722-4b9f-b873-72ccbc3ebcf8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:09.778995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8094e99e-f722-4b9f-b873-72ccbc3ebcf8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:09.779451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8094e99e-f722-4b9f-b873-72ccbc3ebcf8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:09.811567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8094e99e-f722-4b9f-b873-72ccbc3ebcf8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048057 Jul 26 18:38:09.812881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 622/1266] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:09 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:09.831840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-be4ba701-a40b-4664-9d6f-a401ec3e4ddf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:09.834097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-be4ba701-a40b-4664-9d6f-a401ec3e4ddf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:09.840354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be4ba701-a40b-4664-9d6f-a401ec3e4ddf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:09.840792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be4ba701-a40b-4664-9d6f-a401ec3e4ddf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:09.841548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be4ba701-a40b-4664-9d6f-a401ec3e4ddf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:09.841972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be4ba701-a40b-4664-9d6f-a401ec3e4ddf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:09.871370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-be4ba701-a40b-4664-9d6f-a401ec3e4ddf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043829 Jul 26 18:38:09.871952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 645/1267] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:09 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:38:10.337540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-869a373f-ddd5-4923-9d0b-cd25bfe0f07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:10.340387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-869a373f-ddd5-4923-9d0b-cd25bfe0f07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:10.347057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-869a373f-ddd5-4923-9d0b-cd25bfe0f07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:10.347544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-869a373f-ddd5-4923-9d0b-cd25bfe0f07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:10.348298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-869a373f-ddd5-4923-9d0b-cd25bfe0f07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:10.348724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-869a373f-ddd5-4923-9d0b-cd25bfe0f07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:10.378822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-869a373f-ddd5-4923-9d0b-cd25bfe0f07c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046934 Jul 26 18:38:10.379395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 623/1268] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:10 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:10.582263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-83421e7e-f88d-4ea9-9771-8d61eb5ff959 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:10.585637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-83421e7e-f88d-4ea9-9771-8d61eb5ff959 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:10.596175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83421e7e-f88d-4ea9-9771-8d61eb5ff959 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:10.596685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83421e7e-f88d-4ea9-9771-8d61eb5ff959 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:10.597832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83421e7e-f88d-4ea9-9771-8d61eb5ff959 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:10.598452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83421e7e-f88d-4ea9-9771-8d61eb5ff959 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:10.629973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-83421e7e-f88d-4ea9-9771-8d61eb5ff959 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054158 Jul 26 18:38:10.630526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 646/1269] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:10 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:10.828822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b62a65a0-a6d2-4052-a4d0-dcfd9ee34be1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:10.831211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b62a65a0-a6d2-4052-a4d0-dcfd9ee34be1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:10.841171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b62a65a0-a6d2-4052-a4d0-dcfd9ee34be1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:10.841612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b62a65a0-a6d2-4052-a4d0-dcfd9ee34be1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:10.842494 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b62a65a0-a6d2-4052-a4d0-dcfd9ee34be1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:10.843249 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b62a65a0-a6d2-4052-a4d0-dcfd9ee34be1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:10.877964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b62a65a0-a6d2-4052-a4d0-dcfd9ee34be1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055494 Jul 26 18:38:10.881018 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 624/1270] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:10.886194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b8cc6bb8-6f31-4ac5-8aa0-e305a7dcfe4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:10.888407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b8cc6bb8-6f31-4ac5-8aa0-e305a7dcfe4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:10.896950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8cc6bb8-6f31-4ac5-8aa0-e305a7dcfe4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:10.897401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8cc6bb8-6f31-4ac5-8aa0-e305a7dcfe4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:10.898216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8cc6bb8-6f31-4ac5-8aa0-e305a7dcfe4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:10.898658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8cc6bb8-6f31-4ac5-8aa0-e305a7dcfe4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:10.929871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b8cc6bb8-6f31-4ac5-8aa0-e305a7dcfe4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049963 Jul 26 18:38:10.930738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 647/1271] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:10 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:11.392363 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0fd9b781-c9b9-4843-8182-f02b04a93e40 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:11.394559 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0fd9b781-c9b9-4843-8182-f02b04a93e40 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:11.396855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:11.402928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fd9b781-c9b9-4843-8182-f02b04a93e40 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:11.403404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fd9b781-c9b9-4843-8182-f02b04a93e40 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:11.404190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fd9b781-c9b9-4843-8182-f02b04a93e40 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:11.404645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fd9b781-c9b9-4843-8182-f02b04a93e40 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:11.437848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0fd9b781-c9b9-4843-8182-f02b04a93e40 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049677 Jul 26 18:38:11.438435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 625/1272] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:11.642970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-22d9fed3-c231-4ada-87b6-8d25d89306e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:11.645083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-22d9fed3-c231-4ada-87b6-8d25d89306e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:11.652831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-22d9fed3-c231-4ada-87b6-8d25d89306e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:11.653272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-22d9fed3-c231-4ada-87b6-8d25d89306e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:11.654041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-22d9fed3-c231-4ada-87b6-8d25d89306e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:11.654469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-22d9fed3-c231-4ada-87b6-8d25d89306e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:11.684936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-22d9fed3-c231-4ada-87b6-8d25d89306e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046106 Jul 26 18:38:11.685510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 648/1273] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:11.889781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-16d6a983-41af-46a0-9355-125cb061ec7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:11.891951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-16d6a983-41af-46a0-9355-125cb061ec7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:11.899014 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16d6a983-41af-46a0-9355-125cb061ec7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:11.899412 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16d6a983-41af-46a0-9355-125cb061ec7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:11.900172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16d6a983-41af-46a0-9355-125cb061ec7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:11.900595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16d6a983-41af-46a0-9355-125cb061ec7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:11.930193 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-16d6a983-41af-46a0-9355-125cb061ec7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044444 Jul 26 18:38:11.930740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 626/1274] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:11 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:11.942048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-11f25d03-ad48-4b82-a0ed-b1e697cd5c15 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:11.944424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-11f25d03-ad48-4b82-a0ed-b1e697cd5c15 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:11.950817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11f25d03-ad48-4b82-a0ed-b1e697cd5c15 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:11.951292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11f25d03-ad48-4b82-a0ed-b1e697cd5c15 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:11.952048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11f25d03-ad48-4b82-a0ed-b1e697cd5c15 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:11.952477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11f25d03-ad48-4b82-a0ed-b1e697cd5c15 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:11.983536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-11f25d03-ad48-4b82-a0ed-b1e697cd5c15 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Jul 26 18:38:11.984099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 649/1275] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:11 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:12.450454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-836207ad-c3d3-461d-8fa8-8d3fb5c657bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:12.452705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-836207ad-c3d3-461d-8fa8-8d3fb5c657bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:12.459347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-836207ad-c3d3-461d-8fa8-8d3fb5c657bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:12.459807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-836207ad-c3d3-461d-8fa8-8d3fb5c657bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:12.460570 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-836207ad-c3d3-461d-8fa8-8d3fb5c657bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:12.461029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-836207ad-c3d3-461d-8fa8-8d3fb5c657bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:12.490646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-836207ad-c3d3-461d-8fa8-8d3fb5c657bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Jul 26 18:38:12.491250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 627/1276] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:12 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:12.697695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5fe2f0d7-0817-4b71-ad33-d6a8f20046e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:12.699854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5fe2f0d7-0817-4b71-ad33-d6a8f20046e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:12.706795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fe2f0d7-0817-4b71-ad33-d6a8f20046e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:12.707276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fe2f0d7-0817-4b71-ad33-d6a8f20046e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:12.708051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fe2f0d7-0817-4b71-ad33-d6a8f20046e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:12.708487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fe2f0d7-0817-4b71-ad33-d6a8f20046e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:12.739728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5fe2f0d7-0817-4b71-ad33-d6a8f20046e3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046161 Jul 26 18:38:12.740295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 650/1277] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:12 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:12.943523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-54f70a41-9309-46a9-858c-8675abe808cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:12.949637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-54f70a41-9309-46a9-858c-8675abe808cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:12.952316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-54f70a41-9309-46a9-858c-8675abe808cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:12.952758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-54f70a41-9309-46a9-858c-8675abe808cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:12.953530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-54f70a41-9309-46a9-858c-8675abe808cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:12.953960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-54f70a41-9309-46a9-858c-8675abe808cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:12.983104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-54f70a41-9309-46a9-858c-8675abe808cb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043680 Jul 26 18:38:12.983655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 628/1278] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:12 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:12.996327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b1269457-6a10-4ecf-a4c0-8eb237693355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:12.999000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b1269457-6a10-4ecf-a4c0-8eb237693355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:13.005496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1269457-6a10-4ecf-a4c0-8eb237693355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:13.005927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1269457-6a10-4ecf-a4c0-8eb237693355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:13.006677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1269457-6a10-4ecf-a4c0-8eb237693355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:13.007141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1269457-6a10-4ecf-a4c0-8eb237693355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:13.037302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b1269457-6a10-4ecf-a4c0-8eb237693355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045153 Jul 26 18:38:13.037727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 651/1279] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:12 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:38:13.502657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-482ee97e-121b-41b9-9c53-5ff17c81bf21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:13.504835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-482ee97e-121b-41b9-9c53-5ff17c81bf21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:13.511450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-482ee97e-121b-41b9-9c53-5ff17c81bf21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:13.511901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-482ee97e-121b-41b9-9c53-5ff17c81bf21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:13.512673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-482ee97e-121b-41b9-9c53-5ff17c81bf21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:13.513103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-482ee97e-121b-41b9-9c53-5ff17c81bf21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:13.543190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-482ee97e-121b-41b9-9c53-5ff17c81bf21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044532 Jul 26 18:38:13.544020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 629/1280] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:13 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:13.752434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-49e3e803-0d77-4429-a22d-f672b4e738b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:13.754619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-49e3e803-0d77-4429-a22d-f672b4e738b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:13.756995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:13.762453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49e3e803-0d77-4429-a22d-f672b4e738b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:13.762896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49e3e803-0d77-4429-a22d-f672b4e738b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:13.763700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49e3e803-0d77-4429-a22d-f672b4e738b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:13.764132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49e3e803-0d77-4429-a22d-f672b4e738b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:13.795309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-49e3e803-0d77-4429-a22d-f672b4e738b4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046819 Jul 26 18:38:13.795875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 652/1281] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:13.995897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d1a39f79-cc0e-4f4d-8948-f6263dbb7322 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:13.998135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d1a39f79-cc0e-4f4d-8948-f6263dbb7322 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:14.005006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d1a39f79-cc0e-4f4d-8948-f6263dbb7322 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:14.005482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d1a39f79-cc0e-4f4d-8948-f6263dbb7322 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:14.006242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d1a39f79-cc0e-4f4d-8948-f6263dbb7322 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:14.006669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d1a39f79-cc0e-4f4d-8948-f6263dbb7322 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:14.036462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d1a39f79-cc0e-4f4d-8948-f6263dbb7322 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044608 Jul 26 18:38:14.037021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 630/1282] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:14.048918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c4e61b8f-f099-4f14-8338-d53f4c710962 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:14.051188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c4e61b8f-f099-4f14-8338-d53f4c710962 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:14.057630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4e61b8f-f099-4f14-8338-d53f4c710962 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:14.058075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4e61b8f-f099-4f14-8338-d53f4c710962 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:14.058971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4e61b8f-f099-4f14-8338-d53f4c710962 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:14.059438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4e61b8f-f099-4f14-8338-d53f4c710962 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:14.089617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c4e61b8f-f099-4f14-8338-d53f4c710962 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044612 Jul 26 18:38:14.090205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 653/1283] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:14 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:14.558112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8a85761d-776f-4ceb-a2c1-f4e3f1e61108 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:14.560434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8a85761d-776f-4ceb-a2c1-f4e3f1e61108 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:14.567446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a85761d-776f-4ceb-a2c1-f4e3f1e61108 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:14.567872 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a85761d-776f-4ceb-a2c1-f4e3f1e61108 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:14.568664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a85761d-776f-4ceb-a2c1-f4e3f1e61108 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:14.569092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a85761d-776f-4ceb-a2c1-f4e3f1e61108 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:14.598906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8a85761d-776f-4ceb-a2c1-f4e3f1e61108 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046591 Jul 26 18:38:14.599505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 631/1284] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:14 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:14.808585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f4676832-2cb3-47f7-8372-fd462d3c4f98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:14.810648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f4676832-2cb3-47f7-8372-fd462d3c4f98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:14.817394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4676832-2cb3-47f7-8372-fd462d3c4f98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:14.817854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4676832-2cb3-47f7-8372-fd462d3c4f98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:14.818628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4676832-2cb3-47f7-8372-fd462d3c4f98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:14.819070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4676832-2cb3-47f7-8372-fd462d3c4f98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:14.849138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f4676832-2cb3-47f7-8372-fd462d3c4f98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044884 Jul 26 18:38:14.849696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 654/1285] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:14 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 18:38:15.048967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-79a8f835-282d-49ae-906e-04d8294086dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:15.051170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-79a8f835-282d-49ae-906e-04d8294086dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:15.058115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79a8f835-282d-49ae-906e-04d8294086dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:15.058548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79a8f835-282d-49ae-906e-04d8294086dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:15.059403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79a8f835-282d-49ae-906e-04d8294086dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:15.059765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79a8f835-282d-49ae-906e-04d8294086dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:15.062071 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:15.090489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-79a8f835-282d-49ae-906e-04d8294086dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Jul 26 18:38:15.091191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 632/1286] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:15 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:15.101976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-115ad95d-3687-400a-b075-03c5df8da205 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:15.104166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-115ad95d-3687-400a-b075-03c5df8da205 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:15.110919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-115ad95d-3687-400a-b075-03c5df8da205 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:15.111404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-115ad95d-3687-400a-b075-03c5df8da205 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:15.112201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-115ad95d-3687-400a-b075-03c5df8da205 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:15.112631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-115ad95d-3687-400a-b075-03c5df8da205 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:15.138962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:15.143960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-115ad95d-3687-400a-b075-03c5df8da205 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045983 Jul 26 18:38:15.144535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 655/1287] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:15 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:15.612297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2822e200-f5a2-4e3a-8b5e-0933f19293fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:15.614464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2822e200-f5a2-4e3a-8b5e-0933f19293fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:15.621551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2822e200-f5a2-4e3a-8b5e-0933f19293fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:15.622158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2822e200-f5a2-4e3a-8b5e-0933f19293fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:15.623159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2822e200-f5a2-4e3a-8b5e-0933f19293fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:15.623624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2822e200-f5a2-4e3a-8b5e-0933f19293fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:15.653973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2822e200-f5a2-4e3a-8b5e-0933f19293fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046056 Jul 26 18:38:15.654535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 633/1288] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:15.861946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a4cf0cb6-4f69-4a02-9703-3934b49cf31f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:15.864426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a4cf0cb6-4f69-4a02-9703-3934b49cf31f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:15.872198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4cf0cb6-4f69-4a02-9703-3934b49cf31f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:15.872672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4cf0cb6-4f69-4a02-9703-3934b49cf31f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:15.873450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4cf0cb6-4f69-4a02-9703-3934b49cf31f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:15.873883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4cf0cb6-4f69-4a02-9703-3934b49cf31f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:15.908964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a4cf0cb6-4f69-4a02-9703-3934b49cf31f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051326 Jul 26 18:38:15.909541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 656/1289] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:15 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:16.103542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a01c0f97-1821-4753-a014-e3db17359a94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:16.105718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a01c0f97-1821-4753-a014-e3db17359a94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:16.112528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a01c0f97-1821-4753-a014-e3db17359a94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:16.112966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a01c0f97-1821-4753-a014-e3db17359a94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:16.113715 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a01c0f97-1821-4753-a014-e3db17359a94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:16.114140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a01c0f97-1821-4753-a014-e3db17359a94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:16.144215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a01c0f97-1821-4753-a014-e3db17359a94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044706 Jul 26 18:38:16.144789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 634/1290] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:16 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:16.156878 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1ba861f3-7b62-4921-a920-a456c4994790 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:16.159005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1ba861f3-7b62-4921-a920-a456c4994790 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:16.165300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ba861f3-7b62-4921-a920-a456c4994790 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:16.165739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ba861f3-7b62-4921-a920-a456c4994790 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:16.166485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ba861f3-7b62-4921-a920-a456c4994790 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:16.166913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ba861f3-7b62-4921-a920-a456c4994790 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:16.196705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1ba861f3-7b62-4921-a920-a456c4994790 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043726 Jul 26 18:38:16.197325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 657/1291] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:16 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:16.666846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4f61aeb8-3330-413a-8e7a-8ac438fbaabe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:16.669018 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4f61aeb8-3330-413a-8e7a-8ac438fbaabe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:16.675519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4f61aeb8-3330-413a-8e7a-8ac438fbaabe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:16.675965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4f61aeb8-3330-413a-8e7a-8ac438fbaabe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:16.676726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4f61aeb8-3330-413a-8e7a-8ac438fbaabe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:16.677155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4f61aeb8-3330-413a-8e7a-8ac438fbaabe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:16.706539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4f61aeb8-3330-413a-8e7a-8ac438fbaabe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Jul 26 18:38:16.707122 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 635/1292] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:16.922337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-85e2e2a5-0dda-40ec-8a7a-15a929d58cbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:16.924447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-85e2e2a5-0dda-40ec-8a7a-15a929d58cbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:16.931342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-85e2e2a5-0dda-40ec-8a7a-15a929d58cbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:16.931779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-85e2e2a5-0dda-40ec-8a7a-15a929d58cbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:16.932538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-85e2e2a5-0dda-40ec-8a7a-15a929d58cbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:16.932973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-85e2e2a5-0dda-40ec-8a7a-15a929d58cbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:16.962337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-85e2e2a5-0dda-40ec-8a7a-15a929d58cbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044112 Jul 26 18:38:16.962889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 658/1293] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:16 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:17.159201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-41bc9eba-e0cc-4789-b188-847cb2188741 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:17.161357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-41bc9eba-e0cc-4789-b188-847cb2188741 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:17.168409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41bc9eba-e0cc-4789-b188-847cb2188741 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:17.168873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41bc9eba-e0cc-4789-b188-847cb2188741 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:17.169633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41bc9eba-e0cc-4789-b188-847cb2188741 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:17.170060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41bc9eba-e0cc-4789-b188-847cb2188741 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:17.201346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-41bc9eba-e0cc-4789-b188-847cb2188741 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046066 Jul 26 18:38:17.201842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 636/1294] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:17 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:17.209748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0e067058-7c06-4092-95de-00e5504675fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:17.211964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0e067058-7c06-4092-95de-00e5504675fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:17.218108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e067058-7c06-4092-95de-00e5504675fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:17.218547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e067058-7c06-4092-95de-00e5504675fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:17.219339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e067058-7c06-4092-95de-00e5504675fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:17.219769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e067058-7c06-4092-95de-00e5504675fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:17.249071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0e067058-7c06-4092-95de-00e5504675fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043240 Jul 26 18:38:17.249631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 659/1295] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:17 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:17.719525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dea8ad7c-1c9d-480f-aebd-9fdbc6943c74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:17.721735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dea8ad7c-1c9d-480f-aebd-9fdbc6943c74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:17.728459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dea8ad7c-1c9d-480f-aebd-9fdbc6943c74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:17.728900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dea8ad7c-1c9d-480f-aebd-9fdbc6943c74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:17.729670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dea8ad7c-1c9d-480f-aebd-9fdbc6943c74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:17.730125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dea8ad7c-1c9d-480f-aebd-9fdbc6943c74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:17.761738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dea8ad7c-1c9d-480f-aebd-9fdbc6943c74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046244 Jul 26 18:38:17.762301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 637/1296] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:17 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:17.978423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2bbdd580-0f4d-4a39-82e2-37a4fc909b8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:17.980876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2bbdd580-0f4d-4a39-82e2-37a4fc909b8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:17.988116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bbdd580-0f4d-4a39-82e2-37a4fc909b8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:17.988588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bbdd580-0f4d-4a39-82e2-37a4fc909b8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:17.989471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bbdd580-0f4d-4a39-82e2-37a4fc909b8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:17.989896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bbdd580-0f4d-4a39-82e2-37a4fc909b8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:18.020382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2bbdd580-0f4d-4a39-82e2-37a4fc909b8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047726 Jul 26 18:38:18.021468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 660/1297] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:18.214276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7031b10c-6a33-4670-9a38-4786de716a1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:18.216549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7031b10c-6a33-4670-9a38-4786de716a1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:18.223237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7031b10c-6a33-4670-9a38-4786de716a1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:18.223685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7031b10c-6a33-4670-9a38-4786de716a1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:18.224446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7031b10c-6a33-4670-9a38-4786de716a1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:18.224884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7031b10c-6a33-4670-9a38-4786de716a1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:18.259712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7031b10c-6a33-4670-9a38-4786de716a1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049382 Jul 26 18:38:18.260389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 638/1298] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:18 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:18.261738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-deef89ec-64be-4b1c-838f-5b4a91f8a4a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:18.263943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-deef89ec-64be-4b1c-838f-5b4a91f8a4a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:18.270292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-deef89ec-64be-4b1c-838f-5b4a91f8a4a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:18.271073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-deef89ec-64be-4b1c-838f-5b4a91f8a4a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:18.271864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-deef89ec-64be-4b1c-838f-5b4a91f8a4a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:18.272290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-deef89ec-64be-4b1c-838f-5b4a91f8a4a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:18.300898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-deef89ec-64be-4b1c-838f-5b4a91f8a4a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043241 Jul 26 18:38:18.301419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 661/1299] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:18 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:18.774890 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d3685f62-869c-4700-ba26-a4f75e6f3bc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:18.777128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d3685f62-869c-4700-ba26-a4f75e6f3bc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:18.783946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3685f62-869c-4700-ba26-a4f75e6f3bc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:18.784392 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3685f62-869c-4700-ba26-a4f75e6f3bc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:18.785142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3685f62-869c-4700-ba26-a4f75e6f3bc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:18.785582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3685f62-869c-4700-ba26-a4f75e6f3bc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:18.815758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d3685f62-869c-4700-ba26-a4f75e6f3bc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045200 Jul 26 18:38:18.816683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 639/1300] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:19.033911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9832cf00-d5e4-4f34-80f5-00de166c3e8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:19.036060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9832cf00-d5e4-4f34-80f5-00de166c3e8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:19.043236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9832cf00-d5e4-4f34-80f5-00de166c3e8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:19.043681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9832cf00-d5e4-4f34-80f5-00de166c3e8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:19.044434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9832cf00-d5e4-4f34-80f5-00de166c3e8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:19.044920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9832cf00-d5e4-4f34-80f5-00de166c3e8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:19.076095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9832cf00-d5e4-4f34-80f5-00de166c3e8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046324 Jul 26 18:38:19.076625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 662/1301] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:19 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:19.272993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e8881c94-98ef-4ab5-a009-3cb2e131d8fa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:19.275163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e8881c94-98ef-4ab5-a009-3cb2e131d8fa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:19.282188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8881c94-98ef-4ab5-a009-3cb2e131d8fa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:19.282628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8881c94-98ef-4ab5-a009-3cb2e131d8fa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:19.283403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8881c94-98ef-4ab5-a009-3cb2e131d8fa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:19.283854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8881c94-98ef-4ab5-a009-3cb2e131d8fa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:19.313912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e8881c94-98ef-4ab5-a009-3cb2e131d8fa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044990 Jul 26 18:38:19.314457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 640/1302] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:19 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:19.317788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e7a300b4-439a-4b9e-a149-4c226e9b5e3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:19.321200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e7a300b4-439a-4b9e-a149-4c226e9b5e3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:19.329214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7a300b4-439a-4b9e-a149-4c226e9b5e3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:19.329666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7a300b4-439a-4b9e-a149-4c226e9b5e3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:19.330886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7a300b4-439a-4b9e-a149-4c226e9b5e3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:19.331594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7a300b4-439a-4b9e-a149-4c226e9b5e3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:19.364633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e7a300b4-439a-4b9e-a149-4c226e9b5e3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055140 Jul 26 18:38:19.365276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 663/1303] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:19 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:19.828493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9ddbe86c-4ed5-4554-8214-9725dbdd66a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:19.830673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9ddbe86c-4ed5-4554-8214-9725dbdd66a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:19.837178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ddbe86c-4ed5-4554-8214-9725dbdd66a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:19.837622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ddbe86c-4ed5-4554-8214-9725dbdd66a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:19.838397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ddbe86c-4ed5-4554-8214-9725dbdd66a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:19.838807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ddbe86c-4ed5-4554-8214-9725dbdd66a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:19.868702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9ddbe86c-4ed5-4554-8214-9725dbdd66a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044281 Jul 26 18:38:19.869249 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 641/1304] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:19 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:20.089437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aca50199-1f5b-4257-bfd5-fdb4a0ed7add tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:20.091624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aca50199-1f5b-4257-bfd5-fdb4a0ed7add tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:20.098674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aca50199-1f5b-4257-bfd5-fdb4a0ed7add tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:20.099147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aca50199-1f5b-4257-bfd5-fdb4a0ed7add tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:20.099884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aca50199-1f5b-4257-bfd5-fdb4a0ed7add tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:20.100337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aca50199-1f5b-4257-bfd5-fdb4a0ed7add tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:20.130949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aca50199-1f5b-4257-bfd5-fdb4a0ed7add tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045634 Jul 26 18:38:20.131548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 664/1305] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:20.328481 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-420137f9-0083-4eeb-9483-9b77c65e19cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:20.330909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-420137f9-0083-4eeb-9483-9b77c65e19cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:20.337797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-420137f9-0083-4eeb-9483-9b77c65e19cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:20.338237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-420137f9-0083-4eeb-9483-9b77c65e19cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:20.338999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-420137f9-0083-4eeb-9483-9b77c65e19cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:20.339525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-420137f9-0083-4eeb-9483-9b77c65e19cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:20.369389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-420137f9-0083-4eeb-9483-9b77c65e19cf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045102 Jul 26 18:38:20.369945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 642/1306] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:20.379305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0c455c86-8b9e-4cce-a84b-4eb99f18908a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:20.382530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0c455c86-8b9e-4cce-a84b-4eb99f18908a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:20.389962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c455c86-8b9e-4cce-a84b-4eb99f18908a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:20.390412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c455c86-8b9e-4cce-a84b-4eb99f18908a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:20.391217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c455c86-8b9e-4cce-a84b-4eb99f18908a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:20.391651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c455c86-8b9e-4cce-a84b-4eb99f18908a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:20.422385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0c455c86-8b9e-4cce-a84b-4eb99f18908a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048489 Jul 26 18:38:20.422960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 665/1307] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:20 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:20.881742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f6ae36a2-ebee-4402-baf7-e27647fae664 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:20.883972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f6ae36a2-ebee-4402-baf7-e27647fae664 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:20.891147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f6ae36a2-ebee-4402-baf7-e27647fae664 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:20.891523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f6ae36a2-ebee-4402-baf7-e27647fae664 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:20.892335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f6ae36a2-ebee-4402-baf7-e27647fae664 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:20.892775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f6ae36a2-ebee-4402-baf7-e27647fae664 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:20.925819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f6ae36a2-ebee-4402-baf7-e27647fae664 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048152 Jul 26 18:38:20.926395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 643/1308] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:20 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:21.148383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6eb523a6-1d0e-43c1-a78a-612168418d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:21.151753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6eb523a6-1d0e-43c1-a78a-612168418d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:21.162872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6eb523a6-1d0e-43c1-a78a-612168418d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:21.163678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6eb523a6-1d0e-43c1-a78a-612168418d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:21.164947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6eb523a6-1d0e-43c1-a78a-612168418d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:21.165664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6eb523a6-1d0e-43c1-a78a-612168418d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:21.196333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6eb523a6-1d0e-43c1-a78a-612168418d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055146 Jul 26 18:38:21.196891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 666/1309] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:21 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:21.384106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-12e8424a-2422-42d7-8924-d4dd9da70173 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:21.386506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-12e8424a-2422-42d7-8924-d4dd9da70173 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:21.394226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12e8424a-2422-42d7-8924-d4dd9da70173 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:21.394679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12e8424a-2422-42d7-8924-d4dd9da70173 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:21.395534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12e8424a-2422-42d7-8924-d4dd9da70173 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:21.396276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12e8424a-2422-42d7-8924-d4dd9da70173 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:21.438508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-12e8424a-2422-42d7-8924-d4dd9da70173 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058352 Jul 26 18:38:21.439131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 644/1310] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:21 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:21.439570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b7d92d6b-5f43-4e4a-9714-d6a20f0305ed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:21.442319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b7d92d6b-5f43-4e4a-9714-d6a20f0305ed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:21.448804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7d92d6b-5f43-4e4a-9714-d6a20f0305ed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:21.449488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7d92d6b-5f43-4e4a-9714-d6a20f0305ed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:21.450815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7d92d6b-5f43-4e4a-9714-d6a20f0305ed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:21.451534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7d92d6b-5f43-4e4a-9714-d6a20f0305ed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:21.484308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b7d92d6b-5f43-4e4a-9714-d6a20f0305ed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048641 Jul 26 18:38:21.484943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 667/1311] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:21 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:21.938630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bb29e75f-b17d-430e-9d06-ba2c24c1a277 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:21.940822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bb29e75f-b17d-430e-9d06-ba2c24c1a277 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:21.947540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb29e75f-b17d-430e-9d06-ba2c24c1a277 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:21.947958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb29e75f-b17d-430e-9d06-ba2c24c1a277 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:21.948841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb29e75f-b17d-430e-9d06-ba2c24c1a277 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:21.949271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb29e75f-b17d-430e-9d06-ba2c24c1a277 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:21.982832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bb29e75f-b17d-430e-9d06-ba2c24c1a277 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048196 Jul 26 18:38:21.983458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 645/1312] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:22.209519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4755103c-1937-4c50-ad5d-622c430aedcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:22.211608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4755103c-1937-4c50-ad5d-622c430aedcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:22.218690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4755103c-1937-4c50-ad5d-622c430aedcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:22.219153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4755103c-1937-4c50-ad5d-622c430aedcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:22.219918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4755103c-1937-4c50-ad5d-622c430aedcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:22.220341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4755103c-1937-4c50-ad5d-622c430aedcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:22.251511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4755103c-1937-4c50-ad5d-622c430aedcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046200 Jul 26 18:38:22.252076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 668/1313] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:22 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:22.451459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cf1f0ee1-f881-4406-8641-29b5000a7a85 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:22.453774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cf1f0ee1-f881-4406-8641-29b5000a7a85 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:22.460863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf1f0ee1-f881-4406-8641-29b5000a7a85 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:22.461204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf1f0ee1-f881-4406-8641-29b5000a7a85 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:22.462165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf1f0ee1-f881-4406-8641-29b5000a7a85 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:22.462651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf1f0ee1-f881-4406-8641-29b5000a7a85 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:22.492324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cf1f0ee1-f881-4406-8641-29b5000a7a85 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045002 Jul 26 18:38:22.493151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 646/1314] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:22 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:22.496999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-31a2086a-5f66-42f6-9dd4-fa5c52359070 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:22.499261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-31a2086a-5f66-42f6-9dd4-fa5c52359070 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:22.505656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31a2086a-5f66-42f6-9dd4-fa5c52359070 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:22.506106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31a2086a-5f66-42f6-9dd4-fa5c52359070 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:22.506876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31a2086a-5f66-42f6-9dd4-fa5c52359070 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:22.507403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31a2086a-5f66-42f6-9dd4-fa5c52359070 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:22.538990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-31a2086a-5f66-42f6-9dd4-fa5c52359070 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045982 Jul 26 18:38:22.539627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 669/1315] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:22 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:22.997123 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2c5e15aa-4544-40ad-b072-cdbddba960f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:22.999405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2c5e15aa-4544-40ad-b072-cdbddba960f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:23.005752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c5e15aa-4544-40ad-b072-cdbddba960f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:23.006204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c5e15aa-4544-40ad-b072-cdbddba960f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:23.006978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c5e15aa-4544-40ad-b072-cdbddba960f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:23.007427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c5e15aa-4544-40ad-b072-cdbddba960f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:23.040925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2c5e15aa-4544-40ad-b072-cdbddba960f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049250 Jul 26 18:38:23.041480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 647/1316] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:23.264185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8e47613e-2514-4dea-97be-f793a3de65a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:23.266249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8e47613e-2514-4dea-97be-f793a3de65a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:23.273355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e47613e-2514-4dea-97be-f793a3de65a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:23.273797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e47613e-2514-4dea-97be-f793a3de65a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:23.274555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e47613e-2514-4dea-97be-f793a3de65a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:23.274982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e47613e-2514-4dea-97be-f793a3de65a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:23.305515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8e47613e-2514-4dea-97be-f793a3de65a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045574 Jul 26 18:38:23.306292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 670/1317] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:23 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:23.508630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-99e6c2c5-222a-4918-970b-a8dc8ba0efa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:23.511903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-99e6c2c5-222a-4918-970b-a8dc8ba0efa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:23.518806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99e6c2c5-222a-4918-970b-a8dc8ba0efa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:23.519214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99e6c2c5-222a-4918-970b-a8dc8ba0efa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:23.519984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99e6c2c5-222a-4918-970b-a8dc8ba0efa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:23.520416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99e6c2c5-222a-4918-970b-a8dc8ba0efa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:23.544800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:23.551980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-99e6c2c5-222a-4918-970b-a8dc8ba0efa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049712 Jul 26 18:38:23.552546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 648/1318] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:23 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:23.552843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-de374352-1d28-445d-8a2a-27e06b5eee43 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:23.554844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-de374352-1d28-445d-8a2a-27e06b5eee43 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:23.563838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de374352-1d28-445d-8a2a-27e06b5eee43 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:23.564549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de374352-1d28-445d-8a2a-27e06b5eee43 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:23.565842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de374352-1d28-445d-8a2a-27e06b5eee43 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:23.566553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de374352-1d28-445d-8a2a-27e06b5eee43 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:23.597524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-de374352-1d28-445d-8a2a-27e06b5eee43 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048896 Jul 26 18:38:23.598079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 671/1319] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:23 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:24.058507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-45d46783-bed5-4fbc-b2c7-85ad52537ba9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:24.061575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-45d46783-bed5-4fbc-b2c7-85ad52537ba9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:24.070757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45d46783-bed5-4fbc-b2c7-85ad52537ba9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:24.071416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45d46783-bed5-4fbc-b2c7-85ad52537ba9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:24.072575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45d46783-bed5-4fbc-b2c7-85ad52537ba9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:24.073223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45d46783-bed5-4fbc-b2c7-85ad52537ba9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:24.108436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-45d46783-bed5-4fbc-b2c7-85ad52537ba9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056082 Jul 26 18:38:24.108988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 649/1320] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:24 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:24.318348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a3f0ae77-26a4-4ddc-9718-3204e4cab952 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:24.320478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a3f0ae77-26a4-4ddc-9718-3204e4cab952 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:24.327702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3f0ae77-26a4-4ddc-9718-3204e4cab952 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:24.328150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3f0ae77-26a4-4ddc-9718-3204e4cab952 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:24.328913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3f0ae77-26a4-4ddc-9718-3204e4cab952 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:24.329348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3f0ae77-26a4-4ddc-9718-3204e4cab952 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:24.346238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:24.360455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a3f0ae77-26a4-4ddc-9718-3204e4cab952 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046240 Jul 26 18:38:24.361049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 672/1321] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:24.565136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-517aab69-5a36-44aa-a984-b21c46df185b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:24.567335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-517aab69-5a36-44aa-a984-b21c46df185b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:24.574440 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-517aab69-5a36-44aa-a984-b21c46df185b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:24.574814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-517aab69-5a36-44aa-a984-b21c46df185b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:24.575583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-517aab69-5a36-44aa-a984-b21c46df185b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:24.576044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-517aab69-5a36-44aa-a984-b21c46df185b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:24.608611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-517aab69-5a36-44aa-a984-b21c46df185b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047506 Jul 26 18:38:24.609204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 650/1322] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:24 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:24.610233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6dd8b1bf-c925-4fb3-816a-9e74d66d2c0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:24.612761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6dd8b1bf-c925-4fb3-816a-9e74d66d2c0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:24.619483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6dd8b1bf-c925-4fb3-816a-9e74d66d2c0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:24.619923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6dd8b1bf-c925-4fb3-816a-9e74d66d2c0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:24.620818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6dd8b1bf-c925-4fb3-816a-9e74d66d2c0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:24.621231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6dd8b1bf-c925-4fb3-816a-9e74d66d2c0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:24.653766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6dd8b1bf-c925-4fb3-816a-9e74d66d2c0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047622 Jul 26 18:38:24.654357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 673/1323] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:24 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:25.121431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-954c5b46-80bf-4376-a735-35b871f52747 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:25.123657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-954c5b46-80bf-4376-a735-35b871f52747 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:25.130734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-954c5b46-80bf-4376-a735-35b871f52747 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:25.132340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-954c5b46-80bf-4376-a735-35b871f52747 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:25.133607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-954c5b46-80bf-4376-a735-35b871f52747 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:25.134055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-954c5b46-80bf-4376-a735-35b871f52747 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:25.166612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-954c5b46-80bf-4376-a735-35b871f52747 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049223 Jul 26 18:38:25.167207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 651/1324] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:25 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:25.373123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3b0ad2b8-5ffd-45c5-b57c-dc42190e7656 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:25.375303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3b0ad2b8-5ffd-45c5-b57c-dc42190e7656 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:25.382220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b0ad2b8-5ffd-45c5-b57c-dc42190e7656 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:25.382789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b0ad2b8-5ffd-45c5-b57c-dc42190e7656 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:25.383751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b0ad2b8-5ffd-45c5-b57c-dc42190e7656 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:25.384175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b0ad2b8-5ffd-45c5-b57c-dc42190e7656 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:25.416170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3b0ad2b8-5ffd-45c5-b57c-dc42190e7656 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047250 Jul 26 18:38:25.416740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 674/1325] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:25.623268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ee0d9746-85cb-455c-b8e5-e5523f769365 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:25.625297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ee0d9746-85cb-455c-b8e5-e5523f769365 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:25.631667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee0d9746-85cb-455c-b8e5-e5523f769365 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:25.632108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee0d9746-85cb-455c-b8e5-e5523f769365 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:25.632867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee0d9746-85cb-455c-b8e5-e5523f769365 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:25.633292 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee0d9746-85cb-455c-b8e5-e5523f769365 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:25.663696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ee0d9746-85cb-455c-b8e5-e5523f769365 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 Jul 26 18:38:25.664186 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 652/1326] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:25 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:25.665807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-55948127-06b3-48e4-a233-d0d59f872c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:25.668140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-55948127-06b3-48e4-a233-d0d59f872c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:25.674668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-55948127-06b3-48e4-a233-d0d59f872c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:25.675138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-55948127-06b3-48e4-a233-d0d59f872c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:25.675915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-55948127-06b3-48e4-a233-d0d59f872c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:25.676347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-55948127-06b3-48e4-a233-d0d59f872c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:25.706397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-55948127-06b3-48e4-a233-d0d59f872c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044586 Jul 26 18:38:25.706966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 675/1327] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:25 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:26.182883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d3121ce7-aac5-432a-8b79-0502b8c1f84d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:26.185054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d3121ce7-aac5-432a-8b79-0502b8c1f84d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:26.191737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3121ce7-aac5-432a-8b79-0502b8c1f84d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:26.192176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3121ce7-aac5-432a-8b79-0502b8c1f84d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:26.192938 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3121ce7-aac5-432a-8b79-0502b8c1f84d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:26.193366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3121ce7-aac5-432a-8b79-0502b8c1f84d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:26.229807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d3121ce7-aac5-432a-8b79-0502b8c1f84d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053263 Jul 26 18:38:26.230532 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 653/1328] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:26 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:26.429173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-18842936-56db-4e1a-98a2-996b269cb785 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:26.431475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-18842936-56db-4e1a-98a2-996b269cb785 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:26.440692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18842936-56db-4e1a-98a2-996b269cb785 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:26.441147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18842936-56db-4e1a-98a2-996b269cb785 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:26.441832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18842936-56db-4e1a-98a2-996b269cb785 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:26.442262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18842936-56db-4e1a-98a2-996b269cb785 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:26.474454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-18842936-56db-4e1a-98a2-996b269cb785 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049362 Jul 26 18:38:26.475014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 676/1329] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:26.678793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6048cbfc-369c-4747-8e84-32c50cbec146 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:26.680998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6048cbfc-369c-4747-8e84-32c50cbec146 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:26.688274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6048cbfc-369c-4747-8e84-32c50cbec146 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:26.688699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6048cbfc-369c-4747-8e84-32c50cbec146 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:26.689450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6048cbfc-369c-4747-8e84-32c50cbec146 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:26.689904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6048cbfc-369c-4747-8e84-32c50cbec146 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:26.719533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0189f063-5f71-43f7-90e4-08d8058d4dae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:26.720275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6048cbfc-369c-4747-8e84-32c50cbec146 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047478 Jul 26 18:38:26.720933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 654/1330] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:26 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:26.722164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0189f063-5f71-43f7-90e4-08d8058d4dae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:26.731598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0189f063-5f71-43f7-90e4-08d8058d4dae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:26.732241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0189f063-5f71-43f7-90e4-08d8058d4dae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:26.733192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0189f063-5f71-43f7-90e4-08d8058d4dae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:26.733762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0189f063-5f71-43f7-90e4-08d8058d4dae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:26.767939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0189f063-5f71-43f7-90e4-08d8058d4dae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052420 Jul 26 18:38:26.768553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 677/1331] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:26 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:27.244526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-090e8b26-d126-4c58-91e9-881864e52a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:27.247122 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-090e8b26-d126-4c58-91e9-881864e52a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:27.254841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-090e8b26-d126-4c58-91e9-881864e52a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:27.255406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-090e8b26-d126-4c58-91e9-881864e52a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:27.256306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-090e8b26-d126-4c58-91e9-881864e52a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:27.256809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-090e8b26-d126-4c58-91e9-881864e52a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:27.287356 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-090e8b26-d126-4c58-91e9-881864e52a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048051 Jul 26 18:38:27.287904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 655/1332] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:27 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:27.486563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d25bb4c7-3a41-47b6-a56d-3ba6ca6b580c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:27.488767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d25bb4c7-3a41-47b6-a56d-3ba6ca6b580c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:27.495879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d25bb4c7-3a41-47b6-a56d-3ba6ca6b580c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:27.496505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d25bb4c7-3a41-47b6-a56d-3ba6ca6b580c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:27.497799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d25bb4c7-3a41-47b6-a56d-3ba6ca6b580c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:27.498457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d25bb4c7-3a41-47b6-a56d-3ba6ca6b580c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:27.528928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d25bb4c7-3a41-47b6-a56d-3ba6ca6b580c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046409 Jul 26 18:38:27.529484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 678/1333] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:27 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:27.737273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-30680f5d-db39-4dd5-9567-417b6a9f9474 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:27.739867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-30680f5d-db39-4dd5-9567-417b6a9f9474 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:27.746308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30680f5d-db39-4dd5-9567-417b6a9f9474 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:27.746662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30680f5d-db39-4dd5-9567-417b6a9f9474 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:27.747485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30680f5d-db39-4dd5-9567-417b6a9f9474 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:27.747906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30680f5d-db39-4dd5-9567-417b6a9f9474 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:27.781194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6445c4c1-b881-47b1-a134-88d41294d234 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:27.781780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-30680f5d-db39-4dd5-9567-417b6a9f9474 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049506 Jul 26 18:38:27.782131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 656/1334] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:27.785317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6445c4c1-b881-47b1-a134-88d41294d234 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:27.791059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6445c4c1-b881-47b1-a134-88d41294d234 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:27.791498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6445c4c1-b881-47b1-a134-88d41294d234 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:27.792272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6445c4c1-b881-47b1-a134-88d41294d234 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:27.792863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6445c4c1-b881-47b1-a134-88d41294d234 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:27.824160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6445c4c1-b881-47b1-a134-88d41294d234 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046920 Jul 26 18:38:27.824744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 679/1335] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:27 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:28.299963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-552be5d2-1fa1-4663-888f-f85d1cfd5329 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:28.302148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-552be5d2-1fa1-4663-888f-f85d1cfd5329 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:28.309381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-552be5d2-1fa1-4663-888f-f85d1cfd5329 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:28.309828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-552be5d2-1fa1-4663-888f-f85d1cfd5329 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:28.310601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-552be5d2-1fa1-4663-888f-f85d1cfd5329 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:28.311075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-552be5d2-1fa1-4663-888f-f85d1cfd5329 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:28.342362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-552be5d2-1fa1-4663-888f-f85d1cfd5329 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046381 Jul 26 18:38:28.342921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 657/1336] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:28 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:28.542315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0576e2c2-9f65-4ee9-bd25-a9c3800be632 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:28.544640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0576e2c2-9f65-4ee9-bd25-a9c3800be632 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:28.552259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0576e2c2-9f65-4ee9-bd25-a9c3800be632 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:28.552592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0576e2c2-9f65-4ee9-bd25-a9c3800be632 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:28.553376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0576e2c2-9f65-4ee9-bd25-a9c3800be632 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:28.553806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0576e2c2-9f65-4ee9-bd25-a9c3800be632 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:28.586913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0576e2c2-9f65-4ee9-bd25-a9c3800be632 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048961 Jul 26 18:38:28.587523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 680/1337] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:28.794153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4a51e5eb-15cb-411a-b0e9-27a4cf07442f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:28.796354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4a51e5eb-15cb-411a-b0e9-27a4cf07442f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:28.802913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a51e5eb-15cb-411a-b0e9-27a4cf07442f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:28.803434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a51e5eb-15cb-411a-b0e9-27a4cf07442f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:28.804185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a51e5eb-15cb-411a-b0e9-27a4cf07442f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:28.804614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a51e5eb-15cb-411a-b0e9-27a4cf07442f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:28.835143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4a51e5eb-15cb-411a-b0e9-27a4cf07442f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045021 Jul 26 18:38:28.835738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 658/1338] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:28 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:28.837056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-96dc5c20-c77a-4ae6-970c-86ef147735db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:28.839329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-96dc5c20-c77a-4ae6-970c-86ef147735db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:28.845797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96dc5c20-c77a-4ae6-970c-86ef147735db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:28.846242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96dc5c20-c77a-4ae6-970c-86ef147735db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:28.847045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96dc5c20-c77a-4ae6-970c-86ef147735db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:28.847477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96dc5c20-c77a-4ae6-970c-86ef147735db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:28.877939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-96dc5c20-c77a-4ae6-970c-86ef147735db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045204 Jul 26 18:38:28.878468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 681/1339] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:28 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:38:29.355836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6abb01b4-a82b-41e5-af1f-b2fdb27686b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:29.357990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6abb01b4-a82b-41e5-af1f-b2fdb27686b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:29.364841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6abb01b4-a82b-41e5-af1f-b2fdb27686b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:29.365288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6abb01b4-a82b-41e5-af1f-b2fdb27686b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:29.366055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6abb01b4-a82b-41e5-af1f-b2fdb27686b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:29.366491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6abb01b4-a82b-41e5-af1f-b2fdb27686b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:29.396398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6abb01b4-a82b-41e5-af1f-b2fdb27686b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044787 Jul 26 18:38:29.396935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 659/1340] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:29 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:29.601439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-837b55b2-afdc-4f84-a1d3-e92b208231ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:29.603620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-837b55b2-afdc-4f84-a1d3-e92b208231ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:29.610653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-837b55b2-afdc-4f84-a1d3-e92b208231ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:29.611059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-837b55b2-afdc-4f84-a1d3-e92b208231ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:29.611812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-837b55b2-afdc-4f84-a1d3-e92b208231ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:29.612236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-837b55b2-afdc-4f84-a1d3-e92b208231ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:29.642911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-837b55b2-afdc-4f84-a1d3-e92b208231ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045542 Jul 26 18:38:29.643492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 682/1341] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:29.848122 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-70a2d31c-4303-495d-a186-77280f113755 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:29.850349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-70a2d31c-4303-495d-a186-77280f113755 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:29.856571 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70a2d31c-4303-495d-a186-77280f113755 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:29.857020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70a2d31c-4303-495d-a186-77280f113755 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:29.857785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70a2d31c-4303-495d-a186-77280f113755 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:29.858191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70a2d31c-4303-495d-a186-77280f113755 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:29.887170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-70a2d31c-4303-495d-a186-77280f113755 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 Jul 26 18:38:29.887659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 660/1342] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:29 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:29.890576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4b0e028a-13b6-45b0-bc8f-b54fadfeef7d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:29.892766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4b0e028a-13b6-45b0-bc8f-b54fadfeef7d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:29.899536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b0e028a-13b6-45b0-bc8f-b54fadfeef7d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:29.899976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b0e028a-13b6-45b0-bc8f-b54fadfeef7d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:29.900753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b0e028a-13b6-45b0-bc8f-b54fadfeef7d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:29.901188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b0e028a-13b6-45b0-bc8f-b54fadfeef7d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:29.931488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4b0e028a-13b6-45b0-bc8f-b54fadfeef7d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Jul 26 18:38:29.932022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 683/1343] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:29 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:30.410006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-09c24b11-c0b0-4762-971a-fabaee195ec8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:30.412621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-09c24b11-c0b0-4762-971a-fabaee195ec8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:30.421753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09c24b11-c0b0-4762-971a-fabaee195ec8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:30.422358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09c24b11-c0b0-4762-971a-fabaee195ec8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:30.423624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09c24b11-c0b0-4762-971a-fabaee195ec8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:30.424347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09c24b11-c0b0-4762-971a-fabaee195ec8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:30.457515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-09c24b11-c0b0-4762-971a-fabaee195ec8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051654 Jul 26 18:38:30.458064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 661/1344] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:30 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:38:30.656537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a12714c6-d79b-44f0-973b-4ace93909ce7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:30.659076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a12714c6-d79b-44f0-973b-4ace93909ce7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:30.667149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a12714c6-d79b-44f0-973b-4ace93909ce7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:30.667612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a12714c6-d79b-44f0-973b-4ace93909ce7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:30.668503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a12714c6-d79b-44f0-973b-4ace93909ce7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:30.668975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a12714c6-d79b-44f0-973b-4ace93909ce7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:30.700641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a12714c6-d79b-44f0-973b-4ace93909ce7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048928 Jul 26 18:38:30.701190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 684/1345] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:30.902914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-448a0b70-9773-47a7-a2af-fd4382282a1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:30.905757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-448a0b70-9773-47a7-a2af-fd4382282a1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:30.915669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-448a0b70-9773-47a7-a2af-fd4382282a1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:30.916285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-448a0b70-9773-47a7-a2af-fd4382282a1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:30.917699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-448a0b70-9773-47a7-a2af-fd4382282a1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:30.918087 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-448a0b70-9773-47a7-a2af-fd4382282a1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:30.943791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-60806261-878c-4359-876a-6ca6fcb7db6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:30.945980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-60806261-878c-4359-876a-6ca6fcb7db6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:30.947517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-448a0b70-9773-47a7-a2af-fd4382282a1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051179 Jul 26 18:38:30.948090 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 662/1346] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:30 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:30.952550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60806261-878c-4359-876a-6ca6fcb7db6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:30.952982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60806261-878c-4359-876a-6ca6fcb7db6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:30.953764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60806261-878c-4359-876a-6ca6fcb7db6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:30.954191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60806261-878c-4359-876a-6ca6fcb7db6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:30.985477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-60806261-878c-4359-876a-6ca6fcb7db6b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045679 Jul 26 18:38:30.986077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 685/1347] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:30 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:31.470169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1c165160-6dad-47aa-bd70-da0b5b039f49 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:31.472433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1c165160-6dad-47aa-bd70-da0b5b039f49 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:31.479393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c165160-6dad-47aa-bd70-da0b5b039f49 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:31.479847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c165160-6dad-47aa-bd70-da0b5b039f49 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:31.480653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c165160-6dad-47aa-bd70-da0b5b039f49 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:31.481091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c165160-6dad-47aa-bd70-da0b5b039f49 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:31.510659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1c165160-6dad-47aa-bd70-da0b5b039f49 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044537 Jul 26 18:38:31.511495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 663/1348] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:31 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:31.716493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-87c35eee-d4b9-45bc-b21b-c2aed7cf82a1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:31.718630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-87c35eee-d4b9-45bc-b21b-c2aed7cf82a1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:31.725815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87c35eee-d4b9-45bc-b21b-c2aed7cf82a1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:31.726268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87c35eee-d4b9-45bc-b21b-c2aed7cf82a1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:31.727010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87c35eee-d4b9-45bc-b21b-c2aed7cf82a1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:31.727475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87c35eee-d4b9-45bc-b21b-c2aed7cf82a1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:31.767174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-87c35eee-d4b9-45bc-b21b-c2aed7cf82a1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054671 Jul 26 18:38:31.767743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 686/1349] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:31.962843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-410f8d7f-ac75-495e-aadb-517c92405e8f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:31.965809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-410f8d7f-ac75-495e-aadb-517c92405e8f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:31.972411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-410f8d7f-ac75-495e-aadb-517c92405e8f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:31.972789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-410f8d7f-ac75-495e-aadb-517c92405e8f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:31.973555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-410f8d7f-ac75-495e-aadb-517c92405e8f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:31.973988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-410f8d7f-ac75-495e-aadb-517c92405e8f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:31.997628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-71fadb81-1ad2-434d-b7d4-c77e3647c3a6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:31.999990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-71fadb81-1ad2-434d-b7d4-c77e3647c3a6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:32.003633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-410f8d7f-ac75-495e-aadb-517c92405e8f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047035 Jul 26 18:38:32.004179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 664/1350] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:31 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:32.006361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71fadb81-1ad2-434d-b7d4-c77e3647c3a6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:32.006799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71fadb81-1ad2-434d-b7d4-c77e3647c3a6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:32.007585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71fadb81-1ad2-434d-b7d4-c77e3647c3a6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:32.008015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71fadb81-1ad2-434d-b7d4-c77e3647c3a6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:32.037145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-71fadb81-1ad2-434d-b7d4-c77e3647c3a6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043490 Jul 26 18:38:32.037693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 687/1351] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:31 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:32.524026 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2cc65c96-4d3d-4379-a019-59e39152d539 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:32.526217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2cc65c96-4d3d-4379-a019-59e39152d539 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:32.533174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2cc65c96-4d3d-4379-a019-59e39152d539 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:32.533583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2cc65c96-4d3d-4379-a019-59e39152d539 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:32.534345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2cc65c96-4d3d-4379-a019-59e39152d539 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:32.534779 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2cc65c96-4d3d-4379-a019-59e39152d539 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:32.549137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:32.565431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2cc65c96-4d3d-4379-a019-59e39152d539 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045757 Jul 26 18:38:32.565984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 665/1352] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:32 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:32.781217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-142ac35e-2789-4ab0-88ba-1891be3eff34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:32.783367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-142ac35e-2789-4ab0-88ba-1891be3eff34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:32.790460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-142ac35e-2789-4ab0-88ba-1891be3eff34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:32.790905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-142ac35e-2789-4ab0-88ba-1891be3eff34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:32.791719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-142ac35e-2789-4ab0-88ba-1891be3eff34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:32.792147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-142ac35e-2789-4ab0-88ba-1891be3eff34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:32.822585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-142ac35e-2789-4ab0-88ba-1891be3eff34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045537 Jul 26 18:38:32.823182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 688/1353] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:32 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:33.016402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-969b08c1-4aea-433d-a4aa-d149bf98361e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:33.018552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-969b08c1-4aea-433d-a4aa-d149bf98361e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:33.025494 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-969b08c1-4aea-433d-a4aa-d149bf98361e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:33.025961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-969b08c1-4aea-433d-a4aa-d149bf98361e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:33.026753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-969b08c1-4aea-433d-a4aa-d149bf98361e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:33.027218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-969b08c1-4aea-433d-a4aa-d149bf98361e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:33.050503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a3249487-e4f8-4b1a-a8f3-e5bbe7a1c56a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:33.052741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a3249487-e4f8-4b1a-a8f3-e5bbe7a1c56a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:33.058502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-969b08c1-4aea-433d-a4aa-d149bf98361e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046105 Jul 26 18:38:33.059108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 666/1354] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:33 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:33.059659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3249487-e4f8-4b1a-a8f3-e5bbe7a1c56a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:33.060117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3249487-e4f8-4b1a-a8f3-e5bbe7a1c56a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:33.061051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3249487-e4f8-4b1a-a8f3-e5bbe7a1c56a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:33.061483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3249487-e4f8-4b1a-a8f3-e5bbe7a1c56a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:33.066681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:33.095128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a3249487-e4f8-4b1a-a8f3-e5bbe7a1c56a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049093 Jul 26 18:38:33.095694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 689/1355] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:33 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:33.585044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0405f286-ed3f-45ac-b883-07c5815efbf2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:33.588520 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0405f286-ed3f-45ac-b883-07c5815efbf2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:33.595872 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0405f286-ed3f-45ac-b883-07c5815efbf2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:33.596316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0405f286-ed3f-45ac-b883-07c5815efbf2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:33.597075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0405f286-ed3f-45ac-b883-07c5815efbf2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:33.597500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0405f286-ed3f-45ac-b883-07c5815efbf2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:33.627228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0405f286-ed3f-45ac-b883-07c5815efbf2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049383 Jul 26 18:38:33.628075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 667/1356] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:33 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:33.837983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e62ad3a8-396e-4878-a804-1b858bf258ea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:33.840273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e62ad3a8-396e-4878-a804-1b858bf258ea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:33.846988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e62ad3a8-396e-4878-a804-1b858bf258ea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:33.847469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e62ad3a8-396e-4878-a804-1b858bf258ea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:33.848226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e62ad3a8-396e-4878-a804-1b858bf258ea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:33.848682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e62ad3a8-396e-4878-a804-1b858bf258ea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:33.879792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e62ad3a8-396e-4878-a804-1b858bf258ea tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046955 Jul 26 18:38:33.880360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 690/1357] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:34.072313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8ac38ac3-17fa-41a5-b16a-8e0eb51d2f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:34.074507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8ac38ac3-17fa-41a5-b16a-8e0eb51d2f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:34.081017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ac38ac3-17fa-41a5-b16a-8e0eb51d2f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:34.081465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ac38ac3-17fa-41a5-b16a-8e0eb51d2f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:34.082221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ac38ac3-17fa-41a5-b16a-8e0eb51d2f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:34.082650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ac38ac3-17fa-41a5-b16a-8e0eb51d2f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:34.108017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3a3a8a22-c724-433f-9a1c-cc9481b36bef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:34.110206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3a3a8a22-c724-433f-9a1c-cc9481b36bef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:34.114673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8ac38ac3-17fa-41a5-b16a-8e0eb51d2f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046670 Jul 26 18:38:34.115385 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 668/1358] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:34 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:34.117010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a3a8a22-c724-433f-9a1c-cc9481b36bef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:34.117489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a3a8a22-c724-433f-9a1c-cc9481b36bef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:34.118268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a3a8a22-c724-433f-9a1c-cc9481b36bef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:34.118697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a3a8a22-c724-433f-9a1c-cc9481b36bef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:34.149422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3a3a8a22-c724-433f-9a1c-cc9481b36bef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045332 Jul 26 18:38:34.149968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 691/1359] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:34 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:34.643366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c9ef37e0-6fc5-44d7-bd01-1ca8a0d1959a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:34.646890 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c9ef37e0-6fc5-44d7-bd01-1ca8a0d1959a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:34.654531 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c9ef37e0-6fc5-44d7-bd01-1ca8a0d1959a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:34.654973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c9ef37e0-6fc5-44d7-bd01-1ca8a0d1959a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:34.655744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c9ef37e0-6fc5-44d7-bd01-1ca8a0d1959a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:34.656200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c9ef37e0-6fc5-44d7-bd01-1ca8a0d1959a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:34.686666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c9ef37e0-6fc5-44d7-bd01-1ca8a0d1959a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049775 Jul 26 18:38:34.687268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 669/1360] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:34 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:34.892530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7f287dc0-23a1-4af5-9755-13b615a0a0fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:34.894781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7f287dc0-23a1-4af5-9755-13b615a0a0fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:34.901580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f287dc0-23a1-4af5-9755-13b615a0a0fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:34.902131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f287dc0-23a1-4af5-9755-13b615a0a0fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:34.902916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f287dc0-23a1-4af5-9755-13b615a0a0fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:34.903388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f287dc0-23a1-4af5-9755-13b615a0a0fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:34.938311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7f287dc0-23a1-4af5-9755-13b615a0a0fa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049928 Jul 26 18:38:34.938881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 692/1361] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:34 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:35.128009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b5dd1eff-a834-49fc-93fb-5aef16a06334 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:35.130305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b5dd1eff-a834-49fc-93fb-5aef16a06334 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:35.137097 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5dd1eff-a834-49fc-93fb-5aef16a06334 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:35.137571 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5dd1eff-a834-49fc-93fb-5aef16a06334 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:35.138372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5dd1eff-a834-49fc-93fb-5aef16a06334 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:35.138830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5dd1eff-a834-49fc-93fb-5aef16a06334 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:35.162220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9a7fc9cd-65a2-4f6b-ae22-60850066aca3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:35.164312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9a7fc9cd-65a2-4f6b-ae22-60850066aca3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:35.169187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b5dd1eff-a834-49fc-93fb-5aef16a06334 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045381 Jul 26 18:38:35.169744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 670/1362] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:35 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:35.170988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a7fc9cd-65a2-4f6b-ae22-60850066aca3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:35.171468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a7fc9cd-65a2-4f6b-ae22-60850066aca3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:35.172229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a7fc9cd-65a2-4f6b-ae22-60850066aca3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:35.172652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a7fc9cd-65a2-4f6b-ae22-60850066aca3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:35.206248 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9a7fc9cd-65a2-4f6b-ae22-60850066aca3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048108 Jul 26 18:38:35.206806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 693/1363] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:35 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:35.699721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-10056cfa-ab73-4d3b-b76b-fc7082795af3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:35.701886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-10056cfa-ab73-4d3b-b76b-fc7082795af3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:35.709033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10056cfa-ab73-4d3b-b76b-fc7082795af3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:35.709485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10056cfa-ab73-4d3b-b76b-fc7082795af3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:35.710282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10056cfa-ab73-4d3b-b76b-fc7082795af3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:35.710717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10056cfa-ab73-4d3b-b76b-fc7082795af3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:35.744324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-10056cfa-ab73-4d3b-b76b-fc7082795af3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048505 Jul 26 18:38:35.744845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 671/1364] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:35 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:35.952214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-19822f98-44c5-4405-9703-6f6c21143fb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:35.954393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-19822f98-44c5-4405-9703-6f6c21143fb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:35.960853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19822f98-44c5-4405-9703-6f6c21143fb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:35.961294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19822f98-44c5-4405-9703-6f6c21143fb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:35.962047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19822f98-44c5-4405-9703-6f6c21143fb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:35.962475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19822f98-44c5-4405-9703-6f6c21143fb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:35.991816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-19822f98-44c5-4405-9703-6f6c21143fb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044137 Jul 26 18:38:35.992373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 694/1365] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:35 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:36.182159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f512ce42-06f9-411b-86eb-68b3155086a1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:36.184309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f512ce42-06f9-411b-86eb-68b3155086a1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:36.191048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f512ce42-06f9-411b-86eb-68b3155086a1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:36.191521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f512ce42-06f9-411b-86eb-68b3155086a1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:36.192345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f512ce42-06f9-411b-86eb-68b3155086a1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:36.192803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f512ce42-06f9-411b-86eb-68b3155086a1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:36.218015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3aa4607c-6d7e-4319-bd7d-837ca02ccae3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:36.220315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3aa4607c-6d7e-4319-bd7d-837ca02ccae3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:36.223686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f512ce42-06f9-411b-86eb-68b3155086a1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045581 Jul 26 18:38:36.224283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 672/1366] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:36 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:36.227197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3aa4607c-6d7e-4319-bd7d-837ca02ccae3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:36.227633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3aa4607c-6d7e-4319-bd7d-837ca02ccae3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:36.228421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3aa4607c-6d7e-4319-bd7d-837ca02ccae3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:36.228846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3aa4607c-6d7e-4319-bd7d-837ca02ccae3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:36.260356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3aa4607c-6d7e-4319-bd7d-837ca02ccae3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046258 Jul 26 18:38:36.260904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 695/1367] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:36 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:36.758829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b11ce895-85ce-43a9-a3c4-c78017da2c27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:36.761507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b11ce895-85ce-43a9-a3c4-c78017da2c27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:36.768352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b11ce895-85ce-43a9-a3c4-c78017da2c27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:36.769159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b11ce895-85ce-43a9-a3c4-c78017da2c27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:36.771508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b11ce895-85ce-43a9-a3c4-c78017da2c27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:36.771917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b11ce895-85ce-43a9-a3c4-c78017da2c27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:36.802423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b11ce895-85ce-43a9-a3c4-c78017da2c27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048261 Jul 26 18:38:36.802982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 673/1368] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:36 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:37.004156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-943a45b3-daee-4ad0-b50b-a0465907d76a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:37.007111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-943a45b3-daee-4ad0-b50b-a0465907d76a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:37.014678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-943a45b3-daee-4ad0-b50b-a0465907d76a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:37.015143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-943a45b3-daee-4ad0-b50b-a0465907d76a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:37.015910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-943a45b3-daee-4ad0-b50b-a0465907d76a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:37.016337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-943a45b3-daee-4ad0-b50b-a0465907d76a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:37.046496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-943a45b3-daee-4ad0-b50b-a0465907d76a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046783 Jul 26 18:38:37.047061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 696/1369] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:36 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:37.237145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a59fe71f-a37c-49dc-bc37-e1e06c3a6717 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:37.239986 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a59fe71f-a37c-49dc-bc37-e1e06c3a6717 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:37.247152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a59fe71f-a37c-49dc-bc37-e1e06c3a6717 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:37.247597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a59fe71f-a37c-49dc-bc37-e1e06c3a6717 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:37.248405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a59fe71f-a37c-49dc-bc37-e1e06c3a6717 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:37.248831 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a59fe71f-a37c-49dc-bc37-e1e06c3a6717 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:37.273457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2db9f333-70ec-4118-bc42-7e6f91e6bd7f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:37.275617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2db9f333-70ec-4118-bc42-7e6f91e6bd7f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:37.279244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a59fe71f-a37c-49dc-bc37-e1e06c3a6717 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046374 Jul 26 18:38:37.279830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 674/1370] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:37 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:37.282420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2db9f333-70ec-4118-bc42-7e6f91e6bd7f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:37.282871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2db9f333-70ec-4118-bc42-7e6f91e6bd7f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:37.283795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2db9f333-70ec-4118-bc42-7e6f91e6bd7f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:37.284227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2db9f333-70ec-4118-bc42-7e6f91e6bd7f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:37.315842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2db9f333-70ec-4118-bc42-7e6f91e6bd7f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046687 Jul 26 18:38:37.316433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 697/1371] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:37 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:37.819003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e7bcc031-a565-4e94-afbb-8d22733b4fd5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:37.822235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e7bcc031-a565-4e94-afbb-8d22733b4fd5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:37.824940 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:37.830606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7bcc031-a565-4e94-afbb-8d22733b4fd5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:37.831058 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7bcc031-a565-4e94-afbb-8d22733b4fd5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:37.831837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7bcc031-a565-4e94-afbb-8d22733b4fd5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:37.832378 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7bcc031-a565-4e94-afbb-8d22733b4fd5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:37.869828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e7bcc031-a565-4e94-afbb-8d22733b4fd5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056824 Jul 26 18:38:37.870757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 675/1372] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:37 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:38.059987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5530ddb4-8ac8-4922-b9d9-ae6867876200 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:38.062283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5530ddb4-8ac8-4922-b9d9-ae6867876200 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:38.069681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5530ddb4-8ac8-4922-b9d9-ae6867876200 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:38.070120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5530ddb4-8ac8-4922-b9d9-ae6867876200 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:38.070891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5530ddb4-8ac8-4922-b9d9-ae6867876200 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:38.071473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5530ddb4-8ac8-4922-b9d9-ae6867876200 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:38.104727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5530ddb4-8ac8-4922-b9d9-ae6867876200 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049136 Jul 26 18:38:38.105422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 698/1373] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:38.294565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c3573e4d-0c38-4552-ba08-9599ce3c056d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:38.296837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c3573e4d-0c38-4552-ba08-9599ce3c056d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:38.303625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3573e4d-0c38-4552-ba08-9599ce3c056d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:38.304071 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3573e4d-0c38-4552-ba08-9599ce3c056d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:38.304846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3573e4d-0c38-4552-ba08-9599ce3c056d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:38.305252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3573e4d-0c38-4552-ba08-9599ce3c056d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:38.330093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-899bb03c-3a25-4ce3-a7c7-124014cbc434 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:38.332254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-899bb03c-3a25-4ce3-a7c7-124014cbc434 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:38.336564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c3573e4d-0c38-4552-ba08-9599ce3c056d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046935 Jul 26 18:38:38.337163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 676/1374] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:38 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:38.339151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-899bb03c-3a25-4ce3-a7c7-124014cbc434 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:38.339611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-899bb03c-3a25-4ce3-a7c7-124014cbc434 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:38.340400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-899bb03c-3a25-4ce3-a7c7-124014cbc434 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:38.340829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-899bb03c-3a25-4ce3-a7c7-124014cbc434 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:38.375134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-899bb03c-3a25-4ce3-a7c7-124014cbc434 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049282 Jul 26 18:38:38.375703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 699/1375] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:38 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:38.885252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5b20890f-cce5-41cc-8a9a-1e24314561ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:38.887449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5b20890f-cce5-41cc-8a9a-1e24314561ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:38.896331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b20890f-cce5-41cc-8a9a-1e24314561ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:38.896830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b20890f-cce5-41cc-8a9a-1e24314561ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:38.897538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b20890f-cce5-41cc-8a9a-1e24314561ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:38.897970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b20890f-cce5-41cc-8a9a-1e24314561ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:38.928248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5b20890f-cce5-41cc-8a9a-1e24314561ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046996 Jul 26 18:38:38.928843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 677/1376] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:38 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:39.121459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0a6944e6-b986-4a29-af02-79ed2439d62e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:39.123634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0a6944e6-b986-4a29-af02-79ed2439d62e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:39.130413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a6944e6-b986-4a29-af02-79ed2439d62e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:39.130870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a6944e6-b986-4a29-af02-79ed2439d62e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:39.131704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a6944e6-b986-4a29-af02-79ed2439d62e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:39.132094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a6944e6-b986-4a29-af02-79ed2439d62e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:39.161822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0a6944e6-b986-4a29-af02-79ed2439d62e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044640 Jul 26 18:38:39.162384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 700/1377] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:39.350403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2444d4fc-cfa7-4991-b2ff-9260611a30c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:39.353382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2444d4fc-cfa7-4991-b2ff-9260611a30c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:39.362765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2444d4fc-cfa7-4991-b2ff-9260611a30c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:39.363400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2444d4fc-cfa7-4991-b2ff-9260611a30c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:39.364535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2444d4fc-cfa7-4991-b2ff-9260611a30c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:39.365124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2444d4fc-cfa7-4991-b2ff-9260611a30c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:39.389522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-03e6193f-db75-4b4d-b357-b78d454cd879 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:39.391675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-03e6193f-db75-4b4d-b357-b78d454cd879 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:39.398472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2444d4fc-cfa7-4991-b2ff-9260611a30c8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052374 Jul 26 18:38:39.399115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 678/1378] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:39 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:39.399841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-03e6193f-db75-4b4d-b357-b78d454cd879 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:39.400290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-03e6193f-db75-4b4d-b357-b78d454cd879 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:39.401090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-03e6193f-db75-4b4d-b357-b78d454cd879 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:39.401492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-03e6193f-db75-4b4d-b357-b78d454cd879 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:39.433488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-03e6193f-db75-4b4d-b357-b78d454cd879 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047962 Jul 26 18:38:39.434073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 701/1379] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:39 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:39.943509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3a2d03b0-f50f-4777-b5f5-510b90dd9afb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:39.947063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3a2d03b0-f50f-4777-b5f5-510b90dd9afb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:39.955291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a2d03b0-f50f-4777-b5f5-510b90dd9afb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:39.955773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a2d03b0-f50f-4777-b5f5-510b90dd9afb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:39.956961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a2d03b0-f50f-4777-b5f5-510b90dd9afb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:39.957581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a2d03b0-f50f-4777-b5f5-510b90dd9afb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:39.995270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3a2d03b0-f50f-4777-b5f5-510b90dd9afb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058183 Jul 26 18:38:39.995848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 679/1380] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:39 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:40.180341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-18f5d156-68ed-4c89-9fb3-796c1e9395d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:40.183605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-18f5d156-68ed-4c89-9fb3-796c1e9395d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:40.185422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:40.191545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18f5d156-68ed-4c89-9fb3-796c1e9395d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:40.192050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18f5d156-68ed-4c89-9fb3-796c1e9395d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:40.192809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18f5d156-68ed-4c89-9fb3-796c1e9395d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:40.193238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18f5d156-68ed-4c89-9fb3-796c1e9395d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:40.224769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-18f5d156-68ed-4c89-9fb3-796c1e9395d7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052274 Jul 26 18:38:40.225337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 702/1381] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:40 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:40.414528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b3d8c2f4-07bd-4d28-bdc3-bcdb70c605bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:40.416763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b3d8c2f4-07bd-4d28-bdc3-bcdb70c605bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:40.423847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3d8c2f4-07bd-4d28-bdc3-bcdb70c605bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:40.424298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3d8c2f4-07bd-4d28-bdc3-bcdb70c605bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:40.425089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3d8c2f4-07bd-4d28-bdc3-bcdb70c605bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:40.425525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3d8c2f4-07bd-4d28-bdc3-bcdb70c605bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:40.446212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4959c3a7-6104-4d0a-a686-5cb63526ef25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:40.448503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4959c3a7-6104-4d0a-a686-5cb63526ef25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:40.455297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4959c3a7-6104-4d0a-a686-5cb63526ef25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:40.455783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4959c3a7-6104-4d0a-a686-5cb63526ef25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:40.456548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4959c3a7-6104-4d0a-a686-5cb63526ef25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:40.456971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4959c3a7-6104-4d0a-a686-5cb63526ef25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:40.457730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b3d8c2f4-07bd-4d28-bdc3-bcdb70c605bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048480 Jul 26 18:38:40.458512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 680/1382] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:40 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:40.487292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4959c3a7-6104-4d0a-a686-5cb63526ef25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045126 Jul 26 18:38:40.487924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 703/1383] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:40 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:41.008883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ae3a444d-0f13-4c9f-8362-142bafb796d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:41.011053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ae3a444d-0f13-4c9f-8362-142bafb796d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:41.018033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae3a444d-0f13-4c9f-8362-142bafb796d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:41.018474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae3a444d-0f13-4c9f-8362-142bafb796d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:41.019275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae3a444d-0f13-4c9f-8362-142bafb796d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:41.019710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae3a444d-0f13-4c9f-8362-142bafb796d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:41.052219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ae3a444d-0f13-4c9f-8362-142bafb796d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047322 Jul 26 18:38:41.052772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 681/1384] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:41 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:41.237745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5e5880a7-b72c-4e9a-9f0e-d361fe7ec6cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:41.239956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5e5880a7-b72c-4e9a-9f0e-d361fe7ec6cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:41.246451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e5880a7-b72c-4e9a-9f0e-d361fe7ec6cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:41.246921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e5880a7-b72c-4e9a-9f0e-d361fe7ec6cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:41.247716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e5880a7-b72c-4e9a-9f0e-d361fe7ec6cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:41.248141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e5880a7-b72c-4e9a-9f0e-d361fe7ec6cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:41.277742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5e5880a7-b72c-4e9a-9f0e-d361fe7ec6cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044012 Jul 26 18:38:41.278213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 704/1385] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:41 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:41.470346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-011a44b2-0fec-4139-b421-e906098d5d01 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:41.472586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-011a44b2-0fec-4139-b421-e906098d5d01 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:41.479009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-011a44b2-0fec-4139-b421-e906098d5d01 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:41.479487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-011a44b2-0fec-4139-b421-e906098d5d01 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:41.480444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-011a44b2-0fec-4139-b421-e906098d5d01 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:41.480891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-011a44b2-0fec-4139-b421-e906098d5d01 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:41.483331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:41.500051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8303f2f0-f6fa-4e4a-b6a7-cf836410d851 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:41.502247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8303f2f0-f6fa-4e4a-b6a7-cf836410d851 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:41.509159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8303f2f0-f6fa-4e4a-b6a7-cf836410d851 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:41.509601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8303f2f0-f6fa-4e4a-b6a7-cf836410d851 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:41.510367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8303f2f0-f6fa-4e4a-b6a7-cf836410d851 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:41.510797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8303f2f0-f6fa-4e4a-b6a7-cf836410d851 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:41.512220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-011a44b2-0fec-4139-b421-e906098d5d01 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046072 Jul 26 18:38:41.513064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 682/1386] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:41 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:41.543220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:41.548867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8303f2f0-f6fa-4e4a-b6a7-cf836410d851 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052786 Jul 26 18:38:41.549428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 705/1387] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:41 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:42.067672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-50cc8e89-79d8-4508-b2fb-0390eb04cc85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:42.070660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-50cc8e89-79d8-4508-b2fb-0390eb04cc85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:42.079064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50cc8e89-79d8-4508-b2fb-0390eb04cc85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:42.079630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50cc8e89-79d8-4508-b2fb-0390eb04cc85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:42.080424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50cc8e89-79d8-4508-b2fb-0390eb04cc85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:42.080853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50cc8e89-79d8-4508-b2fb-0390eb04cc85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:42.112245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-50cc8e89-79d8-4508-b2fb-0390eb04cc85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050282 Jul 26 18:38:42.112811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 683/1388] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:42 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:42.294112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3499fd53-dcde-4161-9269-df29e91b6e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:42.296701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3499fd53-dcde-4161-9269-df29e91b6e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:42.305045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3499fd53-dcde-4161-9269-df29e91b6e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:42.305648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3499fd53-dcde-4161-9269-df29e91b6e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:42.306844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3499fd53-dcde-4161-9269-df29e91b6e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:42.307459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3499fd53-dcde-4161-9269-df29e91b6e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:42.343887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3499fd53-dcde-4161-9269-df29e91b6e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054445 Jul 26 18:38:42.344355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 706/1389] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:42.528260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c2d62468-16d2-4f99-aa6d-312a18f158d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:42.530421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c2d62468-16d2-4f99-aa6d-312a18f158d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:42.536746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2d62468-16d2-4f99-aa6d-312a18f158d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:42.537195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2d62468-16d2-4f99-aa6d-312a18f158d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:42.537958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2d62468-16d2-4f99-aa6d-312a18f158d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:42.538393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2d62468-16d2-4f99-aa6d-312a18f158d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:42.560839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-25e50be5-ebc2-41bd-b29f-6267eaf333bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:42.563014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-25e50be5-ebc2-41bd-b29f-6267eaf333bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:42.567465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c2d62468-16d2-4f99-aa6d-312a18f158d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045396 Jul 26 18:38:42.568052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 684/1390] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:42 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:42.569638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25e50be5-ebc2-41bd-b29f-6267eaf333bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:42.570086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25e50be5-ebc2-41bd-b29f-6267eaf333bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:42.570854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25e50be5-ebc2-41bd-b29f-6267eaf333bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:42.571304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-25e50be5-ebc2-41bd-b29f-6267eaf333bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:42.600252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-25e50be5-ebc2-41bd-b29f-6267eaf333bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043603 Jul 26 18:38:42.600723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 707/1391] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:42 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:43.126346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0805fd7c-5901-473a-a328-0da8ff71340a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:43.128550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0805fd7c-5901-473a-a328-0da8ff71340a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:43.135445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0805fd7c-5901-473a-a328-0da8ff71340a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:43.135892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0805fd7c-5901-473a-a328-0da8ff71340a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:43.136681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0805fd7c-5901-473a-a328-0da8ff71340a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:43.137103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0805fd7c-5901-473a-a328-0da8ff71340a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:43.167381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0805fd7c-5901-473a-a328-0da8ff71340a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Jul 26 18:38:43.167930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 685/1392] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:43 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:43.356364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-26cb93d5-1b53-48bf-8f61-096041721fd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:43.358551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-26cb93d5-1b53-48bf-8f61-096041721fd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:43.364934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26cb93d5-1b53-48bf-8f61-096041721fd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:43.365379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26cb93d5-1b53-48bf-8f61-096041721fd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:43.366143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26cb93d5-1b53-48bf-8f61-096041721fd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:43.366575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26cb93d5-1b53-48bf-8f61-096041721fd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:43.396549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-26cb93d5-1b53-48bf-8f61-096041721fd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044124 Jul 26 18:38:43.397106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 708/1393] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:43.580734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2a8615f1-1b77-43a5-b7f0-7f463ed1cdb8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:43.582896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2a8615f1-1b77-43a5-b7f0-7f463ed1cdb8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:43.589673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a8615f1-1b77-43a5-b7f0-7f463ed1cdb8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:43.590051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a8615f1-1b77-43a5-b7f0-7f463ed1cdb8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:43.590814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a8615f1-1b77-43a5-b7f0-7f463ed1cdb8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:43.591276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a8615f1-1b77-43a5-b7f0-7f463ed1cdb8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:43.612574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-630bc819-1f98-4653-8254-b29e5dcdb521 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:43.614814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-630bc819-1f98-4653-8254-b29e5dcdb521 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:43.620603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2a8615f1-1b77-43a5-b7f0-7f463ed1cdb8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043850 Jul 26 18:38:43.621512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 686/1394] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:43 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:43.621820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-630bc819-1f98-4653-8254-b29e5dcdb521 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:43.622265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-630bc819-1f98-4653-8254-b29e5dcdb521 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:43.623067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-630bc819-1f98-4653-8254-b29e5dcdb521 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:43.623522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-630bc819-1f98-4653-8254-b29e5dcdb521 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:43.653183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-630bc819-1f98-4653-8254-b29e5dcdb521 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Jul 26 18:38:43.653737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 709/1395] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:43 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:44.180472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8a4b1dce-6a27-413a-8ed7-0cda68a5299e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:44.182600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8a4b1dce-6a27-413a-8ed7-0cda68a5299e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:44.189599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a4b1dce-6a27-413a-8ed7-0cda68a5299e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:44.190043 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a4b1dce-6a27-413a-8ed7-0cda68a5299e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:44.190803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a4b1dce-6a27-413a-8ed7-0cda68a5299e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:44.191345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a4b1dce-6a27-413a-8ed7-0cda68a5299e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:44.223746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8a4b1dce-6a27-413a-8ed7-0cda68a5299e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047200 Jul 26 18:38:44.224700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 687/1396] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:44 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:44.411536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dd2b491e-e284-435a-a0e4-beee4a3cd141 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:44.413738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dd2b491e-e284-435a-a0e4-beee4a3cd141 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:44.420537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd2b491e-e284-435a-a0e4-beee4a3cd141 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:44.420978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd2b491e-e284-435a-a0e4-beee4a3cd141 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:44.421854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd2b491e-e284-435a-a0e4-beee4a3cd141 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:44.422271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd2b491e-e284-435a-a0e4-beee4a3cd141 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:44.456798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dd2b491e-e284-435a-a0e4-beee4a3cd141 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049219 Jul 26 18:38:44.457258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 710/1397] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:44 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:44.636661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d7425691-ee37-4d7b-8bb5-445ab155198f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:44.639915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d7425691-ee37-4d7b-8bb5-445ab155198f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:44.649812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7425691-ee37-4d7b-8bb5-445ab155198f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:44.650443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7425691-ee37-4d7b-8bb5-445ab155198f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:44.651678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7425691-ee37-4d7b-8bb5-445ab155198f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:44.652453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7425691-ee37-4d7b-8bb5-445ab155198f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:44.665327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-57197b1a-62a6-4494-bb47-dff9c41f226a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:44.667589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-57197b1a-62a6-4494-bb47-dff9c41f226a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:44.673965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57197b1a-62a6-4494-bb47-dff9c41f226a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:44.674409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57197b1a-62a6-4494-bb47-dff9c41f226a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:44.675209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57197b1a-62a6-4494-bb47-dff9c41f226a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:44.675637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57197b1a-62a6-4494-bb47-dff9c41f226a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:44.682866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d7425691-ee37-4d7b-8bb5-445ab155198f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052378 Jul 26 18:38:44.683570 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 688/1398] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:44 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:44.706119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-57197b1a-62a6-4494-bb47-dff9c41f226a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044661 Jul 26 18:38:44.706673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 711/1399] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:44 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:45.237416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b78abcdc-bd20-4f81-8faa-515c9497031a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:45.239600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b78abcdc-bd20-4f81-8faa-515c9497031a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:45.246405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b78abcdc-bd20-4f81-8faa-515c9497031a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:45.246849 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b78abcdc-bd20-4f81-8faa-515c9497031a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:45.247632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b78abcdc-bd20-4f81-8faa-515c9497031a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:45.248065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b78abcdc-bd20-4f81-8faa-515c9497031a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:45.277763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b78abcdc-bd20-4f81-8faa-515c9497031a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Jul 26 18:38:45.278321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 689/1400] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:45 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:45.469791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-294bf8da-971f-4869-84a1-72a423d10c6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:45.471653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-294bf8da-971f-4869-84a1-72a423d10c6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:45.478265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-294bf8da-971f-4869-84a1-72a423d10c6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:45.478713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-294bf8da-971f-4869-84a1-72a423d10c6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:45.479498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-294bf8da-971f-4869-84a1-72a423d10c6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:45.479939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-294bf8da-971f-4869-84a1-72a423d10c6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:45.509783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-294bf8da-971f-4869-84a1-72a423d10c6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044356 Jul 26 18:38:45.510259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 712/1401] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:45.698266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-17978e75-303d-45a6-a118-7f300a136b61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:45.700736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-17978e75-303d-45a6-a118-7f300a136b61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:45.709204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17978e75-303d-45a6-a118-7f300a136b61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:45.709645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17978e75-303d-45a6-a118-7f300a136b61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:45.710403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17978e75-303d-45a6-a118-7f300a136b61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:45.710830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17978e75-303d-45a6-a118-7f300a136b61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:45.718750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cea1d08e-bbec-4a20-aa1f-211b5b8e0453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:45.721051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cea1d08e-bbec-4a20-aa1f-211b5b8e0453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:45.728007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cea1d08e-bbec-4a20-aa1f-211b5b8e0453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:45.728447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cea1d08e-bbec-4a20-aa1f-211b5b8e0453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:45.729263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cea1d08e-bbec-4a20-aa1f-211b5b8e0453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:45.729694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cea1d08e-bbec-4a20-aa1f-211b5b8e0453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:45.740949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-17978e75-303d-45a6-a118-7f300a136b61 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048247 Jul 26 18:38:45.741717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 690/1402] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:45 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:45.764931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cea1d08e-bbec-4a20-aa1f-211b5b8e0453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050065 Jul 26 18:38:45.765393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 713/1403] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:45 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:46.290692 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-baf64b9f-4e08-47a1-b312-d0de8cb194a5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:46.292902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-baf64b9f-4e08-47a1-b312-d0de8cb194a5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:46.300016 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-baf64b9f-4e08-47a1-b312-d0de8cb194a5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:46.300456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-baf64b9f-4e08-47a1-b312-d0de8cb194a5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:46.301204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-baf64b9f-4e08-47a1-b312-d0de8cb194a5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:46.301627 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-baf64b9f-4e08-47a1-b312-d0de8cb194a5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:46.331558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-baf64b9f-4e08-47a1-b312-d0de8cb194a5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Jul 26 18:38:46.332110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 691/1404] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:46 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:46.525512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9059201b-2095-4c73-b240-27fea35c7f17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:46.527830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9059201b-2095-4c73-b240-27fea35c7f17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:46.535297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9059201b-2095-4c73-b240-27fea35c7f17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:46.535734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9059201b-2095-4c73-b240-27fea35c7f17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:46.536509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9059201b-2095-4c73-b240-27fea35c7f17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:46.536935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9059201b-2095-4c73-b240-27fea35c7f17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:46.567434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9059201b-2095-4c73-b240-27fea35c7f17 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048141 Jul 26 18:38:46.567907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 714/1405] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:46.756458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-04a55a37-ac18-4449-8270-ccb90396218a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:46.759653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-04a55a37-ac18-4449-8270-ccb90396218a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:46.766836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04a55a37-ac18-4449-8270-ccb90396218a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:46.767308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04a55a37-ac18-4449-8270-ccb90396218a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:46.768101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04a55a37-ac18-4449-8270-ccb90396218a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:46.768529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04a55a37-ac18-4449-8270-ccb90396218a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:46.777895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d4798fb3-4912-478c-8610-f479ee2c6e8b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:46.780078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d4798fb3-4912-478c-8610-f479ee2c6e8b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:46.786700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4798fb3-4912-478c-8610-f479ee2c6e8b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:46.787208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4798fb3-4912-478c-8610-f479ee2c6e8b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:46.787972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4798fb3-4912-478c-8610-f479ee2c6e8b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:46.788423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4798fb3-4912-478c-8610-f479ee2c6e8b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:46.798912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-04a55a37-ac18-4449-8270-ccb90396218a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048715 Jul 26 18:38:46.799527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 692/1406] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:46 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:46.819884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d4798fb3-4912-478c-8610-f479ee2c6e8b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046131 Jul 26 18:38:46.820360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 715/1407] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:46 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:47.347223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-010ec6c2-32fd-429b-ad13-d2eba121e2d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:47.350670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-010ec6c2-32fd-429b-ad13-d2eba121e2d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:47.361621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-010ec6c2-32fd-429b-ad13-d2eba121e2d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:47.362220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-010ec6c2-32fd-429b-ad13-d2eba121e2d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:47.363398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-010ec6c2-32fd-429b-ad13-d2eba121e2d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:47.363923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-010ec6c2-32fd-429b-ad13-d2eba121e2d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:47.399733 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-010ec6c2-32fd-429b-ad13-d2eba121e2d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058636 Jul 26 18:38:47.400295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 693/1408] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:47 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:47.584149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6702292b-07f1-4eaa-84ee-bb4c0b69cc41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:47.587669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6702292b-07f1-4eaa-84ee-bb4c0b69cc41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:47.595282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6702292b-07f1-4eaa-84ee-bb4c0b69cc41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:47.595726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6702292b-07f1-4eaa-84ee-bb4c0b69cc41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:47.596496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6702292b-07f1-4eaa-84ee-bb4c0b69cc41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:47.596933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6702292b-07f1-4eaa-84ee-bb4c0b69cc41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:47.627748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6702292b-07f1-4eaa-84ee-bb4c0b69cc41 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050314 Jul 26 18:38:47.628258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 716/1409] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:47 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:47.812851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6f4d627f-b3d1-4d10-8185-953d44c73597 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:47.815003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6f4d627f-b3d1-4d10-8185-953d44c73597 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:47.821542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f4d627f-b3d1-4d10-8185-953d44c73597 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:47.821987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f4d627f-b3d1-4d10-8185-953d44c73597 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:47.822751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f4d627f-b3d1-4d10-8185-953d44c73597 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:47.823194 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f4d627f-b3d1-4d10-8185-953d44c73597 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:47.837533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b330db20-1b1d-4df9-9ec1-4d33dc7df71e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:47.839795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b330db20-1b1d-4df9-9ec1-4d33dc7df71e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:47.846658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b330db20-1b1d-4df9-9ec1-4d33dc7df71e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:47.847048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b330db20-1b1d-4df9-9ec1-4d33dc7df71e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:47.848176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b330db20-1b1d-4df9-9ec1-4d33dc7df71e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:47.848313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b330db20-1b1d-4df9-9ec1-4d33dc7df71e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:47.852701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6f4d627f-b3d1-4d10-8185-953d44c73597 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Jul 26 18:38:47.853292 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 694/1410] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:47 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:47.878019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b330db20-1b1d-4df9-9ec1-4d33dc7df71e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Jul 26 18:38:47.878498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 717/1411] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:47 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:48.412826 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7f49b866-1abb-4fe4-b922-35c4149b3def tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:48.414992 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7f49b866-1abb-4fe4-b922-35c4149b3def tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:48.422086 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f49b866-1abb-4fe4-b922-35c4149b3def tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:48.422524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f49b866-1abb-4fe4-b922-35c4149b3def tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:48.423325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f49b866-1abb-4fe4-b922-35c4149b3def tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:48.423760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f49b866-1abb-4fe4-b922-35c4149b3def tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:48.453503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7f49b866-1abb-4fe4-b922-35c4149b3def tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044676 Jul 26 18:38:48.454042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 695/1412] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:48 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:48.642685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-941c9f67-8f6c-47da-b391-4884ad77177e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:48.645457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-941c9f67-8f6c-47da-b391-4884ad77177e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:48.654012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-941c9f67-8f6c-47da-b391-4884ad77177e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:48.654570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-941c9f67-8f6c-47da-b391-4884ad77177e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:48.655568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-941c9f67-8f6c-47da-b391-4884ad77177e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:48.656122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-941c9f67-8f6c-47da-b391-4884ad77177e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:48.694594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-941c9f67-8f6c-47da-b391-4884ad77177e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056496 Jul 26 18:38:48.695331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 718/1413] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:48.868165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-09378f07-3e4b-4d5e-acc8-e1dd7e31c26c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:48.871056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-09378f07-3e4b-4d5e-acc8-e1dd7e31c26c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:48.877456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09378f07-3e4b-4d5e-acc8-e1dd7e31c26c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:48.877898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09378f07-3e4b-4d5e-acc8-e1dd7e31c26c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:48.878652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09378f07-3e4b-4d5e-acc8-e1dd7e31c26c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:48.879088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09378f07-3e4b-4d5e-acc8-e1dd7e31c26c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:48.889902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c2832f34-2578-454f-8b36-41274af6f02d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:48.892076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c2832f34-2578-454f-8b36-41274af6f02d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:48.898748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2832f34-2578-454f-8b36-41274af6f02d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:48.899221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2832f34-2578-454f-8b36-41274af6f02d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:48.899984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2832f34-2578-454f-8b36-41274af6f02d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:48.900411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2832f34-2578-454f-8b36-41274af6f02d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:48.911344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-09378f07-3e4b-4d5e-acc8-e1dd7e31c26c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049576 Jul 26 18:38:48.912114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 696/1414] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:48 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:48.938134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c2832f34-2578-454f-8b36-41274af6f02d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052088 Jul 26 18:38:48.938683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 719/1415] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:48 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:49.467678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-32a4ea22-e530-4ba6-bc93-7207a45a50cb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:49.469873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-32a4ea22-e530-4ba6-bc93-7207a45a50cb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:49.476917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32a4ea22-e530-4ba6-bc93-7207a45a50cb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:49.477445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32a4ea22-e530-4ba6-bc93-7207a45a50cb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:49.478122 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32a4ea22-e530-4ba6-bc93-7207a45a50cb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:49.478557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32a4ea22-e530-4ba6-bc93-7207a45a50cb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:49.509880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-32a4ea22-e530-4ba6-bc93-7207a45a50cb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047107 Jul 26 18:38:49.510440 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 697/1416] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:49 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:49.709700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9e8710ab-81e8-48d7-828c-02f142ee1d9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:49.712005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9e8710ab-81e8-48d7-828c-02f142ee1d9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:49.718667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e8710ab-81e8-48d7-828c-02f142ee1d9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:49.719056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e8710ab-81e8-48d7-828c-02f142ee1d9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:49.719818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e8710ab-81e8-48d7-828c-02f142ee1d9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:49.720243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e8710ab-81e8-48d7-828c-02f142ee1d9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:49.754063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9e8710ab-81e8-48d7-828c-02f142ee1d9a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048533 Jul 26 18:38:49.754637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 720/1417] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:49 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:49.924423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-56481f55-31b9-4593-9092-5267db6918fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:49.926575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-56481f55-31b9-4593-9092-5267db6918fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:49.933117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56481f55-31b9-4593-9092-5267db6918fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:49.933562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56481f55-31b9-4593-9092-5267db6918fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:49.934313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56481f55-31b9-4593-9092-5267db6918fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:49.934742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56481f55-31b9-4593-9092-5267db6918fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:49.950191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7a64ed64-6706-45c0-b563-3bb98b8c2749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:49.952422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7a64ed64-6706-45c0-b563-3bb98b8c2749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:49.959247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a64ed64-6706-45c0-b563-3bb98b8c2749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:49.959450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:49.959683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a64ed64-6706-45c0-b563-3bb98b8c2749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:49.960491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a64ed64-6706-45c0-b563-3bb98b8c2749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:49.960958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a64ed64-6706-45c0-b563-3bb98b8c2749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:49.965914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-56481f55-31b9-4593-9092-5267db6918fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045637 Jul 26 18:38:49.966487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 698/1418] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:49 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:49.991475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7a64ed64-6706-45c0-b563-3bb98b8c2749 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045297 Jul 26 18:38:49.991976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 721/1419] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:49 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:50.522248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-79b1f3d3-c5be-44e5-8007-b501dd9aa537 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:50.524324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-79b1f3d3-c5be-44e5-8007-b501dd9aa537 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:50.532754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79b1f3d3-c5be-44e5-8007-b501dd9aa537 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:50.533472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79b1f3d3-c5be-44e5-8007-b501dd9aa537 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:50.534654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79b1f3d3-c5be-44e5-8007-b501dd9aa537 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:50.535446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79b1f3d3-c5be-44e5-8007-b501dd9aa537 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:50.573749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-79b1f3d3-c5be-44e5-8007-b501dd9aa537 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055915 Jul 26 18:38:50.574297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 699/1420] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:50 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:50.766668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-440e32e5-6c04-45f8-8d4c-24fb3b0c28ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:50.768835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-440e32e5-6c04-45f8-8d4c-24fb3b0c28ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:50.775850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-440e32e5-6c04-45f8-8d4c-24fb3b0c28ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:50.776226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-440e32e5-6c04-45f8-8d4c-24fb3b0c28ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:50.776974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-440e32e5-6c04-45f8-8d4c-24fb3b0c28ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:50.777406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-440e32e5-6c04-45f8-8d4c-24fb3b0c28ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:50.795302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:50.808843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-440e32e5-6c04-45f8-8d4c-24fb3b0c28ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046289 Jul 26 18:38:50.809400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 722/1421] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:50 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:50.981204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5c0eba6f-9f9e-44c9-871e-99738fa19d45 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:50.983910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5c0eba6f-9f9e-44c9-871e-99738fa19d45 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:50.991997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c0eba6f-9f9e-44c9-871e-99738fa19d45 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:50.992557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c0eba6f-9f9e-44c9-871e-99738fa19d45 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:50.993518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c0eba6f-9f9e-44c9-871e-99738fa19d45 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:50.994063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c0eba6f-9f9e-44c9-871e-99738fa19d45 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:51.004241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f04a687e-da57-461a-8e21-f6e5dc3d6e7e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:51.006422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f04a687e-da57-461a-8e21-f6e5dc3d6e7e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:51.013278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f04a687e-da57-461a-8e21-f6e5dc3d6e7e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:51.013758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f04a687e-da57-461a-8e21-f6e5dc3d6e7e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:51.014483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f04a687e-da57-461a-8e21-f6e5dc3d6e7e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:51.014940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f04a687e-da57-461a-8e21-f6e5dc3d6e7e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:51.025315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5c0eba6f-9f9e-44c9-871e-99738fa19d45 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049182 Jul 26 18:38:51.025962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 700/1422] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:50 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:51.045784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f04a687e-da57-461a-8e21-f6e5dc3d6e7e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045361 Jul 26 18:38:51.046362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 723/1423] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:50 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:51.587562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f2ff8f46-58b4-49e5-a62c-8317d39622b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:51.589690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f2ff8f46-58b4-49e5-a62c-8317d39622b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:51.596420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2ff8f46-58b4-49e5-a62c-8317d39622b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:51.596863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2ff8f46-58b4-49e5-a62c-8317d39622b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:51.597611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2ff8f46-58b4-49e5-a62c-8317d39622b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:51.598065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2ff8f46-58b4-49e5-a62c-8317d39622b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:51.629672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f2ff8f46-58b4-49e5-a62c-8317d39622b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046182 Jul 26 18:38:51.630266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 701/1424] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:51 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:51.821430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-54d2c287-5afb-4166-960d-0430c183ed2a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:51.823692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-54d2c287-5afb-4166-960d-0430c183ed2a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:51.830112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54d2c287-5afb-4166-960d-0430c183ed2a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:51.830555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54d2c287-5afb-4166-960d-0430c183ed2a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:51.831361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54d2c287-5afb-4166-960d-0430c183ed2a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:51.831789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54d2c287-5afb-4166-960d-0430c183ed2a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:51.861464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-54d2c287-5afb-4166-960d-0430c183ed2a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043923 Jul 26 18:38:51.862199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 724/1425] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:52.038160 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dee135ac-504f-4719-8cbe-4dc7ae726bea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:52.040414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dee135ac-504f-4719-8cbe-4dc7ae726bea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:52.046850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dee135ac-504f-4719-8cbe-4dc7ae726bea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:52.047338 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dee135ac-504f-4719-8cbe-4dc7ae726bea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:52.048099 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dee135ac-504f-4719-8cbe-4dc7ae726bea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:52.048534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dee135ac-504f-4719-8cbe-4dc7ae726bea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:52.058871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fc836270-a26f-4570-a1dc-c87b343ba488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:52.062446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fc836270-a26f-4570-a1dc-c87b343ba488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:52.069294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc836270-a26f-4570-a1dc-c87b343ba488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:52.069734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc836270-a26f-4570-a1dc-c87b343ba488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:52.070496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc836270-a26f-4570-a1dc-c87b343ba488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:52.070926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc836270-a26f-4570-a1dc-c87b343ba488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:52.079413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dee135ac-504f-4719-8cbe-4dc7ae726bea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045165 Jul 26 18:38:52.084056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 702/1426] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:52 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:52.101258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fc836270-a26f-4570-a1dc-c87b343ba488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046476 Jul 26 18:38:52.101817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 725/1427] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:52 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:52.642372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fbe9b76f-44e3-4e80-82f6-19aeb267ef63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:52.644492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fbe9b76f-44e3-4e80-82f6-19aeb267ef63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:52.651790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbe9b76f-44e3-4e80-82f6-19aeb267ef63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:52.652333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbe9b76f-44e3-4e80-82f6-19aeb267ef63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:52.653096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbe9b76f-44e3-4e80-82f6-19aeb267ef63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:52.653519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbe9b76f-44e3-4e80-82f6-19aeb267ef63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:52.684037 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fbe9b76f-44e3-4e80-82f6-19aeb267ef63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045821 Jul 26 18:38:52.684590 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 703/1428] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:52 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:52.874314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-565845f4-2d6d-44d8-b8be-386e74af74ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:52.876580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-565845f4-2d6d-44d8-b8be-386e74af74ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:52.883655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-565845f4-2d6d-44d8-b8be-386e74af74ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:52.884096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-565845f4-2d6d-44d8-b8be-386e74af74ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:52.884851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-565845f4-2d6d-44d8-b8be-386e74af74ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:52.885276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-565845f4-2d6d-44d8-b8be-386e74af74ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:52.915500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-565845f4-2d6d-44d8-b8be-386e74af74ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045509 Jul 26 18:38:52.915974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 726/1429] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:53.091960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cf1edfa8-f19c-488d-96fc-42b9a0e099aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:53.094135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cf1edfa8-f19c-488d-96fc-42b9a0e099aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:53.100741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf1edfa8-f19c-488d-96fc-42b9a0e099aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:53.101178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf1edfa8-f19c-488d-96fc-42b9a0e099aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:53.101931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf1edfa8-f19c-488d-96fc-42b9a0e099aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:53.102360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf1edfa8-f19c-488d-96fc-42b9a0e099aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:53.116461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-33436da4-ce02-4e61-a292-12271cd90f3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:53.120526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-33436da4-ce02-4e61-a292-12271cd90f3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:53.133583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33436da4-ce02-4e61-a292-12271cd90f3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:53.134259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33436da4-ce02-4e61-a292-12271cd90f3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:53.135552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33436da4-ce02-4e61-a292-12271cd90f3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:53.136263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33436da4-ce02-4e61-a292-12271cd90f3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:53.144212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cf1edfa8-f19c-488d-96fc-42b9a0e099aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056174 Jul 26 18:38:53.144786 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 704/1430] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:53 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:53.166398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-33436da4-ce02-4e61-a292-12271cd90f3a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055451 Jul 26 18:38:53.166841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 727/1431] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:53 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:53.699239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-de434c70-8159-4399-af57-c5d91ce6c9fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:53.701318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-de434c70-8159-4399-af57-c5d91ce6c9fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:53.708306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de434c70-8159-4399-af57-c5d91ce6c9fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:53.708760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de434c70-8159-4399-af57-c5d91ce6c9fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:53.709516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de434c70-8159-4399-af57-c5d91ce6c9fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:53.709951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de434c70-8159-4399-af57-c5d91ce6c9fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:53.739052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-de434c70-8159-4399-af57-c5d91ce6c9fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045381 Jul 26 18:38:53.739665 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 705/1432] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:53 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:53.928733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3b65ce77-f21f-418b-ba41-6c78c91e0f49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:53.930922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3b65ce77-f21f-418b-ba41-6c78c91e0f49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:53.937460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b65ce77-f21f-418b-ba41-6c78c91e0f49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:53.937903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b65ce77-f21f-418b-ba41-6c78c91e0f49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:53.938655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b65ce77-f21f-418b-ba41-6c78c91e0f49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:53.939081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b65ce77-f21f-418b-ba41-6c78c91e0f49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:53.968491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3b65ce77-f21f-418b-ba41-6c78c91e0f49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043925 Jul 26 18:38:53.969048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 728/1433] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:54.157009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-73c6eca3-76d2-443d-94db-83f025bafaa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:54.159218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-73c6eca3-76d2-443d-94db-83f025bafaa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:54.165985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73c6eca3-76d2-443d-94db-83f025bafaa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:54.166433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73c6eca3-76d2-443d-94db-83f025bafaa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:54.167242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73c6eca3-76d2-443d-94db-83f025bafaa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:54.167678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73c6eca3-76d2-443d-94db-83f025bafaa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:54.180374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a94ede8b-69d3-49d7-a31b-2d11b5584423 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:54.182883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a94ede8b-69d3-49d7-a31b-2d11b5584423 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:54.189776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a94ede8b-69d3-49d7-a31b-2d11b5584423 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:54.190213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a94ede8b-69d3-49d7-a31b-2d11b5584423 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:54.191090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a94ede8b-69d3-49d7-a31b-2d11b5584423 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:54.191437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a94ede8b-69d3-49d7-a31b-2d11b5584423 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:54.200965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-73c6eca3-76d2-443d-94db-83f025bafaa1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047931 Jul 26 18:38:54.201534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 706/1434] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:54.221015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a94ede8b-69d3-49d7-a31b-2d11b5584423 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046757 Jul 26 18:38:54.221490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 729/1435] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:54 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:54.752319 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b41bd414-2b8f-4676-b515-e29bbba9034b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:54.754493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b41bd414-2b8f-4676-b515-e29bbba9034b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:54.761474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b41bd414-2b8f-4676-b515-e29bbba9034b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:54.761922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b41bd414-2b8f-4676-b515-e29bbba9034b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:54.762670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b41bd414-2b8f-4676-b515-e29bbba9034b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:54.763124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b41bd414-2b8f-4676-b515-e29bbba9034b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:54.797106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b41bd414-2b8f-4676-b515-e29bbba9034b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048478 Jul 26 18:38:54.797838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 707/1436] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:54 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:54.981739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d4cac543-5c3b-42e3-8191-6d7b6442e08e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:54.983969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d4cac543-5c3b-42e3-8191-6d7b6442e08e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:54.990438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4cac543-5c3b-42e3-8191-6d7b6442e08e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:54.990887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4cac543-5c3b-42e3-8191-6d7b6442e08e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:54.991720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4cac543-5c3b-42e3-8191-6d7b6442e08e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:54.992144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4cac543-5c3b-42e3-8191-6d7b6442e08e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:55.022950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d4cac543-5c3b-42e3-8191-6d7b6442e08e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045249 Jul 26 18:38:55.023466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 730/1437] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:54 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 18:38:55.213892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-04c247b7-3b43-4ca9-a3ad-6d2a2200625f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:55.216080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-04c247b7-3b43-4ca9-a3ad-6d2a2200625f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:55.222646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04c247b7-3b43-4ca9-a3ad-6d2a2200625f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:55.223119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04c247b7-3b43-4ca9-a3ad-6d2a2200625f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:55.223878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04c247b7-3b43-4ca9-a3ad-6d2a2200625f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:55.224303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04c247b7-3b43-4ca9-a3ad-6d2a2200625f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:55.233798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3549e90e-2dcc-41a8-ac04-2706b7b2310d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:55.235956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3549e90e-2dcc-41a8-ac04-2706b7b2310d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:55.242654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3549e90e-2dcc-41a8-ac04-2706b7b2310d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:55.243124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3549e90e-2dcc-41a8-ac04-2706b7b2310d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:55.243887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3549e90e-2dcc-41a8-ac04-2706b7b2310d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:55.244315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3549e90e-2dcc-41a8-ac04-2706b7b2310d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:55.254225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-04c247b7-3b43-4ca9-a3ad-6d2a2200625f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044263 Jul 26 18:38:55.254790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 708/1438] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:55 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:55.274733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3549e90e-2dcc-41a8-ac04-2706b7b2310d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Jul 26 18:38:55.275242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 731/1439] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:55 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:55.810858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-92f3e578-179b-471e-b283-30a6eaa98212 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:55.812905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-92f3e578-179b-471e-b283-30a6eaa98212 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:55.820016 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92f3e578-179b-471e-b283-30a6eaa98212 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:55.820467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92f3e578-179b-471e-b283-30a6eaa98212 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:55.821201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92f3e578-179b-471e-b283-30a6eaa98212 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:55.821661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92f3e578-179b-471e-b283-30a6eaa98212 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:55.852986 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-92f3e578-179b-471e-b283-30a6eaa98212 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046623 Jul 26 18:38:55.853570 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 709/1440] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:55 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:56.035911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fea7f208-9ea9-44ac-ae42-fd86e9723534 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:56.038061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fea7f208-9ea9-44ac-ae42-fd86e9723534 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:56.044721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fea7f208-9ea9-44ac-ae42-fd86e9723534 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:56.045164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fea7f208-9ea9-44ac-ae42-fd86e9723534 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:56.045921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fea7f208-9ea9-44ac-ae42-fd86e9723534 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:56.046345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fea7f208-9ea9-44ac-ae42-fd86e9723534 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:56.075964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fea7f208-9ea9-44ac-ae42-fd86e9723534 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043966 Jul 26 18:38:56.076433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 732/1441] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:56 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:56.266937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8e16715c-218c-4a2b-825e-abc1d9fbae4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:56.269095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8e16715c-218c-4a2b-825e-abc1d9fbae4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:56.276390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e16715c-218c-4a2b-825e-abc1d9fbae4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:56.276825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e16715c-218c-4a2b-825e-abc1d9fbae4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:56.277631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e16715c-218c-4a2b-825e-abc1d9fbae4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:56.278054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e16715c-218c-4a2b-825e-abc1d9fbae4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:56.287063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9b2c321f-dec5-446c-935e-8d8e69249386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:56.289372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9b2c321f-dec5-446c-935e-8d8e69249386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:56.298351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9b2c321f-dec5-446c-935e-8d8e69249386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:56.298808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9b2c321f-dec5-446c-935e-8d8e69249386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:56.299621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9b2c321f-dec5-446c-935e-8d8e69249386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:56.300057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9b2c321f-dec5-446c-935e-8d8e69249386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:56.314916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8e16715c-218c-4a2b-825e-abc1d9fbae4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049303 Jul 26 18:38:56.315538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 710/1442] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:56 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:56.331858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9b2c321f-dec5-446c-935e-8d8e69249386 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048646 Jul 26 18:38:56.332313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 733/1443] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:56 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:56.866560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9d401b43-34bc-4621-9239-2fd6dd19a6dc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:56.868737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9d401b43-34bc-4621-9239-2fd6dd19a6dc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:56.876070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d401b43-34bc-4621-9239-2fd6dd19a6dc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:56.876516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d401b43-34bc-4621-9239-2fd6dd19a6dc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:56.877283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d401b43-34bc-4621-9239-2fd6dd19a6dc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:56.877713 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d401b43-34bc-4621-9239-2fd6dd19a6dc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:56.908280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9d401b43-34bc-4621-9239-2fd6dd19a6dc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046277 Jul 26 18:38:56.908841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 711/1444] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:56 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:57.088674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c691591f-a0f8-4f91-b21e-64bee2096835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:57.090969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c691591f-a0f8-4f91-b21e-64bee2096835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:57.099995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c691591f-a0f8-4f91-b21e-64bee2096835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:57.100452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c691591f-a0f8-4f91-b21e-64bee2096835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:57.101234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c691591f-a0f8-4f91-b21e-64bee2096835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:57.101994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c691591f-a0f8-4f91-b21e-64bee2096835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:57.134542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c691591f-a0f8-4f91-b21e-64bee2096835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049753 Jul 26 18:38:57.135038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 734/1445] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:57 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:57.264222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:38:57.264596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 18:38:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:38:57.331717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-06088316-a59b-4ff6-af5f-75b6e28ccff8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:57.335285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-06088316-a59b-4ff6-af5f-75b6e28ccff8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:57.343837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06088316-a59b-4ff6-af5f-75b6e28ccff8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:57.344273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06088316-a59b-4ff6-af5f-75b6e28ccff8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:57.345084 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3dc94e33-55c7-48e0-8ed0-8c2d34151c1a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:57.345549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06088316-a59b-4ff6-af5f-75b6e28ccff8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:57.345549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06088316-a59b-4ff6-af5f-75b6e28ccff8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:57.347260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3dc94e33-55c7-48e0-8ed0-8c2d34151c1a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:57.354841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3dc94e33-55c7-48e0-8ed0-8c2d34151c1a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:57.355718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3dc94e33-55c7-48e0-8ed0-8c2d34151c1a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:57.356616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3dc94e33-55c7-48e0-8ed0-8c2d34151c1a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:57.357005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3dc94e33-55c7-48e0-8ed0-8c2d34151c1a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:57.376281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-06088316-a59b-4ff6-af5f-75b6e28ccff8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051240 Jul 26 18:38:57.377226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 712/1446] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:57 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:57.388443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3dc94e33-55c7-48e0-8ed0-8c2d34151c1a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047145 Jul 26 18:38:57.388932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 735/1447] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:57 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:57.923879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-90a846cb-f562-464f-b8b4-e114a6a19d26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:57.927260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-90a846cb-f562-464f-b8b4-e114a6a19d26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:57.936282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-90a846cb-f562-464f-b8b4-e114a6a19d26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:57.936724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-90a846cb-f562-464f-b8b4-e114a6a19d26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:57.937452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-90a846cb-f562-464f-b8b4-e114a6a19d26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:57.937907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-90a846cb-f562-464f-b8b4-e114a6a19d26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:57.967918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-90a846cb-f562-464f-b8b4-e114a6a19d26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050407 Jul 26 18:38:57.968434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 713/1448] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:57 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:58.152914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-17efdb9f-a469-4289-986c-86eb021dcef2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:58.156166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-17efdb9f-a469-4289-986c-86eb021dcef2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:58.166081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17efdb9f-a469-4289-986c-86eb021dcef2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:58.166774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17efdb9f-a469-4289-986c-86eb021dcef2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:58.168100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17efdb9f-a469-4289-986c-86eb021dcef2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:58.168529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17efdb9f-a469-4289-986c-86eb021dcef2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:58.197666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-17efdb9f-a469-4289-986c-86eb021dcef2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051195 Jul 26 18:38:58.198143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 736/1449] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:58.389268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fed3c9f3-a661-4043-8567-ceb7a445be9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:58.391985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fed3c9f3-a661-4043-8567-ceb7a445be9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:58.400082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fed3c9f3-a661-4043-8567-ceb7a445be9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:58.400530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fed3c9f3-a661-4043-8567-ceb7a445be9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:58.401308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fed3c9f3-a661-4043-8567-ceb7a445be9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:58.401425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5bf7d257-5b11-4244-a556-65c1b7352e14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:58.401963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fed3c9f3-a661-4043-8567-ceb7a445be9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:58.403516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5bf7d257-5b11-4244-a556-65c1b7352e14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:58.411152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5bf7d257-5b11-4244-a556-65c1b7352e14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:58.411745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5bf7d257-5b11-4244-a556-65c1b7352e14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:58.412517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5bf7d257-5b11-4244-a556-65c1b7352e14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:58.412943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5bf7d257-5b11-4244-a556-65c1b7352e14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:58.438675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fed3c9f3-a661-4043-8567-ceb7a445be9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054406 Jul 26 18:38:58.439269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 714/1450] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:58 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:58.451914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5bf7d257-5b11-4244-a556-65c1b7352e14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054370 Jul 26 18:38:58.452408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 737/1451] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:58 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:58.982613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5bc0ad3c-ca17-45d0-b122-bd5286fab6ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:58.984904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5bc0ad3c-ca17-45d0-b122-bd5286fab6ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:58.991357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5bc0ad3c-ca17-45d0-b122-bd5286fab6ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:58.991804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5bc0ad3c-ca17-45d0-b122-bd5286fab6ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:58.992564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5bc0ad3c-ca17-45d0-b122-bd5286fab6ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:58.992991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5bc0ad3c-ca17-45d0-b122-bd5286fab6ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:59.007053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:59.030251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5bc0ad3c-ca17-45d0-b122-bd5286fab6ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051444 Jul 26 18:38:59.030968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 715/1452] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:58 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:59.211350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-876f40ff-333b-4ab0-9bf2-1cebe4c1aa8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:59.213526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-876f40ff-333b-4ab0-9bf2-1cebe4c1aa8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:59.220115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-876f40ff-333b-4ab0-9bf2-1cebe4c1aa8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:59.220557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-876f40ff-333b-4ab0-9bf2-1cebe4c1aa8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:59.221309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-876f40ff-333b-4ab0-9bf2-1cebe4c1aa8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:59.221734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-876f40ff-333b-4ab0-9bf2-1cebe4c1aa8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:59.250926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-876f40ff-333b-4ab0-9bf2-1cebe4c1aa8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043543 Jul 26 18:38:59.251415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 738/1453] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:38:59 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:38:59.455069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4576da86-6ae6-4c59-a1be-c80913cfc427 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:59.458381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4576da86-6ae6-4c59-a1be-c80913cfc427 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:59.466847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f7c84481-4587-4707-94de-fe06872255cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:38:59.467930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4576da86-6ae6-4c59-a1be-c80913cfc427 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:59.468075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4576da86-6ae6-4c59-a1be-c80913cfc427 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:59.471584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4576da86-6ae6-4c59-a1be-c80913cfc427 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:59.472082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f7c84481-4587-4707-94de-fe06872255cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:38:59.472191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4576da86-6ae6-4c59-a1be-c80913cfc427 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:59.476611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7c84481-4587-4707-94de-fe06872255cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:59.477059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7c84481-4587-4707-94de-fe06872255cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:59.477919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7c84481-4587-4707-94de-fe06872255cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:38:59.478923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7c84481-4587-4707-94de-fe06872255cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:38:59.483937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:38:59.502218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4576da86-6ae6-4c59-a1be-c80913cfc427 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053640 Jul 26 18:38:59.502636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 716/1454] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:59 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:38:59.510657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f7c84481-4587-4707-94de-fe06872255cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049027 Jul 26 18:38:59.511253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 739/1455] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:38:59 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:00.047613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-72cb662c-0585-44d6-8c17-880a5810efaf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:00.049790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-72cb662c-0585-44d6-8c17-880a5810efaf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:00.056671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-72cb662c-0585-44d6-8c17-880a5810efaf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:00.057114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-72cb662c-0585-44d6-8c17-880a5810efaf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:00.057907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-72cb662c-0585-44d6-8c17-880a5810efaf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:00.058557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-72cb662c-0585-44d6-8c17-880a5810efaf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:00.091473 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-72cb662c-0585-44d6-8c17-880a5810efaf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047720 Jul 26 18:39:00.092036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 717/1456] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:00 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:00.266445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fc87e28c-5691-4fd9-bced-2858e970b8e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:00.269440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fc87e28c-5691-4fd9-bced-2858e970b8e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:00.278503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc87e28c-5691-4fd9-bced-2858e970b8e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:00.278952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc87e28c-5691-4fd9-bced-2858e970b8e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:00.279738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc87e28c-5691-4fd9-bced-2858e970b8e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:00.280167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc87e28c-5691-4fd9-bced-2858e970b8e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:00.314565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fc87e28c-5691-4fd9-bced-2858e970b8e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054006 Jul 26 18:39:00.315251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 740/1457] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:00 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:00.514548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b61f677e-d03b-4d10-8050-59baded8037b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:00.516794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b61f677e-d03b-4d10-8050-59baded8037b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:00.524089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-877c86c2-fb43-4f2a-befc-032f887d416f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:00.524682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b61f677e-d03b-4d10-8050-59baded8037b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:00.524682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b61f677e-d03b-4d10-8050-59baded8037b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:00.525361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b61f677e-d03b-4d10-8050-59baded8037b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:00.525799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b61f677e-d03b-4d10-8050-59baded8037b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:00.526248 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-877c86c2-fb43-4f2a-befc-032f887d416f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:00.532655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-877c86c2-fb43-4f2a-befc-032f887d416f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:00.533123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-877c86c2-fb43-4f2a-befc-032f887d416f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:00.533890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-877c86c2-fb43-4f2a-befc-032f887d416f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:00.534316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-877c86c2-fb43-4f2a-befc-032f887d416f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:00.555625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b61f677e-d03b-4d10-8050-59baded8037b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Jul 26 18:39:00.556184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 718/1458] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:00 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:00.564249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-877c86c2-fb43-4f2a-befc-032f887d416f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Jul 26 18:39:00.564799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 741/1459] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:00 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:01.106393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e49a7a3c-dde7-43b0-8973-b6d6eda994b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:01.108507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e49a7a3c-dde7-43b0-8973-b6d6eda994b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:01.114868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e49a7a3c-dde7-43b0-8973-b6d6eda994b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:01.115344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e49a7a3c-dde7-43b0-8973-b6d6eda994b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:01.116102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e49a7a3c-dde7-43b0-8973-b6d6eda994b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:01.116525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e49a7a3c-dde7-43b0-8973-b6d6eda994b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:01.152563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e49a7a3c-dde7-43b0-8973-b6d6eda994b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051884 Jul 26 18:39:01.153138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 719/1460] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:01 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:01.329961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2931d9d4-fcf8-49f6-8888-fa3d5aea2835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:01.332518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2931d9d4-fcf8-49f6-8888-fa3d5aea2835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:01.340259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2931d9d4-fcf8-49f6-8888-fa3d5aea2835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:01.340800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2931d9d4-fcf8-49f6-8888-fa3d5aea2835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:01.341701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2931d9d4-fcf8-49f6-8888-fa3d5aea2835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:01.342211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2931d9d4-fcf8-49f6-8888-fa3d5aea2835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:01.374129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2931d9d4-fcf8-49f6-8888-fa3d5aea2835 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049134 Jul 26 18:39:01.374626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 742/1461] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:01 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:01.568894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e259aa7f-8b08-4f7d-9c9c-40900169ecd4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:01.571152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e259aa7f-8b08-4f7d-9c9c-40900169ecd4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:01.578029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e259aa7f-8b08-4f7d-9c9c-40900169ecd4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:01.578469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e259aa7f-8b08-4f7d-9c9c-40900169ecd4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:01.578604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7a81e934-976f-454c-a341-d62c37bee6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:01.579272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e259aa7f-8b08-4f7d-9c9c-40900169ecd4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:01.579708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e259aa7f-8b08-4f7d-9c9c-40900169ecd4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:01.580756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7a81e934-976f-454c-a341-d62c37bee6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:01.587321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a81e934-976f-454c-a341-d62c37bee6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:01.587773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a81e934-976f-454c-a341-d62c37bee6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:01.588536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a81e934-976f-454c-a341-d62c37bee6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:01.588968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a81e934-976f-454c-a341-d62c37bee6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:01.608892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e259aa7f-8b08-4f7d-9c9c-40900169ecd4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043999 Jul 26 18:39:01.609469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 720/1462] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:01 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:01.618529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7a81e934-976f-454c-a341-d62c37bee6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Jul 26 18:39:01.619129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 743/1463] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:01 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:02.164919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-46004b38-b9f2-412a-8636-03a98c90c7ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:02.167174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-46004b38-b9f2-412a-8636-03a98c90c7ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:02.173751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46004b38-b9f2-412a-8636-03a98c90c7ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:02.174200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46004b38-b9f2-412a-8636-03a98c90c7ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:02.174963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46004b38-b9f2-412a-8636-03a98c90c7ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:02.175448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46004b38-b9f2-412a-8636-03a98c90c7ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:02.207056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-46004b38-b9f2-412a-8636-03a98c90c7ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046446 Jul 26 18:39:02.207634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 721/1464] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:02.387644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-83df3b80-9750-4c42-b38e-caaddbf45f79 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:02.390383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-83df3b80-9750-4c42-b38e-caaddbf45f79 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:02.397796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83df3b80-9750-4c42-b38e-caaddbf45f79 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:02.398237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83df3b80-9750-4c42-b38e-caaddbf45f79 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:02.399006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83df3b80-9750-4c42-b38e-caaddbf45f79 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:02.399470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83df3b80-9750-4c42-b38e-caaddbf45f79 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:02.430400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-83df3b80-9750-4c42-b38e-caaddbf45f79 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047187 Jul 26 18:39:02.430880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 744/1465] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:02 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:02.621614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ccd8ff14-99ea-49b1-ab8b-d4c1eed7ecce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:02.623784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ccd8ff14-99ea-49b1-ab8b-d4c1eed7ecce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:02.630257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ccd8ff14-99ea-49b1-ab8b-d4c1eed7ecce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:02.630503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1d0bdb66-f19b-47a3-a3f2-440afb78db64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:02.630980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ccd8ff14-99ea-49b1-ab8b-d4c1eed7ecce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:02.631552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ccd8ff14-99ea-49b1-ab8b-d4c1eed7ecce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:02.631981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ccd8ff14-99ea-49b1-ab8b-d4c1eed7ecce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:02.632653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1d0bdb66-f19b-47a3-a3f2-440afb78db64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:02.639010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d0bdb66-f19b-47a3-a3f2-440afb78db64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:02.639485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d0bdb66-f19b-47a3-a3f2-440afb78db64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:02.640244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d0bdb66-f19b-47a3-a3f2-440afb78db64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:02.640664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d0bdb66-f19b-47a3-a3f2-440afb78db64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:02.661612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ccd8ff14-99ea-49b1-ab8b-d4c1eed7ecce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043949 Jul 26 18:39:02.662152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 722/1466] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:02 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:02.672307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1d0bdb66-f19b-47a3-a3f2-440afb78db64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045653 Jul 26 18:39:02.672866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 745/1467] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:02 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:03.220224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ce3e3843-a8c5-4162-9a93-124ba13f21c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:03.222383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ce3e3843-a8c5-4162-9a93-124ba13f21c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:03.228854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce3e3843-a8c5-4162-9a93-124ba13f21c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:03.229310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce3e3843-a8c5-4162-9a93-124ba13f21c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:03.230075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce3e3843-a8c5-4162-9a93-124ba13f21c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:03.230479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce3e3843-a8c5-4162-9a93-124ba13f21c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:03.261047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ce3e3843-a8c5-4162-9a93-124ba13f21c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Jul 26 18:39:03.261533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 723/1468] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:03 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:03.531876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e072d1e2-59a1-47e5-b42d-47a94b420eb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:03.534025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e072d1e2-59a1-47e5-b42d-47a94b420eb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:03.540152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e072d1e2-59a1-47e5-b42d-47a94b420eb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:03.540603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e072d1e2-59a1-47e5-b42d-47a94b420eb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:03.541359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e072d1e2-59a1-47e5-b42d-47a94b420eb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:03.541810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e072d1e2-59a1-47e5-b42d-47a94b420eb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:03.577483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e072d1e2-59a1-47e5-b42d-47a94b420eb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.137256 Jul 26 18:39:03.578042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 746/1469] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:03 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:03.676603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7e42283f-c424-4e34-9759-10c6f21bcd96 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:03.679681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7e42283f-c424-4e34-9759-10c6f21bcd96 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:03.687547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7835ff5f-cfdd-4e5d-b796-93f56995bf30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:03.688874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e42283f-c424-4e34-9759-10c6f21bcd96 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:03.689458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e42283f-c424-4e34-9759-10c6f21bcd96 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:03.690400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7835ff5f-cfdd-4e5d-b796-93f56995bf30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:03.690612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e42283f-c424-4e34-9759-10c6f21bcd96 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:03.691183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e42283f-c424-4e34-9759-10c6f21bcd96 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:03.699142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7835ff5f-cfdd-4e5d-b796-93f56995bf30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:03.699591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7835ff5f-cfdd-4e5d-b796-93f56995bf30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:03.700349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7835ff5f-cfdd-4e5d-b796-93f56995bf30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:03.700778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7835ff5f-cfdd-4e5d-b796-93f56995bf30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:03.724038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7e42283f-c424-4e34-9759-10c6f21bcd96 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053420 Jul 26 18:39:03.724606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 724/1470] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:03 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:03.734308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7835ff5f-cfdd-4e5d-b796-93f56995bf30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052320 Jul 26 18:39:03.735101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 747/1471] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:03 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:04.274246 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d6d58e89-4598-4e3a-96f4-1cb2a7aa0c10 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:04.276324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d6d58e89-4598-4e3a-96f4-1cb2a7aa0c10 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:04.278173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:04.283785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6d58e89-4598-4e3a-96f4-1cb2a7aa0c10 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:04.284230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6d58e89-4598-4e3a-96f4-1cb2a7aa0c10 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:04.284988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6d58e89-4598-4e3a-96f4-1cb2a7aa0c10 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:04.285414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d6d58e89-4598-4e3a-96f4-1cb2a7aa0c10 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:04.315073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d6d58e89-4598-4e3a-96f4-1cb2a7aa0c10 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Jul 26 18:39:04.315647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 725/1472] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:04 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:04.592119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-19d6285f-f239-45b7-8efb-53aed33ef5a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:04.594162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-19d6285f-f239-45b7-8efb-53aed33ef5a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:04.601210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19d6285f-f239-45b7-8efb-53aed33ef5a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:04.601650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19d6285f-f239-45b7-8efb-53aed33ef5a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:04.602409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19d6285f-f239-45b7-8efb-53aed33ef5a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:04.602833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19d6285f-f239-45b7-8efb-53aed33ef5a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:04.638650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-19d6285f-f239-45b7-8efb-53aed33ef5a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052372 Jul 26 18:39:04.639223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 748/1473] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:04 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:04.736843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0c6c4910-19e9-4cb3-9a65-f945ac1677e6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:04.738996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0c6c4910-19e9-4cb3-9a65-f945ac1677e6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:04.745850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c6c4910-19e9-4cb3-9a65-f945ac1677e6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:04.746335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c6c4910-19e9-4cb3-9a65-f945ac1677e6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:04.747092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c6c4910-19e9-4cb3-9a65-f945ac1677e6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:04.747569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c6c4910-19e9-4cb3-9a65-f945ac1677e6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:04.748231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-29d8254c-746c-447d-9087-697562c2f6ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:04.750274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-29d8254c-746c-447d-9087-697562c2f6ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:04.756668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-29d8254c-746c-447d-9087-697562c2f6ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:04.757108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-29d8254c-746c-447d-9087-697562c2f6ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:04.757871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-29d8254c-746c-447d-9087-697562c2f6ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:04.758299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-29d8254c-746c-447d-9087-697562c2f6ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:04.777607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0c6c4910-19e9-4cb3-9a65-f945ac1677e6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044587 Jul 26 18:39:04.778246 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 726/1474] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:04 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:04.788655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-29d8254c-746c-447d-9087-697562c2f6ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046688 Jul 26 18:39:04.789221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 749/1475] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:04 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:05.332181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e9e2a4a5-916f-4546-b6d5-a035db789c98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:05.334960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e9e2a4a5-916f-4546-b6d5-a035db789c98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:05.342635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9e2a4a5-916f-4546-b6d5-a035db789c98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:05.343083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9e2a4a5-916f-4546-b6d5-a035db789c98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:05.343878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9e2a4a5-916f-4546-b6d5-a035db789c98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:05.344304 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9e2a4a5-916f-4546-b6d5-a035db789c98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:05.374012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e9e2a4a5-916f-4546-b6d5-a035db789c98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047429 Jul 26 18:39:05.374560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 727/1476] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:05 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:05.654096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-50560a53-9eca-4a77-ad33-0f9fe70af0c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:05.656210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-50560a53-9eca-4a77-ad33-0f9fe70af0c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:05.663218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50560a53-9eca-4a77-ad33-0f9fe70af0c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:05.663660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50560a53-9eca-4a77-ad33-0f9fe70af0c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:05.664416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50560a53-9eca-4a77-ad33-0f9fe70af0c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:05.664840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50560a53-9eca-4a77-ad33-0f9fe70af0c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:05.694166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-50560a53-9eca-4a77-ad33-0f9fe70af0c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044237 Jul 26 18:39:05.694712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 750/1477] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:05.790360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-66c85c4c-e857-4d17-ad59-984026b02e07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:05.792691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-66c85c4c-e857-4d17-ad59-984026b02e07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:05.800686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66c85c4c-e857-4d17-ad59-984026b02e07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:05.801134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66c85c4c-e857-4d17-ad59-984026b02e07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:05.801692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-08656f68-85b7-4550-8832-6abf5457d92b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:05.802242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66c85c4c-e857-4d17-ad59-984026b02e07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:05.802401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66c85c4c-e857-4d17-ad59-984026b02e07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:05.803905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-08656f68-85b7-4550-8832-6abf5457d92b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:05.810088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-08656f68-85b7-4550-8832-6abf5457d92b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:05.810532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-08656f68-85b7-4550-8832-6abf5457d92b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:05.811346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-08656f68-85b7-4550-8832-6abf5457d92b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:05.811782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-08656f68-85b7-4550-8832-6abf5457d92b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:05.832643 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-66c85c4c-e857-4d17-ad59-984026b02e07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046245 Jul 26 18:39:05.833213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 728/1478] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:05 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:05.842030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-08656f68-85b7-4550-8832-6abf5457d92b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044503 Jul 26 18:39:05.842577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 751/1479] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:05 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:06.389479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9b2b6e5f-c15d-47fe-a7ab-462ba7c0b0e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:06.391567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9b2b6e5f-c15d-47fe-a7ab-462ba7c0b0e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:06.398408 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b2b6e5f-c15d-47fe-a7ab-462ba7c0b0e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:06.398934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b2b6e5f-c15d-47fe-a7ab-462ba7c0b0e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:06.399686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b2b6e5f-c15d-47fe-a7ab-462ba7c0b0e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:06.400120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b2b6e5f-c15d-47fe-a7ab-462ba7c0b0e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:06.430320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9b2b6e5f-c15d-47fe-a7ab-462ba7c0b0e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046019 Jul 26 18:39:06.430874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 729/1480] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:06 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:06.708743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7ffbd355-0092-4aed-aedc-aff155834797 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:06.711536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7ffbd355-0092-4aed-aedc-aff155834797 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:06.714681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:06.720580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ffbd355-0092-4aed-aedc-aff155834797 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:06.721015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ffbd355-0092-4aed-aedc-aff155834797 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:06.721776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ffbd355-0092-4aed-aedc-aff155834797 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:06.722199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ffbd355-0092-4aed-aedc-aff155834797 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:06.753749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7ffbd355-0092-4aed-aedc-aff155834797 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050570 Jul 26 18:39:06.754576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 752/1481] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:06 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:06.845552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3ab3d441-421a-4cdd-99a9-8d9d45e0dd63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:06.847790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3ab3d441-421a-4cdd-99a9-8d9d45e0dd63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:06.853830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7165d42d-5570-4d0f-85c0-c589c7e39cc7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:06.854736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ab3d441-421a-4cdd-99a9-8d9d45e0dd63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:06.855213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ab3d441-421a-4cdd-99a9-8d9d45e0dd63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:06.855959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7165d42d-5570-4d0f-85c0-c589c7e39cc7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:06.856103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ab3d441-421a-4cdd-99a9-8d9d45e0dd63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:06.856418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ab3d441-421a-4cdd-99a9-8d9d45e0dd63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:06.862080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7165d42d-5570-4d0f-85c0-c589c7e39cc7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:06.862517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7165d42d-5570-4d0f-85c0-c589c7e39cc7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:06.863310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7165d42d-5570-4d0f-85c0-c589c7e39cc7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:06.863708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7165d42d-5570-4d0f-85c0-c589c7e39cc7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:06.885671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3ab3d441-421a-4cdd-99a9-8d9d45e0dd63 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044110 Jul 26 18:39:06.886242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 730/1482] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:06 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:06.892568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7165d42d-5570-4d0f-85c0-c589c7e39cc7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042656 Jul 26 18:39:06.893134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 753/1483] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:06 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:39:07.445215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c1bcaf7d-d1c1-41fb-a183-1a5a19bbe016 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:07.447397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c1bcaf7d-d1c1-41fb-a183-1a5a19bbe016 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:07.454197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1bcaf7d-d1c1-41fb-a183-1a5a19bbe016 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:07.454569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1bcaf7d-d1c1-41fb-a183-1a5a19bbe016 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:07.455371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1bcaf7d-d1c1-41fb-a183-1a5a19bbe016 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:07.455792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c1bcaf7d-d1c1-41fb-a183-1a5a19bbe016 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:07.485080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c1bcaf7d-d1c1-41fb-a183-1a5a19bbe016 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Jul 26 18:39:07.485657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 731/1484] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:07 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:07.766267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-891bb25b-d95c-460b-b64a-b8bd130e6d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:07.768449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-891bb25b-d95c-460b-b64a-b8bd130e6d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:07.775956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-891bb25b-d95c-460b-b64a-b8bd130e6d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:07.776400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-891bb25b-d95c-460b-b64a-b8bd130e6d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:07.777262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-891bb25b-d95c-460b-b64a-b8bd130e6d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:07.777705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-891bb25b-d95c-460b-b64a-b8bd130e6d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:07.808484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-891bb25b-d95c-460b-b64a-b8bd130e6d39 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046220 Jul 26 18:39:07.809047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 754/1485] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:07.901182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1e8f4473-9d91-4c5c-9b58-31b13d49d66c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:07.905139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1e8f4473-9d91-4c5c-9b58-31b13d49d66c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:07.908498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-462d7e6c-ce85-483f-a979-95bc46203c74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:07.911662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-462d7e6c-ce85-483f-a979-95bc46203c74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:07.914916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e8f4473-9d91-4c5c-9b58-31b13d49d66c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:07.915593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e8f4473-9d91-4c5c-9b58-31b13d49d66c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:07.916670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e8f4473-9d91-4c5c-9b58-31b13d49d66c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:07.917404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e8f4473-9d91-4c5c-9b58-31b13d49d66c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:07.919795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-462d7e6c-ce85-483f-a979-95bc46203c74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:07.920240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-462d7e6c-ce85-483f-a979-95bc46203c74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:07.921023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-462d7e6c-ce85-483f-a979-95bc46203c74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:07.921455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-462d7e6c-ce85-483f-a979-95bc46203c74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:07.932119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:07.949945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:07.951318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1e8f4473-9d91-4c5c-9b58-31b13d49d66c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056140 Jul 26 18:39:07.951897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 732/1486] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:07 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:07.955699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-462d7e6c-ce85-483f-a979-95bc46203c74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052892 Jul 26 18:39:07.956260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 755/1487] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:07 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:08.499474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1c791658-fcc8-48cf-a8bb-e8f43d7c2fab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:08.501630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1c791658-fcc8-48cf-a8bb-e8f43d7c2fab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:08.508389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c791658-fcc8-48cf-a8bb-e8f43d7c2fab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:08.508734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c791658-fcc8-48cf-a8bb-e8f43d7c2fab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:08.509691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c791658-fcc8-48cf-a8bb-e8f43d7c2fab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:08.510118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c791658-fcc8-48cf-a8bb-e8f43d7c2fab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:08.551572 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1c791658-fcc8-48cf-a8bb-e8f43d7c2fab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055849 Jul 26 18:39:08.552197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 733/1488] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:08.820776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ea2d0683-8175-40b9-9d42-359eb998bc6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:08.822973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ea2d0683-8175-40b9-9d42-359eb998bc6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:08.829870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea2d0683-8175-40b9-9d42-359eb998bc6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:08.830341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea2d0683-8175-40b9-9d42-359eb998bc6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:08.831144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea2d0683-8175-40b9-9d42-359eb998bc6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:08.831581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea2d0683-8175-40b9-9d42-359eb998bc6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:08.861781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ea2d0683-8175-40b9-9d42-359eb998bc6f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045084 Jul 26 18:39:08.862393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 756/1489] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:08 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:08.964199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f339bb5f-1220-490e-8fec-fb526f3496dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:08.966406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f339bb5f-1220-490e-8fec-fb526f3496dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:08.968102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-af0cc3a6-e3bb-4396-9ff4-d1501b8058dd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:08.970132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-af0cc3a6-e3bb-4396-9ff4-d1501b8058dd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:08.973640 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f339bb5f-1220-490e-8fec-fb526f3496dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:08.974083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f339bb5f-1220-490e-8fec-fb526f3496dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:08.974972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f339bb5f-1220-490e-8fec-fb526f3496dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:08.975507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f339bb5f-1220-490e-8fec-fb526f3496dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:08.976724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af0cc3a6-e3bb-4396-9ff4-d1501b8058dd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:08.977163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af0cc3a6-e3bb-4396-9ff4-d1501b8058dd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:08.977924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af0cc3a6-e3bb-4396-9ff4-d1501b8058dd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:08.978350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af0cc3a6-e3bb-4396-9ff4-d1501b8058dd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:09.005985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f339bb5f-1220-490e-8fec-fb526f3496dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045754 Jul 26 18:39:09.006549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 734/1490] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:08 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:09.009270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-af0cc3a6-e3bb-4396-9ff4-d1501b8058dd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045313 Jul 26 18:39:09.009830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 757/1491] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:08 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:09.567547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-49e0d72d-cc5f-417a-8c5c-74df4104714f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:09.570670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-49e0d72d-cc5f-417a-8c5c-74df4104714f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:09.578432 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49e0d72d-cc5f-417a-8c5c-74df4104714f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:09.578892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49e0d72d-cc5f-417a-8c5c-74df4104714f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:09.579653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49e0d72d-cc5f-417a-8c5c-74df4104714f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:09.580086 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49e0d72d-cc5f-417a-8c5c-74df4104714f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:09.609437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-49e0d72d-cc5f-417a-8c5c-74df4104714f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048253 Jul 26 18:39:09.610011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 735/1492] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:09 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:09.875622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cbfddd6d-84bd-4453-a087-a7c9122a6ab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:09.877676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cbfddd6d-84bd-4453-a087-a7c9122a6ab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:09.884410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbfddd6d-84bd-4453-a087-a7c9122a6ab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:09.884861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbfddd6d-84bd-4453-a087-a7c9122a6ab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:09.885619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbfddd6d-84bd-4453-a087-a7c9122a6ab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:09.886049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbfddd6d-84bd-4453-a087-a7c9122a6ab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:09.915413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cbfddd6d-84bd-4453-a087-a7c9122a6ab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043918 Jul 26 18:39:09.915994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 758/1493] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:09 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:10.018499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1096a035-d70d-4aa9-9f21-d3ac5475c991 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:10.020709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1096a035-d70d-4aa9-9f21-d3ac5475c991 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:10.023937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0f41b117-3c9e-4062-bba1-93128f7adaef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:10.026114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f41b117-3c9e-4062-bba1-93128f7adaef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:10.028355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1096a035-d70d-4aa9-9f21-d3ac5475c991 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:10.028805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1096a035-d70d-4aa9-9f21-d3ac5475c991 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:10.029569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1096a035-d70d-4aa9-9f21-d3ac5475c991 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:10.029996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1096a035-d70d-4aa9-9f21-d3ac5475c991 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:10.032425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f41b117-3c9e-4062-bba1-93128f7adaef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:10.032873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f41b117-3c9e-4062-bba1-93128f7adaef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:10.033663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f41b117-3c9e-4062-bba1-93128f7adaef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:10.034082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f41b117-3c9e-4062-bba1-93128f7adaef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:10.060177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1096a035-d70d-4aa9-9f21-d3ac5475c991 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045808 Jul 26 18:39:10.060750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 736/1494] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:10.064411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0f41b117-3c9e-4062-bba1-93128f7adaef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Jul 26 18:39:10.065106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 759/1495] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:10 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:10.625230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7dc21407-07d5-4660-8e54-a91610bdb69b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:10.628284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7dc21407-07d5-4660-8e54-a91610bdb69b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:10.636885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7dc21407-07d5-4660-8e54-a91610bdb69b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:10.637250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7dc21407-07d5-4660-8e54-a91610bdb69b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:10.638025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7dc21407-07d5-4660-8e54-a91610bdb69b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:10.638465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7dc21407-07d5-4660-8e54-a91610bdb69b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:10.668888 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7dc21407-07d5-4660-8e54-a91610bdb69b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048591 Jul 26 18:39:10.669711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 737/1496] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:10 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:10.929599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d88003c1-9dbe-41b8-b7e0-b53247b5e871 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:10.932063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d88003c1-9dbe-41b8-b7e0-b53247b5e871 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:10.940509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d88003c1-9dbe-41b8-b7e0-b53247b5e871 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:10.941033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d88003c1-9dbe-41b8-b7e0-b53247b5e871 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:10.941928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d88003c1-9dbe-41b8-b7e0-b53247b5e871 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:10.942435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d88003c1-9dbe-41b8-b7e0-b53247b5e871 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:10.974412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d88003c1-9dbe-41b8-b7e0-b53247b5e871 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049770 Jul 26 18:39:10.974972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 760/1497] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:10 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:11.075758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fbe8c3ff-1a13-4818-b9d6-f373b51f9073 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:11.077965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1c1d69ad-a8fd-4ed3-80f9-4b167996e43b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:11.078397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fbe8c3ff-1a13-4818-b9d6-f373b51f9073 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:11.080120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1c1d69ad-a8fd-4ed3-80f9-4b167996e43b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:11.085226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbe8c3ff-1a13-4818-b9d6-f373b51f9073 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:11.085707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbe8c3ff-1a13-4818-b9d6-f373b51f9073 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:11.086402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1c1d69ad-a8fd-4ed3-80f9-4b167996e43b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:11.086555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbe8c3ff-1a13-4818-b9d6-f373b51f9073 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:11.086849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1c1d69ad-a8fd-4ed3-80f9-4b167996e43b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:11.086979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbe8c3ff-1a13-4818-b9d6-f373b51f9073 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:11.087680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1c1d69ad-a8fd-4ed3-80f9-4b167996e43b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:11.088108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1c1d69ad-a8fd-4ed3-80f9-4b167996e43b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:11.116318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fbe8c3ff-1a13-4818-b9d6-f373b51f9073 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046270 Jul 26 18:39:11.117071 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 738/1498] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:11 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:11.118211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1c1d69ad-a8fd-4ed3-80f9-4b167996e43b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044438 Jul 26 18:39:11.118986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 761/1499] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:11 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:11.682307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8de41152-dabd-4323-a133-4b6fd6dfbbfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:11.685524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8de41152-dabd-4323-a133-4b6fd6dfbbfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:11.691874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8de41152-dabd-4323-a133-4b6fd6dfbbfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:11.692314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8de41152-dabd-4323-a133-4b6fd6dfbbfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:11.693072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8de41152-dabd-4323-a133-4b6fd6dfbbfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:11.693504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8de41152-dabd-4323-a133-4b6fd6dfbbfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:11.733191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8de41152-dabd-4323-a133-4b6fd6dfbbfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054912 Jul 26 18:39:11.733733 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 739/1500] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:11.989259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1428cc51-0b6f-47d6-904f-73e64b287d8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:11.992166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1428cc51-0b6f-47d6-904f-73e64b287d8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:12.001512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1428cc51-0b6f-47d6-904f-73e64b287d8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:12.002038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1428cc51-0b6f-47d6-904f-73e64b287d8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:12.003250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1428cc51-0b6f-47d6-904f-73e64b287d8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:12.003994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1428cc51-0b6f-47d6-904f-73e64b287d8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:12.039588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1428cc51-0b6f-47d6-904f-73e64b287d8c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055583 Jul 26 18:39:12.040144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 762/1501] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:12.130719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-594eff16-b6a2-4410-866c-b46b6715469c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:12.132180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-61eef681-30ca-4bad-9b98-a85e5199ab65 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:12.132898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-594eff16-b6a2-4410-866c-b46b6715469c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:12.134271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-61eef681-30ca-4bad-9b98-a85e5199ab65 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:12.140169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-594eff16-b6a2-4410-866c-b46b6715469c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:12.140575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61eef681-30ca-4bad-9b98-a85e5199ab65 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:12.140749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-594eff16-b6a2-4410-866c-b46b6715469c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:12.141168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61eef681-30ca-4bad-9b98-a85e5199ab65 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:12.141340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-594eff16-b6a2-4410-866c-b46b6715469c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:12.141788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-594eff16-b6a2-4410-866c-b46b6715469c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:12.141941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61eef681-30ca-4bad-9b98-a85e5199ab65 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:12.142357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61eef681-30ca-4bad-9b98-a85e5199ab65 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:12.171801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-61eef681-30ca-4bad-9b98-a85e5199ab65 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043574 Jul 26 18:39:12.172288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-594eff16-b6a2-4410-866c-b46b6715469c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045593 Jul 26 18:39:12.176404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 763/1502] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:12 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:12.176530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 740/1503] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:12 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:12.746070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d8764256-1121-4e14-8ae1-8ed235a7c2fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:12.748474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d8764256-1121-4e14-8ae1-8ed235a7c2fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:12.755194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8764256-1121-4e14-8ae1-8ed235a7c2fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:12.755616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8764256-1121-4e14-8ae1-8ed235a7c2fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:12.756427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8764256-1121-4e14-8ae1-8ed235a7c2fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:12.756850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8764256-1121-4e14-8ae1-8ed235a7c2fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:12.787755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d8764256-1121-4e14-8ae1-8ed235a7c2fa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045929 Jul 26 18:39:12.788323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 764/1504] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:12 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:13.054614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2614bda0-e460-4367-a6f5-7b57132c6907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:13.057711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2614bda0-e460-4367-a6f5-7b57132c6907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:13.064270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2614bda0-e460-4367-a6f5-7b57132c6907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:13.064718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2614bda0-e460-4367-a6f5-7b57132c6907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:13.065474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2614bda0-e460-4367-a6f5-7b57132c6907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:13.065901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2614bda0-e460-4367-a6f5-7b57132c6907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:13.094861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2614bda0-e460-4367-a6f5-7b57132c6907 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046243 Jul 26 18:39:13.095444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 741/1505] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:13.184416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6615e272-1b95-4584-beee-03b39e11ee2c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:13.185196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5095261d-3440-4680-8f51-d7f13dbeff95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:13.186619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6615e272-1b95-4584-beee-03b39e11ee2c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:13.187342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5095261d-3440-4680-8f51-d7f13dbeff95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:13.195593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6615e272-1b95-4584-beee-03b39e11ee2c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:13.195812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5095261d-3440-4680-8f51-d7f13dbeff95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:13.196051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6615e272-1b95-4584-beee-03b39e11ee2c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:13.196308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5095261d-3440-4680-8f51-d7f13dbeff95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:13.197052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6615e272-1b95-4584-beee-03b39e11ee2c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:13.197481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5095261d-3440-4680-8f51-d7f13dbeff95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:13.197616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6615e272-1b95-4584-beee-03b39e11ee2c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:13.197991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5095261d-3440-4680-8f51-d7f13dbeff95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:13.228022 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6615e272-1b95-4584-beee-03b39e11ee2c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047553 Jul 26 18:39:13.228995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5095261d-3440-4680-8f51-d7f13dbeff95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047773 Jul 26 18:39:13.229394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 742/1506] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:13.233616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 765/1507] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:13 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:13.804287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cb1022be-700d-4483-a2b4-4e6b816ee1c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:13.807437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cb1022be-700d-4483-a2b4-4e6b816ee1c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:13.814514 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb1022be-700d-4483-a2b4-4e6b816ee1c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:13.814965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb1022be-700d-4483-a2b4-4e6b816ee1c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:13.815802 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb1022be-700d-4483-a2b4-4e6b816ee1c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:13.816239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb1022be-700d-4483-a2b4-4e6b816ee1c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:13.847371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cb1022be-700d-4483-a2b4-4e6b816ee1c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048914 Jul 26 18:39:13.847911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 743/1508] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:13 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:14.109027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fa73f40a-aeea-4eb2-b6fd-5bf5c156fef1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:14.111062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fa73f40a-aeea-4eb2-b6fd-5bf5c156fef1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:14.117969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa73f40a-aeea-4eb2-b6fd-5bf5c156fef1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:14.118409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa73f40a-aeea-4eb2-b6fd-5bf5c156fef1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:14.119197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa73f40a-aeea-4eb2-b6fd-5bf5c156fef1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:14.119623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa73f40a-aeea-4eb2-b6fd-5bf5c156fef1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:14.149249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fa73f40a-aeea-4eb2-b6fd-5bf5c156fef1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044742 Jul 26 18:39:14.149793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 766/1509] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:14 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:14.241226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b520b261-0883-43a7-824a-86e0a605ac46 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:14.241821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-52e9ea09-29d1-447c-8b08-ff1666d41498 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:14.243745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-52e9ea09-29d1-447c-8b08-ff1666d41498 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:14.244438 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b520b261-0883-43a7-824a-86e0a605ac46 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:14.251070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52e9ea09-29d1-447c-8b08-ff1666d41498 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:14.251712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52e9ea09-29d1-447c-8b08-ff1666d41498 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:14.251871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b520b261-0883-43a7-824a-86e0a605ac46 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:14.252254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b520b261-0883-43a7-824a-86e0a605ac46 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:14.252523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52e9ea09-29d1-447c-8b08-ff1666d41498 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:14.253012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b520b261-0883-43a7-824a-86e0a605ac46 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:14.253348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52e9ea09-29d1-447c-8b08-ff1666d41498 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:14.254191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b520b261-0883-43a7-824a-86e0a605ac46 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:14.283043 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b520b261-0883-43a7-824a-86e0a605ac46 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045776 Jul 26 18:39:14.283606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 744/1510] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:14 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:14.283745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-52e9ea09-29d1-447c-8b08-ff1666d41498 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046167 Jul 26 18:39:14.284267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 767/1511] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:14 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:14.543914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:39:14.544186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 18:39:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:39:14.860327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0d9e4c13-112d-4d7e-9e06-9ca8cf6f910d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:14.862434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0d9e4c13-112d-4d7e-9e06-9ca8cf6f910d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:14.869128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d9e4c13-112d-4d7e-9e06-9ca8cf6f910d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:14.869609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d9e4c13-112d-4d7e-9e06-9ca8cf6f910d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:14.870381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d9e4c13-112d-4d7e-9e06-9ca8cf6f910d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:14.870813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d9e4c13-112d-4d7e-9e06-9ca8cf6f910d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:14.901691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0d9e4c13-112d-4d7e-9e06-9ca8cf6f910d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045467 Jul 26 18:39:14.902252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 745/1512] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:14 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:15.162745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b03a5fff-3db9-4313-b98b-ce023670b31c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:15.164884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b03a5fff-3db9-4313-b98b-ce023670b31c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:15.171583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b03a5fff-3db9-4313-b98b-ce023670b31c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:15.172016 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b03a5fff-3db9-4313-b98b-ce023670b31c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:15.172781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b03a5fff-3db9-4313-b98b-ce023670b31c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:15.173207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b03a5fff-3db9-4313-b98b-ce023670b31c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:15.209175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b03a5fff-3db9-4313-b98b-ce023670b31c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050182 Jul 26 18:39:15.210187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 768/1513] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:15 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:15.295443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-867656ea-f00a-430e-b8a3-a985144a3489 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:15.296036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-350b777e-c4d9-4cac-9fea-27c22d74c7f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:15.297598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-867656ea-f00a-430e-b8a3-a985144a3489 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:15.297761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-350b777e-c4d9-4cac-9fea-27c22d74c7f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:15.304581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-350b777e-c4d9-4cac-9fea-27c22d74c7f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:15.304758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-867656ea-f00a-430e-b8a3-a985144a3489 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:15.305031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-350b777e-c4d9-4cac-9fea-27c22d74c7f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:15.305175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-867656ea-f00a-430e-b8a3-a985144a3489 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:15.305796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-350b777e-c4d9-4cac-9fea-27c22d74c7f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:15.305954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-867656ea-f00a-430e-b8a3-a985144a3489 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:15.306228 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-350b777e-c4d9-4cac-9fea-27c22d74c7f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:15.306383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-867656ea-f00a-430e-b8a3-a985144a3489 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:15.336071 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-867656ea-f00a-430e-b8a3-a985144a3489 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044672 Jul 26 18:39:15.336633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 746/1514] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:15 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:15.336834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-350b777e-c4d9-4cac-9fea-27c22d74c7f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045030 Jul 26 18:39:15.337411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 769/1515] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:15 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:15.916088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-22497181-6048-43ef-a3d8-db831e4fed38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:15.918270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-22497181-6048-43ef-a3d8-db831e4fed38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:15.925491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22497181-6048-43ef-a3d8-db831e4fed38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:15.925491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22497181-6048-43ef-a3d8-db831e4fed38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:15.926245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22497181-6048-43ef-a3d8-db831e4fed38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:15.926674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22497181-6048-43ef-a3d8-db831e4fed38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:15.957332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-22497181-6048-43ef-a3d8-db831e4fed38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Jul 26 18:39:15.957894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 747/1516] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:16.225509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c238efdf-27af-4a10-8869-c9a5e9d8ee7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:16.228336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c238efdf-27af-4a10-8869-c9a5e9d8ee7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:16.235598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c238efdf-27af-4a10-8869-c9a5e9d8ee7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:16.236040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c238efdf-27af-4a10-8869-c9a5e9d8ee7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:16.236805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c238efdf-27af-4a10-8869-c9a5e9d8ee7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:16.237257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c238efdf-27af-4a10-8869-c9a5e9d8ee7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:16.270139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c238efdf-27af-4a10-8869-c9a5e9d8ee7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049977 Jul 26 18:39:16.270666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 770/1517] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:16 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:16.349156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-25a1de48-d92f-4d66-b596-7332ea6635f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:16.349757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-964d166a-f899-44cf-ac94-545ea587eebe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:16.351576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-964d166a-f899-44cf-ac94-545ea587eebe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:16.351734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-25a1de48-d92f-4d66-b596-7332ea6635f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:16.358181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-964d166a-f899-44cf-ac94-545ea587eebe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:16.358799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-964d166a-f899-44cf-ac94-545ea587eebe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:16.358979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-25a1de48-d92f-4d66-b596-7332ea6635f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:16.359222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-25a1de48-d92f-4d66-b596-7332ea6635f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:16.359481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-964d166a-f899-44cf-ac94-545ea587eebe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:16.359926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-964d166a-f899-44cf-ac94-545ea587eebe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:16.360043 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-25a1de48-d92f-4d66-b596-7332ea6635f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:16.360492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-25a1de48-d92f-4d66-b596-7332ea6635f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:16.385043 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:16.389907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-964d166a-f899-44cf-ac94-545ea587eebe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044290 Jul 26 18:39:16.390456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 771/1518] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:16 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:16.391765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-25a1de48-d92f-4d66-b596-7332ea6635f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046643 Jul 26 18:39:16.396314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 748/1519] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:16 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:16.973431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-174fd36a-d2a1-480d-95a5-4de7b7c23139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:16.976502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-174fd36a-d2a1-480d-95a5-4de7b7c23139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:16.983947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-174fd36a-d2a1-480d-95a5-4de7b7c23139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:16.984395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-174fd36a-d2a1-480d-95a5-4de7b7c23139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:16.985165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-174fd36a-d2a1-480d-95a5-4de7b7c23139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:16.985598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-174fd36a-d2a1-480d-95a5-4de7b7c23139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:17.003293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:17.016937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-174fd36a-d2a1-480d-95a5-4de7b7c23139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049856 Jul 26 18:39:17.017510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 772/1520] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:17.288829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3093db79-feb5-4c26-b1e7-09a313abe12b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:17.292506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3093db79-feb5-4c26-b1e7-09a313abe12b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:17.302663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3093db79-feb5-4c26-b1e7-09a313abe12b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:17.303403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3093db79-feb5-4c26-b1e7-09a313abe12b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:17.304671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3093db79-feb5-4c26-b1e7-09a313abe12b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:17.305228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3093db79-feb5-4c26-b1e7-09a313abe12b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:17.350294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3093db79-feb5-4c26-b1e7-09a313abe12b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067739 Jul 26 18:39:17.351358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 749/1521] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:17.403923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a8bf00de-e921-40d8-b3ac-18a3bc027fcb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:17.404874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6c994e8b-2283-490d-8c02-c09f2c1b8203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:17.406071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a8bf00de-e921-40d8-b3ac-18a3bc027fcb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:17.406955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6c994e8b-2283-490d-8c02-c09f2c1b8203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:17.412841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8bf00de-e921-40d8-b3ac-18a3bc027fcb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:17.413310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8bf00de-e921-40d8-b3ac-18a3bc027fcb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:17.413973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c994e8b-2283-490d-8c02-c09f2c1b8203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:17.414125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8bf00de-e921-40d8-b3ac-18a3bc027fcb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:17.414427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c994e8b-2283-490d-8c02-c09f2c1b8203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:17.414566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8bf00de-e921-40d8-b3ac-18a3bc027fcb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:17.415219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c994e8b-2283-490d-8c02-c09f2c1b8203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:17.415648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c994e8b-2283-490d-8c02-c09f2c1b8203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:17.445424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6c994e8b-2283-490d-8c02-c09f2c1b8203 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Jul 26 18:39:17.445712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a8bf00de-e921-40d8-b3ac-18a3bc027fcb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045766 Jul 26 18:39:17.447308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 750/1522] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:17 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:17.447486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 773/1523] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:17 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:18.032892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2b20f81a-0542-4485-8daf-2ba863a4d452 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:18.034948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2b20f81a-0542-4485-8daf-2ba863a4d452 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:18.041657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b20f81a-0542-4485-8daf-2ba863a4d452 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:18.042099 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b20f81a-0542-4485-8daf-2ba863a4d452 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:18.042861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b20f81a-0542-4485-8daf-2ba863a4d452 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:18.043325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b20f81a-0542-4485-8daf-2ba863a4d452 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:18.075829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2b20f81a-0542-4485-8daf-2ba863a4d452 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046987 Jul 26 18:39:18.076412 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 751/1524] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:18.366285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7a2fe58f-cfda-476c-856b-826ba44dc939 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:18.368965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7a2fe58f-cfda-476c-856b-826ba44dc939 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:18.376986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a2fe58f-cfda-476c-856b-826ba44dc939 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:18.377546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a2fe58f-cfda-476c-856b-826ba44dc939 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:18.378475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a2fe58f-cfda-476c-856b-826ba44dc939 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:18.379010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a2fe58f-cfda-476c-856b-826ba44dc939 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:18.412419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7a2fe58f-cfda-476c-856b-826ba44dc939 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051205 Jul 26 18:39:18.413149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 774/1525] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:18 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:18.460640 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bce28301-12ab-4555-9b42-3457273baf3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:18.461469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-86e917e7-6292-41c2-844c-448dd4b919b2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:18.463848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bce28301-12ab-4555-9b42-3457273baf3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:18.464049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-86e917e7-6292-41c2-844c-448dd4b919b2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:18.474226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86e917e7-6292-41c2-844c-448dd4b919b2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:18.474960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86e917e7-6292-41c2-844c-448dd4b919b2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:18.476224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86e917e7-6292-41c2-844c-448dd4b919b2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:18.477063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86e917e7-6292-41c2-844c-448dd4b919b2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:18.477386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bce28301-12ab-4555-9b42-3457273baf3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:18.478131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bce28301-12ab-4555-9b42-3457273baf3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:18.479394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bce28301-12ab-4555-9b42-3457273baf3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:18.480198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bce28301-12ab-4555-9b42-3457273baf3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:18.508183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-86e917e7-6292-41c2-844c-448dd4b919b2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053301 Jul 26 18:39:18.508745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 775/1526] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:18 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:18.509878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bce28301-12ab-4555-9b42-3457273baf3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055160 Jul 26 18:39:18.510485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 752/1527] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:18 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:19.090132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-81aaf256-f387-4601-9ab2-b232a42c8076 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:19.092234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-81aaf256-f387-4601-9ab2-b232a42c8076 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:19.098708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81aaf256-f387-4601-9ab2-b232a42c8076 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:19.099190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81aaf256-f387-4601-9ab2-b232a42c8076 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:19.099977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81aaf256-f387-4601-9ab2-b232a42c8076 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:19.100429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81aaf256-f387-4601-9ab2-b232a42c8076 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:19.130043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-81aaf256-f387-4601-9ab2-b232a42c8076 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Jul 26 18:39:19.130603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 776/1528] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:19 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:19.425513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6b7bfe34-7721-4616-8a25-d1f9e849cde8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:19.427620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6b7bfe34-7721-4616-8a25-d1f9e849cde8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:19.434183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b7bfe34-7721-4616-8a25-d1f9e849cde8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:19.434630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b7bfe34-7721-4616-8a25-d1f9e849cde8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:19.435427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b7bfe34-7721-4616-8a25-d1f9e849cde8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:19.435854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b7bfe34-7721-4616-8a25-d1f9e849cde8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:19.465588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6b7bfe34-7721-4616-8a25-d1f9e849cde8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044242 Jul 26 18:39:19.466266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 753/1529] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:19 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:19.521384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-840f08f4-d1db-4924-8b7c-c9467adec323 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:19.522313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-09968123-287d-4474-8c78-815b09feb967 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:19.523872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-840f08f4-d1db-4924-8b7c-c9467adec323 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:19.524505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-09968123-287d-4474-8c78-815b09feb967 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:19.531302 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09968123-287d-4474-8c78-815b09feb967 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:19.531652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-840f08f4-d1db-4924-8b7c-c9467adec323 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:19.531876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09968123-287d-4474-8c78-815b09feb967 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:19.532117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-840f08f4-d1db-4924-8b7c-c9467adec323 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:19.532499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09968123-287d-4474-8c78-815b09feb967 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:19.532912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-840f08f4-d1db-4924-8b7c-c9467adec323 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:19.533075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09968123-287d-4474-8c78-815b09feb967 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:19.533334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-840f08f4-d1db-4924-8b7c-c9467adec323 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:19.563450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-09968123-287d-4474-8c78-815b09feb967 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045547 Jul 26 18:39:19.563856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-840f08f4-d1db-4924-8b7c-c9467adec323 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046783 Jul 26 18:39:19.564364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 754/1530] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:19 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:39:19.564698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 777/1531] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:19 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:20.144292 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c0bf9e89-bbae-4ad3-9870-fe85c2d0904b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:20.147047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c0bf9e89-bbae-4ad3-9870-fe85c2d0904b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:20.154198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0bf9e89-bbae-4ad3-9870-fe85c2d0904b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:20.154699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0bf9e89-bbae-4ad3-9870-fe85c2d0904b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:20.155636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0bf9e89-bbae-4ad3-9870-fe85c2d0904b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:20.156118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0bf9e89-bbae-4ad3-9870-fe85c2d0904b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:20.187741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c0bf9e89-bbae-4ad3-9870-fe85c2d0904b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048104 Jul 26 18:39:20.188293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 755/1532] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:20 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:20.480371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f1e8f9e7-618f-481d-81ba-084720aa3955 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:20.482551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f1e8f9e7-618f-481d-81ba-084720aa3955 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:20.489096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1e8f9e7-618f-481d-81ba-084720aa3955 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:20.489543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1e8f9e7-618f-481d-81ba-084720aa3955 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:20.490305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1e8f9e7-618f-481d-81ba-084720aa3955 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:20.490735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1e8f9e7-618f-481d-81ba-084720aa3955 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:20.522008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f1e8f9e7-618f-481d-81ba-084720aa3955 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045334 Jul 26 18:39:20.522737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 778/1533] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:20.577803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e7bd5214-1080-4500-8271-4de6d9fdd0ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:20.578053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9e5250a1-295c-4e4d-801d-3aee3acafa9c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:20.580624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e7bd5214-1080-4500-8271-4de6d9fdd0ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:20.580851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9e5250a1-295c-4e4d-801d-3aee3acafa9c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:20.589764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e5250a1-295c-4e4d-801d-3aee3acafa9c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:20.589957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7bd5214-1080-4500-8271-4de6d9fdd0ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:20.590212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e5250a1-295c-4e4d-801d-3aee3acafa9c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:20.590375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7bd5214-1080-4500-8271-4de6d9fdd0ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:20.590985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e5250a1-295c-4e4d-801d-3aee3acafa9c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:20.591158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7bd5214-1080-4500-8271-4de6d9fdd0ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:20.591449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7bd5214-1080-4500-8271-4de6d9fdd0ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:20.591606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e5250a1-295c-4e4d-801d-3aee3acafa9c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:20.622297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9e5250a1-295c-4e4d-801d-3aee3acafa9c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049723 Jul 26 18:39:20.622568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e7bd5214-1080-4500-8271-4de6d9fdd0ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049845 Jul 26 18:39:20.622918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 779/1534] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:20.623114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 756/1535] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:20 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:21.201040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dfddc0da-1f58-4b48-a438-181bee2e2186 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:21.203355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dfddc0da-1f58-4b48-a438-181bee2e2186 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:21.210258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfddc0da-1f58-4b48-a438-181bee2e2186 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:21.210724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfddc0da-1f58-4b48-a438-181bee2e2186 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:21.211553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfddc0da-1f58-4b48-a438-181bee2e2186 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:21.212015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfddc0da-1f58-4b48-a438-181bee2e2186 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:21.241814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dfddc0da-1f58-4b48-a438-181bee2e2186 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044975 Jul 26 18:39:21.242352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 780/1536] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:21.537159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1bdc1e6b-0431-4455-83a1-c43faf7db8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:21.540295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1bdc1e6b-0431-4455-83a1-c43faf7db8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:21.547564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1bdc1e6b-0431-4455-83a1-c43faf7db8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:21.548012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1bdc1e6b-0431-4455-83a1-c43faf7db8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:21.548777 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1bdc1e6b-0431-4455-83a1-c43faf7db8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:21.549209 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1bdc1e6b-0431-4455-83a1-c43faf7db8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:21.578707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1bdc1e6b-0431-4455-83a1-c43faf7db8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047503 Jul 26 18:39:21.579377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 757/1537] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:21 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:21.636592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fe4c67c4-3888-4a68-8cb8-08a2cbf37269 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:21.637129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c97221ad-d8a2-4e75-9603-9470b4e63b9d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:21.638627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fe4c67c4-3888-4a68-8cb8-08a2cbf37269 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:21.639320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c97221ad-d8a2-4e75-9603-9470b4e63b9d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:21.645245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe4c67c4-3888-4a68-8cb8-08a2cbf37269 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:21.645687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe4c67c4-3888-4a68-8cb8-08a2cbf37269 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:21.646005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c97221ad-d8a2-4e75-9603-9470b4e63b9d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:21.646439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe4c67c4-3888-4a68-8cb8-08a2cbf37269 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:21.646880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c97221ad-d8a2-4e75-9603-9470b4e63b9d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:21.647219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe4c67c4-3888-4a68-8cb8-08a2cbf37269 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:21.647692 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c97221ad-d8a2-4e75-9603-9470b4e63b9d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:21.648143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c97221ad-d8a2-4e75-9603-9470b4e63b9d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:21.677538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fe4c67c4-3888-4a68-8cb8-08a2cbf37269 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045147 Jul 26 18:39:21.678110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 781/1538] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:21 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:21.678480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c97221ad-d8a2-4e75-9603-9470b4e63b9d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045226 Jul 26 18:39:21.679223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 758/1539] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:21 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:22.256199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6db36be8-4769-4581-8f5c-3e376b7717ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:22.258571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6db36be8-4769-4581-8f5c-3e376b7717ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:22.265696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6db36be8-4769-4581-8f5c-3e376b7717ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:22.266142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6db36be8-4769-4581-8f5c-3e376b7717ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:22.266907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6db36be8-4769-4581-8f5c-3e376b7717ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:22.267379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6db36be8-4769-4581-8f5c-3e376b7717ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:22.297096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6db36be8-4769-4581-8f5c-3e376b7717ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Jul 26 18:39:22.297648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 782/1540] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:22.595318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f3935da2-cf3d-4b9c-806a-5ae6903c018e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:22.597759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f3935da2-cf3d-4b9c-806a-5ae6903c018e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:22.605393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3935da2-cf3d-4b9c-806a-5ae6903c018e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:22.605939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3935da2-cf3d-4b9c-806a-5ae6903c018e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:22.606865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3935da2-cf3d-4b9c-806a-5ae6903c018e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:22.607460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3935da2-cf3d-4b9c-806a-5ae6903c018e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:22.639065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f3935da2-cf3d-4b9c-806a-5ae6903c018e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048722 Jul 26 18:39:22.639619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 759/1541] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:22 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:22.692438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b327cfce-cdce-443a-958d-abbbd754627e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:22.693166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0fff52b4-3e35-47e1-8eee-8b0984c81a63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:22.695155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b327cfce-cdce-443a-958d-abbbd754627e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:22.695362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0fff52b4-3e35-47e1-8eee-8b0984c81a63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:22.704110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fff52b4-3e35-47e1-8eee-8b0984c81a63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:22.704447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b327cfce-cdce-443a-958d-abbbd754627e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:22.704654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fff52b4-3e35-47e1-8eee-8b0984c81a63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:22.705072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b327cfce-cdce-443a-958d-abbbd754627e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:22.705688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fff52b4-3e35-47e1-8eee-8b0984c81a63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:22.706082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b327cfce-cdce-443a-958d-abbbd754627e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:22.706268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fff52b4-3e35-47e1-8eee-8b0984c81a63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:22.706647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b327cfce-cdce-443a-958d-abbbd754627e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:22.738223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b327cfce-cdce-443a-958d-abbbd754627e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051146 Jul 26 18:39:22.738503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0fff52b4-3e35-47e1-8eee-8b0984c81a63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051269 Jul 26 18:39:22.738780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 783/1542] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:22 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:22.739329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 760/1543] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:22 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:23.311207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c7ffafd9-c724-4ba4-83ee-cb1cc65ce3ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:23.313413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c7ffafd9-c724-4ba4-83ee-cb1cc65ce3ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:23.319846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c7ffafd9-c724-4ba4-83ee-cb1cc65ce3ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:23.320290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c7ffafd9-c724-4ba4-83ee-cb1cc65ce3ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:23.321044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c7ffafd9-c724-4ba4-83ee-cb1cc65ce3ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:23.321503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c7ffafd9-c724-4ba4-83ee-cb1cc65ce3ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:23.350677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c7ffafd9-c724-4ba4-83ee-cb1cc65ce3ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Jul 26 18:39:23.351257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 784/1544] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:23 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:23.653358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-34241568-2803-433a-b193-4935e9084f04 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:23.655936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-34241568-2803-433a-b193-4935e9084f04 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:23.663382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34241568-2803-433a-b193-4935e9084f04 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:23.663854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34241568-2803-433a-b193-4935e9084f04 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:23.664615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34241568-2803-433a-b193-4935e9084f04 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:23.665079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34241568-2803-433a-b193-4935e9084f04 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:23.706975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-34241568-2803-433a-b193-4935e9084f04 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058485 Jul 26 18:39:23.707569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 761/1545] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:23 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:23.750269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-496b927b-a85b-4e5f-8bcf-b1ab9d1091e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:23.752489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5b39459b-33a2-45fc-9acc-7f2bd145a8af tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:23.752677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-496b927b-a85b-4e5f-8bcf-b1ab9d1091e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:23.754612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5b39459b-33a2-45fc-9acc-7f2bd145a8af tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:23.759615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-496b927b-a85b-4e5f-8bcf-b1ab9d1091e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:23.760055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-496b927b-a85b-4e5f-8bcf-b1ab9d1091e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:23.760818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-496b927b-a85b-4e5f-8bcf-b1ab9d1091e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:23.760932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b39459b-33a2-45fc-9acc-7f2bd145a8af tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:23.761303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-496b927b-a85b-4e5f-8bcf-b1ab9d1091e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:23.761422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b39459b-33a2-45fc-9acc-7f2bd145a8af tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:23.762143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b39459b-33a2-45fc-9acc-7f2bd145a8af tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:23.762566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b39459b-33a2-45fc-9acc-7f2bd145a8af tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:23.791544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-496b927b-a85b-4e5f-8bcf-b1ab9d1091e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045278 Jul 26 18:39:23.792474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 785/1546] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:23 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:23.792898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5b39459b-33a2-45fc-9acc-7f2bd145a8af tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045349 Jul 26 18:39:23.793485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 762/1547] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:23 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:24.366104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-31be5da4-e905-4e69-84ec-26c22d5fdb85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:24.368917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-31be5da4-e905-4e69-84ec-26c22d5fdb85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:24.377502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31be5da4-e905-4e69-84ec-26c22d5fdb85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:24.378099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31be5da4-e905-4e69-84ec-26c22d5fdb85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:24.379146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31be5da4-e905-4e69-84ec-26c22d5fdb85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:24.379724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31be5da4-e905-4e69-84ec-26c22d5fdb85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:24.411416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-31be5da4-e905-4e69-84ec-26c22d5fdb85 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050855 Jul 26 18:39:24.411978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 786/1548] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:24 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:24.722959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-447b6413-0e0b-4947-bb1b-54009460f3bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:24.725853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-447b6413-0e0b-4947-bb1b-54009460f3bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:24.735541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-447b6413-0e0b-4947-bb1b-54009460f3bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:24.736196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-447b6413-0e0b-4947-bb1b-54009460f3bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:24.737238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-447b6413-0e0b-4947-bb1b-54009460f3bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:24.737797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-447b6413-0e0b-4947-bb1b-54009460f3bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:24.769233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-447b6413-0e0b-4947-bb1b-54009460f3bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052621 Jul 26 18:39:24.769806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 763/1549] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:24.804251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-49fd83d0-b56e-42db-83e4-dfb83d3cc731 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:24.804960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-52a84a49-976c-4f80-ac40-ed4914fa64f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:24.806426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-49fd83d0-b56e-42db-83e4-dfb83d3cc731 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:24.806946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-52a84a49-976c-4f80-ac40-ed4914fa64f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:24.813253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52a84a49-976c-4f80-ac40-ed4914fa64f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:24.813440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49fd83d0-b56e-42db-83e4-dfb83d3cc731 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:24.813699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52a84a49-976c-4f80-ac40-ed4914fa64f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:24.813845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49fd83d0-b56e-42db-83e4-dfb83d3cc731 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:24.814457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52a84a49-976c-4f80-ac40-ed4914fa64f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:24.814604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49fd83d0-b56e-42db-83e4-dfb83d3cc731 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:24.814885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52a84a49-976c-4f80-ac40-ed4914fa64f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:24.815049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49fd83d0-b56e-42db-83e4-dfb83d3cc731 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:24.845152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-52a84a49-976c-4f80-ac40-ed4914fa64f8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044171 Jul 26 18:39:24.845437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-49fd83d0-b56e-42db-83e4-dfb83d3cc731 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045109 Jul 26 18:39:24.847508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 764/1550] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:24 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:24.847699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 787/1551] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:24 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:25.424185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d2fc106a-04ce-43ab-8af3-e24311210adf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:25.426322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d2fc106a-04ce-43ab-8af3-e24311210adf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:25.432786 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2fc106a-04ce-43ab-8af3-e24311210adf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:25.433252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2fc106a-04ce-43ab-8af3-e24311210adf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:25.434012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2fc106a-04ce-43ab-8af3-e24311210adf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:25.434443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2fc106a-04ce-43ab-8af3-e24311210adf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:25.450722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:25.469924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d2fc106a-04ce-43ab-8af3-e24311210adf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049742 Jul 26 18:39:25.470474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 765/1552] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:25 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:25.782769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3227aeb3-4328-4121-a50b-4bd2779f2b7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:25.785019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3227aeb3-4328-4121-a50b-4bd2779f2b7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:25.793437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3227aeb3-4328-4121-a50b-4bd2779f2b7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:25.794073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3227aeb3-4328-4121-a50b-4bd2779f2b7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:25.795268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3227aeb3-4328-4121-a50b-4bd2779f2b7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:25.795911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3227aeb3-4328-4121-a50b-4bd2779f2b7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:25.833488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3227aeb3-4328-4121-a50b-4bd2779f2b7a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054747 Jul 26 18:39:25.834198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 788/1553] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:25.857434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2a632f15-738d-4e3a-907a-bb4fe3bbbda9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:25.857990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-008ba90c-39eb-48d6-8618-90aaa461f0c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:25.859621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-008ba90c-39eb-48d6-8618-90aaa461f0c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:25.859766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2a632f15-738d-4e3a-907a-bb4fe3bbbda9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:25.865803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-008ba90c-39eb-48d6-8618-90aaa461f0c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:25.866219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a632f15-738d-4e3a-907a-bb4fe3bbbda9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:25.866384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-008ba90c-39eb-48d6-8618-90aaa461f0c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:25.866674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a632f15-738d-4e3a-907a-bb4fe3bbbda9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:25.866985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-008ba90c-39eb-48d6-8618-90aaa461f0c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:25.867433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-008ba90c-39eb-48d6-8618-90aaa461f0c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:25.867550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a632f15-738d-4e3a-907a-bb4fe3bbbda9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:25.867901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a632f15-738d-4e3a-907a-bb4fe3bbbda9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:25.871138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:25.897677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2a632f15-738d-4e3a-907a-bb4fe3bbbda9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044182 Jul 26 18:39:25.897912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-008ba90c-39eb-48d6-8618-90aaa461f0c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043992 Jul 26 18:39:25.902251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 766/1555] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:25 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:25.902389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 789/1555] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:25 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:26.464569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:39:26.465108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:39:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:39:26.482785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0f4f06c4-0742-495d-832f-a2cb52f971db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:26.484977 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0f4f06c4-0742-495d-832f-a2cb52f971db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:26.491477 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f4f06c4-0742-495d-832f-a2cb52f971db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:26.491901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f4f06c4-0742-495d-832f-a2cb52f971db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:26.492689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f4f06c4-0742-495d-832f-a2cb52f971db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:26.493120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f4f06c4-0742-495d-832f-a2cb52f971db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:26.523501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0f4f06c4-0742-495d-832f-a2cb52f971db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Jul 26 18:39:26.524082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 767/1556] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:26 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:26.846448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-72074e09-5ada-4793-a824-8180792cdeb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:26.848650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-72074e09-5ada-4793-a824-8180792cdeb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:26.855915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72074e09-5ada-4793-a824-8180792cdeb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:26.856358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72074e09-5ada-4793-a824-8180792cdeb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:26.857124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72074e09-5ada-4793-a824-8180792cdeb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:26.857555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72074e09-5ada-4793-a824-8180792cdeb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:26.888280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-72074e09-5ada-4793-a824-8180792cdeb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045821 Jul 26 18:39:26.888835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 790/1557] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:26.911385 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7c9846ce-f0dd-4806-b22e-3a4de6bb0cae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:26.913176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bd0bc1d6-b41b-44e0-bf31-85267eb09ad0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:26.913555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7c9846ce-f0dd-4806-b22e-3a4de6bb0cae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:26.915585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bd0bc1d6-b41b-44e0-bf31-85267eb09ad0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:26.920358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c9846ce-f0dd-4806-b22e-3a4de6bb0cae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:26.920802 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c9846ce-f0dd-4806-b22e-3a4de6bb0cae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:26.921602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c9846ce-f0dd-4806-b22e-3a4de6bb0cae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:26.922032 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c9846ce-f0dd-4806-b22e-3a4de6bb0cae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:26.925162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd0bc1d6-b41b-44e0-bf31-85267eb09ad0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:26.925876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd0bc1d6-b41b-44e0-bf31-85267eb09ad0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:26.927187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd0bc1d6-b41b-44e0-bf31-85267eb09ad0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:26.927633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd0bc1d6-b41b-44e0-bf31-85267eb09ad0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:26.951384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7c9846ce-f0dd-4806-b22e-3a4de6bb0cae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044177 Jul 26 18:39:26.952664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 768/1558] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:26 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:26.956883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bd0bc1d6-b41b-44e0-bf31-85267eb09ad0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047558 Jul 26 18:39:26.957433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 791/1559] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:26 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:39:27.537399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-07e224df-ebdc-447c-b4e8-b2350dfe1e3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:27.539584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-07e224df-ebdc-447c-b4e8-b2350dfe1e3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:27.546183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07e224df-ebdc-447c-b4e8-b2350dfe1e3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:27.546636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07e224df-ebdc-447c-b4e8-b2350dfe1e3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:27.547445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07e224df-ebdc-447c-b4e8-b2350dfe1e3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:27.547877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07e224df-ebdc-447c-b4e8-b2350dfe1e3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:27.577177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-07e224df-ebdc-447c-b4e8-b2350dfe1e3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044053 Jul 26 18:39:27.577975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 769/1560] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:27 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:27.905180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8bef4cac-3cf5-43ae-affe-04648181e94c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:27.908514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8bef4cac-3cf5-43ae-affe-04648181e94c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:27.919067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8bef4cac-3cf5-43ae-affe-04648181e94c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:27.919500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8bef4cac-3cf5-43ae-affe-04648181e94c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:27.920256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8bef4cac-3cf5-43ae-affe-04648181e94c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:27.920685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8bef4cac-3cf5-43ae-affe-04648181e94c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:27.956050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8bef4cac-3cf5-43ae-affe-04648181e94c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057832 Jul 26 18:39:27.956606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 792/1561] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:27 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:27.964205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ab664a07-f7f9-4c63-9cf6-ac372f6c3ccc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:27.966419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ab664a07-f7f9-4c63-9cf6-ac372f6c3ccc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:27.969351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3816ce0f-b359-4816-9092-71072adb6996 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:27.971523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3816ce0f-b359-4816-9092-71072adb6996 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:27.973239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab664a07-f7f9-4c63-9cf6-ac372f6c3ccc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:27.973712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab664a07-f7f9-4c63-9cf6-ac372f6c3ccc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:27.974459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab664a07-f7f9-4c63-9cf6-ac372f6c3ccc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:27.974852 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab664a07-f7f9-4c63-9cf6-ac372f6c3ccc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:27.977565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3816ce0f-b359-4816-9092-71072adb6996 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:27.978005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3816ce0f-b359-4816-9092-71072adb6996 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:27.978809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3816ce0f-b359-4816-9092-71072adb6996 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:27.979273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3816ce0f-b359-4816-9092-71072adb6996 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:28.004280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ab664a07-f7f9-4c63-9cf6-ac372f6c3ccc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044268 Jul 26 18:39:28.004908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 770/1562] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:28.009510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3816ce0f-b359-4816-9092-71072adb6996 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Jul 26 18:39:28.010087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 793/1563] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:27 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:28.590822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-badf51ee-86e9-430b-b7e5-b3da9be932f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:28.593289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-badf51ee-86e9-430b-b7e5-b3da9be932f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:28.601066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-badf51ee-86e9-430b-b7e5-b3da9be932f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:28.601568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-badf51ee-86e9-430b-b7e5-b3da9be932f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:28.602415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-badf51ee-86e9-430b-b7e5-b3da9be932f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:28.602937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-badf51ee-86e9-430b-b7e5-b3da9be932f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:28.643420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-badf51ee-86e9-430b-b7e5-b3da9be932f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056977 Jul 26 18:39:28.643959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 771/1564] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:28 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:28.969675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d5f604c9-1a1b-4e12-9a37-dc19dd6137a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:28.972606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d5f604c9-1a1b-4e12-9a37-dc19dd6137a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:28.979637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5f604c9-1a1b-4e12-9a37-dc19dd6137a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:28.980077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5f604c9-1a1b-4e12-9a37-dc19dd6137a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:28.980831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5f604c9-1a1b-4e12-9a37-dc19dd6137a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:28.981254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5f604c9-1a1b-4e12-9a37-dc19dd6137a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:29.011183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d5f604c9-1a1b-4e12-9a37-dc19dd6137a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046030 Jul 26 18:39:29.011864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 794/1565] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:29.020314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-779b93ce-4b6b-45d9-9980-4ba170cc12b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:29.022047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cebcdb5d-aba5-49e1-9486-998f67ad1a25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:29.022988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-779b93ce-4b6b-45d9-9980-4ba170cc12b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:29.024209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cebcdb5d-aba5-49e1-9486-998f67ad1a25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:29.029420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-779b93ce-4b6b-45d9-9980-4ba170cc12b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:29.029872 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-779b93ce-4b6b-45d9-9980-4ba170cc12b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:29.030552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cebcdb5d-aba5-49e1-9486-998f67ad1a25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:29.030679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-779b93ce-4b6b-45d9-9980-4ba170cc12b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:29.031005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cebcdb5d-aba5-49e1-9486-998f67ad1a25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:29.031120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-779b93ce-4b6b-45d9-9980-4ba170cc12b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:29.031806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cebcdb5d-aba5-49e1-9486-998f67ad1a25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:29.032236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cebcdb5d-aba5-49e1-9486-998f67ad1a25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:29.060551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-779b93ce-4b6b-45d9-9980-4ba170cc12b5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046753 Jul 26 18:39:29.061102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 772/1566] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:29 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:29.061396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cebcdb5d-aba5-49e1-9486-998f67ad1a25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043516 Jul 26 18:39:29.062036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 795/1567] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:29 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:29.657891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-937e39ab-2ae7-4d7e-ba1e-7ecd21d08f52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:29.660075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-937e39ab-2ae7-4d7e-ba1e-7ecd21d08f52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:29.667216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-937e39ab-2ae7-4d7e-ba1e-7ecd21d08f52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:29.667666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-937e39ab-2ae7-4d7e-ba1e-7ecd21d08f52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:29.668433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-937e39ab-2ae7-4d7e-ba1e-7ecd21d08f52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:29.668870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-937e39ab-2ae7-4d7e-ba1e-7ecd21d08f52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:29.699100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-937e39ab-2ae7-4d7e-ba1e-7ecd21d08f52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045226 Jul 26 18:39:29.699655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 773/1568] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:29 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:30.027233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b2b8642d-7e20-4449-a913-8e1696dd6af3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:30.029514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b2b8642d-7e20-4449-a913-8e1696dd6af3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:30.037320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2b8642d-7e20-4449-a913-8e1696dd6af3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:30.037794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2b8642d-7e20-4449-a913-8e1696dd6af3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:30.038610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2b8642d-7e20-4449-a913-8e1696dd6af3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:30.039072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2b8642d-7e20-4449-a913-8e1696dd6af3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:30.071365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b2b8642d-7e20-4449-a913-8e1696dd6af3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048782 Jul 26 18:39:30.072267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 796/1569] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:30.073009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a823b044-9fa9-4927-bd8f-2329eaff8c47 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:30.075337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a823b044-9fa9-4927-bd8f-2329eaff8c47 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:30.077101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a200bd6f-7871-4c52-b092-f11a20e44ab6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:30.079104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a200bd6f-7871-4c52-b092-f11a20e44ab6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:30.081775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a823b044-9fa9-4927-bd8f-2329eaff8c47 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:30.082227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a823b044-9fa9-4927-bd8f-2329eaff8c47 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:30.083124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a823b044-9fa9-4927-bd8f-2329eaff8c47 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:30.083482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a823b044-9fa9-4927-bd8f-2329eaff8c47 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:30.085479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a200bd6f-7871-4c52-b092-f11a20e44ab6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:30.085932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a200bd6f-7871-4c52-b092-f11a20e44ab6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:30.086734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a200bd6f-7871-4c52-b092-f11a20e44ab6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:30.087219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a200bd6f-7871-4c52-b092-f11a20e44ab6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:30.112965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a823b044-9fa9-4927-bd8f-2329eaff8c47 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 Jul 26 18:39:30.113532 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 774/1570] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:30 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:30.117269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a200bd6f-7871-4c52-b092-f11a20e44ab6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043911 Jul 26 18:39:30.117834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 797/1571] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:30 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:30.716249 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-51473b1c-0b32-4310-8336-cabed6e5b9e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:30.718427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-51473b1c-0b32-4310-8336-cabed6e5b9e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:30.720813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:30.726763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-51473b1c-0b32-4310-8336-cabed6e5b9e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:30.727259 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-51473b1c-0b32-4310-8336-cabed6e5b9e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:30.728002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-51473b1c-0b32-4310-8336-cabed6e5b9e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:30.728436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-51473b1c-0b32-4310-8336-cabed6e5b9e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:30.762845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-51473b1c-0b32-4310-8336-cabed6e5b9e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052174 Jul 26 18:39:30.763417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 775/1572] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:30 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:31.086996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c2ce6f01-af9f-40cd-83d9-c15d21453c8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:31.090116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c2ce6f01-af9f-40cd-83d9-c15d21453c8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:31.100341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2ce6f01-af9f-40cd-83d9-c15d21453c8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:31.100931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2ce6f01-af9f-40cd-83d9-c15d21453c8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:31.101854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2ce6f01-af9f-40cd-83d9-c15d21453c8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:31.102449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2ce6f01-af9f-40cd-83d9-c15d21453c8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:31.125567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9deefe23-7bc4-4773-8e8d-3b7205a1f194 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:31.127801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9deefe23-7bc4-4773-8e8d-3b7205a1f194 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:31.133926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c2ce6f01-af9f-40cd-83d9-c15d21453c8e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053036 Jul 26 18:39:31.134222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9deefe23-7bc4-4773-8e8d-3b7205a1f194 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:31.134473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 798/1573] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:31.134644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9deefe23-7bc4-4773-8e8d-3b7205a1f194 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:31.135476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9deefe23-7bc4-4773-8e8d-3b7205a1f194 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:31.136027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9deefe23-7bc4-4773-8e8d-3b7205a1f194 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:31.139147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b8873f19-3662-4a80-8953-e9c4b234a4bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:31.141277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b8873f19-3662-4a80-8953-e9c4b234a4bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:31.147607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8873f19-3662-4a80-8953-e9c4b234a4bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:31.148056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8873f19-3662-4a80-8953-e9c4b234a4bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:31.148817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8873f19-3662-4a80-8953-e9c4b234a4bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:31.149250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8873f19-3662-4a80-8953-e9c4b234a4bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:31.166489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9deefe23-7bc4-4773-8e8d-3b7205a1f194 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044917 Jul 26 18:39:31.167329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 776/1574] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:31 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:31.178572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b8873f19-3662-4a80-8953-e9c4b234a4bb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043047 Jul 26 18:39:31.179123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 799/1575] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:31 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:31.777848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-26e69649-0f06-4508-a44f-39859039e9b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:31.780031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-26e69649-0f06-4508-a44f-39859039e9b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:31.787114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26e69649-0f06-4508-a44f-39859039e9b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:31.787562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26e69649-0f06-4508-a44f-39859039e9b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:31.788330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26e69649-0f06-4508-a44f-39859039e9b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:31.788758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26e69649-0f06-4508-a44f-39859039e9b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:31.818230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-26e69649-0f06-4508-a44f-39859039e9b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044336 Jul 26 18:39:31.818784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 777/1576] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:31 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:32.147185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e5b846fd-9761-424a-b980-df5e493c06fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:32.149328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e5b846fd-9761-424a-b980-df5e493c06fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:32.156477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5b846fd-9761-424a-b980-df5e493c06fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:32.156924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5b846fd-9761-424a-b980-df5e493c06fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:32.157684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5b846fd-9761-424a-b980-df5e493c06fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:32.158146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5b846fd-9761-424a-b980-df5e493c06fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:32.178274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-11b71be7-39e1-40af-b65f-f6b84e1a8392 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:32.180498 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-11b71be7-39e1-40af-b65f-f6b84e1a8392 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:32.186933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11b71be7-39e1-40af-b65f-f6b84e1a8392 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:32.187434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11b71be7-39e1-40af-b65f-f6b84e1a8392 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:32.187903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e5b846fd-9761-424a-b980-df5e493c06fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045146 Jul 26 18:39:32.188188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11b71be7-39e1-40af-b65f-f6b84e1a8392 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:32.188474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 800/1577] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:32 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:32.192622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11b71be7-39e1-40af-b65f-f6b84e1a8392 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:32.193059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-03d0434d-bf81-43fe-baa7-92b3a1677c8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:32.195219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-03d0434d-bf81-43fe-baa7-92b3a1677c8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:32.201367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-03d0434d-bf81-43fe-baa7-92b3a1677c8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:32.201809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-03d0434d-bf81-43fe-baa7-92b3a1677c8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:32.202599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-03d0434d-bf81-43fe-baa7-92b3a1677c8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:32.203050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-03d0434d-bf81-43fe-baa7-92b3a1677c8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:32.218232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-11b71be7-39e1-40af-b65f-f6b84e1a8392 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 Jul 26 18:39:32.218888 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 778/1578] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:32 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:32.232443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-03d0434d-bf81-43fe-baa7-92b3a1677c8f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042913 Jul 26 18:39:32.233013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 801/1579] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:32 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:32.832365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-466f58f9-c673-4bec-ba97-696c76663511 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:32.834787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-466f58f9-c673-4bec-ba97-696c76663511 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:32.843682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-466f58f9-c673-4bec-ba97-696c76663511 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:32.844132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-466f58f9-c673-4bec-ba97-696c76663511 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:32.844901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-466f58f9-c673-4bec-ba97-696c76663511 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:32.845337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-466f58f9-c673-4bec-ba97-696c76663511 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:32.875126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-466f58f9-c673-4bec-ba97-696c76663511 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048155 Jul 26 18:39:32.875688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 779/1580] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:32 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:33.201516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bfcf8e39-8b1d-45b3-b6f2-d49783e2a010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:33.203858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bfcf8e39-8b1d-45b3-b6f2-d49783e2a010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:33.205874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:33.211856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfcf8e39-8b1d-45b3-b6f2-d49783e2a010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:33.212324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfcf8e39-8b1d-45b3-b6f2-d49783e2a010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:33.213135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfcf8e39-8b1d-45b3-b6f2-d49783e2a010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:33.213589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfcf8e39-8b1d-45b3-b6f2-d49783e2a010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:33.230403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-78146b81-3915-4824-a9ee-65120b6b2cf6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:33.232690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-78146b81-3915-4824-a9ee-65120b6b2cf6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:33.239281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78146b81-3915-4824-a9ee-65120b6b2cf6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:33.239825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78146b81-3915-4824-a9ee-65120b6b2cf6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:33.240489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78146b81-3915-4824-a9ee-65120b6b2cf6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:33.240912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78146b81-3915-4824-a9ee-65120b6b2cf6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:33.245149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bfcf8e39-8b1d-45b3-b6f2-d49783e2a010 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048203 Jul 26 18:39:33.245757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 802/1581] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:33.253386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e9741168-4e46-421e-90c8-85ea9a944ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:33.255594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e9741168-4e46-421e-90c8-85ea9a944ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:33.262020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9741168-4e46-421e-90c8-85ea9a944ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:33.262428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9741168-4e46-421e-90c8-85ea9a944ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:33.263243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9741168-4e46-421e-90c8-85ea9a944ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:33.263676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9741168-4e46-421e-90c8-85ea9a944ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:33.272095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-78146b81-3915-4824-a9ee-65120b6b2cf6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045632 Jul 26 18:39:33.272669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 780/1582] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:33 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:33.293642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e9741168-4e46-421e-90c8-85ea9a944ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046906 Jul 26 18:39:33.294233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 803/1583] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:33 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:33.887324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6017f3c0-ed6f-4bf4-82a0-7cab12968ad4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:33.889520 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6017f3c0-ed6f-4bf4-82a0-7cab12968ad4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:33.896390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6017f3c0-ed6f-4bf4-82a0-7cab12968ad4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:33.897129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6017f3c0-ed6f-4bf4-82a0-7cab12968ad4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:33.897909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6017f3c0-ed6f-4bf4-82a0-7cab12968ad4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:33.898337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6017f3c0-ed6f-4bf4-82a0-7cab12968ad4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:33.927816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6017f3c0-ed6f-4bf4-82a0-7cab12968ad4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044564 Jul 26 18:39:33.928366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 781/1584] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:33 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:34.261506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1874c152-e0c2-4444-a921-c0bfed85f5fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:34.264941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1874c152-e0c2-4444-a921-c0bfed85f5fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:34.275796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1874c152-e0c2-4444-a921-c0bfed85f5fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:34.276773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1874c152-e0c2-4444-a921-c0bfed85f5fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:34.278100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1874c152-e0c2-4444-a921-c0bfed85f5fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:34.278881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1874c152-e0c2-4444-a921-c0bfed85f5fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:34.284838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b837ce88-9c74-43f8-b318-fbecd92554b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:34.287720 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b837ce88-9c74-43f8-b318-fbecd92554b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:34.294320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b837ce88-9c74-43f8-b318-fbecd92554b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:34.294766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b837ce88-9c74-43f8-b318-fbecd92554b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:34.295564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b837ce88-9c74-43f8-b318-fbecd92554b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:34.295995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b837ce88-9c74-43f8-b318-fbecd92554b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:34.298551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:34.314751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1874c152-e0c2-4444-a921-c0bfed85f5fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059608 Jul 26 18:39:34.315565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 804/1585] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:34 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:34.319933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8aa60170-2679-429f-959f-e378e8f43f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:34.322067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8aa60170-2679-429f-959f-e378e8f43f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:34.327476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b837ce88-9c74-43f8-b318-fbecd92554b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046793 Jul 26 18:39:34.328238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 782/1586] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:34 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:34.328356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8aa60170-2679-429f-959f-e378e8f43f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:34.328510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8aa60170-2679-429f-959f-e378e8f43f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:34.329271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8aa60170-2679-429f-959f-e378e8f43f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:34.329717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8aa60170-2679-429f-959f-e378e8f43f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:34.355640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:34.361069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8aa60170-2679-429f-959f-e378e8f43f63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044634 Jul 26 18:39:34.361838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 805/1587] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:34 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:34.940978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1ba2cdac-e5c1-4e6a-acd6-32107c37ef42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:34.943166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1ba2cdac-e5c1-4e6a-acd6-32107c37ef42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:34.950192 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ba2cdac-e5c1-4e6a-acd6-32107c37ef42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:34.950638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ba2cdac-e5c1-4e6a-acd6-32107c37ef42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:34.951451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ba2cdac-e5c1-4e6a-acd6-32107c37ef42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:34.951887 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ba2cdac-e5c1-4e6a-acd6-32107c37ef42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:34.982171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1ba2cdac-e5c1-4e6a-acd6-32107c37ef42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045295 Jul 26 18:39:34.982726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 783/1588] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:34 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:35.328800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f9a14871-5ac4-46fb-830a-79d5e74eb905 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:35.330834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f9a14871-5ac4-46fb-830a-79d5e74eb905 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:35.338463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9a14871-5ac4-46fb-830a-79d5e74eb905 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:35.338906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9a14871-5ac4-46fb-830a-79d5e74eb905 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:35.339684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9a14871-5ac4-46fb-830a-79d5e74eb905 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:35.340108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9a14871-5ac4-46fb-830a-79d5e74eb905 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:35.340314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1d28778c-e795-403e-af2e-45392a475b07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:35.342466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1d28778c-e795-403e-af2e-45392a475b07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:35.348651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d28778c-e795-403e-af2e-45392a475b07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:35.349108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d28778c-e795-403e-af2e-45392a475b07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:35.349883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d28778c-e795-403e-af2e-45392a475b07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:35.350318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d28778c-e795-403e-af2e-45392a475b07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:35.370970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f9a14871-5ac4-46fb-830a-79d5e74eb905 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046305 Jul 26 18:39:35.371577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 806/1589] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:35 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:35.376310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-62eb02af-ab80-44dd-998b-d65e6e57f949 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:35.378446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-62eb02af-ab80-44dd-998b-d65e6e57f949 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:35.381011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1d28778c-e795-403e-af2e-45392a475b07 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044752 Jul 26 18:39:35.381570 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 784/1590] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:35 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:35.384717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-62eb02af-ab80-44dd-998b-d65e6e57f949 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:35.385165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-62eb02af-ab80-44dd-998b-d65e6e57f949 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:35.386012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-62eb02af-ab80-44dd-998b-d65e6e57f949 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:35.386447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-62eb02af-ab80-44dd-998b-d65e6e57f949 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:35.416527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-62eb02af-ab80-44dd-998b-d65e6e57f949 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 Jul 26 18:39:35.417090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 807/1591] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:35 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:35.998654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5a7a593d-ee95-469d-828e-95491e955c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:36.001941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5a7a593d-ee95-469d-828e-95491e955c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:36.011880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a7a593d-ee95-469d-828e-95491e955c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:36.012512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a7a593d-ee95-469d-828e-95491e955c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:36.013709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a7a593d-ee95-469d-828e-95491e955c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:36.014286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a7a593d-ee95-469d-828e-95491e955c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:36.053384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5a7a593d-ee95-469d-828e-95491e955c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060435 Jul 26 18:39:36.053954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 785/1592] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:35 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:39:36.386659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6862b9dc-8a5a-4be7-9a0d-c3e6f5a71cd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:36.389184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6862b9dc-8a5a-4be7-9a0d-c3e6f5a71cd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:36.395492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3455c36a-a128-4b19-b99a-bad4321040e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:36.398551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3455c36a-a128-4b19-b99a-bad4321040e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:36.399059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6862b9dc-8a5a-4be7-9a0d-c3e6f5a71cd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:36.399626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6862b9dc-8a5a-4be7-9a0d-c3e6f5a71cd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:36.400656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6862b9dc-8a5a-4be7-9a0d-c3e6f5a71cd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:36.401240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6862b9dc-8a5a-4be7-9a0d-c3e6f5a71cd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:36.405673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3455c36a-a128-4b19-b99a-bad4321040e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:36.406152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3455c36a-a128-4b19-b99a-bad4321040e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:36.406916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3455c36a-a128-4b19-b99a-bad4321040e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:36.407395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3455c36a-a128-4b19-b99a-bad4321040e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:36.432198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6862b9dc-8a5a-4be7-9a0d-c3e6f5a71cd8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051803 Jul 26 18:39:36.432818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 808/1593] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:36 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:36.437943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-97f4857f-f40f-4439-b441-98e1f4884808 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:36.438184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3455c36a-a128-4b19-b99a-bad4321040e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048104 Jul 26 18:39:36.438513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 786/1594] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:36 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:36.440238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-97f4857f-f40f-4439-b441-98e1f4884808 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:36.446541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97f4857f-f40f-4439-b441-98e1f4884808 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:36.446979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97f4857f-f40f-4439-b441-98e1f4884808 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:36.447888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97f4857f-f40f-4439-b441-98e1f4884808 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:36.448315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97f4857f-f40f-4439-b441-98e1f4884808 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:36.476861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-97f4857f-f40f-4439-b441-98e1f4884808 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043007 Jul 26 18:39:36.477414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 809/1595] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:36 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:37.068376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-10d1e672-abd6-474c-ad61-275feaa78198 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:37.071642 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-10d1e672-abd6-474c-ad61-275feaa78198 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:37.078926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10d1e672-abd6-474c-ad61-275feaa78198 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:37.079407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10d1e672-abd6-474c-ad61-275feaa78198 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:37.080165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10d1e672-abd6-474c-ad61-275feaa78198 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:37.080598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10d1e672-abd6-474c-ad61-275feaa78198 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:37.109774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-10d1e672-abd6-474c-ad61-275feaa78198 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047298 Jul 26 18:39:37.110323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 787/1596] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:37 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:37.449124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-004e57cb-c75d-4500-91b8-30e7fbef412f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:37.452420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-004e57cb-c75d-4500-91b8-30e7fbef412f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:37.453876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-66a3a874-be69-4bc9-ba99-e95bbe989098 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:37.457174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-66a3a874-be69-4bc9-ba99-e95bbe989098 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:37.463182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-004e57cb-c75d-4500-91b8-30e7fbef412f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:37.463911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-004e57cb-c75d-4500-91b8-30e7fbef412f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:37.464852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-004e57cb-c75d-4500-91b8-30e7fbef412f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:37.465288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-004e57cb-c75d-4500-91b8-30e7fbef412f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:37.466134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66a3a874-be69-4bc9-ba99-e95bbe989098 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:37.466582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66a3a874-be69-4bc9-ba99-e95bbe989098 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:37.467385 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66a3a874-be69-4bc9-ba99-e95bbe989098 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:37.467819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-66a3a874-be69-4bc9-ba99-e95bbe989098 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:37.494861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-004e57cb-c75d-4500-91b8-30e7fbef412f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052375 Jul 26 18:39:37.495483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 810/1597] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:37.497460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-66a3a874-be69-4bc9-ba99-e95bbe989098 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050269 Jul 26 18:39:37.498200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 788/1598] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:37 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:39:37.499964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-91a03c62-4bc4-4eee-8483-068549a6be26 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:37.502136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-91a03c62-4bc4-4eee-8483-068549a6be26 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:37.508215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91a03c62-4bc4-4eee-8483-068549a6be26 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:37.508656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91a03c62-4bc4-4eee-8483-068549a6be26 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:37.509414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91a03c62-4bc4-4eee-8483-068549a6be26 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:37.509870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91a03c62-4bc4-4eee-8483-068549a6be26 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:37.538638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-91a03c62-4bc4-4eee-8483-068549a6be26 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042146 Jul 26 18:39:37.539292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 811/1599] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:37 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:38.124100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b2855fdd-a61c-441c-bec4-75bf543712b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:38.126266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b2855fdd-a61c-441c-bec4-75bf543712b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:38.133270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2855fdd-a61c-441c-bec4-75bf543712b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:38.133806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2855fdd-a61c-441c-bec4-75bf543712b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:38.134487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2855fdd-a61c-441c-bec4-75bf543712b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:38.134931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2855fdd-a61c-441c-bec4-75bf543712b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:38.165245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b2855fdd-a61c-441c-bec4-75bf543712b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045836 Jul 26 18:39:38.165837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 789/1600] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:38 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:38.513211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-671db38d-54cd-4d34-af7a-db9b05e385b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:38.513783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9ede492c-58cf-475a-8757-682539750993 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:38.515440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-671db38d-54cd-4d34-af7a-db9b05e385b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:38.515815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9ede492c-58cf-475a-8757-682539750993 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:38.522419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-671db38d-54cd-4d34-af7a-db9b05e385b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:38.522679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ede492c-58cf-475a-8757-682539750993 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:38.522823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-671db38d-54cd-4d34-af7a-db9b05e385b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:38.523156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ede492c-58cf-475a-8757-682539750993 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:38.523655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-671db38d-54cd-4d34-af7a-db9b05e385b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:38.523932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ede492c-58cf-475a-8757-682539750993 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:38.524040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-671db38d-54cd-4d34-af7a-db9b05e385b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:38.524347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ede492c-58cf-475a-8757-682539750993 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:38.554254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9ede492c-58cf-475a-8757-682539750993 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045696 Jul 26 18:39:38.554514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-671db38d-54cd-4d34-af7a-db9b05e385b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046752 Jul 26 18:39:38.554808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 790/1601] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:38.555236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 812/1602] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:38 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:38.559820 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-baf07707-af6a-41f7-bbcb-f864f91f247e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:38.562064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-baf07707-af6a-41f7-bbcb-f864f91f247e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:38.568080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-baf07707-af6a-41f7-bbcb-f864f91f247e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:38.568519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-baf07707-af6a-41f7-bbcb-f864f91f247e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:38.569268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-baf07707-af6a-41f7-bbcb-f864f91f247e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:38.569736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-baf07707-af6a-41f7-bbcb-f864f91f247e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:38.598557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-baf07707-af6a-41f7-bbcb-f864f91f247e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042412 Jul 26 18:39:38.599348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 791/1603] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:38 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:39.181046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-edb24cd2-3423-4689-8e09-827b67cf478a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:39.184524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-edb24cd2-3423-4689-8e09-827b67cf478a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:39.193968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-edb24cd2-3423-4689-8e09-827b67cf478a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:39.194691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-edb24cd2-3423-4689-8e09-827b67cf478a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:39.196046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-edb24cd2-3423-4689-8e09-827b67cf478a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:39.196656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-edb24cd2-3423-4689-8e09-827b67cf478a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:39.227054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-edb24cd2-3423-4689-8e09-827b67cf478a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052348 Jul 26 18:39:39.227673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 813/1604] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:39 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:39.566662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-86ac1ea8-da93-451d-b04d-b0691e37c13f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:39.568831 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-86ac1ea8-da93-451d-b04d-b0691e37c13f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:39.569779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2548c81a-18f2-4cda-b118-2246b6ad08db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:39.572520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2548c81a-18f2-4cda-b118-2246b6ad08db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:39.575821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86ac1ea8-da93-451d-b04d-b0691e37c13f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:39.576266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86ac1ea8-da93-451d-b04d-b0691e37c13f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:39.577025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86ac1ea8-da93-451d-b04d-b0691e37c13f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:39.577452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-86ac1ea8-da93-451d-b04d-b0691e37c13f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:39.578634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2548c81a-18f2-4cda-b118-2246b6ad08db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:39.579131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2548c81a-18f2-4cda-b118-2246b6ad08db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:39.579886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2548c81a-18f2-4cda-b118-2246b6ad08db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:39.580317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2548c81a-18f2-4cda-b118-2246b6ad08db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:39.609561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-86ac1ea8-da93-451d-b04d-b0691e37c13f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046851 Jul 26 18:39:39.610046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2548c81a-18f2-4cda-b118-2246b6ad08db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044139 Jul 26 18:39:39.610177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 792/1605] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:39 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:39.610777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 814/1606] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:39.614684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9acd8735-7a68-41ae-8a5a-b2d2b51d61ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:39.616843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9acd8735-7a68-41ae-8a5a-b2d2b51d61ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:39.622976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9acd8735-7a68-41ae-8a5a-b2d2b51d61ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:39.623443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9acd8735-7a68-41ae-8a5a-b2d2b51d61ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:39.624199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9acd8735-7a68-41ae-8a5a-b2d2b51d61ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:39.624623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9acd8735-7a68-41ae-8a5a-b2d2b51d61ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:39.662853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9acd8735-7a68-41ae-8a5a-b2d2b51d61ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051714 Jul 26 18:39:39.663461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 793/1607] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:39 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:40.242591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-091a3e82-7f01-48bb-b90d-17d9c51e244a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:40.245829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-091a3e82-7f01-48bb-b90d-17d9c51e244a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:40.252311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-091a3e82-7f01-48bb-b90d-17d9c51e244a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:40.252758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-091a3e82-7f01-48bb-b90d-17d9c51e244a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:40.253983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-091a3e82-7f01-48bb-b90d-17d9c51e244a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:40.254701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-091a3e82-7f01-48bb-b90d-17d9c51e244a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:40.287502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-091a3e82-7f01-48bb-b90d-17d9c51e244a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052310 Jul 26 18:39:40.288039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 815/1608] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:40 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:40.624857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-831a69c0-d161-4036-bbf1-7f3b50fdda15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:40.625815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dbad3827-601f-4076-8471-6cf613807382 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:40.627985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-831a69c0-d161-4036-bbf1-7f3b50fdda15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:40.628211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dbad3827-601f-4076-8471-6cf613807382 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:40.637057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dbad3827-601f-4076-8471-6cf613807382 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:40.637248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-831a69c0-d161-4036-bbf1-7f3b50fdda15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:40.637509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dbad3827-601f-4076-8471-6cf613807382 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:40.637678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-831a69c0-d161-4036-bbf1-7f3b50fdda15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:40.638271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-831a69c0-d161-4036-bbf1-7f3b50fdda15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:40.638413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dbad3827-601f-4076-8471-6cf613807382 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:40.638717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-831a69c0-d161-4036-bbf1-7f3b50fdda15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:40.638864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dbad3827-601f-4076-8471-6cf613807382 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:40.670385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dbad3827-601f-4076-8471-6cf613807382 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049475 Jul 26 18:39:40.670628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-831a69c0-d161-4036-bbf1-7f3b50fdda15 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051338 Jul 26 18:39:40.671694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 794/1609] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:40 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:40.675068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 816/1610] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:40 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:40.676511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c559803f-568a-47fa-8ae5-2f706e631c1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:40.678709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c559803f-568a-47fa-8ae5-2f706e631c1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:40.685026 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c559803f-568a-47fa-8ae5-2f706e631c1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:40.685468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c559803f-568a-47fa-8ae5-2f706e631c1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:40.686261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c559803f-568a-47fa-8ae5-2f706e631c1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:40.686702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c559803f-568a-47fa-8ae5-2f706e631c1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:40.716441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c559803f-568a-47fa-8ae5-2f706e631c1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043662 Jul 26 18:39:40.717020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 795/1611] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:40 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:41.302774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ef81b69f-3f0e-47fb-886a-062ecc7e2992 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:41.305103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ef81b69f-3f0e-47fb-886a-062ecc7e2992 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:41.311564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef81b69f-3f0e-47fb-886a-062ecc7e2992 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:41.312006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef81b69f-3f0e-47fb-886a-062ecc7e2992 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:41.312757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef81b69f-3f0e-47fb-886a-062ecc7e2992 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:41.313178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef81b69f-3f0e-47fb-886a-062ecc7e2992 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:41.342384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ef81b69f-3f0e-47fb-886a-062ecc7e2992 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043651 Jul 26 18:39:41.342905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 817/1612] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:41 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:41.684654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-781d5173-c55c-45ef-9c19-2f516a9719ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:41.685275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dc038770-c076-4182-b32d-dade7ad7b157 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:41.686811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-781d5173-c55c-45ef-9c19-2f516a9719ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:41.687366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dc038770-c076-4182-b32d-dade7ad7b157 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:41.693979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-781d5173-c55c-45ef-9c19-2f516a9719ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:41.694425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-781d5173-c55c-45ef-9c19-2f516a9719ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:41.694589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dc038770-c076-4182-b32d-dade7ad7b157 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:41.694917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dc038770-c076-4182-b32d-dade7ad7b157 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:41.695410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-781d5173-c55c-45ef-9c19-2f516a9719ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:41.695759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dc038770-c076-4182-b32d-dade7ad7b157 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:41.695903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-781d5173-c55c-45ef-9c19-2f516a9719ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:41.696181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dc038770-c076-4182-b32d-dade7ad7b157 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:41.726526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dc038770-c076-4182-b32d-dade7ad7b157 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046052 Jul 26 18:39:41.726778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-781d5173-c55c-45ef-9c19-2f516a9719ec tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046883 Jul 26 18:39:41.727162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 818/1613] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:41 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:41.731175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 796/1614] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:41 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:41.731976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-14797a0b-e848-44b7-847f-71f73a244007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:41.734105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-14797a0b-e848-44b7-847f-71f73a244007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:41.740287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14797a0b-e848-44b7-847f-71f73a244007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:41.740727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14797a0b-e848-44b7-847f-71f73a244007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:41.741516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14797a0b-e848-44b7-847f-71f73a244007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:41.741938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14797a0b-e848-44b7-847f-71f73a244007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:41.772376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-14797a0b-e848-44b7-847f-71f73a244007 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043773 Jul 26 18:39:41.772849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 819/1615] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:41 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:42.354015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7876dd47-a7ce-4740-96bf-dd78f60d8731 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:42.356243 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7876dd47-a7ce-4740-96bf-dd78f60d8731 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:42.363878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7876dd47-a7ce-4740-96bf-dd78f60d8731 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:42.364327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7876dd47-a7ce-4740-96bf-dd78f60d8731 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:42.365097 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7876dd47-a7ce-4740-96bf-dd78f60d8731 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:42.365532 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7876dd47-a7ce-4740-96bf-dd78f60d8731 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:42.397298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7876dd47-a7ce-4740-96bf-dd78f60d8731 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046696 Jul 26 18:39:42.398127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 797/1616] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:42 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:42.738254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-855dcb1d-f1c9-496a-bf04-485c8c7d5905 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:42.738918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-40ef09ee-39a8-4be0-b44d-1497435e18ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:42.740461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-855dcb1d-f1c9-496a-bf04-485c8c7d5905 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:42.741466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-40ef09ee-39a8-4be0-b44d-1497435e18ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:42.748447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-855dcb1d-f1c9-496a-bf04-485c8c7d5905 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:42.748447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-855dcb1d-f1c9-496a-bf04-485c8c7d5905 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:42.748665 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40ef09ee-39a8-4be0-b44d-1497435e18ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:42.748952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40ef09ee-39a8-4be0-b44d-1497435e18ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:42.749113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-855dcb1d-f1c9-496a-bf04-485c8c7d5905 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:42.749528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-855dcb1d-f1c9-496a-bf04-485c8c7d5905 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:42.749689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40ef09ee-39a8-4be0-b44d-1497435e18ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:42.750138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-40ef09ee-39a8-4be0-b44d-1497435e18ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:42.775265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:42.781692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-855dcb1d-f1c9-496a-bf04-485c8c7d5905 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047460 Jul 26 18:39:42.782254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 820/1617] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:42 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:42.782576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-40ef09ee-39a8-4be0-b44d-1497435e18ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047765 Jul 26 18:39:42.783409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 798/1618] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:42.786885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8ee577da-7411-44e6-b5ca-4c32f3e1c63c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:42.789054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8ee577da-7411-44e6-b5ca-4c32f3e1c63c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:42.795471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ee577da-7411-44e6-b5ca-4c32f3e1c63c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:42.795911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ee577da-7411-44e6-b5ca-4c32f3e1c63c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:42.796675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ee577da-7411-44e6-b5ca-4c32f3e1c63c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:42.797095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ee577da-7411-44e6-b5ca-4c32f3e1c63c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:42.826327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8ee577da-7411-44e6-b5ca-4c32f3e1c63c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043046 Jul 26 18:39:42.826901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 821/1619] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:42 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:43.416504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2917f434-b51e-4ac2-8f5f-a307b0166cee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:43.419342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2917f434-b51e-4ac2-8f5f-a307b0166cee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:43.427662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2917f434-b51e-4ac2-8f5f-a307b0166cee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:43.428115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2917f434-b51e-4ac2-8f5f-a307b0166cee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:43.429262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2917f434-b51e-4ac2-8f5f-a307b0166cee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:43.429698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2917f434-b51e-4ac2-8f5f-a307b0166cee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:43.463479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2917f434-b51e-4ac2-8f5f-a307b0166cee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050845 Jul 26 18:39:43.464120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 799/1620] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:43 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:43.794411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6612f41c-6221-4381-9385-4800fc1a3fb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:43.795239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-10e29ddb-d71e-4b10-9197-80faca1adf86 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:43.796616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6612f41c-6221-4381-9385-4800fc1a3fb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:43.797372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-10e29ddb-d71e-4b10-9197-80faca1adf86 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:43.803553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6612f41c-6221-4381-9385-4800fc1a3fb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:43.803995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6612f41c-6221-4381-9385-4800fc1a3fb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:43.804150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10e29ddb-d71e-4b10-9197-80faca1adf86 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:43.804564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10e29ddb-d71e-4b10-9197-80faca1adf86 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:43.804848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6612f41c-6221-4381-9385-4800fc1a3fb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:43.805282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6612f41c-6221-4381-9385-4800fc1a3fb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:43.805436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10e29ddb-d71e-4b10-9197-80faca1adf86 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:43.805738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10e29ddb-d71e-4b10-9197-80faca1adf86 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:43.822448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:43.835538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-10e29ddb-d71e-4b10-9197-80faca1adf86 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044212 Jul 26 18:39:43.836120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 800/1621] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:43.836885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6612f41c-6221-4381-9385-4800fc1a3fb4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046435 Jul 26 18:39:43.837635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 822/1622] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:43 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:43.840989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6e5543ea-9dac-4aaa-9bf2-0936ccb4dea5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:43.843175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6e5543ea-9dac-4aaa-9bf2-0936ccb4dea5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:43.849424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e5543ea-9dac-4aaa-9bf2-0936ccb4dea5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:43.849869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e5543ea-9dac-4aaa-9bf2-0936ccb4dea5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:43.850627 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e5543ea-9dac-4aaa-9bf2-0936ccb4dea5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:43.851056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e5543ea-9dac-4aaa-9bf2-0936ccb4dea5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:43.880421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6e5543ea-9dac-4aaa-9bf2-0936ccb4dea5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043250 Jul 26 18:39:43.880962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 801/1623] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:43 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:44.480397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8d99658d-8ce8-49dd-92ad-ace74eee2adb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:44.482723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8d99658d-8ce8-49dd-92ad-ace74eee2adb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:44.489206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d99658d-8ce8-49dd-92ad-ace74eee2adb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:44.489654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d99658d-8ce8-49dd-92ad-ace74eee2adb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:44.490462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d99658d-8ce8-49dd-92ad-ace74eee2adb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:44.490898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d99658d-8ce8-49dd-92ad-ace74eee2adb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:44.520125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8d99658d-8ce8-49dd-92ad-ace74eee2adb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045409 Jul 26 18:39:44.520632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 823/1624] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:44 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:44.848464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-17abdde6-d12e-41f7-8d59-f53d41198202 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:44.849446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-18bd3612-381b-41fd-b9bb-8b4b2a914f1f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:44.850543 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-17abdde6-d12e-41f7-8d59-f53d41198202 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:44.851616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-18bd3612-381b-41fd-b9bb-8b4b2a914f1f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:44.857456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17abdde6-d12e-41f7-8d59-f53d41198202 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:44.857897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17abdde6-d12e-41f7-8d59-f53d41198202 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:44.858126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18bd3612-381b-41fd-b9bb-8b4b2a914f1f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:44.858576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18bd3612-381b-41fd-b9bb-8b4b2a914f1f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:44.858711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17abdde6-d12e-41f7-8d59-f53d41198202 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:44.859078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17abdde6-d12e-41f7-8d59-f53d41198202 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:44.859387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18bd3612-381b-41fd-b9bb-8b4b2a914f1f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:44.859819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18bd3612-381b-41fd-b9bb-8b4b2a914f1f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:44.891270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-18bd3612-381b-41fd-b9bb-8b4b2a914f1f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045676 Jul 26 18:39:44.895933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 824/1625] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:44 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:44.896105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-17abdde6-d12e-41f7-8d59-f53d41198202 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049812 Jul 26 18:39:44.896105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 802/1626] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:44 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:44.897148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fa007817-1415-4042-9660-3121d4ff1874 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:44.899324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fa007817-1415-4042-9660-3121d4ff1874 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:44.905760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa007817-1415-4042-9660-3121d4ff1874 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:44.906264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa007817-1415-4042-9660-3121d4ff1874 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:44.907110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa007817-1415-4042-9660-3121d4ff1874 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:44.907538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa007817-1415-4042-9660-3121d4ff1874 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:44.937624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fa007817-1415-4042-9660-3121d4ff1874 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044656 Jul 26 18:39:44.938184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 825/1627] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:44 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:45.532973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8cf8f484-eb34-46fb-abaf-2c28804b2c3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:45.535673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8cf8f484-eb34-46fb-abaf-2c28804b2c3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:45.541906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8cf8f484-eb34-46fb-abaf-2c28804b2c3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:45.542354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8cf8f484-eb34-46fb-abaf-2c28804b2c3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:45.543155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8cf8f484-eb34-46fb-abaf-2c28804b2c3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:45.543591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8cf8f484-eb34-46fb-abaf-2c28804b2c3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:45.574245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8cf8f484-eb34-46fb-abaf-2c28804b2c3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045291 Jul 26 18:39:45.574806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 803/1628] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:45 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:45.905223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bf6ec95f-319f-477e-8d7f-62b2213c6f12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:45.906104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9fb464c2-f9ae-4ed6-a210-570147c25d88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:45.908191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bf6ec95f-319f-477e-8d7f-62b2213c6f12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:45.908434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9fb464c2-f9ae-4ed6-a210-570147c25d88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:45.915363 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9fb464c2-f9ae-4ed6-a210-570147c25d88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:45.915808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9fb464c2-f9ae-4ed6-a210-570147c25d88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:45.916574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9fb464c2-f9ae-4ed6-a210-570147c25d88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:45.916854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf6ec95f-319f-477e-8d7f-62b2213c6f12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:45.917008 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9fb464c2-f9ae-4ed6-a210-570147c25d88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:45.917433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf6ec95f-319f-477e-8d7f-62b2213c6f12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:45.918192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf6ec95f-319f-477e-8d7f-62b2213c6f12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:45.918620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf6ec95f-319f-477e-8d7f-62b2213c6f12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:45.950156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bf6ec95f-319f-477e-8d7f-62b2213c6f12 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049710 Jul 26 18:39:45.954775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 826/1629] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:45 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:45.957988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9fb464c2-f9ae-4ed6-a210-570147c25d88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055975 Jul 26 18:39:45.958564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 804/1630] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:45.959672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ebb3bddb-24ec-41a7-b654-db9799c66b69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:45.961833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ebb3bddb-24ec-41a7-b654-db9799c66b69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:45.968140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ebb3bddb-24ec-41a7-b654-db9799c66b69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:45.968574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ebb3bddb-24ec-41a7-b654-db9799c66b69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:45.969333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ebb3bddb-24ec-41a7-b654-db9799c66b69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:45.969763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ebb3bddb-24ec-41a7-b654-db9799c66b69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:46.004320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ebb3bddb-24ec-41a7-b654-db9799c66b69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048252 Jul 26 18:39:46.004861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 827/1631] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:45 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:46.589855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b71639a2-0397-4383-9336-6a815e0299f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:46.592382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b71639a2-0397-4383-9336-6a815e0299f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:46.600299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b71639a2-0397-4383-9336-6a815e0299f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:46.600299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b71639a2-0397-4383-9336-6a815e0299f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:46.600299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b71639a2-0397-4383-9336-6a815e0299f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:46.600299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b71639a2-0397-4383-9336-6a815e0299f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:46.629607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b71639a2-0397-4383-9336-6a815e0299f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044659 Jul 26 18:39:46.630138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 805/1632] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:46 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:46.962197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e7e992af-cb7b-4599-834b-6be0c41732a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:46.964387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e7e992af-cb7b-4599-834b-6be0c41732a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:46.969978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7da288b1-6eab-4d6d-9daa-d1b32537809d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:46.971356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7e992af-cb7b-4599-834b-6be0c41732a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:46.971801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7e992af-cb7b-4599-834b-6be0c41732a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:46.972165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7da288b1-6eab-4d6d-9daa-d1b32537809d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:46.972569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7e992af-cb7b-4599-834b-6be0c41732a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:46.972999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7e992af-cb7b-4599-834b-6be0c41732a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:46.978987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7da288b1-6eab-4d6d-9daa-d1b32537809d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:46.979471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7da288b1-6eab-4d6d-9daa-d1b32537809d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:46.980241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7da288b1-6eab-4d6d-9daa-d1b32537809d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:46.980681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7da288b1-6eab-4d6d-9daa-d1b32537809d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:47.002650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e7e992af-cb7b-4599-834b-6be0c41732a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044521 Jul 26 18:39:47.003246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 828/1633] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:46 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:47.011046 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7da288b1-6eab-4d6d-9daa-d1b32537809d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045019 Jul 26 18:39:47.011741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 806/1634] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:47.017023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-de6d29ae-c63c-4ff4-8d44-04e5ce80d57d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:47.019169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-de6d29ae-c63c-4ff4-8d44-04e5ce80d57d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:47.025852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de6d29ae-c63c-4ff4-8d44-04e5ce80d57d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:47.026300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de6d29ae-c63c-4ff4-8d44-04e5ce80d57d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:47.027138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de6d29ae-c63c-4ff4-8d44-04e5ce80d57d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:47.027803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de6d29ae-c63c-4ff4-8d44-04e5ce80d57d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:47.060307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-de6d29ae-c63c-4ff4-8d44-04e5ce80d57d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047130 Jul 26 18:39:47.060857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 829/1635] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:47 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:47.642241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e61dc2b3-3f1f-4441-be08-3e37537fbaf1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:47.644519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e61dc2b3-3f1f-4441-be08-3e37537fbaf1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:47.651359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e61dc2b3-3f1f-4441-be08-3e37537fbaf1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:47.651887 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e61dc2b3-3f1f-4441-be08-3e37537fbaf1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:47.652668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e61dc2b3-3f1f-4441-be08-3e37537fbaf1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:47.653163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e61dc2b3-3f1f-4441-be08-3e37537fbaf1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:47.682003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e61dc2b3-3f1f-4441-be08-3e37537fbaf1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044059 Jul 26 18:39:47.682568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 807/1636] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:47 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:48.015493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fdff1db5-3572-43a2-835c-11d1f778569e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:48.017640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fdff1db5-3572-43a2-835c-11d1f778569e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:48.023909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d17f9809-98ca-45cb-82aa-170cc10ec7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:48.024944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdff1db5-3572-43a2-835c-11d1f778569e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:48.025390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdff1db5-3572-43a2-835c-11d1f778569e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:48.026061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d17f9809-98ca-45cb-82aa-170cc10ec7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:48.026214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdff1db5-3572-43a2-835c-11d1f778569e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:48.026570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdff1db5-3572-43a2-835c-11d1f778569e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:48.032687 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d17f9809-98ca-45cb-82aa-170cc10ec7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:48.033153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d17f9809-98ca-45cb-82aa-170cc10ec7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:48.033904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d17f9809-98ca-45cb-82aa-170cc10ec7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:48.034341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d17f9809-98ca-45cb-82aa-170cc10ec7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:48.055919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fdff1db5-3572-43a2-835c-11d1f778569e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Jul 26 18:39:48.056486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 830/1637] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:48 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:48.064574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d17f9809-98ca-45cb-82aa-170cc10ec7d8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045133 Jul 26 18:39:48.065150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 808/1638] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:48.072613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b24426cf-0c09-4ef7-a399-d8866aac0d0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:48.074846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b24426cf-0c09-4ef7-a399-d8866aac0d0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:48.081023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b24426cf-0c09-4ef7-a399-d8866aac0d0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:48.081469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b24426cf-0c09-4ef7-a399-d8866aac0d0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:48.082231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b24426cf-0c09-4ef7-a399-d8866aac0d0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:48.082668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b24426cf-0c09-4ef7-a399-d8866aac0d0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:48.111069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b24426cf-0c09-4ef7-a399-d8866aac0d0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042213 Jul 26 18:39:48.111602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 831/1639] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:48 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:48.693962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5dbe8eb6-2968-4958-8b69-91327b35eec3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:48.696214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5dbe8eb6-2968-4958-8b69-91327b35eec3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:48.704066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5dbe8eb6-2968-4958-8b69-91327b35eec3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:48.704526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5dbe8eb6-2968-4958-8b69-91327b35eec3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:48.705308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5dbe8eb6-2968-4958-8b69-91327b35eec3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:48.705748 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5dbe8eb6-2968-4958-8b69-91327b35eec3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:48.740399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5dbe8eb6-2968-4958-8b69-91327b35eec3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050354 Jul 26 18:39:48.741197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 809/1640] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:48 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:49.072703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-527cc71d-2340-443d-ab88-e8797a6aa3c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:49.075307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-527cc71d-2340-443d-ab88-e8797a6aa3c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:49.078288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7e91e1da-1eef-4e73-b06a-305f7d972298 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:49.080673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7e91e1da-1eef-4e73-b06a-305f7d972298 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:49.082250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-527cc71d-2340-443d-ab88-e8797a6aa3c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:49.082704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-527cc71d-2340-443d-ab88-e8797a6aa3c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:49.083522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-527cc71d-2340-443d-ab88-e8797a6aa3c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:49.083982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-527cc71d-2340-443d-ab88-e8797a6aa3c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:49.087546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e91e1da-1eef-4e73-b06a-305f7d972298 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:49.087957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e91e1da-1eef-4e73-b06a-305f7d972298 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:49.088743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e91e1da-1eef-4e73-b06a-305f7d972298 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:49.089169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e91e1da-1eef-4e73-b06a-305f7d972298 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:49.113611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-527cc71d-2340-443d-ab88-e8797a6aa3c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047544 Jul 26 18:39:49.114509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 832/1641] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:49 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:49.119174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7e91e1da-1eef-4e73-b06a-305f7d972298 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044775 Jul 26 18:39:49.123342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-19a0b883-3427-4f57-a3ae-05755fd35298 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:49.123860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 810/1642] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:49 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:49.125501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-19a0b883-3427-4f57-a3ae-05755fd35298 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:49.131852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19a0b883-3427-4f57-a3ae-05755fd35298 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:49.132292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19a0b883-3427-4f57-a3ae-05755fd35298 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:49.133048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19a0b883-3427-4f57-a3ae-05755fd35298 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:49.133472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19a0b883-3427-4f57-a3ae-05755fd35298 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:49.162715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-19a0b883-3427-4f57-a3ae-05755fd35298 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043222 Jul 26 18:39:49.163508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 833/1643] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:49 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:49.752961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e47ed4fe-21c5-4990-9fa2-db4549ead886 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:49.755170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e47ed4fe-21c5-4990-9fa2-db4549ead886 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:49.761746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e47ed4fe-21c5-4990-9fa2-db4549ead886 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:49.762206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e47ed4fe-21c5-4990-9fa2-db4549ead886 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:49.762981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e47ed4fe-21c5-4990-9fa2-db4549ead886 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:49.763447 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e47ed4fe-21c5-4990-9fa2-db4549ead886 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:49.795951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e47ed4fe-21c5-4990-9fa2-db4549ead886 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046782 Jul 26 18:39:49.796860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 811/1644] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:49 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:50.130402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5299bd6d-d879-4a1b-a194-b9060e56fba8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:50.133769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5299bd6d-d879-4a1b-a194-b9060e56fba8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:50.135782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-65f28e83-39e7-4aa3-a54e-2047eb352a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:50.139360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-65f28e83-39e7-4aa3-a54e-2047eb352a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:50.144956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5299bd6d-d879-4a1b-a194-b9060e56fba8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:50.145700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5299bd6d-d879-4a1b-a194-b9060e56fba8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:50.147459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5299bd6d-d879-4a1b-a194-b9060e56fba8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:50.148176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5299bd6d-d879-4a1b-a194-b9060e56fba8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:50.150497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65f28e83-39e7-4aa3-a54e-2047eb352a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:50.151294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65f28e83-39e7-4aa3-a54e-2047eb352a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:50.152325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65f28e83-39e7-4aa3-a54e-2047eb352a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:50.152756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-65f28e83-39e7-4aa3-a54e-2047eb352a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:50.181028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5299bd6d-d879-4a1b-a194-b9060e56fba8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057452 Jul 26 18:39:50.181855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 834/1645] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:50 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:50.182011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-65f28e83-39e7-4aa3-a54e-2047eb352a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052807 Jul 26 18:39:50.186427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 812/1646] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:50 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:50.186586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6cee82e8-aba3-4a8f-8ae3-99c0b34cf56d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:50.188349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6cee82e8-aba3-4a8f-8ae3-99c0b34cf56d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:50.194331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6cee82e8-aba3-4a8f-8ae3-99c0b34cf56d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:50.194777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6cee82e8-aba3-4a8f-8ae3-99c0b34cf56d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:50.195561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6cee82e8-aba3-4a8f-8ae3-99c0b34cf56d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:50.195993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6cee82e8-aba3-4a8f-8ae3-99c0b34cf56d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:50.224523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6cee82e8-aba3-4a8f-8ae3-99c0b34cf56d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041952 Jul 26 18:39:50.225057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 835/1647] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:50 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:50.809896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c20c2b00-0703-4198-9bfb-ddf7bee03ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:50.812087 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c20c2b00-0703-4198-9bfb-ddf7bee03ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:50.818300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c20c2b00-0703-4198-9bfb-ddf7bee03ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:50.818753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c20c2b00-0703-4198-9bfb-ddf7bee03ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:50.819548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c20c2b00-0703-4198-9bfb-ddf7bee03ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:50.819985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c20c2b00-0703-4198-9bfb-ddf7bee03ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:50.849866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c20c2b00-0703-4198-9bfb-ddf7bee03ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044360 Jul 26 18:39:50.850419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 813/1648] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:50 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:51.198057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ac985691-27db-4dcd-91bf-dd7fc9eb3038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:51.198833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0bf7a0dc-02ce-46b0-bd52-d30f8488edcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:51.200405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ac985691-27db-4dcd-91bf-dd7fc9eb3038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:51.200542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0bf7a0dc-02ce-46b0-bd52-d30f8488edcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:51.207173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bf7a0dc-02ce-46b0-bd52-d30f8488edcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:51.207364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac985691-27db-4dcd-91bf-dd7fc9eb3038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:51.207611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bf7a0dc-02ce-46b0-bd52-d30f8488edcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:51.207770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac985691-27db-4dcd-91bf-dd7fc9eb3038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:51.208376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bf7a0dc-02ce-46b0-bd52-d30f8488edcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:51.208513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac985691-27db-4dcd-91bf-dd7fc9eb3038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:51.208830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bf7a0dc-02ce-46b0-bd52-d30f8488edcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:51.208993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac985691-27db-4dcd-91bf-dd7fc9eb3038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:51.237901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ac985691-27db-4dcd-91bf-dd7fc9eb3038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046636 Jul 26 18:39:51.238417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0bf7a0dc-02ce-46b0-bd52-d30f8488edcd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046765 Jul 26 18:39:51.238575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 836/1649] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:51 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:51.243013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 814/1650] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:51.243195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-66b60415-117c-41dc-b37a-d71795c50c04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:51.245139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-66b60415-117c-41dc-b37a-d71795c50c04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:51.251170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66b60415-117c-41dc-b37a-d71795c50c04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:51.251611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66b60415-117c-41dc-b37a-d71795c50c04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:51.252369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66b60415-117c-41dc-b37a-d71795c50c04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:51.252807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66b60415-117c-41dc-b37a-d71795c50c04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:51.281876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-66b60415-117c-41dc-b37a-d71795c50c04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042444 Jul 26 18:39:51.282413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 837/1651] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:51 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:51.862064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8c7bdbb5-3bf7-4b2d-941b-01d92a7517f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:51.864535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8c7bdbb5-3bf7-4b2d-941b-01d92a7517f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:51.870650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbb5-3bf7-4b2d-941b-01d92a7517f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:51.871155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbb5-3bf7-4b2d-941b-01d92a7517f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:51.871939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbb5-3bf7-4b2d-941b-01d92a7517f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:51.872371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c7bdbb5-3bf7-4b2d-941b-01d92a7517f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:51.886872 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:51.905659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8c7bdbb5-3bf7-4b2d-941b-01d92a7517f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047512 Jul 26 18:39:51.906527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 815/1652] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:51 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:52.254184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e968b1a5-0d67-46d1-839a-da9ab899855b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:52.256319 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dafde315-f56a-458e-8d13-8ab44263d26d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:52.257895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e968b1a5-0d67-46d1-839a-da9ab899855b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:52.259764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dafde315-f56a-458e-8d13-8ab44263d26d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:52.269211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e968b1a5-0d67-46d1-839a-da9ab899855b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:52.269949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e968b1a5-0d67-46d1-839a-da9ab899855b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:52.270579 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dafde315-f56a-458e-8d13-8ab44263d26d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:52.271257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e968b1a5-0d67-46d1-839a-da9ab899855b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:52.271497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dafde315-f56a-458e-8d13-8ab44263d26d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:52.272307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e968b1a5-0d67-46d1-839a-da9ab899855b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:52.272932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dafde315-f56a-458e-8d13-8ab44263d26d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:52.273697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dafde315-f56a-458e-8d13-8ab44263d26d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:52.303966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e968b1a5-0d67-46d1-839a-da9ab899855b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056288 Jul 26 18:39:52.304175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dafde315-f56a-458e-8d13-8ab44263d26d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054635 Jul 26 18:39:52.304438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 838/1653] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:52.304876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 816/1654] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:52 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:52.309008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a4aa09e8-e78a-44d4-a923-6dd848386810 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:52.311137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a4aa09e8-e78a-44d4-a923-6dd848386810 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:52.317099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4aa09e8-e78a-44d4-a923-6dd848386810 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:52.317539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4aa09e8-e78a-44d4-a923-6dd848386810 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:52.318289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4aa09e8-e78a-44d4-a923-6dd848386810 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:52.318716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4aa09e8-e78a-44d4-a923-6dd848386810 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:52.322312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:52.347485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a4aa09e8-e78a-44d4-a923-6dd848386810 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042085 Jul 26 18:39:52.348042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 839/1655] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:52 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:52.922248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dcf540ca-69d3-46a8-98f2-0f651f944133 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:52.926265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dcf540ca-69d3-46a8-98f2-0f651f944133 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:52.935293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcf540ca-69d3-46a8-98f2-0f651f944133 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:52.935744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcf540ca-69d3-46a8-98f2-0f651f944133 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:52.936493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcf540ca-69d3-46a8-98f2-0f651f944133 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:52.936919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcf540ca-69d3-46a8-98f2-0f651f944133 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:52.976117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dcf540ca-69d3-46a8-98f2-0f651f944133 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060497 Jul 26 18:39:52.976946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 817/1656] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:52 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:53.317615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-66191940-6f99-4dba-855d-ad055774b4a3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:53.318260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-12970907-1ed9-4616-b9e2-ad6c80ddfac4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:53.320110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-66191940-6f99-4dba-855d-ad055774b4a3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:53.320401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-12970907-1ed9-4616-b9e2-ad6c80ddfac4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:53.327750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66191940-6f99-4dba-855d-ad055774b4a3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:53.327942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12970907-1ed9-4616-b9e2-ad6c80ddfac4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:53.328190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66191940-6f99-4dba-855d-ad055774b4a3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:53.328401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12970907-1ed9-4616-b9e2-ad6c80ddfac4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:53.328951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66191940-6f99-4dba-855d-ad055774b4a3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:53.329114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12970907-1ed9-4616-b9e2-ad6c80ddfac4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:53.329376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66191940-6f99-4dba-855d-ad055774b4a3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:53.329553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12970907-1ed9-4616-b9e2-ad6c80ddfac4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:53.358873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-66191940-6f99-4dba-855d-ad055774b4a3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045943 Jul 26 18:39:53.359247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-12970907-1ed9-4616-b9e2-ad6c80ddfac4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046023 Jul 26 18:39:53.359737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 840/1657] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:53.360950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 818/1658] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:53 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:53.364158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d2b9219c-efe5-44f6-ba4b-30e616b9559b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:53.366314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d2b9219c-efe5-44f6-ba4b-30e616b9559b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:53.372337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2b9219c-efe5-44f6-ba4b-30e616b9559b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:53.372776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2b9219c-efe5-44f6-ba4b-30e616b9559b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:53.373512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2b9219c-efe5-44f6-ba4b-30e616b9559b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:53.373939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2b9219c-efe5-44f6-ba4b-30e616b9559b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:53.403528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d2b9219c-efe5-44f6-ba4b-30e616b9559b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042890 Jul 26 18:39:53.404073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 841/1659] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:53 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:53.989273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-af524dff-3701-4d9b-903e-6ae6331005b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:53.991485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-af524dff-3701-4d9b-903e-6ae6331005b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:53.998162 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af524dff-3701-4d9b-903e-6ae6331005b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:53.998621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af524dff-3701-4d9b-903e-6ae6331005b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:53.999411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af524dff-3701-4d9b-903e-6ae6331005b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:53.999838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af524dff-3701-4d9b-903e-6ae6331005b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:54.034517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-af524dff-3701-4d9b-903e-6ae6331005b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049132 Jul 26 18:39:54.035198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 819/1660] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:53 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:54.373577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cef4de52-3004-4084-8861-ec5b4d909780 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:54.374113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1eff2add-3b6e-4525-9371-7225a564015f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:54.375718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cef4de52-3004-4084-8861-ec5b4d909780 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:54.375895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1eff2add-3b6e-4525-9371-7225a564015f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:54.382545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cef4de52-3004-4084-8861-ec5b4d909780 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:54.382773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1eff2add-3b6e-4525-9371-7225a564015f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:54.382996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1eff2add-3b6e-4525-9371-7225a564015f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:54.383170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cef4de52-3004-4084-8861-ec5b4d909780 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:54.383807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1eff2add-3b6e-4525-9371-7225a564015f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:54.383956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cef4de52-3004-4084-8861-ec5b4d909780 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:54.384239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cef4de52-3004-4084-8861-ec5b4d909780 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:54.384365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1eff2add-3b6e-4525-9371-7225a564015f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:54.415470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cef4de52-3004-4084-8861-ec5b4d909780 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046745 Jul 26 18:39:54.416043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 842/1661] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:54 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:54.416856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1eff2add-3b6e-4525-9371-7225a564015f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047588 Jul 26 18:39:54.421420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 820/1662] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:54.421566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3563c90d-00b5-411d-b532-ec81d05651e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:54.422689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3563c90d-00b5-411d-b532-ec81d05651e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:54.428731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3563c90d-00b5-411d-b532-ec81d05651e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:54.429175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3563c90d-00b5-411d-b532-ec81d05651e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:54.429907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3563c90d-00b5-411d-b532-ec81d05651e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:54.430368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3563c90d-00b5-411d-b532-ec81d05651e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:54.458307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3563c90d-00b5-411d-b532-ec81d05651e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041315 Jul 26 18:39:54.458895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 843/1663] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:54 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:55.046127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1665b17d-5ba8-422a-8cd9-53d336ac1d88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:55.048309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1665b17d-5ba8-422a-8cd9-53d336ac1d88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:55.054369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1665b17d-5ba8-422a-8cd9-53d336ac1d88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:55.054885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1665b17d-5ba8-422a-8cd9-53d336ac1d88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:55.055612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1665b17d-5ba8-422a-8cd9-53d336ac1d88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:55.056044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1665b17d-5ba8-422a-8cd9-53d336ac1d88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:55.085535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1665b17d-5ba8-422a-8cd9-53d336ac1d88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043608 Jul 26 18:39:55.086309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 821/1664] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:55 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:55.432384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-596b757d-efd0-425d-9516-2430568ed697 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:55.433250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fefa5559-0839-4b9d-81ed-a8ed2349e185 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:55.434672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-596b757d-efd0-425d-9516-2430568ed697 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:55.435157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fefa5559-0839-4b9d-81ed-a8ed2349e185 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:55.441667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-596b757d-efd0-425d-9516-2430568ed697 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:55.441843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fefa5559-0839-4b9d-81ed-a8ed2349e185 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:55.442115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-596b757d-efd0-425d-9516-2430568ed697 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:55.442272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fefa5559-0839-4b9d-81ed-a8ed2349e185 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:55.442915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-596b757d-efd0-425d-9516-2430568ed697 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:55.443097 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fefa5559-0839-4b9d-81ed-a8ed2349e185 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:55.443396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-596b757d-efd0-425d-9516-2430568ed697 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:55.443564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fefa5559-0839-4b9d-81ed-a8ed2349e185 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:55.474784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-596b757d-efd0-425d-9516-2430568ed697 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049155 Jul 26 18:39:55.475069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fefa5559-0839-4b9d-81ed-a8ed2349e185 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048560 Jul 26 18:39:55.475374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 844/1665] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:55 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:55.479569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 822/1666] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:55 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:55.479967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f10475e9-bfcf-4068-8fc0-84df38305ec2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:55.482103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f10475e9-bfcf-4068-8fc0-84df38305ec2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:55.487987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f10475e9-bfcf-4068-8fc0-84df38305ec2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:55.488445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f10475e9-bfcf-4068-8fc0-84df38305ec2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:55.489209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f10475e9-bfcf-4068-8fc0-84df38305ec2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:55.489646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f10475e9-bfcf-4068-8fc0-84df38305ec2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:55.518957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f10475e9-bfcf-4068-8fc0-84df38305ec2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042557 Jul 26 18:39:55.519561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 845/1667] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:55 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:56.193243 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-99a5bfac-7dcc-468a-a488-443eff8d8ba6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:56.195583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-99a5bfac-7dcc-468a-a488-443eff8d8ba6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:56.201788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99a5bfac-7dcc-468a-a488-443eff8d8ba6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:56.202235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99a5bfac-7dcc-468a-a488-443eff8d8ba6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:56.202997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99a5bfac-7dcc-468a-a488-443eff8d8ba6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:56.203456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99a5bfac-7dcc-468a-a488-443eff8d8ba6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:56.232255 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-99a5bfac-7dcc-468a-a488-443eff8d8ba6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136898 Jul 26 18:39:56.232806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 823/1668] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:56 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:56.487329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3718c8bf-de6e-435d-b647-1a6a58313ecb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:56.487924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-260b586d-d6cb-4930-9ffd-0615c92b5471 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:56.489591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3718c8bf-de6e-435d-b647-1a6a58313ecb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:56.489756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-260b586d-d6cb-4930-9ffd-0615c92b5471 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:56.496492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3718c8bf-de6e-435d-b647-1a6a58313ecb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:56.496658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-260b586d-d6cb-4930-9ffd-0615c92b5471 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:56.496944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3718c8bf-de6e-435d-b647-1a6a58313ecb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:56.497109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-260b586d-d6cb-4930-9ffd-0615c92b5471 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:56.497718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3718c8bf-de6e-435d-b647-1a6a58313ecb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:56.497873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-260b586d-d6cb-4930-9ffd-0615c92b5471 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:56.498145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-260b586d-d6cb-4930-9ffd-0615c92b5471 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:56.498295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3718c8bf-de6e-435d-b647-1a6a58313ecb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:56.527920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3718c8bf-de6e-435d-b647-1a6a58313ecb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044563 Jul 26 18:39:56.528522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 846/1669] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:56 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:56.529284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-260b586d-d6cb-4930-9ffd-0615c92b5471 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045963 Jul 26 18:39:56.529857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 824/1670] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:56 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:56.536297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0580758a-e962-41f8-868e-be57101dd27c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:56.538448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0580758a-e962-41f8-868e-be57101dd27c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:56.544676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0580758a-e962-41f8-868e-be57101dd27c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:56.545129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0580758a-e962-41f8-868e-be57101dd27c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:56.545895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0580758a-e962-41f8-868e-be57101dd27c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:56.546328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0580758a-e962-41f8-868e-be57101dd27c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:56.574809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0580758a-e962-41f8-868e-be57101dd27c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Jul 26 18:39:56.575367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 847/1671] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:56 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:57.244645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e9c46850-5734-4885-9852-32e4f1796604 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:57.246795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e9c46850-5734-4885-9852-32e4f1796604 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:57.248871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:57.254603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9c46850-5734-4885-9852-32e4f1796604 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:57.255055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9c46850-5734-4885-9852-32e4f1796604 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:57.255822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9c46850-5734-4885-9852-32e4f1796604 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:57.256248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9c46850-5734-4885-9852-32e4f1796604 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:57.286307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e9c46850-5734-4885-9852-32e4f1796604 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045726 Jul 26 18:39:57.286862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 825/1672] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:57 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:57.541008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5b102374-f182-4f7a-b333-8bb0d457f4f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:57.541497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-16678d2e-1f44-4f49-b6ae-0a81ef6f226c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:57.543302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5b102374-f182-4f7a-b333-8bb0d457f4f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:57.543621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-16678d2e-1f44-4f49-b6ae-0a81ef6f226c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:57.550118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16678d2e-1f44-4f49-b6ae-0a81ef6f226c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:57.550279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b102374-f182-4f7a-b333-8bb0d457f4f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:57.550571 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16678d2e-1f44-4f49-b6ae-0a81ef6f226c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:57.550686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b102374-f182-4f7a-b333-8bb0d457f4f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:57.551376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16678d2e-1f44-4f49-b6ae-0a81ef6f226c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:57.551483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b102374-f182-4f7a-b333-8bb0d457f4f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:57.551817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16678d2e-1f44-4f49-b6ae-0a81ef6f226c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:57.551920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b102374-f182-4f7a-b333-8bb0d457f4f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:57.581490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-16678d2e-1f44-4f49-b6ae-0a81ef6f226c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043840 Jul 26 18:39:57.581737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5b102374-f182-4f7a-b333-8bb0d457f4f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044537 Jul 26 18:39:57.585884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 826/1674] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:57 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:57.586105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 848/1674] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:57 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:57.591176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2eeafd63-e11d-4910-861c-07c79d26c328 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:57.593307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2eeafd63-e11d-4910-861c-07c79d26c328 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:57.599675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2eeafd63-e11d-4910-861c-07c79d26c328 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:57.600121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2eeafd63-e11d-4910-861c-07c79d26c328 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:57.600875 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2eeafd63-e11d-4910-861c-07c79d26c328 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:57.601309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2eeafd63-e11d-4910-861c-07c79d26c328 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:57.630082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2eeafd63-e11d-4910-861c-07c79d26c328 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042752 Jul 26 18:39:57.630628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 827/1675] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:57 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:58.298298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-331d312a-903a-48fc-bac4-96cfa7f75ebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:58.300498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-331d312a-903a-48fc-bac4-96cfa7f75ebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:58.306740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-331d312a-903a-48fc-bac4-96cfa7f75ebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:58.307231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-331d312a-903a-48fc-bac4-96cfa7f75ebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:58.308116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-331d312a-903a-48fc-bac4-96cfa7f75ebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:58.308554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-331d312a-903a-48fc-bac4-96cfa7f75ebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:58.338543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-331d312a-903a-48fc-bac4-96cfa7f75ebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044231 Jul 26 18:39:58.339236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 849/1676] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:58 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:58.597886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e5bc4f08-23ff-4bf8-a2f3-73b96247bd74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:58.598580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-60ac4ae7-13ed-467a-a8a1-b4eed83a8563 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:58.600957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e5bc4f08-23ff-4bf8-a2f3-73b96247bd74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:58.601178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-60ac4ae7-13ed-467a-a8a1-b4eed83a8563 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:58.609167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e5bc4f08-23ff-4bf8-a2f3-73b96247bd74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:58.609351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60ac4ae7-13ed-467a-a8a1-b4eed83a8563 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:58.609611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e5bc4f08-23ff-4bf8-a2f3-73b96247bd74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:58.609769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60ac4ae7-13ed-467a-a8a1-b4eed83a8563 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:58.610369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e5bc4f08-23ff-4bf8-a2f3-73b96247bd74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:58.610531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60ac4ae7-13ed-467a-a8a1-b4eed83a8563 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:58.610799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e5bc4f08-23ff-4bf8-a2f3-73b96247bd74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:58.610955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60ac4ae7-13ed-467a-a8a1-b4eed83a8563 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:58.639830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-60ac4ae7-13ed-467a-a8a1-b4eed83a8563 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048249 Jul 26 18:39:58.640368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 850/1677] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:58 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:58.641679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e5bc4f08-23ff-4bf8-a2f3-73b96247bd74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050424 Jul 26 18:39:58.642422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 828/1678] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:58.644870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b53fa495-4858-4abd-8b3c-ec7cbd15fd80 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:58.647333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b53fa495-4858-4abd-8b3c-ec7cbd15fd80 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:58.653334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b53fa495-4858-4abd-8b3c-ec7cbd15fd80 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:58.653782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b53fa495-4858-4abd-8b3c-ec7cbd15fd80 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:58.654539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b53fa495-4858-4abd-8b3c-ec7cbd15fd80 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:58.654977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b53fa495-4858-4abd-8b3c-ec7cbd15fd80 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:58.683468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b53fa495-4858-4abd-8b3c-ec7cbd15fd80 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042070 Jul 26 18:39:58.684202 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 851/1679] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:58 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:59.351192 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-496c42ff-7c74-429a-ad90-6a6685099bb3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:59.353350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-496c42ff-7c74-429a-ad90-6a6685099bb3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:59.359905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-496c42ff-7c74-429a-ad90-6a6685099bb3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:59.360291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-496c42ff-7c74-429a-ad90-6a6685099bb3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:59.361047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-496c42ff-7c74-429a-ad90-6a6685099bb3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:59.361538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-496c42ff-7c74-429a-ad90-6a6685099bb3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:59.390657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-496c42ff-7c74-429a-ad90-6a6685099bb3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043499 Jul 26 18:39:59.391231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 829/1680] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:59 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:59.655048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-41af7cd0-90d2-4031-83c6-d450b6caae66 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:59.656222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bae7b0a8-7063-4973-be45-6ab78b21a98e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:59.657558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-41af7cd0-90d2-4031-83c6-d450b6caae66 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:59.658695 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bae7b0a8-7063-4973-be45-6ab78b21a98e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:59.660240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:39:59.666549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41af7cd0-90d2-4031-83c6-d450b6caae66 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:59.666754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bae7b0a8-7063-4973-be45-6ab78b21a98e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:59.667063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41af7cd0-90d2-4031-83c6-d450b6caae66 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:59.667233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bae7b0a8-7063-4973-be45-6ab78b21a98e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:59.667973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41af7cd0-90d2-4031-83c6-d450b6caae66 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:59.668099 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bae7b0a8-7063-4973-be45-6ab78b21a98e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:59.668478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41af7cd0-90d2-4031-83c6-d450b6caae66 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:59.668611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bae7b0a8-7063-4973-be45-6ab78b21a98e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:59.699823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-41af7cd0-90d2-4031-83c6-d450b6caae66 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050301 Jul 26 18:39:59.700236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bae7b0a8-7063-4973-be45-6ab78b21a98e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048946 Jul 26 18:39:59.700389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 852/1681] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:59 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:39:59.700996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 830/1682] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:39:59 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:39:59.706937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-edbc982b-16dc-408e-a8be-efc13810684b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:39:59.709064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-edbc982b-16dc-408e-a8be-efc13810684b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:39:59.715052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-edbc982b-16dc-408e-a8be-efc13810684b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:59.715491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-edbc982b-16dc-408e-a8be-efc13810684b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:59.716234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-edbc982b-16dc-408e-a8be-efc13810684b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:39:59.716659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-edbc982b-16dc-408e-a8be-efc13810684b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:39:59.745987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-edbc982b-16dc-408e-a8be-efc13810684b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044608 Jul 26 18:39:59.746539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 853/1683] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:39:59 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:00.403646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0cb5a594-1169-4aeb-90e6-49ade99b3dfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:00.405792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0cb5a594-1169-4aeb-90e6-49ade99b3dfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:00.412132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cb5a594-1169-4aeb-90e6-49ade99b3dfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:00.412571 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cb5a594-1169-4aeb-90e6-49ade99b3dfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:00.413337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cb5a594-1169-4aeb-90e6-49ade99b3dfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:00.413719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cb5a594-1169-4aeb-90e6-49ade99b3dfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:00.443328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0cb5a594-1169-4aeb-90e6-49ade99b3dfa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Jul 26 18:40:00.443886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 831/1684] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:00 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:00.715572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-965238f4-7c1d-4a6e-b9c6-972277cdf6b0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:00.716143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-48c113c9-9f7b-45b8-986e-046819e8212a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:00.717737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-965238f4-7c1d-4a6e-b9c6-972277cdf6b0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:00.717883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-48c113c9-9f7b-45b8-986e-046819e8212a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:00.724527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-48c113c9-9f7b-45b8-986e-046819e8212a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:00.724718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-965238f4-7c1d-4a6e-b9c6-972277cdf6b0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:00.724980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-48c113c9-9f7b-45b8-986e-046819e8212a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:00.725129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-965238f4-7c1d-4a6e-b9c6-972277cdf6b0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:00.725741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-48c113c9-9f7b-45b8-986e-046819e8212a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:00.725888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-965238f4-7c1d-4a6e-b9c6-972277cdf6b0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:00.726176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-48c113c9-9f7b-45b8-986e-046819e8212a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:00.726324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-965238f4-7c1d-4a6e-b9c6-972277cdf6b0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:00.729856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:00.755944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-965238f4-7c1d-4a6e-b9c6-972277cdf6b0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046059 Jul 26 18:40:00.756518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 854/1685] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:00 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:00.757633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-48c113c9-9f7b-45b8-986e-046819e8212a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047708 Jul 26 18:40:00.762461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 832/1686] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:00 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:00.762629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6636550d-d354-455d-b8f7-8e8f12209a30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:00.763412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6636550d-d354-455d-b8f7-8e8f12209a30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:00.769597 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6636550d-d354-455d-b8f7-8e8f12209a30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:00.770051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6636550d-d354-455d-b8f7-8e8f12209a30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:00.770822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6636550d-d354-455d-b8f7-8e8f12209a30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:00.771296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6636550d-d354-455d-b8f7-8e8f12209a30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:00.796377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:00.801165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6636550d-d354-455d-b8f7-8e8f12209a30 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Jul 26 18:40:00.801701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 855/1687] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:00 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:01.455640 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d69f3d60-17a3-472c-8911-a10e51d29d7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:01.457843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d69f3d60-17a3-472c-8911-a10e51d29d7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:01.464135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d69f3d60-17a3-472c-8911-a10e51d29d7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:01.464551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d69f3d60-17a3-472c-8911-a10e51d29d7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:01.465202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d69f3d60-17a3-472c-8911-a10e51d29d7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:01.465642 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d69f3d60-17a3-472c-8911-a10e51d29d7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:01.494456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d69f3d60-17a3-472c-8911-a10e51d29d7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042780 Jul 26 18:40:01.495045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 833/1688] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:01 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:01.770102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c8501b9e-5df3-4824-9b6c-4a9de53c4fce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:01.770926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ec2a358f-abdd-4312-8005-b40c815ce481 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:01.773034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c8501b9e-5df3-4824-9b6c-4a9de53c4fce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:01.773745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ec2a358f-abdd-4312-8005-b40c815ce481 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:01.781066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8501b9e-5df3-4824-9b6c-4a9de53c4fce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:01.781536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec2a358f-abdd-4312-8005-b40c815ce481 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:01.781704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8501b9e-5df3-4824-9b6c-4a9de53c4fce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:01.782483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8501b9e-5df3-4824-9b6c-4a9de53c4fce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:01.782640 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec2a358f-abdd-4312-8005-b40c815ce481 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:01.783085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8501b9e-5df3-4824-9b6c-4a9de53c4fce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:01.783575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec2a358f-abdd-4312-8005-b40c815ce481 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:01.784105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec2a358f-abdd-4312-8005-b40c815ce481 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:01.815293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ec2a358f-abdd-4312-8005-b40c815ce481 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048936 Jul 26 18:40:01.815555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c8501b9e-5df3-4824-9b6c-4a9de53c4fce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050317 Jul 26 18:40:01.815857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 834/1689] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:01 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:01.816257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 856/1690] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:01 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:01.820320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a34a592d-d357-472a-8300-41d089140488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:01.822513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a34a592d-d357-472a-8300-41d089140488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:01.828481 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a34a592d-d357-472a-8300-41d089140488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:01.828923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a34a592d-d357-472a-8300-41d089140488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:01.829667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a34a592d-d357-472a-8300-41d089140488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:01.830093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a34a592d-d357-472a-8300-41d089140488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:01.859949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a34a592d-d357-472a-8300-41d089140488 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043117 Jul 26 18:40:01.860498 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 835/1691] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:01 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:02.509831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-042f72bd-eeb8-4961-91a7-8e6206ff1d3e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:02.512566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-042f72bd-eeb8-4961-91a7-8e6206ff1d3e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:02.518724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-042f72bd-eeb8-4961-91a7-8e6206ff1d3e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:02.519209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-042f72bd-eeb8-4961-91a7-8e6206ff1d3e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:02.519989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-042f72bd-eeb8-4961-91a7-8e6206ff1d3e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:02.520677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-042f72bd-eeb8-4961-91a7-8e6206ff1d3e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:02.551752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-042f72bd-eeb8-4961-91a7-8e6206ff1d3e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048500 Jul 26 18:40:02.552329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 857/1692] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:02.829153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ab4a9733-c45a-40db-86f0-efdd913579d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:02.831856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ab4a9733-c45a-40db-86f0-efdd913579d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:02.832807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4d1dc691-68f9-45ce-abb6-b05cdbcae1e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:02.835716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4d1dc691-68f9-45ce-abb6-b05cdbcae1e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:02.840054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab4a9733-c45a-40db-86f0-efdd913579d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:02.840500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab4a9733-c45a-40db-86f0-efdd913579d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:02.841269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab4a9733-c45a-40db-86f0-efdd913579d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:02.841699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab4a9733-c45a-40db-86f0-efdd913579d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:02.842417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d1dc691-68f9-45ce-abb6-b05cdbcae1e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:02.842858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d1dc691-68f9-45ce-abb6-b05cdbcae1e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:02.843686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d1dc691-68f9-45ce-abb6-b05cdbcae1e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:02.844114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d1dc691-68f9-45ce-abb6-b05cdbcae1e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:02.871900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ab4a9733-c45a-40db-86f0-efdd913579d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047605 Jul 26 18:40:02.872679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 836/1693] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:02 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:02.872827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4d1dc691-68f9-45ce-abb6-b05cdbcae1e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 Jul 26 18:40:02.873546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 858/1694] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:02 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:02.877918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-42ff6932-3fdf-4bec-9a8a-5920be5e9a69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:02.880127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-42ff6932-3fdf-4bec-9a8a-5920be5e9a69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:02.886238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42ff6932-3fdf-4bec-9a8a-5920be5e9a69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:02.886679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42ff6932-3fdf-4bec-9a8a-5920be5e9a69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:02.887468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42ff6932-3fdf-4bec-9a8a-5920be5e9a69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:02.887898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42ff6932-3fdf-4bec-9a8a-5920be5e9a69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:02.916667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-42ff6932-3fdf-4bec-9a8a-5920be5e9a69 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042462 Jul 26 18:40:02.917239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 837/1695] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:02 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:03.568733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9587e37c-93a1-4249-a76e-5760e48b7377 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:03.572273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9587e37c-93a1-4249-a76e-5760e48b7377 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:03.582726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9587e37c-93a1-4249-a76e-5760e48b7377 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:03.583653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9587e37c-93a1-4249-a76e-5760e48b7377 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:03.584917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9587e37c-93a1-4249-a76e-5760e48b7377 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:03.585693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9587e37c-93a1-4249-a76e-5760e48b7377 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:03.615790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9587e37c-93a1-4249-a76e-5760e48b7377 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054007 Jul 26 18:40:03.619447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 859/1696] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:03 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:03.887947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-686d1fc2-c52e-4d94-99c9-57db1da2a5e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:03.888517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-22713c3c-898a-4c8d-98c0-625c45a748a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:03.890141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-686d1fc2-c52e-4d94-99c9-57db1da2a5e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:03.890322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-22713c3c-898a-4c8d-98c0-625c45a748a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:03.897323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-22713c3c-898a-4c8d-98c0-625c45a748a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:03.897632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-686d1fc2-c52e-4d94-99c9-57db1da2a5e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:03.897799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-22713c3c-898a-4c8d-98c0-625c45a748a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:03.898132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-686d1fc2-c52e-4d94-99c9-57db1da2a5e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:03.898571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-22713c3c-898a-4c8d-98c0-625c45a748a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:03.898934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-686d1fc2-c52e-4d94-99c9-57db1da2a5e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:03.899130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-22713c3c-898a-4c8d-98c0-625c45a748a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:03.899424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-686d1fc2-c52e-4d94-99c9-57db1da2a5e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:03.929627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-22713c3c-898a-4c8d-98c0-625c45a748a5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047249 Jul 26 18:40:03.929891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-686d1fc2-c52e-4d94-99c9-57db1da2a5e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047482 Jul 26 18:40:03.930424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 860/1697] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:03 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 18:40:03.930556 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 838/1698] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:03 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:03.934944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-37372a3d-ce1a-4bb3-b57f-6561a8daa820 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:03.937063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-37372a3d-ce1a-4bb3-b57f-6561a8daa820 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:03.943338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37372a3d-ce1a-4bb3-b57f-6561a8daa820 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:03.943785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37372a3d-ce1a-4bb3-b57f-6561a8daa820 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:03.944526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37372a3d-ce1a-4bb3-b57f-6561a8daa820 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:03.944964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37372a3d-ce1a-4bb3-b57f-6561a8daa820 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:03.973375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-37372a3d-ce1a-4bb3-b57f-6561a8daa820 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042254 Jul 26 18:40:03.973916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 861/1699] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:03 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:04.629887 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-235ffc51-95c6-421b-b469-3ff27aeab54c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:04.632438 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-235ffc51-95c6-421b-b469-3ff27aeab54c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:04.639715 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-235ffc51-95c6-421b-b469-3ff27aeab54c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:04.640170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-235ffc51-95c6-421b-b469-3ff27aeab54c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:04.640931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-235ffc51-95c6-421b-b469-3ff27aeab54c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:04.641406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-235ffc51-95c6-421b-b469-3ff27aeab54c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:04.672708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-235ffc51-95c6-421b-b469-3ff27aeab54c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047544 Jul 26 18:40:04.673260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 839/1700] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:04 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:04.943462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0a2207d2-fb3d-47c2-bedc-bf353ceb2cd0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:04.944240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-eb6d0112-42ec-4acf-8db6-bd7b85f2a8e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:04.945993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0a2207d2-fb3d-47c2-bedc-bf353ceb2cd0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:04.946300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-eb6d0112-42ec-4acf-8db6-bd7b85f2a8e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:04.954241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb6d0112-42ec-4acf-8db6-bd7b85f2a8e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:04.954441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a2207d2-fb3d-47c2-bedc-bf353ceb2cd0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:04.954796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb6d0112-42ec-4acf-8db6-bd7b85f2a8e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:04.955010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a2207d2-fb3d-47c2-bedc-bf353ceb2cd0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:04.955791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb6d0112-42ec-4acf-8db6-bd7b85f2a8e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:04.955972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a2207d2-fb3d-47c2-bedc-bf353ceb2cd0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:04.956330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb6d0112-42ec-4acf-8db6-bd7b85f2a8e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:04.956529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a2207d2-fb3d-47c2-bedc-bf353ceb2cd0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:04.987541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0a2207d2-fb3d-47c2-bedc-bf353ceb2cd0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048957 Jul 26 18:40:04.987979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-eb6d0112-42ec-4acf-8db6-bd7b85f2a8e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049436 Jul 26 18:40:04.988141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 840/1701] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:04 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:04.988703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 862/1702] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:04 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:04.992651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7e7dbaba-71cd-4d04-912b-7e81ed65c551 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:04.994783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7e7dbaba-71cd-4d04-912b-7e81ed65c551 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:05.000826 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e7dbaba-71cd-4d04-912b-7e81ed65c551 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:05.001267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e7dbaba-71cd-4d04-912b-7e81ed65c551 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:05.002034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e7dbaba-71cd-4d04-912b-7e81ed65c551 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:05.002462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e7dbaba-71cd-4d04-912b-7e81ed65c551 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:05.031596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7e7dbaba-71cd-4d04-912b-7e81ed65c551 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042497 Jul 26 18:40:05.032434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 841/1703] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:04 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:05.689438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-89e2383d-f406-485f-adc7-826011659a63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:05.693645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-89e2383d-f406-485f-adc7-826011659a63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:05.702986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89e2383d-f406-485f-adc7-826011659a63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:05.703889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89e2383d-f406-485f-adc7-826011659a63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:05.705209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89e2383d-f406-485f-adc7-826011659a63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:05.705947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89e2383d-f406-485f-adc7-826011659a63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:05.738431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-89e2383d-f406-485f-adc7-826011659a63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055763 Jul 26 18:40:05.739223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 863/1704] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:05 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:06.003978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0970a171-408f-4652-a231-77ab6458e6ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:06.004877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-db4885c5-cf6e-4c5a-9d2c-5ce33ebeb9f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:06.007479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0970a171-408f-4652-a231-77ab6458e6ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:06.009178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-db4885c5-cf6e-4c5a-9d2c-5ce33ebeb9f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:06.015619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0970a171-408f-4652-a231-77ab6458e6ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:06.016064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0970a171-408f-4652-a231-77ab6458e6ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:06.016635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db4885c5-cf6e-4c5a-9d2c-5ce33ebeb9f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:06.016847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0970a171-408f-4652-a231-77ab6458e6ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:06.017088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db4885c5-cf6e-4c5a-9d2c-5ce33ebeb9f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:06.022352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0970a171-408f-4652-a231-77ab6458e6ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:06.026571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db4885c5-cf6e-4c5a-9d2c-5ce33ebeb9f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:06.026571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db4885c5-cf6e-4c5a-9d2c-5ce33ebeb9f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:06.047689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0970a171-408f-4652-a231-77ab6458e6ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049766 Jul 26 18:40:06.051449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 842/1705] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:05 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:06.052839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-db4885c5-cf6e-4c5a-9d2c-5ce33ebeb9f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055274 Jul 26 18:40:06.053416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 864/1706] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:06.056508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-28540447-b718-4b7f-9ee3-23d1b81cfc70 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:06.058632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-28540447-b718-4b7f-9ee3-23d1b81cfc70 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:06.066085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-28540447-b718-4b7f-9ee3-23d1b81cfc70 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:06.066543 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-28540447-b718-4b7f-9ee3-23d1b81cfc70 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:06.067684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-28540447-b718-4b7f-9ee3-23d1b81cfc70 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:06.068121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-28540447-b718-4b7f-9ee3-23d1b81cfc70 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:06.097063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-28540447-b718-4b7f-9ee3-23d1b81cfc70 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044574 Jul 26 18:40:06.097613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 843/1707] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:06 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:06.755574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ab012883-08c9-4aee-be40-20d714393b4d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:06.759088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ab012883-08c9-4aee-be40-20d714393b4d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:06.766378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab012883-08c9-4aee-be40-20d714393b4d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:06.766825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab012883-08c9-4aee-be40-20d714393b4d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:06.767615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab012883-08c9-4aee-be40-20d714393b4d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:06.768043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab012883-08c9-4aee-be40-20d714393b4d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:06.800644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ab012883-08c9-4aee-be40-20d714393b4d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051901 Jul 26 18:40:06.801211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 865/1708] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:06 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:07.064091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-577e3aa0-7240-4157-a1c3-a67fff393809 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:07.067455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-577e3aa0-7240-4157-a1c3-a67fff393809 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:07.069112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ca750a85-c87a-4e00-9f14-ac8ba57e51c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:07.073060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ca750a85-c87a-4e00-9f14-ac8ba57e51c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:07.077873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-577e3aa0-7240-4157-a1c3-a67fff393809 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:07.078668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-577e3aa0-7240-4157-a1c3-a67fff393809 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:07.079867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-577e3aa0-7240-4157-a1c3-a67fff393809 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:07.080020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca750a85-c87a-4e00-9f14-ac8ba57e51c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:07.080415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-577e3aa0-7240-4157-a1c3-a67fff393809 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:07.080561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca750a85-c87a-4e00-9f14-ac8ba57e51c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:07.081277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca750a85-c87a-4e00-9f14-ac8ba57e51c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:07.081700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca750a85-c87a-4e00-9f14-ac8ba57e51c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:07.112736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ca750a85-c87a-4e00-9f14-ac8ba57e51c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050167 Jul 26 18:40:07.113202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-577e3aa0-7240-4157-a1c3-a67fff393809 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056276 Jul 26 18:40:07.113343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 866/1709] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:07.113924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 844/1710] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:07 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:07.120901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fd7737a2-4227-4a4e-8889-47729ed1c064 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:07.123015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fd7737a2-4227-4a4e-8889-47729ed1c064 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:07.129168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd7737a2-4227-4a4e-8889-47729ed1c064 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:07.129604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd7737a2-4227-4a4e-8889-47729ed1c064 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:07.130354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd7737a2-4227-4a4e-8889-47729ed1c064 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:07.130756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fd7737a2-4227-4a4e-8889-47729ed1c064 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:07.159110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fd7737a2-4227-4a4e-8889-47729ed1c064 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044792 Jul 26 18:40:07.159669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 867/1711] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:07 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:07.814090 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-83792f4d-8323-4e78-987a-b2e2962cde4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:07.816400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-83792f4d-8323-4e78-987a-b2e2962cde4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:07.823689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83792f4d-8323-4e78-987a-b2e2962cde4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:07.824134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83792f4d-8323-4e78-987a-b2e2962cde4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:07.825312 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83792f4d-8323-4e78-987a-b2e2962cde4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:07.825312 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83792f4d-8323-4e78-987a-b2e2962cde4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:07.855438 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-83792f4d-8323-4e78-987a-b2e2962cde4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045787 Jul 26 18:40:07.856303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 845/1712] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:07 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:08.129299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9b8fe899-02fa-40ef-891d-2705026428d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:08.130125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a9302399-371c-4273-b8d6-1d238d67bdeb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:08.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9b8fe899-02fa-40ef-891d-2705026428d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:08.133002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a9302399-371c-4273-b8d6-1d238d67bdeb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:08.143475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9b8fe899-02fa-40ef-891d-2705026428d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:08.143793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a9302399-371c-4273-b8d6-1d238d67bdeb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:08.144212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9b8fe899-02fa-40ef-891d-2705026428d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:08.144510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a9302399-371c-4273-b8d6-1d238d67bdeb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:08.145470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9b8fe899-02fa-40ef-891d-2705026428d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:08.145716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a9302399-371c-4273-b8d6-1d238d67bdeb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:08.146176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9b8fe899-02fa-40ef-891d-2705026428d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:08.146420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a9302399-371c-4273-b8d6-1d238d67bdeb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:08.178164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9b8fe899-02fa-40ef-891d-2705026428d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055568 Jul 26 18:40:08.178695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 868/1713] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:08 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:08.179381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a9302399-371c-4273-b8d6-1d238d67bdeb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056442 Jul 26 18:40:08.179979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 846/1714] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:08 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:40:08.183763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4e7ba603-4273-44c8-93d0-f19f3ed8085c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:08.185874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4e7ba603-4273-44c8-93d0-f19f3ed8085c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:08.191776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4e7ba603-4273-44c8-93d0-f19f3ed8085c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:08.192218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4e7ba603-4273-44c8-93d0-f19f3ed8085c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:08.192966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4e7ba603-4273-44c8-93d0-f19f3ed8085c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:08.193387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4e7ba603-4273-44c8-93d0-f19f3ed8085c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:08.221772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4e7ba603-4273-44c8-93d0-f19f3ed8085c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042032 Jul 26 18:40:08.222318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 869/1715] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:08 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:08.868369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b15804f6-e77a-4f4e-9911-f3d1d5e83a03 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:08.870648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b15804f6-e77a-4f4e-9911-f3d1d5e83a03 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:08.877136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b15804f6-e77a-4f4e-9911-f3d1d5e83a03 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:08.877607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b15804f6-e77a-4f4e-9911-f3d1d5e83a03 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:08.878467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b15804f6-e77a-4f4e-9911-f3d1d5e83a03 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:08.878931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b15804f6-e77a-4f4e-9911-f3d1d5e83a03 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:08.909495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b15804f6-e77a-4f4e-9911-f3d1d5e83a03 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045408 Jul 26 18:40:08.910075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 847/1716] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:09.193634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7eb1718d-f3cd-47de-89c8-a3f26c1c48c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:09.194382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2cc0707b-4f62-4671-a643-53a865e3d759 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:09.196621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7eb1718d-f3cd-47de-89c8-a3f26c1c48c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:09.197514 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2cc0707b-4f62-4671-a643-53a865e3d759 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:09.204265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7eb1718d-f3cd-47de-89c8-a3f26c1c48c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:09.204601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2cc0707b-4f62-4671-a643-53a865e3d759 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:09.204734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7eb1718d-f3cd-47de-89c8-a3f26c1c48c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:09.205054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2cc0707b-4f62-4671-a643-53a865e3d759 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:09.205460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7eb1718d-f3cd-47de-89c8-a3f26c1c48c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:09.205828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2cc0707b-4f62-4671-a643-53a865e3d759 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:09.205947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7eb1718d-f3cd-47de-89c8-a3f26c1c48c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:09.206241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2cc0707b-4f62-4671-a643-53a865e3d759 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:09.231253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:09.235952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7eb1718d-f3cd-47de-89c8-a3f26c1c48c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047952 Jul 26 18:40:09.236516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 870/1717] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:09 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:09.236678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2cc0707b-4f62-4671-a643-53a865e3d759 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047811 Jul 26 18:40:09.237290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 848/1718] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:09 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:09.241096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-254c9f91-7bdf-4c57-ad2d-9a0bda825efd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:09.243276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-254c9f91-7bdf-4c57-ad2d-9a0bda825efd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:09.249399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-254c9f91-7bdf-4c57-ad2d-9a0bda825efd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:09.249843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-254c9f91-7bdf-4c57-ad2d-9a0bda825efd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:09.250610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-254c9f91-7bdf-4c57-ad2d-9a0bda825efd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:09.251056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-254c9f91-7bdf-4c57-ad2d-9a0bda825efd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:09.279830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-254c9f91-7bdf-4c57-ad2d-9a0bda825efd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042339 Jul 26 18:40:09.280388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 871/1719] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:09 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:09.926752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-355ba633-b085-49d1-907f-813474b5a874 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:09.930303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-355ba633-b085-49d1-907f-813474b5a874 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:09.940767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-355ba633-b085-49d1-907f-813474b5a874 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:09.942197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-355ba633-b085-49d1-907f-813474b5a874 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:09.942783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-355ba633-b085-49d1-907f-813474b5a874 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:09.943579 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-355ba633-b085-49d1-907f-813474b5a874 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:09.975694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-355ba633-b085-49d1-907f-813474b5a874 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056032 Jul 26 18:40:09.976249 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 849/1720] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:09 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:10.252399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0ccedcb1-f060-4fc3-9619-b3b1e41169d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:10.253314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f5beda24-1ed3-4330-95a5-7cffdc1b5301 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:10.255886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0ccedcb1-f060-4fc3-9619-b3b1e41169d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:10.256794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f5beda24-1ed3-4330-95a5-7cffdc1b5301 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:10.267882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5beda24-1ed3-4330-95a5-7cffdc1b5301 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:10.268219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ccedcb1-f060-4fc3-9619-b3b1e41169d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:10.268635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5beda24-1ed3-4330-95a5-7cffdc1b5301 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:10.268893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ccedcb1-f060-4fc3-9619-b3b1e41169d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:10.269897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5beda24-1ed3-4330-95a5-7cffdc1b5301 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:10.270137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ccedcb1-f060-4fc3-9619-b3b1e41169d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:10.270612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5beda24-1ed3-4330-95a5-7cffdc1b5301 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:10.270852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ccedcb1-f060-4fc3-9619-b3b1e41169d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:10.290172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:10.303420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f5beda24-1ed3-4330-95a5-7cffdc1b5301 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056596 Jul 26 18:40:10.303641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0ccedcb1-f060-4fc3-9619-b3b1e41169d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057804 Jul 26 18:40:10.303988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 850/1721] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:10.304339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 872/1722] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:10 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:10.311791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3e833142-52af-45d6-b0a3-73050a4cabfc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:10.313909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3e833142-52af-45d6-b0a3-73050a4cabfc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:10.319712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3e833142-52af-45d6-b0a3-73050a4cabfc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:10.320165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3e833142-52af-45d6-b0a3-73050a4cabfc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:10.320895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3e833142-52af-45d6-b0a3-73050a4cabfc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:10.321394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3e833142-52af-45d6-b0a3-73050a4cabfc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:10.349663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3e833142-52af-45d6-b0a3-73050a4cabfc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041512 Jul 26 18:40:10.350196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 851/1723] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:10 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:10.991797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0f82711b-ffe6-48cc-916d-47cab06229d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:10.995318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f82711b-ffe6-48cc-916d-47cab06229d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:11.001734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f82711b-ffe6-48cc-916d-47cab06229d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:11.002203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f82711b-ffe6-48cc-916d-47cab06229d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:11.002962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f82711b-ffe6-48cc-916d-47cab06229d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:11.003426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f82711b-ffe6-48cc-916d-47cab06229d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:11.034068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0f82711b-ffe6-48cc-916d-47cab06229d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048967 Jul 26 18:40:11.034629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 873/1724] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:10 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:11.320156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f1972127-e23b-4ab4-80c0-7b50a71a6167 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:11.320986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c06b5645-1acf-4cd2-982a-b4de05967c10 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:11.323452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f1972127-e23b-4ab4-80c0-7b50a71a6167 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:11.323620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c06b5645-1acf-4cd2-982a-b4de05967c10 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:11.330308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c06b5645-1acf-4cd2-982a-b4de05967c10 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:11.330488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1972127-e23b-4ab4-80c0-7b50a71a6167 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:11.330750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1972127-e23b-4ab4-80c0-7b50a71a6167 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:11.330908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c06b5645-1acf-4cd2-982a-b4de05967c10 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:11.331542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1972127-e23b-4ab4-80c0-7b50a71a6167 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:11.331687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c06b5645-1acf-4cd2-982a-b4de05967c10 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:11.331967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c06b5645-1acf-4cd2-982a-b4de05967c10 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:11.332134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1972127-e23b-4ab4-80c0-7b50a71a6167 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:11.361632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f1972127-e23b-4ab4-80c0-7b50a71a6167 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048207 Jul 26 18:40:11.363569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 852/1725] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:11.367454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c06b5645-1acf-4cd2-982a-b4de05967c10 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049624 Jul 26 18:40:11.367454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 874/1726] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:11 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:11.367882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6ea7eaef-2655-4efd-971d-932e4bb88760 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:11.369599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6ea7eaef-2655-4efd-971d-932e4bb88760 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:11.377170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ea7eaef-2655-4efd-971d-932e4bb88760 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:11.377616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ea7eaef-2655-4efd-971d-932e4bb88760 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:11.378551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ea7eaef-2655-4efd-971d-932e4bb88760 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:11.379216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ea7eaef-2655-4efd-971d-932e4bb88760 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:11.407970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6ea7eaef-2655-4efd-971d-932e4bb88760 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Jul 26 18:40:11.408526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 853/1727] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:11 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:12.048068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-83b9d0b2-c356-438f-84d3-2a1623e874f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:12.050498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-83b9d0b2-c356-438f-84d3-2a1623e874f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:12.058101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83b9d0b2-c356-438f-84d3-2a1623e874f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:12.058557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83b9d0b2-c356-438f-84d3-2a1623e874f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:12.059490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83b9d0b2-c356-438f-84d3-2a1623e874f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:12.060002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83b9d0b2-c356-438f-84d3-2a1623e874f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:12.092993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-83b9d0b2-c356-438f-84d3-2a1623e874f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049802 Jul 26 18:40:12.093555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 875/1728] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:12 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:12.377330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0a6dd29d-f53b-4546-a987-d3469d3d9e6e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:12.378111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1a4b5550-b3fb-48c7-8e37-dad367ad246a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:12.379597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0a6dd29d-f53b-4546-a987-d3469d3d9e6e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:12.380259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1a4b5550-b3fb-48c7-8e37-dad367ad246a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:12.386783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a6dd29d-f53b-4546-a987-d3469d3d9e6e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:12.386979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a4b5550-b3fb-48c7-8e37-dad367ad246a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:12.387262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a6dd29d-f53b-4546-a987-d3469d3d9e6e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:12.387418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a4b5550-b3fb-48c7-8e37-dad367ad246a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:12.388029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a6dd29d-f53b-4546-a987-d3469d3d9e6e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:12.388175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a4b5550-b3fb-48c7-8e37-dad367ad246a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:12.388448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a6dd29d-f53b-4546-a987-d3469d3d9e6e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:12.389179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a4b5550-b3fb-48c7-8e37-dad367ad246a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:12.418357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1a4b5550-b3fb-48c7-8e37-dad367ad246a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044217 Jul 26 18:40:12.418929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 876/1729] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:12 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:12.419960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0a6dd29d-f53b-4546-a987-d3469d3d9e6e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047045 Jul 26 18:40:12.424747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 854/1730] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:12 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:12.424908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ad9242b6-6f79-4a68-b7d9-a8d9ddb72a2f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:12.425663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ad9242b6-6f79-4a68-b7d9-a8d9ddb72a2f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:12.431693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad9242b6-6f79-4a68-b7d9-a8d9ddb72a2f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:12.432141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad9242b6-6f79-4a68-b7d9-a8d9ddb72a2f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:12.433032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad9242b6-6f79-4a68-b7d9-a8d9ddb72a2f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:12.433433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad9242b6-6f79-4a68-b7d9-a8d9ddb72a2f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:12.462475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ad9242b6-6f79-4a68-b7d9-a8d9ddb72a2f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042573 Jul 26 18:40:12.463053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 877/1731] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:12 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:13.108734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-613c9b8f-bba9-43a0-9caa-31aabdb9bf1a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:13.111335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-613c9b8f-bba9-43a0-9caa-31aabdb9bf1a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:13.119241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-613c9b8f-bba9-43a0-9caa-31aabdb9bf1a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:13.119800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-613c9b8f-bba9-43a0-9caa-31aabdb9bf1a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:13.120669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-613c9b8f-bba9-43a0-9caa-31aabdb9bf1a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:13.121115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-613c9b8f-bba9-43a0-9caa-31aabdb9bf1a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:13.150549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-613c9b8f-bba9-43a0-9caa-31aabdb9bf1a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047602 Jul 26 18:40:13.156015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 855/1732] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:13 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:13.434194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-59a3c333-dd8e-47e3-89d2-3e57283d99c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:13.435546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c76d32fd-593b-4c7b-815b-656128660ccb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:13.436307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-59a3c333-dd8e-47e3-89d2-3e57283d99c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:13.437687 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c76d32fd-593b-4c7b-815b-656128660ccb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:13.442869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59a3c333-dd8e-47e3-89d2-3e57283d99c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:13.443343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59a3c333-dd8e-47e3-89d2-3e57283d99c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:13.444115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59a3c333-dd8e-47e3-89d2-3e57283d99c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:13.444543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59a3c333-dd8e-47e3-89d2-3e57283d99c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:13.444962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c76d32fd-593b-4c7b-815b-656128660ccb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:13.445407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c76d32fd-593b-4c7b-815b-656128660ccb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:13.446164 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c76d32fd-593b-4c7b-815b-656128660ccb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:13.446587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c76d32fd-593b-4c7b-815b-656128660ccb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:13.473512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-59a3c333-dd8e-47e3-89d2-3e57283d99c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045201 Jul 26 18:40:13.474070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 878/1733] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:40:13.475997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c76d32fd-593b-4c7b-815b-656128660ccb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045332 Jul 26 18:40:13.476706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 856/1734] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:13.478581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ea57186f-f664-48ae-9484-7e2045f8e3d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:13.480798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ea57186f-f664-48ae-9484-7e2045f8e3d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:13.486659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea57186f-f664-48ae-9484-7e2045f8e3d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:13.487125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea57186f-f664-48ae-9484-7e2045f8e3d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:13.487885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea57186f-f664-48ae-9484-7e2045f8e3d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:13.488304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea57186f-f664-48ae-9484-7e2045f8e3d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:13.517980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ea57186f-f664-48ae-9484-7e2045f8e3d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042867 Jul 26 18:40:13.518536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 879/1735] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:13 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:14.168355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0acbbcfb-0d64-44eb-8cc7-e4833f1dbf28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:14.171765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0acbbcfb-0d64-44eb-8cc7-e4833f1dbf28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:14.182205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0acbbcfb-0d64-44eb-8cc7-e4833f1dbf28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:14.182876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0acbbcfb-0d64-44eb-8cc7-e4833f1dbf28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:14.183789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0acbbcfb-0d64-44eb-8cc7-e4833f1dbf28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:14.189816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0acbbcfb-0d64-44eb-8cc7-e4833f1dbf28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:14.215889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0acbbcfb-0d64-44eb-8cc7-e4833f1dbf28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054314 Jul 26 18:40:14.216435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 857/1736] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:14 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:14.490697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0f7c4fd6-6624-4660-b2a2-ee78b2a4bf3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:14.492431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8b8f3d55-57a7-490f-b0e0-4b024ccce14e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:14.494245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f7c4fd6-6624-4660-b2a2-ee78b2a4bf3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:14.496006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8b8f3d55-57a7-490f-b0e0-4b024ccce14e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:14.505508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f7c4fd6-6624-4660-b2a2-ee78b2a4bf3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:14.506245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f7c4fd6-6624-4660-b2a2-ee78b2a4bf3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:14.506491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8b8f3d55-57a7-490f-b0e0-4b024ccce14e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:14.507554 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8b8f3d55-57a7-490f-b0e0-4b024ccce14e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:14.507826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f7c4fd6-6624-4660-b2a2-ee78b2a4bf3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:14.508261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f7c4fd6-6624-4660-b2a2-ee78b2a4bf3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:14.508535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8b8f3d55-57a7-490f-b0e0-4b024ccce14e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:14.509207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8b8f3d55-57a7-490f-b0e0-4b024ccce14e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:14.539262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0f7c4fd6-6624-4660-b2a2-ee78b2a4bf3c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055135 Jul 26 18:40:14.539806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 880/1737] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:14 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:14.539980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8b8f3d55-57a7-490f-b0e0-4b024ccce14e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054192 Jul 26 18:40:14.540593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 858/1738] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:14 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:14.544475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-edd36668-5d4f-4b5e-bb91-9ff0bf19e454 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:14.546642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-edd36668-5d4f-4b5e-bb91-9ff0bf19e454 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:14.552693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-edd36668-5d4f-4b5e-bb91-9ff0bf19e454 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:14.553139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-edd36668-5d4f-4b5e-bb91-9ff0bf19e454 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:14.553896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-edd36668-5d4f-4b5e-bb91-9ff0bf19e454 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:14.554325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-edd36668-5d4f-4b5e-bb91-9ff0bf19e454 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:14.586650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-edd36668-5d4f-4b5e-bb91-9ff0bf19e454 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045778 Jul 26 18:40:14.587254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 881/1739] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:14 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:15.232310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7944c32e-58bb-4afb-b931-623b867b9214 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:15.235773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7944c32e-58bb-4afb-b931-623b867b9214 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:15.246128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7944c32e-58bb-4afb-b931-623b867b9214 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:15.246867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7944c32e-58bb-4afb-b931-623b867b9214 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:15.248183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7944c32e-58bb-4afb-b931-623b867b9214 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:15.248903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7944c32e-58bb-4afb-b931-623b867b9214 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:15.283340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7944c32e-58bb-4afb-b931-623b867b9214 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057746 Jul 26 18:40:15.283900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 859/1740] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:15.554799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7afa4dd7-c140-445a-96cc-5e860a5562ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:15.556096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0a0b3121-3b24-4915-9db6-f76b205c3edc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:15.557848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7afa4dd7-c140-445a-96cc-5e860a5562ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:15.559290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0a0b3121-3b24-4915-9db6-f76b205c3edc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:15.564602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7afa4dd7-c140-445a-96cc-5e860a5562ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:15.565051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7afa4dd7-c140-445a-96cc-5e860a5562ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:15.565876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a0b3121-3b24-4915-9db6-f76b205c3edc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:15.565992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7afa4dd7-c140-445a-96cc-5e860a5562ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:15.566237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7afa4dd7-c140-445a-96cc-5e860a5562ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:15.566390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a0b3121-3b24-4915-9db6-f76b205c3edc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:15.567048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a0b3121-3b24-4915-9db6-f76b205c3edc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:15.567474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a0b3121-3b24-4915-9db6-f76b205c3edc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:15.595199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7afa4dd7-c140-445a-96cc-5e860a5562ba tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045937 Jul 26 18:40:15.595795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 882/1741] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:15 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:15.599972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0a0b3121-3b24-4915-9db6-f76b205c3edc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046693 Jul 26 18:40:15.599972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 860/1742] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:15 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:15.603396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-eea5fed3-4188-4a5b-b269-a9d26e62b65e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:15.605581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-eea5fed3-4188-4a5b-b269-a9d26e62b65e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:15.611618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eea5fed3-4188-4a5b-b269-a9d26e62b65e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:15.612063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eea5fed3-4188-4a5b-b269-a9d26e62b65e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:15.612815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eea5fed3-4188-4a5b-b269-a9d26e62b65e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:15.613242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eea5fed3-4188-4a5b-b269-a9d26e62b65e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:15.641860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-eea5fed3-4188-4a5b-b269-a9d26e62b65e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045126 Jul 26 18:40:15.642407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 883/1743] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:15 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:16.298208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-47998c16-2fb0-4668-9f6b-51db40de50c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:16.301657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-47998c16-2fb0-4668-9f6b-51db40de50c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:16.310404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47998c16-2fb0-4668-9f6b-51db40de50c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:16.310860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47998c16-2fb0-4668-9f6b-51db40de50c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:16.311660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47998c16-2fb0-4668-9f6b-51db40de50c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:16.312097 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47998c16-2fb0-4668-9f6b-51db40de50c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:16.341566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-47998c16-2fb0-4668-9f6b-51db40de50c5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048734 Jul 26 18:40:16.342100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 861/1744] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:16.609536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-838b6c5a-4487-48f0-b67d-70da2e5191a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:16.610105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9ac3a48e-17f0-4ae8-be8c-972d73f37d5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:16.611608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-838b6c5a-4487-48f0-b67d-70da2e5191a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:16.611792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9ac3a48e-17f0-4ae8-be8c-972d73f37d5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:16.619366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ac3a48e-17f0-4ae8-be8c-972d73f37d5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:16.619818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ac3a48e-17f0-4ae8-be8c-972d73f37d5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:16.620582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ac3a48e-17f0-4ae8-be8c-972d73f37d5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:16.621019 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ac3a48e-17f0-4ae8-be8c-972d73f37d5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:16.623198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-838b6c5a-4487-48f0-b67d-70da2e5191a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:16.623643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-838b6c5a-4487-48f0-b67d-70da2e5191a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:16.624411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-838b6c5a-4487-48f0-b67d-70da2e5191a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:16.624838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-838b6c5a-4487-48f0-b67d-70da2e5191a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:16.651848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9ac3a48e-17f0-4ae8-be8c-972d73f37d5a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046199 Jul 26 18:40:16.652463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 862/1745] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:16 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:16.657054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-175c2a60-ca7b-4f55-b500-4934a43ddeb3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:16.659265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-175c2a60-ca7b-4f55-b500-4934a43ddeb3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:16.661295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-838b6c5a-4487-48f0-b67d-70da2e5191a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055989 Jul 26 18:40:16.662037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 884/1746] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:16 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:16.665228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-175c2a60-ca7b-4f55-b500-4934a43ddeb3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:16.665649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-175c2a60-ca7b-4f55-b500-4934a43ddeb3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:16.666929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-175c2a60-ca7b-4f55-b500-4934a43ddeb3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:16.667395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-175c2a60-ca7b-4f55-b500-4934a43ddeb3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:16.696507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-175c2a60-ca7b-4f55-b500-4934a43ddeb3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043023 Jul 26 18:40:16.697003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 863/1747] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:16 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:17.361056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-01d4050f-94c6-49dc-a13d-496921f76e63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:17.364642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-01d4050f-94c6-49dc-a13d-496921f76e63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:17.375662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01d4050f-94c6-49dc-a13d-496921f76e63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:17.376496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01d4050f-94c6-49dc-a13d-496921f76e63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:17.377935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01d4050f-94c6-49dc-a13d-496921f76e63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:17.378656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01d4050f-94c6-49dc-a13d-496921f76e63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:17.411745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-01d4050f-94c6-49dc-a13d-496921f76e63 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057714 Jul 26 18:40:17.412282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 885/1748] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:17 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:17.668613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e68bb974-afe9-4ae8-9fdf-d943f2ebfd88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:17.671981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e68bb974-afe9-4ae8-9fdf-d943f2ebfd88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:17.677528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-274bcd97-fa93-4356-964c-fb83ad7896be tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:17.681001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-274bcd97-fa93-4356-964c-fb83ad7896be tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:17.682900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e68bb974-afe9-4ae8-9fdf-d943f2ebfd88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:17.683556 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e68bb974-afe9-4ae8-9fdf-d943f2ebfd88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:17.684334 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e68bb974-afe9-4ae8-9fdf-d943f2ebfd88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:17.684776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e68bb974-afe9-4ae8-9fdf-d943f2ebfd88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:17.688196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-274bcd97-fa93-4356-964c-fb83ad7896be tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:17.688653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-274bcd97-fa93-4356-964c-fb83ad7896be tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:17.689407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-274bcd97-fa93-4356-964c-fb83ad7896be tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:17.689834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-274bcd97-fa93-4356-964c-fb83ad7896be tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:17.715101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e68bb974-afe9-4ae8-9fdf-d943f2ebfd88 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053310 Jul 26 18:40:17.715662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 864/1749] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:17.718500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-274bcd97-fa93-4356-964c-fb83ad7896be tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047468 Jul 26 18:40:17.722977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 886/1750] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:17 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:17.723148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3e6ddc86-ce65-43f9-983b-a1d9c93b7f45 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:17.723148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3e6ddc86-ce65-43f9-983b-a1d9c93b7f45 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:17.728808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3e6ddc86-ce65-43f9-983b-a1d9c93b7f45 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:17.729596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3e6ddc86-ce65-43f9-983b-a1d9c93b7f45 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:17.730363 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3e6ddc86-ce65-43f9-983b-a1d9c93b7f45 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:17.730794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3e6ddc86-ce65-43f9-983b-a1d9c93b7f45 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:17.744601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:17.761111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3e6ddc86-ce65-43f9-983b-a1d9c93b7f45 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Jul 26 18:40:17.761684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 865/1751] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:17 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:18.427229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cb50dcb0-bcf0-494e-b25a-96a3e6fc8ce4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:18.429418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cb50dcb0-bcf0-494e-b25a-96a3e6fc8ce4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:18.436027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb50dcb0-bcf0-494e-b25a-96a3e6fc8ce4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:18.436481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb50dcb0-bcf0-494e-b25a-96a3e6fc8ce4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:18.437253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb50dcb0-bcf0-494e-b25a-96a3e6fc8ce4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:18.437678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb50dcb0-bcf0-494e-b25a-96a3e6fc8ce4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:18.467968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cb50dcb0-bcf0-494e-b25a-96a3e6fc8ce4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Jul 26 18:40:18.468506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 887/1752] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:18.731315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5fc96c1c-89f0-49d6-997f-e71f6a13135f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:18.733574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b1bd020c-ea59-4737-9320-48c12135f7ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:18.733982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5fc96c1c-89f0-49d6-997f-e71f6a13135f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:18.735746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b1bd020c-ea59-4737-9320-48c12135f7ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:18.740541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5fc96c1c-89f0-49d6-997f-e71f6a13135f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:18.741015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5fc96c1c-89f0-49d6-997f-e71f6a13135f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:18.741782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5fc96c1c-89f0-49d6-997f-e71f6a13135f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:18.742187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1bd020c-ea59-4737-9320-48c12135f7ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:18.742307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5fc96c1c-89f0-49d6-997f-e71f6a13135f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:18.742626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1bd020c-ea59-4737-9320-48c12135f7ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:18.743447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1bd020c-ea59-4737-9320-48c12135f7ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:18.743879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1bd020c-ea59-4737-9320-48c12135f7ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:18.772790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5fc96c1c-89f0-49d6-997f-e71f6a13135f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047418 Jul 26 18:40:18.773331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 866/1753] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:18 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:18.775787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b1bd020c-ea59-4737-9320-48c12135f7ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047813 Jul 26 18:40:18.776494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 888/1754] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:18 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:18.777844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-392ee1a4-d7b0-4302-b772-17ab6efb657d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:18.780022 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-392ee1a4-d7b0-4302-b772-17ab6efb657d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:18.786315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-392ee1a4-d7b0-4302-b772-17ab6efb657d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:18.786762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-392ee1a4-d7b0-4302-b772-17ab6efb657d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:18.787565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-392ee1a4-d7b0-4302-b772-17ab6efb657d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:18.788001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-392ee1a4-d7b0-4302-b772-17ab6efb657d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:18.818185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-392ee1a4-d7b0-4302-b772-17ab6efb657d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043840 Jul 26 18:40:18.818747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 867/1755] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:18 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:19.483495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-195eaefb-ab06-4ca5-8a8e-0df0bbdf7d90 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:19.486256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-195eaefb-ab06-4ca5-8a8e-0df0bbdf7d90 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:19.494185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-195eaefb-ab06-4ca5-8a8e-0df0bbdf7d90 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:19.494755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-195eaefb-ab06-4ca5-8a8e-0df0bbdf7d90 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:19.495738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-195eaefb-ab06-4ca5-8a8e-0df0bbdf7d90 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:19.496277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-195eaefb-ab06-4ca5-8a8e-0df0bbdf7d90 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:19.500783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:19.529632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-195eaefb-ab06-4ca5-8a8e-0df0bbdf7d90 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051673 Jul 26 18:40:19.530391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 889/1756] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:19 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:19.784904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c163d7d3-684a-410c-bc3c-d51089260aad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:19.787176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c163d7d3-684a-410c-bc3c-d51089260aad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:19.788469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ea81d2d7-0616-40fc-bdee-168775786112 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:19.790731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ea81d2d7-0616-40fc-bdee-168775786112 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:19.794661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c163d7d3-684a-410c-bc3c-d51089260aad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:19.795139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c163d7d3-684a-410c-bc3c-d51089260aad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:19.795950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c163d7d3-684a-410c-bc3c-d51089260aad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:19.796534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c163d7d3-684a-410c-bc3c-d51089260aad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:19.799145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea81d2d7-0616-40fc-bdee-168775786112 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:19.799671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea81d2d7-0616-40fc-bdee-168775786112 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:19.801139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea81d2d7-0616-40fc-bdee-168775786112 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:19.801139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea81d2d7-0616-40fc-bdee-168775786112 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:19.827103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c163d7d3-684a-410c-bc3c-d51089260aad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046337 Jul 26 18:40:19.827677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 868/1757] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:19 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:19.831166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ea81d2d7-0616-40fc-bdee-168775786112 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046756 Jul 26 18:40:19.831882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 890/1758] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:19 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:19.832192 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-60ff5bd8-5251-4dd0-9d34-a1fe9ca7b924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:19.834321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-60ff5bd8-5251-4dd0-9d34-a1fe9ca7b924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:19.840390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60ff5bd8-5251-4dd0-9d34-a1fe9ca7b924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:19.840843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60ff5bd8-5251-4dd0-9d34-a1fe9ca7b924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:19.841610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60ff5bd8-5251-4dd0-9d34-a1fe9ca7b924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:19.842045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60ff5bd8-5251-4dd0-9d34-a1fe9ca7b924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:19.870340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-60ff5bd8-5251-4dd0-9d34-a1fe9ca7b924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041645 Jul 26 18:40:19.870872 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 869/1759] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:19 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:20.545544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-492f3cf9-807a-4029-9503-9f03b49a9c6c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:20.548409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-492f3cf9-807a-4029-9503-9f03b49a9c6c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:20.556696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-492f3cf9-807a-4029-9503-9f03b49a9c6c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:20.557298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-492f3cf9-807a-4029-9503-9f03b49a9c6c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:20.558305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-492f3cf9-807a-4029-9503-9f03b49a9c6c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:20.558884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-492f3cf9-807a-4029-9503-9f03b49a9c6c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:20.600930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-492f3cf9-807a-4029-9503-9f03b49a9c6c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061270 Jul 26 18:40:20.601480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 891/1760] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:20 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:20.840280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-42fe6293-5358-4d8d-9892-67ef1b190e21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:20.842358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-42fe6293-5358-4d8d-9892-67ef1b190e21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:20.843527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3e59f159-13c4-48dd-8a44-817053468308 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:20.845676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3e59f159-13c4-48dd-8a44-817053468308 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:20.849323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42fe6293-5358-4d8d-9892-67ef1b190e21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:20.849767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42fe6293-5358-4d8d-9892-67ef1b190e21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:20.850536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42fe6293-5358-4d8d-9892-67ef1b190e21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:20.850966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42fe6293-5358-4d8d-9892-67ef1b190e21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:20.852288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e59f159-13c4-48dd-8a44-817053468308 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:20.852767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e59f159-13c4-48dd-8a44-817053468308 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:20.853549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e59f159-13c4-48dd-8a44-817053468308 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:20.853976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e59f159-13c4-48dd-8a44-817053468308 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:20.880478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-42fe6293-5358-4d8d-9892-67ef1b190e21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044278 Jul 26 18:40:20.881331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 870/1761] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:20.883708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3e59f159-13c4-48dd-8a44-817053468308 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044084 Jul 26 18:40:20.884429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 892/1762] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:20.886064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-204c8a0f-bb95-4eef-ad87-4dc7b720c1fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:20.888373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-204c8a0f-bb95-4eef-ad87-4dc7b720c1fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:20.894578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-204c8a0f-bb95-4eef-ad87-4dc7b720c1fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:20.895039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-204c8a0f-bb95-4eef-ad87-4dc7b720c1fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:20.895815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-204c8a0f-bb95-4eef-ad87-4dc7b720c1fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:20.896335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-204c8a0f-bb95-4eef-ad87-4dc7b720c1fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:20.924914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-204c8a0f-bb95-4eef-ad87-4dc7b720c1fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042437 Jul 26 18:40:20.925458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 871/1763] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:20 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:21.618007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d0a24f43-d1a4-4c8b-9ea2-60c54206ed9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:21.621001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d0a24f43-d1a4-4c8b-9ea2-60c54206ed9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:21.627506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0a24f43-d1a4-4c8b-9ea2-60c54206ed9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:21.627952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0a24f43-d1a4-4c8b-9ea2-60c54206ed9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:21.628711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0a24f43-d1a4-4c8b-9ea2-60c54206ed9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:21.629143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0a24f43-d1a4-4c8b-9ea2-60c54206ed9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:21.659001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d0a24f43-d1a4-4c8b-9ea2-60c54206ed9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047702 Jul 26 18:40:21.659592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 893/1764] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:21.898552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6b8db43f-1905-4aae-9ec3-c8737f51fd56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:21.900257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e11928dd-c8e9-4d78-b2c9-f3d243a71b1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:21.901873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6b8db43f-1905-4aae-9ec3-c8737f51fd56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:21.903924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e11928dd-c8e9-4d78-b2c9-f3d243a71b1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:21.912108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b8db43f-1905-4aae-9ec3-c8737f51fd56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:21.912840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b8db43f-1905-4aae-9ec3-c8737f51fd56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:21.914083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b8db43f-1905-4aae-9ec3-c8737f51fd56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:21.914313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e11928dd-c8e9-4d78-b2c9-f3d243a71b1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:21.914793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b8db43f-1905-4aae-9ec3-c8737f51fd56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:21.915112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e11928dd-c8e9-4d78-b2c9-f3d243a71b1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:21.916371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e11928dd-c8e9-4d78-b2c9-f3d243a71b1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:21.917180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e11928dd-c8e9-4d78-b2c9-f3d243a71b1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:21.946283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6b8db43f-1905-4aae-9ec3-c8737f51fd56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055167 Jul 26 18:40:21.946541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e11928dd-c8e9-4d78-b2c9-f3d243a71b1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053126 Jul 26 18:40:21.947123 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 872/1765] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:21 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:21.947298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 894/1766] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:21 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:21.951448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-17173e0f-0b50-4ea8-af71-7319449d0ea4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:21.953540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-17173e0f-0b50-4ea8-af71-7319449d0ea4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:21.959658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17173e0f-0b50-4ea8-af71-7319449d0ea4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:21.960097 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17173e0f-0b50-4ea8-af71-7319449d0ea4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:21.960851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17173e0f-0b50-4ea8-af71-7319449d0ea4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:21.961277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17173e0f-0b50-4ea8-af71-7319449d0ea4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:21.989507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-17173e0f-0b50-4ea8-af71-7319449d0ea4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041654 Jul 26 18:40:21.990049 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 873/1767] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:21 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:22.675629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5edd15f2-1a41-4d6f-91e0-32045113bec9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:22.679096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5edd15f2-1a41-4d6f-91e0-32045113bec9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:22.689528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5edd15f2-1a41-4d6f-91e0-32045113bec9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:22.690270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5edd15f2-1a41-4d6f-91e0-32045113bec9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:22.691615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5edd15f2-1a41-4d6f-91e0-32045113bec9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:22.692311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5edd15f2-1a41-4d6f-91e0-32045113bec9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:22.724036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5edd15f2-1a41-4d6f-91e0-32045113bec9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055058 Jul 26 18:40:22.724590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 895/1768] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:22.962301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3ddd1e9c-b267-4237-ab13-398032c6c2e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:22.963175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e6e0ae00-20f7-4dc6-8198-6890c12f02d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:22.964952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3ddd1e9c-b267-4237-ab13-398032c6c2e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:22.965309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e6e0ae00-20f7-4dc6-8198-6890c12f02d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:22.971923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ddd1e9c-b267-4237-ab13-398032c6c2e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:22.972104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6e0ae00-20f7-4dc6-8198-6890c12f02d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:22.972370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ddd1e9c-b267-4237-ab13-398032c6c2e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:22.972533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6e0ae00-20f7-4dc6-8198-6890c12f02d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:22.973135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ddd1e9c-b267-4237-ab13-398032c6c2e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:22.973279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6e0ae00-20f7-4dc6-8198-6890c12f02d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:22.973568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ddd1e9c-b267-4237-ab13-398032c6c2e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:22.973714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6e0ae00-20f7-4dc6-8198-6890c12f02d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:23.003589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3ddd1e9c-b267-4237-ab13-398032c6c2e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048138 Jul 26 18:40:23.003867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e6e0ae00-20f7-4dc6-8198-6890c12f02d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047656 Jul 26 18:40:23.004164 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 874/1769] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:22 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:23.008142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 896/1770] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:22 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:23.008996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-16a0d0ff-33b0-4239-bb86-76623dfb8fb6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:23.011149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-16a0d0ff-33b0-4239-bb86-76623dfb8fb6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:23.012854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:23.018552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16a0d0ff-33b0-4239-bb86-76623dfb8fb6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:23.018985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16a0d0ff-33b0-4239-bb86-76623dfb8fb6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:23.019768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16a0d0ff-33b0-4239-bb86-76623dfb8fb6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:23.020194 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16a0d0ff-33b0-4239-bb86-76623dfb8fb6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:23.049195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-16a0d0ff-33b0-4239-bb86-76623dfb8fb6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Jul 26 18:40:23.049749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 875/1771] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:23 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:23.740671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7476bff7-7ab1-4e8e-8681-c902af842b89 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:23.744210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7476bff7-7ab1-4e8e-8681-c902af842b89 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:23.755478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7476bff7-7ab1-4e8e-8681-c902af842b89 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:23.755924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7476bff7-7ab1-4e8e-8681-c902af842b89 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:23.756696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7476bff7-7ab1-4e8e-8681-c902af842b89 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:23.757225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7476bff7-7ab1-4e8e-8681-c902af842b89 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:23.787542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7476bff7-7ab1-4e8e-8681-c902af842b89 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053358 Jul 26 18:40:23.788015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 897/1772] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:23 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:24.016689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8564e460-b59e-41be-b7a6-17fc50d9417e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:24.017284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-73e60ae4-7b36-46ca-9620-77286444ca27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:24.018804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8564e460-b59e-41be-b7a6-17fc50d9417e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:24.019046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-73e60ae4-7b36-46ca-9620-77286444ca27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:24.026088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8564e460-b59e-41be-b7a6-17fc50d9417e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:24.026577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73e60ae4-7b36-46ca-9620-77286444ca27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:24.026733 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8564e460-b59e-41be-b7a6-17fc50d9417e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:24.027038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73e60ae4-7b36-46ca-9620-77286444ca27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:24.027562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8564e460-b59e-41be-b7a6-17fc50d9417e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:24.027833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73e60ae4-7b36-46ca-9620-77286444ca27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:24.028108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8564e460-b59e-41be-b7a6-17fc50d9417e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:24.028251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73e60ae4-7b36-46ca-9620-77286444ca27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:24.057287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8564e460-b59e-41be-b7a6-17fc50d9417e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044438 Jul 26 18:40:24.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 876/1773] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:24 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:24.059316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-73e60ae4-7b36-46ca-9620-77286444ca27 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046401 Jul 26 18:40:24.061691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 898/1774] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:24.062239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-05e79ad1-0dd2-4930-8216-3a8a72012ecc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:24.064379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-05e79ad1-0dd2-4930-8216-3a8a72012ecc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:24.070362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-05e79ad1-0dd2-4930-8216-3a8a72012ecc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:24.070804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-05e79ad1-0dd2-4930-8216-3a8a72012ecc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:24.071585 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-05e79ad1-0dd2-4930-8216-3a8a72012ecc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:24.072017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-05e79ad1-0dd2-4930-8216-3a8a72012ecc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:24.100664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-05e79ad1-0dd2-4930-8216-3a8a72012ecc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041916 Jul 26 18:40:24.101223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 877/1775] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:24 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:24.803102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2d73fa40-b051-4950-9f7c-41d0604940d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:24.806325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2d73fa40-b051-4950-9f7c-41d0604940d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:24.817708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d73fa40-b051-4950-9f7c-41d0604940d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:24.818768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d73fa40-b051-4950-9f7c-41d0604940d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:24.820459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d73fa40-b051-4950-9f7c-41d0604940d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:24.821035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d73fa40-b051-4950-9f7c-41d0604940d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:24.852741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2d73fa40-b051-4950-9f7c-41d0604940d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055729 Jul 26 18:40:24.853293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 899/1776] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:24 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:25.073831 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3ff2456e-bcff-439b-bb25-c2275b91d3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:25.074728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-26b5a19f-198b-446b-b241-43bf822f28a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:25.075924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3ff2456e-bcff-439b-bb25-c2275b91d3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:25.076987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-26b5a19f-198b-446b-b241-43bf822f28a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:25.082883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ff2456e-bcff-439b-bb25-c2275b91d3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:25.083371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ff2456e-bcff-439b-bb25-c2275b91d3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:25.084126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ff2456e-bcff-439b-bb25-c2275b91d3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:25.084543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26b5a19f-198b-446b-b241-43bf822f28a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:25.084686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ff2456e-bcff-439b-bb25-c2275b91d3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:25.084994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26b5a19f-198b-446b-b241-43bf822f28a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:25.085763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26b5a19f-198b-446b-b241-43bf822f28a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:25.086195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26b5a19f-198b-446b-b241-43bf822f28a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:25.113485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3ff2456e-bcff-439b-bb25-c2275b91d3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046505 Jul 26 18:40:25.114039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 878/1777] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:25 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:25.116543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-26b5a19f-198b-446b-b241-43bf822f28a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047471 Jul 26 18:40:25.117444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 900/1778] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:25.118769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ce3ee881-a1c9-42ba-b9c1-4891a5bcf97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:25.121046 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ce3ee881-a1c9-42ba-b9c1-4891a5bcf97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:25.126909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce3ee881-a1c9-42ba-b9c1-4891a5bcf97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:25.127383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce3ee881-a1c9-42ba-b9c1-4891a5bcf97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:25.128129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce3ee881-a1c9-42ba-b9c1-4891a5bcf97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:25.128530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce3ee881-a1c9-42ba-b9c1-4891a5bcf97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:25.157010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ce3ee881-a1c9-42ba-b9c1-4891a5bcf97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042015 Jul 26 18:40:25.157544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 879/1779] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:25 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:25.870312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-11125408-1bfc-48a0-90db-06d20ce1faa9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:25.872427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-11125408-1bfc-48a0-90db-06d20ce1faa9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:25.878816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11125408-1bfc-48a0-90db-06d20ce1faa9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:25.879311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11125408-1bfc-48a0-90db-06d20ce1faa9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:25.880066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11125408-1bfc-48a0-90db-06d20ce1faa9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:25.880489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11125408-1bfc-48a0-90db-06d20ce1faa9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:25.911167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-11125408-1bfc-48a0-90db-06d20ce1faa9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047644 Jul 26 18:40:25.911724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 901/1780] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:25 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:26.130295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-50868fcc-a57b-480e-92c7-53ada949f533 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:26.133096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5f98dd23-c253-4d0a-982b-1a97fb7f0589 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:26.133829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-50868fcc-a57b-480e-92c7-53ada949f533 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:26.136572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5f98dd23-c253-4d0a-982b-1a97fb7f0589 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:26.140982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:26.145823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50868fcc-a57b-480e-92c7-53ada949f533 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:26.146557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50868fcc-a57b-480e-92c7-53ada949f533 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:26.148206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50868fcc-a57b-480e-92c7-53ada949f533 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:26.148884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50868fcc-a57b-480e-92c7-53ada949f533 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:26.150252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f98dd23-c253-4d0a-982b-1a97fb7f0589 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:26.151153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f98dd23-c253-4d0a-982b-1a97fb7f0589 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:26.151935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f98dd23-c253-4d0a-982b-1a97fb7f0589 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:26.152365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f98dd23-c253-4d0a-982b-1a97fb7f0589 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:26.179409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-50868fcc-a57b-480e-92c7-53ada949f533 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055946 Jul 26 18:40:26.179968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 880/1781] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:26 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:26.181489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5f98dd23-c253-4d0a-982b-1a97fb7f0589 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054999 Jul 26 18:40:26.186147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 902/1782] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:26.186314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e798bf03-0b05-4952-8b8f-01c18b12872a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:26.186635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e798bf03-0b05-4952-8b8f-01c18b12872a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:26.192619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e798bf03-0b05-4952-8b8f-01c18b12872a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:26.193069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e798bf03-0b05-4952-8b8f-01c18b12872a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:26.193832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e798bf03-0b05-4952-8b8f-01c18b12872a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:26.194260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e798bf03-0b05-4952-8b8f-01c18b12872a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:26.222387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e798bf03-0b05-4952-8b8f-01c18b12872a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041475 Jul 26 18:40:26.222945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 881/1783] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:26 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:26.928068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dd1dd6fc-f214-4891-990e-4c3bcfeaa25f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:26.931613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dd1dd6fc-f214-4891-990e-4c3bcfeaa25f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:26.938389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd1dd6fc-f214-4891-990e-4c3bcfeaa25f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:26.938836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd1dd6fc-f214-4891-990e-4c3bcfeaa25f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:26.939635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd1dd6fc-f214-4891-990e-4c3bcfeaa25f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:26.940073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd1dd6fc-f214-4891-990e-4c3bcfeaa25f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:26.969183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dd1dd6fc-f214-4891-990e-4c3bcfeaa25f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047892 Jul 26 18:40:26.969734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 903/1784] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:26 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:27.196637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3692269c-e089-4279-9865-cc0834a7c590 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:27.197763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1f347ab2-31d5-41e5-af34-fbf9f1d33751 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:27.199368 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3692269c-e089-4279-9865-cc0834a7c590 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:27.200096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1f347ab2-31d5-41e5-af34-fbf9f1d33751 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:27.206166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3692269c-e089-4279-9865-cc0834a7c590 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:27.206614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3692269c-e089-4279-9865-cc0834a7c590 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:27.206768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f347ab2-31d5-41e5-af34-fbf9f1d33751 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:27.207296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f347ab2-31d5-41e5-af34-fbf9f1d33751 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:27.207456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3692269c-e089-4279-9865-cc0834a7c590 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:27.207811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3692269c-e089-4279-9865-cc0834a7c590 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:27.208054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f347ab2-31d5-41e5-af34-fbf9f1d33751 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:27.208480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f347ab2-31d5-41e5-af34-fbf9f1d33751 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:27.210141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:27.237124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3692269c-e089-4279-9865-cc0834a7c590 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047738 Jul 26 18:40:27.237725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 882/1785] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:27.239710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1f347ab2-31d5-41e5-af34-fbf9f1d33751 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048346 Jul 26 18:40:27.240483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 904/1786] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:27 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:27.242185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1b043020-210b-4321-a82b-715293259828 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:27.244303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1b043020-210b-4321-a82b-715293259828 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:27.250379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b043020-210b-4321-a82b-715293259828 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:27.250818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b043020-210b-4321-a82b-715293259828 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:27.251598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b043020-210b-4321-a82b-715293259828 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:27.252024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b043020-210b-4321-a82b-715293259828 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:27.280928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1b043020-210b-4321-a82b-715293259828 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042155 Jul 26 18:40:27.281348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 883/1787] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:27 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:27.987877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6be01db6-ab1d-446a-bac7-54129197e2fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:27.991626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6be01db6-ab1d-446a-bac7-54129197e2fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:28.002020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6be01db6-ab1d-446a-bac7-54129197e2fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:28.002770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6be01db6-ab1d-446a-bac7-54129197e2fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:28.004090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6be01db6-ab1d-446a-bac7-54129197e2fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:28.004811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6be01db6-ab1d-446a-bac7-54129197e2fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:28.032440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:28.037068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6be01db6-ab1d-446a-bac7-54129197e2fc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055903 Jul 26 18:40:28.037634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 905/1788] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:27 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:28.250227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-105da66b-2b9e-4bcd-9d8a-7f3b10c5ee8a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:28.252330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-105da66b-2b9e-4bcd-9d8a-7f3b10c5ee8a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:28.252977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c6e52b43-979f-4427-88ad-93247b12c4f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:28.255187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c6e52b43-979f-4427-88ad-93247b12c4f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:28.259399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-105da66b-2b9e-4bcd-9d8a-7f3b10c5ee8a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:28.259851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-105da66b-2b9e-4bcd-9d8a-7f3b10c5ee8a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:28.260677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-105da66b-2b9e-4bcd-9d8a-7f3b10c5ee8a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:28.261037 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-105da66b-2b9e-4bcd-9d8a-7f3b10c5ee8a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:28.261909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6e52b43-979f-4427-88ad-93247b12c4f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:28.262358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6e52b43-979f-4427-88ad-93247b12c4f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:28.263344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6e52b43-979f-4427-88ad-93247b12c4f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:28.263786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6e52b43-979f-4427-88ad-93247b12c4f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:28.290956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-105da66b-2b9e-4bcd-9d8a-7f3b10c5ee8a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 Jul 26 18:40:28.295762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 884/1789] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:28 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:28.295904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c6e52b43-979f-4427-88ad-93247b12c4f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045599 Jul 26 18:40:28.295904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 906/1790] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:28.296344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b4ca64c5-b2e7-4551-839d-0aebce78a622 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:28.298481 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b4ca64c5-b2e7-4551-839d-0aebce78a622 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:28.304364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4ca64c5-b2e7-4551-839d-0aebce78a622 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:28.304810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4ca64c5-b2e7-4551-839d-0aebce78a622 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:28.305566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4ca64c5-b2e7-4551-839d-0aebce78a622 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:28.305998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b4ca64c5-b2e7-4551-839d-0aebce78a622 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:28.334230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b4ca64c5-b2e7-4551-839d-0aebce78a622 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041524 Jul 26 18:40:28.334777 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 885/1791] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:28 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:29.049978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9d20443e-7fdb-4018-90f3-86d3d6aa63e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:29.052069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9d20443e-7fdb-4018-90f3-86d3d6aa63e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:29.058634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d20443e-7fdb-4018-90f3-86d3d6aa63e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:29.059077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d20443e-7fdb-4018-90f3-86d3d6aa63e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:29.059861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d20443e-7fdb-4018-90f3-86d3d6aa63e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:29.060295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d20443e-7fdb-4018-90f3-86d3d6aa63e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:29.089611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9d20443e-7fdb-4018-90f3-86d3d6aa63e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043760 Jul 26 18:40:29.090121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 907/1792] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:29 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:29.308561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6b77ef48-0510-41b0-b1c6-c5a69f7b1b53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:29.310449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-98cab36d-ce40-46ad-a199-df22c77dac46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:29.312102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6b77ef48-0510-41b0-b1c6-c5a69f7b1b53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:29.313971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-98cab36d-ce40-46ad-a199-df22c77dac46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:29.322376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b77ef48-0510-41b0-b1c6-c5a69f7b1b53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:29.323199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b77ef48-0510-41b0-b1c6-c5a69f7b1b53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:29.323755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98cab36d-ce40-46ad-a199-df22c77dac46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:29.323921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b77ef48-0510-41b0-b1c6-c5a69f7b1b53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:29.324199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98cab36d-ce40-46ad-a199-df22c77dac46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:29.324351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b77ef48-0510-41b0-b1c6-c5a69f7b1b53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:29.324945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98cab36d-ce40-46ad-a199-df22c77dac46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:29.325370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98cab36d-ce40-46ad-a199-df22c77dac46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:29.354329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6b77ef48-0510-41b0-b1c6-c5a69f7b1b53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052982 Jul 26 18:40:29.354893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 886/1793] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:29 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:29.355091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-98cab36d-ce40-46ad-a199-df22c77dac46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051228 Jul 26 18:40:29.359812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 908/1794] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:29.426860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d63a8476-fa54-40b8-b4a1-47288a285453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:29.429091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d63a8476-fa54-40b8-b4a1-47288a285453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:29.435485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d63a8476-fa54-40b8-b4a1-47288a285453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:29.435927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d63a8476-fa54-40b8-b4a1-47288a285453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:29.436690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d63a8476-fa54-40b8-b4a1-47288a285453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:29.437122 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d63a8476-fa54-40b8-b4a1-47288a285453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:29.466349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d63a8476-fa54-40b8-b4a1-47288a285453 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110487 Jul 26 18:40:29.466891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 887/1795] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:29 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:30.108562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4c0a25a4-0dcf-4309-8684-2651342b055d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:30.111980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4c0a25a4-0dcf-4309-8684-2651342b055d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:30.122277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c0a25a4-0dcf-4309-8684-2651342b055d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:30.123099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c0a25a4-0dcf-4309-8684-2651342b055d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:30.124388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c0a25a4-0dcf-4309-8684-2651342b055d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:30.125106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c0a25a4-0dcf-4309-8684-2651342b055d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:30.158640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4c0a25a4-0dcf-4309-8684-2651342b055d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057101 Jul 26 18:40:30.159203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 909/1796] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:30 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:30.368320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-330ba041-a272-4128-b09b-2fca28731ee7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:30.369232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-47dbc9ba-1dc3-4579-afd8-fb16fe077182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:30.370708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-330ba041-a272-4128-b09b-2fca28731ee7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:30.371518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-47dbc9ba-1dc3-4579-afd8-fb16fe077182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:30.377575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-330ba041-a272-4128-b09b-2fca28731ee7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:30.378025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-330ba041-a272-4128-b09b-2fca28731ee7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:30.378143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47dbc9ba-1dc3-4579-afd8-fb16fe077182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:30.378513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47dbc9ba-1dc3-4579-afd8-fb16fe077182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:30.378801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-330ba041-a272-4128-b09b-2fca28731ee7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:30.379258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-330ba041-a272-4128-b09b-2fca28731ee7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:30.379395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47dbc9ba-1dc3-4579-afd8-fb16fe077182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:30.379803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47dbc9ba-1dc3-4579-afd8-fb16fe077182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:30.408972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-330ba041-a272-4128-b09b-2fca28731ee7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045502 Jul 26 18:40:30.409541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 888/1797] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:30 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:30.410096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-47dbc9ba-1dc3-4579-afd8-fb16fe077182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045747 Jul 26 18:40:30.410746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 910/1798] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:30.482668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-afee9b2e-0c48-411f-a7a9-51e0b47cd1c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:30.486187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-afee9b2e-0c48-411f-a7a9-51e0b47cd1c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:30.495845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afee9b2e-0c48-411f-a7a9-51e0b47cd1c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:30.496291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afee9b2e-0c48-411f-a7a9-51e0b47cd1c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:30.497053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afee9b2e-0c48-411f-a7a9-51e0b47cd1c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:30.497487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afee9b2e-0c48-411f-a7a9-51e0b47cd1c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:30.528024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-afee9b2e-0c48-411f-a7a9-51e0b47cd1c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051835 Jul 26 18:40:30.528580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 889/1799] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:30 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:31.175454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2441bf49-c0d0-4ce7-8e03-c6dc0e8e16c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:31.178853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2441bf49-c0d0-4ce7-8e03-c6dc0e8e16c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:31.186644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2441bf49-c0d0-4ce7-8e03-c6dc0e8e16c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:31.187108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2441bf49-c0d0-4ce7-8e03-c6dc0e8e16c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:31.187951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2441bf49-c0d0-4ce7-8e03-c6dc0e8e16c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:31.188386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2441bf49-c0d0-4ce7-8e03-c6dc0e8e16c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:31.217828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2441bf49-c0d0-4ce7-8e03-c6dc0e8e16c2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049149 Jul 26 18:40:31.218371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 911/1800] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:31 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:31.421046 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b1ceb06a-8735-4e78-b5da-cddc7141312d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:31.422783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dfc9d087-88a2-498e-9cc5-c55332dd678f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:31.423465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b1ceb06a-8735-4e78-b5da-cddc7141312d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:31.425038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dfc9d087-88a2-498e-9cc5-c55332dd678f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:31.430507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b1ceb06a-8735-4e78-b5da-cddc7141312d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:31.430920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b1ceb06a-8735-4e78-b5da-cddc7141312d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:31.431682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b1ceb06a-8735-4e78-b5da-cddc7141312d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:31.431819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfc9d087-88a2-498e-9cc5-c55332dd678f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:31.432160 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b1ceb06a-8735-4e78-b5da-cddc7141312d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:31.432348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfc9d087-88a2-498e-9cc5-c55332dd678f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:31.433121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfc9d087-88a2-498e-9cc5-c55332dd678f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:31.433533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfc9d087-88a2-498e-9cc5-c55332dd678f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:31.461383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b1ceb06a-8735-4e78-b5da-cddc7141312d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044375 Jul 26 18:40:31.461947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 890/1801] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:31 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:31.462859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dfc9d087-88a2-498e-9cc5-c55332dd678f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044173 Jul 26 18:40:31.463520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 912/1802] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:31.540357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-69ba486a-dde7-4d48-9d58-5116cdb4c1a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:31.542608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-69ba486a-dde7-4d48-9d58-5116cdb4c1a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:31.549188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69ba486a-dde7-4d48-9d58-5116cdb4c1a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:31.549636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69ba486a-dde7-4d48-9d58-5116cdb4c1a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:31.550400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69ba486a-dde7-4d48-9d58-5116cdb4c1a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:31.550831 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69ba486a-dde7-4d48-9d58-5116cdb4c1a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:31.579949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-69ba486a-dde7-4d48-9d58-5116cdb4c1a8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043573 Jul 26 18:40:31.580499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 891/1803] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:31 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:32.232655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5f681ac2-7874-42eb-8343-7c716cdb309f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:32.234875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5f681ac2-7874-42eb-8343-7c716cdb309f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:32.241445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f681ac2-7874-42eb-8343-7c716cdb309f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:32.241917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f681ac2-7874-42eb-8343-7c716cdb309f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:32.242744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f681ac2-7874-42eb-8343-7c716cdb309f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:32.243247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f681ac2-7874-42eb-8343-7c716cdb309f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:32.274360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5f681ac2-7874-42eb-8343-7c716cdb309f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046728 Jul 26 18:40:32.274938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 913/1804] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:32 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:32.478153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5ed30bfd-b458-4252-8537-0495d8155cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:32.479418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1baa509d-4815-46ac-8e74-da7554406e4a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:32.480799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5ed30bfd-b458-4252-8537-0495d8155cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:32.481718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1baa509d-4815-46ac-8e74-da7554406e4a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:32.487820 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ed30bfd-b458-4252-8537-0495d8155cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:32.488198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ed30bfd-b458-4252-8537-0495d8155cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:32.488340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1baa509d-4815-46ac-8e74-da7554406e4a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:32.488721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1baa509d-4815-46ac-8e74-da7554406e4a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:32.489013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ed30bfd-b458-4252-8537-0495d8155cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:32.489447 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ed30bfd-b458-4252-8537-0495d8155cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:32.489584 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1baa509d-4815-46ac-8e74-da7554406e4a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:32.489909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1baa509d-4815-46ac-8e74-da7554406e4a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:32.519066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5ed30bfd-b458-4252-8537-0495d8155cf7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047590 Jul 26 18:40:32.519598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1baa509d-4815-46ac-8e74-da7554406e4a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046661 Jul 26 18:40:32.519785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 892/1805] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:32 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:32.520157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 914/1806] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:32 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:32.596655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-453468e1-4032-4355-9a2c-e415e5dd3aed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:32.600163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-453468e1-4032-4355-9a2c-e415e5dd3aed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:32.608159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-453468e1-4032-4355-9a2c-e415e5dd3aed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:32.608609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-453468e1-4032-4355-9a2c-e415e5dd3aed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:32.609381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-453468e1-4032-4355-9a2c-e415e5dd3aed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:32.609816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-453468e1-4032-4355-9a2c-e415e5dd3aed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:32.639382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-453468e1-4032-4355-9a2c-e415e5dd3aed tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049176 Jul 26 18:40:32.639942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 893/1807] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:32 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:33.292947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-002c3c66-b87a-48e3-8b44-4bb2460f41d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:33.295780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-002c3c66-b87a-48e3-8b44-4bb2460f41d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:33.304333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-002c3c66-b87a-48e3-8b44-4bb2460f41d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:33.304940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-002c3c66-b87a-48e3-8b44-4bb2460f41d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:33.305915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-002c3c66-b87a-48e3-8b44-4bb2460f41d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:33.306526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-002c3c66-b87a-48e3-8b44-4bb2460f41d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:33.341135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-002c3c66-b87a-48e3-8b44-4bb2460f41d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054711 Jul 26 18:40:33.341686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 915/1808] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:33 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:33.535739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-44953005-8468-4009-8833-65e408aac01b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:33.536604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2d0c098c-0cf2-443f-8ab8-98b6abe71b04 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:33.539252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-44953005-8468-4009-8833-65e408aac01b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:33.539818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2d0c098c-0cf2-443f-8ab8-98b6abe71b04 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:33.549589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44953005-8468-4009-8833-65e408aac01b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:33.549865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d0c098c-0cf2-443f-8ab8-98b6abe71b04 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:33.550226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44953005-8468-4009-8833-65e408aac01b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:33.550504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d0c098c-0cf2-443f-8ab8-98b6abe71b04 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:33.551565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44953005-8468-4009-8833-65e408aac01b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:33.551794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d0c098c-0cf2-443f-8ab8-98b6abe71b04 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:33.552244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d0c098c-0cf2-443f-8ab8-98b6abe71b04 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:33.552482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44953005-8468-4009-8833-65e408aac01b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:33.583056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-44953005-8468-4009-8833-65e408aac01b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054014 Jul 26 18:40:33.583559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2d0c098c-0cf2-443f-8ab8-98b6abe71b04 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053940 Jul 26 18:40:33.583708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 894/1809] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:33.584099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 916/1810] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:33 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:33.654728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5bbfa390-3d26-4e2c-9d5d-783b3594d610 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:33.657264 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5bbfa390-3d26-4e2c-9d5d-783b3594d610 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:33.664671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5bbfa390-3d26-4e2c-9d5d-783b3594d610 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:33.665202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5bbfa390-3d26-4e2c-9d5d-783b3594d610 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:33.666092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5bbfa390-3d26-4e2c-9d5d-783b3594d610 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:33.666603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5bbfa390-3d26-4e2c-9d5d-783b3594d610 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:33.698628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5bbfa390-3d26-4e2c-9d5d-783b3594d610 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048881 Jul 26 18:40:33.699613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 895/1811] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:33 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:34.302868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:40:34.303318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:40:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:40:34.354266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-232fbec6-b8e9-4465-88cf-3674a632c042 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:34.356699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-232fbec6-b8e9-4465-88cf-3674a632c042 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:34.364559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-232fbec6-b8e9-4465-88cf-3674a632c042 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:34.365067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-232fbec6-b8e9-4465-88cf-3674a632c042 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:34.365934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-232fbec6-b8e9-4465-88cf-3674a632c042 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:34.366393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-232fbec6-b8e9-4465-88cf-3674a632c042 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:34.398310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-232fbec6-b8e9-4465-88cf-3674a632c042 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048373 Jul 26 18:40:34.398857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 917/1812] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:34 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:34.599954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2cfb7ba2-a373-4027-adf2-96f37cb05b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:34.600922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b181e296-3ef3-448b-895b-60aa51cf19a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:34.603262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b181e296-3ef3-448b-895b-60aa51cf19a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:34.603594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2cfb7ba2-a373-4027-adf2-96f37cb05b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:34.610297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2cfb7ba2-a373-4027-adf2-96f37cb05b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:34.610470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b181e296-3ef3-448b-895b-60aa51cf19a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:34.610743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2cfb7ba2-a373-4027-adf2-96f37cb05b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:34.610902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b181e296-3ef3-448b-895b-60aa51cf19a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:34.611559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2cfb7ba2-a373-4027-adf2-96f37cb05b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:34.611697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b181e296-3ef3-448b-895b-60aa51cf19a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:34.611984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b181e296-3ef3-448b-895b-60aa51cf19a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:34.612127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2cfb7ba2-a373-4027-adf2-96f37cb05b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:34.642078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b181e296-3ef3-448b-895b-60aa51cf19a9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048818 Jul 26 18:40:34.642680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 896/1813] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:34 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:34.643296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2cfb7ba2-a373-4027-adf2-96f37cb05b4e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049951 Jul 26 18:40:34.643854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 918/1814] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:34 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:34.717449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4d58cb88-69f0-4a4d-ae88-269dac61494d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:34.720901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4d58cb88-69f0-4a4d-ae88-269dac61494d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:34.730237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d58cb88-69f0-4a4d-ae88-269dac61494d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:34.730675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d58cb88-69f0-4a4d-ae88-269dac61494d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:34.731468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d58cb88-69f0-4a4d-ae88-269dac61494d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:34.731893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d58cb88-69f0-4a4d-ae88-269dac61494d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:34.760923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4d58cb88-69f0-4a4d-ae88-269dac61494d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049891 Jul 26 18:40:34.761468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 897/1815] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:34 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:35.414911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-11986dcc-6992-4025-a12a-23515359550a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:35.418419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-11986dcc-6992-4025-a12a-23515359550a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:35.427922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11986dcc-6992-4025-a12a-23515359550a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:35.428382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11986dcc-6992-4025-a12a-23515359550a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:35.429373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11986dcc-6992-4025-a12a-23515359550a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:35.430209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11986dcc-6992-4025-a12a-23515359550a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:35.464609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-11986dcc-6992-4025-a12a-23515359550a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056088 Jul 26 18:40:35.465311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 919/1816] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:35 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:35.659452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-09389ba0-00a3-4970-8fec-4b392e8a13a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:35.661026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9536bfe2-95c6-4bce-a47d-ce0e186f0ffe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:35.662971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-09389ba0-00a3-4970-8fec-4b392e8a13a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:35.664441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9536bfe2-95c6-4bce-a47d-ce0e186f0ffe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:35.674378 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09389ba0-00a3-4970-8fec-4b392e8a13a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:35.674627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9536bfe2-95c6-4bce-a47d-ce0e186f0ffe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:35.675108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09389ba0-00a3-4970-8fec-4b392e8a13a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:35.675364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9536bfe2-95c6-4bce-a47d-ce0e186f0ffe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:35.676454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9536bfe2-95c6-4bce-a47d-ce0e186f0ffe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:35.676694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09389ba0-00a3-4970-8fec-4b392e8a13a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:35.677179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9536bfe2-95c6-4bce-a47d-ce0e186f0ffe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:35.677430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09389ba0-00a3-4970-8fec-4b392e8a13a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:35.703956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:35.708647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9536bfe2-95c6-4bce-a47d-ce0e186f0ffe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054395 Jul 26 18:40:35.709210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 920/1817] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:35 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:35.710441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-09389ba0-00a3-4970-8fec-4b392e8a13a2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057822 Jul 26 18:40:35.711000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 898/1818] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:35 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:35.776829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-df1294aa-945c-4340-ad23-dd7d5e0c1056 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:35.779275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-df1294aa-945c-4340-ad23-dd7d5e0c1056 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:35.789626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df1294aa-945c-4340-ad23-dd7d5e0c1056 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:35.790103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df1294aa-945c-4340-ad23-dd7d5e0c1056 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:35.790893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df1294aa-945c-4340-ad23-dd7d5e0c1056 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:35.791359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df1294aa-945c-4340-ad23-dd7d5e0c1056 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:35.822059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-df1294aa-945c-4340-ad23-dd7d5e0c1056 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051237 Jul 26 18:40:35.822613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 921/1819] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:35 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:36.483297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eb80403e-53b1-471e-b094-0723149e68e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:36.486803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eb80403e-53b1-471e-b094-0723149e68e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:36.496260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb80403e-53b1-471e-b094-0723149e68e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:36.496722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb80403e-53b1-471e-b094-0723149e68e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:36.497546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb80403e-53b1-471e-b094-0723149e68e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:36.497979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb80403e-53b1-471e-b094-0723149e68e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:36.527753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eb80403e-53b1-471e-b094-0723149e68e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051212 Jul 26 18:40:36.528297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 899/1820] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:36 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:36.725050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aa79f6d4-966c-4fe2-8171-96a8d59eb485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:36.726714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5897a7db-29f6-4ec0-a821-f2b35eaf2e56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:36.728523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aa79f6d4-966c-4fe2-8171-96a8d59eb485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:36.729867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5897a7db-29f6-4ec0-a821-f2b35eaf2e56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:36.735874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa79f6d4-966c-4fe2-8171-96a8d59eb485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:36.736220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa79f6d4-966c-4fe2-8171-96a8d59eb485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:36.736575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5897a7db-29f6-4ec0-a821-f2b35eaf2e56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:36.737015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5897a7db-29f6-4ec0-a821-f2b35eaf2e56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:36.737172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa79f6d4-966c-4fe2-8171-96a8d59eb485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:36.737446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa79f6d4-966c-4fe2-8171-96a8d59eb485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:36.737770 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5897a7db-29f6-4ec0-a821-f2b35eaf2e56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:36.738205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5897a7db-29f6-4ec0-a821-f2b35eaf2e56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:36.754700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:36.768226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5897a7db-29f6-4ec0-a821-f2b35eaf2e56 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048033 Jul 26 18:40:36.768446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aa79f6d4-966c-4fe2-8171-96a8d59eb485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049879 Jul 26 18:40:36.768769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 900/1821] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:36 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:36.769139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 922/1822] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:36 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:36.838907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ef88e4a2-f88c-4fe3-adc8-df19e8838924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:36.842554 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ef88e4a2-f88c-4fe3-adc8-df19e8838924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:36.852881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef88e4a2-f88c-4fe3-adc8-df19e8838924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:36.853638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef88e4a2-f88c-4fe3-adc8-df19e8838924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:36.854676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef88e4a2-f88c-4fe3-adc8-df19e8838924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:36.855174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef88e4a2-f88c-4fe3-adc8-df19e8838924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:36.884333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ef88e4a2-f88c-4fe3-adc8-df19e8838924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052184 Jul 26 18:40:36.884869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 901/1823] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:36 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:37.543596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ebcc246b-a316-4e82-828b-88ffabbfa16d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:37.545735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ebcc246b-a316-4e82-828b-88ffabbfa16d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:37.552225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ebcc246b-a316-4e82-828b-88ffabbfa16d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:37.552669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ebcc246b-a316-4e82-828b-88ffabbfa16d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:37.553465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ebcc246b-a316-4e82-828b-88ffabbfa16d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:37.553927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ebcc246b-a316-4e82-828b-88ffabbfa16d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:37.583200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ebcc246b-a316-4e82-828b-88ffabbfa16d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045470 Jul 26 18:40:37.583935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 923/1824] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:37 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:37.781654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3aac2fb1-9f66-4ac7-90ff-be517771de0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:37.782255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8f3e08e6-823e-47d2-b4b1-1918528f8b9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:37.784575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8f3e08e6-823e-47d2-b4b1-1918528f8b9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:37.784773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3aac2fb1-9f66-4ac7-90ff-be517771de0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:37.792618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f3e08e6-823e-47d2-b4b1-1918528f8b9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:37.792800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3aac2fb1-9f66-4ac7-90ff-be517771de0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:37.792970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f3e08e6-823e-47d2-b4b1-1918528f8b9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:37.793101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3aac2fb1-9f66-4ac7-90ff-be517771de0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:37.793751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f3e08e6-823e-47d2-b4b1-1918528f8b9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:37.793897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3aac2fb1-9f66-4ac7-90ff-be517771de0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:37.794176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f3e08e6-823e-47d2-b4b1-1918528f8b9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:37.794333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3aac2fb1-9f66-4ac7-90ff-be517771de0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:37.823698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3aac2fb1-9f66-4ac7-90ff-be517771de0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046453 Jul 26 18:40:37.824520 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 902/1825] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:37 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:37.824975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8f3e08e6-823e-47d2-b4b1-1918528f8b9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047270 Jul 26 18:40:37.825530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 924/1826] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:37.900147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-76326a21-e57d-4961-8df3-a5432ff1e3ef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:37.902968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-76326a21-e57d-4961-8df3-a5432ff1e3ef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:37.910332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76326a21-e57d-4961-8df3-a5432ff1e3ef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:37.910856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76326a21-e57d-4961-8df3-a5432ff1e3ef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:37.911794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76326a21-e57d-4961-8df3-a5432ff1e3ef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:37.912303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-76326a21-e57d-4961-8df3-a5432ff1e3ef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:37.945086 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-76326a21-e57d-4961-8df3-a5432ff1e3ef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051705 Jul 26 18:40:37.945628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 903/1827] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:37 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:38.599704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-303fbb04-3639-49d6-8faa-8bf585a094f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:38.603253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-303fbb04-3639-49d6-8faa-8bf585a094f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:38.610076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-303fbb04-3639-49d6-8faa-8bf585a094f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:38.610518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-303fbb04-3639-49d6-8faa-8bf585a094f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:38.611313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-303fbb04-3639-49d6-8faa-8bf585a094f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:38.611736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-303fbb04-3639-49d6-8faa-8bf585a094f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:38.641217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-303fbb04-3639-49d6-8faa-8bf585a094f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048146 Jul 26 18:40:38.641757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 925/1828] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:38 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:38.837871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7e23f2a6-9bb3-4796-a56d-fc55418c563d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:38.839001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a4e2afed-3ebd-4140-9d16-7d43fa9ee8e9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:38.840263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7e23f2a6-9bb3-4796-a56d-fc55418c563d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:38.841176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a4e2afed-3ebd-4140-9d16-7d43fa9ee8e9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:38.846885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e23f2a6-9bb3-4796-a56d-fc55418c563d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:38.847359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e23f2a6-9bb3-4796-a56d-fc55418c563d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:38.847539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4e2afed-3ebd-4140-9d16-7d43fa9ee8e9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:38.847969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4e2afed-3ebd-4140-9d16-7d43fa9ee8e9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:38.848082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e23f2a6-9bb3-4796-a56d-fc55418c563d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:38.848519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e23f2a6-9bb3-4796-a56d-fc55418c563d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:38.848717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4e2afed-3ebd-4140-9d16-7d43fa9ee8e9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:38.849136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a4e2afed-3ebd-4140-9d16-7d43fa9ee8e9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:38.877035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7e23f2a6-9bb3-4796-a56d-fc55418c563d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Jul 26 18:40:38.877512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 904/1829] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:38 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:38.878223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a4e2afed-3ebd-4140-9d16-7d43fa9ee8e9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044309 Jul 26 18:40:38.878845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 926/1830] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:38.961237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2a790d94-5c24-46e2-b7e0-64ffb31bcc3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:38.964346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2a790d94-5c24-46e2-b7e0-64ffb31bcc3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:38.970894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a790d94-5c24-46e2-b7e0-64ffb31bcc3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:38.971382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a790d94-5c24-46e2-b7e0-64ffb31bcc3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:38.972174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a790d94-5c24-46e2-b7e0-64ffb31bcc3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:38.972629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a790d94-5c24-46e2-b7e0-64ffb31bcc3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:39.005133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2a790d94-5c24-46e2-b7e0-64ffb31bcc3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050336 Jul 26 18:40:39.005680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 905/1831] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:38 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:39.658400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b5ea870f-ac94-4586-be31-9192a6285785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:39.661912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b5ea870f-ac94-4586-be31-9192a6285785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:39.672456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5ea870f-ac94-4586-be31-9192a6285785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:39.673090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5ea870f-ac94-4586-be31-9192a6285785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:39.674338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5ea870f-ac94-4586-be31-9192a6285785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:39.675075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5ea870f-ac94-4586-be31-9192a6285785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:39.707355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b5ea870f-ac94-4586-be31-9192a6285785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055636 Jul 26 18:40:39.707896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 927/1832] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:39 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:39.893663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bb1b583e-efc7-4dab-979c-73bbddb0d9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:39.895889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a6d744e0-9055-45db-9497-bf2e1f4b7e8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:39.897190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bb1b583e-efc7-4dab-979c-73bbddb0d9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:39.899724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a6d744e0-9055-45db-9497-bf2e1f4b7e8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:39.908517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb1b583e-efc7-4dab-979c-73bbddb0d9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:39.909240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb1b583e-efc7-4dab-979c-73bbddb0d9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:39.910345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a6d744e0-9055-45db-9497-bf2e1f4b7e8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:39.910551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb1b583e-efc7-4dab-979c-73bbddb0d9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:39.911253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb1b583e-efc7-4dab-979c-73bbddb0d9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:39.911504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a6d744e0-9055-45db-9497-bf2e1f4b7e8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:39.912531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a6d744e0-9055-45db-9497-bf2e1f4b7e8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:39.913262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a6d744e0-9055-45db-9497-bf2e1f4b7e8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:39.942273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bb1b583e-efc7-4dab-979c-73bbddb0d9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055172 Jul 26 18:40:39.942761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 906/1833] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:39 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:39.943630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a6d744e0-9055-45db-9497-bf2e1f4b7e8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054384 Jul 26 18:40:39.944520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 928/1834] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:40.021436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-291ca9eb-85c8-40f9-9fa8-d1c2778e173e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:40.025289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-291ca9eb-85c8-40f9-9fa8-d1c2778e173e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:40.035520 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-291ca9eb-85c8-40f9-9fa8-d1c2778e173e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:40.036303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-291ca9eb-85c8-40f9-9fa8-d1c2778e173e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:40.037558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-291ca9eb-85c8-40f9-9fa8-d1c2778e173e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:40.038275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-291ca9eb-85c8-40f9-9fa8-d1c2778e173e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:40.068778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-291ca9eb-85c8-40f9-9fa8-d1c2778e173e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053883 Jul 26 18:40:40.069330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 907/1835] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:40 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:40.720160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d257473d-8bca-4d56-b9f1-cb642e0ee05a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:40.722348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d257473d-8bca-4d56-b9f1-cb642e0ee05a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:40.728981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d257473d-8bca-4d56-b9f1-cb642e0ee05a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:40.729550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d257473d-8bca-4d56-b9f1-cb642e0ee05a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:40.730362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d257473d-8bca-4d56-b9f1-cb642e0ee05a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:40.730796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d257473d-8bca-4d56-b9f1-cb642e0ee05a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:40.761772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d257473d-8bca-4d56-b9f1-cb642e0ee05a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045629 Jul 26 18:40:40.762337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 929/1836] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:40 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:40.956242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3d2e1f60-d902-440a-8e07-5359d9b07f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:40.958289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-da74845b-35a3-4f2f-8d9a-0ad2046350d0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:40.958990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3d2e1f60-d902-440a-8e07-5359d9b07f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:40.961204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-da74845b-35a3-4f2f-8d9a-0ad2046350d0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:40.967671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d2e1f60-d902-440a-8e07-5359d9b07f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:40.968426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d2e1f60-d902-440a-8e07-5359d9b07f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:40.968583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da74845b-35a3-4f2f-8d9a-0ad2046350d0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:40.968921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da74845b-35a3-4f2f-8d9a-0ad2046350d0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:40.969311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d2e1f60-d902-440a-8e07-5359d9b07f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:40.969678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da74845b-35a3-4f2f-8d9a-0ad2046350d0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:40.969941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d2e1f60-d902-440a-8e07-5359d9b07f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:40.970087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da74845b-35a3-4f2f-8d9a-0ad2046350d0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:41.000874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-da74845b-35a3-4f2f-8d9a-0ad2046350d0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048156 Jul 26 18:40:41.001441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 930/1837] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:40 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:41.002232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3d2e1f60-d902-440a-8e07-5359d9b07f1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051376 Jul 26 18:40:41.002815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 908/1838] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:40 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:41.083860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4a6f5906-3e78-4b84-96c0-b72e7c72d0ba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:41.086824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4a6f5906-3e78-4b84-96c0-b72e7c72d0ba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:41.094118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a6f5906-3e78-4b84-96c0-b72e7c72d0ba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:41.094561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a6f5906-3e78-4b84-96c0-b72e7c72d0ba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:41.095355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a6f5906-3e78-4b84-96c0-b72e7c72d0ba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:41.095785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a6f5906-3e78-4b84-96c0-b72e7c72d0ba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:41.126703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4a6f5906-3e78-4b84-96c0-b72e7c72d0ba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047213 Jul 26 18:40:41.127280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 931/1839] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:41 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:41.777835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-77ce2fd7-d7bf-49ee-a2f2-c9723ab77b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:41.780033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-77ce2fd7-d7bf-49ee-a2f2-c9723ab77b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:41.786530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77ce2fd7-d7bf-49ee-a2f2-c9723ab77b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:41.786978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77ce2fd7-d7bf-49ee-a2f2-c9723ab77b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:41.787794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77ce2fd7-d7bf-49ee-a2f2-c9723ab77b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:41.788209 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77ce2fd7-d7bf-49ee-a2f2-c9723ab77b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:41.817736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-77ce2fd7-d7bf-49ee-a2f2-c9723ab77b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045741 Jul 26 18:40:41.818207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 909/1840] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:41 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:42.016977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3156bc5f-4ca0-41f8-b3ba-1dbdfa38d4ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:42.018430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-74ead226-f9c2-4c83-a8c4-166860a80eaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:42.020466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3156bc5f-4ca0-41f8-b3ba-1dbdfa38d4ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:42.021870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-74ead226-f9c2-4c83-a8c4-166860a80eaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:42.031748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3156bc5f-4ca0-41f8-b3ba-1dbdfa38d4ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:42.032496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3156bc5f-4ca0-41f8-b3ba-1dbdfa38d4ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:42.033007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-74ead226-f9c2-4c83-a8c4-166860a80eaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:42.033761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3156bc5f-4ca0-41f8-b3ba-1dbdfa38d4ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:42.034014 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-74ead226-f9c2-4c83-a8c4-166860a80eaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:42.034455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3156bc5f-4ca0-41f8-b3ba-1dbdfa38d4ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:42.035476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-74ead226-f9c2-4c83-a8c4-166860a80eaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:42.036200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-74ead226-f9c2-4c83-a8c4-166860a80eaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:42.066478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3156bc5f-4ca0-41f8-b3ba-1dbdfa38d4ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056398 Jul 26 18:40:42.067278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 932/1841] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:42.068078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-74ead226-f9c2-4c83-a8c4-166860a80eaa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056238 Jul 26 18:40:42.068577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 910/1842] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:42 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:42.140382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2bd35423-4734-451f-99b8-444aaaf4f0c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:42.142556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2bd35423-4734-451f-99b8-444aaaf4f0c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:42.149405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bd35423-4734-451f-99b8-444aaaf4f0c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:42.149849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bd35423-4734-451f-99b8-444aaaf4f0c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:42.150616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bd35423-4734-451f-99b8-444aaaf4f0c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:42.151064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bd35423-4734-451f-99b8-444aaaf4f0c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:42.180772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2bd35423-4734-451f-99b8-444aaaf4f0c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044330 Jul 26 18:40:42.181322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 933/1843] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:42 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:42.427575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:40:42.427905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:40:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:40:42.834085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f1bd1f9b-cf39-47cb-a542-d69308991098 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:42.837536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f1bd1f9b-cf39-47cb-a542-d69308991098 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:42.847858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1bd1f9b-cf39-47cb-a542-d69308991098 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:42.848607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1bd1f9b-cf39-47cb-a542-d69308991098 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:42.849929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1bd1f9b-cf39-47cb-a542-d69308991098 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:42.850650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f1bd1f9b-cf39-47cb-a542-d69308991098 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:42.882607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f1bd1f9b-cf39-47cb-a542-d69308991098 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055211 Jul 26 18:40:42.883189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 911/1844] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:42 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:43.082269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cee96cc5-c9f0-4336-8e95-650c076937dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:43.085587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cee96cc5-c9f0-4336-8e95-650c076937dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:43.090663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-91082ef5-6e3f-4db7-9012-67d81e6b9211 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:43.093968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-91082ef5-6e3f-4db7-9012-67d81e6b9211 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:43.096024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cee96cc5-c9f0-4336-8e95-650c076937dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:43.096702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cee96cc5-c9f0-4336-8e95-650c076937dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:43.097862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cee96cc5-c9f0-4336-8e95-650c076937dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:43.098516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cee96cc5-c9f0-4336-8e95-650c076937dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:43.104275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91082ef5-6e3f-4db7-9012-67d81e6b9211 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:43.104731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91082ef5-6e3f-4db7-9012-67d81e6b9211 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:43.105529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91082ef5-6e3f-4db7-9012-67d81e6b9211 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:43.105985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91082ef5-6e3f-4db7-9012-67d81e6b9211 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:43.129565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cee96cc5-c9f0-4336-8e95-650c076937dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053534 Jul 26 18:40:43.130120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 934/1845] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:43.135688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-91082ef5-6e3f-4db7-9012-67d81e6b9211 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056571 Jul 26 18:40:43.136273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 912/1846] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:43 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:43.196321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5a51aeee-4fee-4e36-9313-e2478d079f11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:43.199810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5a51aeee-4fee-4e36-9313-e2478d079f11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:43.209880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a51aeee-4fee-4e36-9313-e2478d079f11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:43.210607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a51aeee-4fee-4e36-9313-e2478d079f11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:43.211908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a51aeee-4fee-4e36-9313-e2478d079f11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:43.212611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a51aeee-4fee-4e36-9313-e2478d079f11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:43.241499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5a51aeee-4fee-4e36-9313-e2478d079f11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051671 Jul 26 18:40:43.242041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 935/1847] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:43 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:43.901250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4a3ac72f-732f-4d84-b4d8-b1b997a1b600 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:43.903421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4a3ac72f-732f-4d84-b4d8-b1b997a1b600 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:43.910129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a3ac72f-732f-4d84-b4d8-b1b997a1b600 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:43.910576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a3ac72f-732f-4d84-b4d8-b1b997a1b600 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:43.911375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a3ac72f-732f-4d84-b4d8-b1b997a1b600 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:43.911809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a3ac72f-732f-4d84-b4d8-b1b997a1b600 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:43.942506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4a3ac72f-732f-4d84-b4d8-b1b997a1b600 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048239 Jul 26 18:40:43.943062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 913/1848] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:43 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:44.146183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e0c39945-4ff7-4577-a93c-8f633dd1773e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:44.149977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e0c39945-4ff7-4577-a93c-8f633dd1773e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:44.152047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dc43c8ed-c307-4f5b-afaa-318517d2cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:44.153880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dc43c8ed-c307-4f5b-afaa-318517d2cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:44.157253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0c39945-4ff7-4577-a93c-8f633dd1773e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:44.157695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0c39945-4ff7-4577-a93c-8f633dd1773e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:44.158450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0c39945-4ff7-4577-a93c-8f633dd1773e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:44.158879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0c39945-4ff7-4577-a93c-8f633dd1773e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:44.160736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc43c8ed-c307-4f5b-afaa-318517d2cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:44.161184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc43c8ed-c307-4f5b-afaa-318517d2cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:44.161930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc43c8ed-c307-4f5b-afaa-318517d2cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:44.162380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc43c8ed-c307-4f5b-afaa-318517d2cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:44.188528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e0c39945-4ff7-4577-a93c-8f633dd1773e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049158 Jul 26 18:40:44.189355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 936/1849] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:44 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:44.191314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dc43c8ed-c307-4f5b-afaa-318517d2cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046187 Jul 26 18:40:44.191867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 914/1850] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:44 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:44.257035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c6103235-f7f5-46ad-b734-898d8a5f5b3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:44.260266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c6103235-f7f5-46ad-b734-898d8a5f5b3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:44.266658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6103235-f7f5-46ad-b734-898d8a5f5b3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:44.267229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6103235-f7f5-46ad-b734-898d8a5f5b3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:44.267989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6103235-f7f5-46ad-b734-898d8a5f5b3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:44.269019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6103235-f7f5-46ad-b734-898d8a5f5b3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:44.299340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c6103235-f7f5-46ad-b734-898d8a5f5b3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048260 Jul 26 18:40:44.299891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 937/1851] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:44 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:44.959542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0e5f8ce5-3281-49e9-bab4-68c59a961f88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:44.962991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0e5f8ce5-3281-49e9-bab4-68c59a961f88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:44.969568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e5f8ce5-3281-49e9-bab4-68c59a961f88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:44.970030 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e5f8ce5-3281-49e9-bab4-68c59a961f88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:44.970800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e5f8ce5-3281-49e9-bab4-68c59a961f88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:44.971315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e5f8ce5-3281-49e9-bab4-68c59a961f88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:44.986648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:45.002596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0e5f8ce5-3281-49e9-bab4-68c59a961f88 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049696 Jul 26 18:40:45.003101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 915/1852] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:44 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:45.205100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4084ac09-5a7f-40fb-af7b-e08054ed9b82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:45.207760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-81cd29b8-cd81-420a-8681-9da5f3732394 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:45.208578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4084ac09-5a7f-40fb-af7b-e08054ed9b82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:45.211401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-81cd29b8-cd81-420a-8681-9da5f3732394 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:45.219710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4084ac09-5a7f-40fb-af7b-e08054ed9b82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:45.220458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4084ac09-5a7f-40fb-af7b-e08054ed9b82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:45.221724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4084ac09-5a7f-40fb-af7b-e08054ed9b82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:45.221967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-81cd29b8-cd81-420a-8681-9da5f3732394 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:45.222443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4084ac09-5a7f-40fb-af7b-e08054ed9b82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:45.222686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-81cd29b8-cd81-420a-8681-9da5f3732394 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:45.223808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-81cd29b8-cd81-420a-8681-9da5f3732394 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:45.224515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-81cd29b8-cd81-420a-8681-9da5f3732394 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:45.255088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4084ac09-5a7f-40fb-af7b-e08054ed9b82 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056353 Jul 26 18:40:45.255324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-81cd29b8-cd81-420a-8681-9da5f3732394 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054262 Jul 26 18:40:45.255886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 938/1853] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:45.259184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 916/1854] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:45 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:45.315571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-82859b8b-224d-44b3-acaf-ca7822896647 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:45.318895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-82859b8b-224d-44b3-acaf-ca7822896647 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:45.326720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82859b8b-224d-44b3-acaf-ca7822896647 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:45.327210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82859b8b-224d-44b3-acaf-ca7822896647 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:45.327978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82859b8b-224d-44b3-acaf-ca7822896647 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:45.328444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82859b8b-224d-44b3-acaf-ca7822896647 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:45.332015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:45.357823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-82859b8b-224d-44b3-acaf-ca7822896647 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048767 Jul 26 18:40:45.358430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 939/1855] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:45 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:46.015439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-51b731b1-babd-42bc-acff-c522a1814044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:46.017611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-51b731b1-babd-42bc-acff-c522a1814044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:46.024901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-51b731b1-babd-42bc-acff-c522a1814044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:46.025354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-51b731b1-babd-42bc-acff-c522a1814044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:46.026100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-51b731b1-babd-42bc-acff-c522a1814044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:46.026656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-51b731b1-babd-42bc-acff-c522a1814044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:46.058197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-51b731b1-babd-42bc-acff-c522a1814044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046882 Jul 26 18:40:46.058785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 917/1856] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:46 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:46.271213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-283e371f-c511-478f-940f-1c3035f2f1ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:46.272075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6678ca41-8e4f-4d0b-b667-18fa012e0775 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:46.274927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-283e371f-c511-478f-940f-1c3035f2f1ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:46.275258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6678ca41-8e4f-4d0b-b667-18fa012e0775 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:46.282361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-283e371f-c511-478f-940f-1c3035f2f1ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:46.282542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6678ca41-8e4f-4d0b-b667-18fa012e0775 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:46.282807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6678ca41-8e4f-4d0b-b667-18fa012e0775 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:46.283082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-283e371f-c511-478f-940f-1c3035f2f1ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:46.283702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-283e371f-c511-478f-940f-1c3035f2f1ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:46.283844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6678ca41-8e4f-4d0b-b667-18fa012e0775 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:46.284118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-283e371f-c511-478f-940f-1c3035f2f1ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:46.284244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6678ca41-8e4f-4d0b-b667-18fa012e0775 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:46.313521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6678ca41-8e4f-4d0b-b667-18fa012e0775 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048767 Jul 26 18:40:46.313772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-283e371f-c511-478f-940f-1c3035f2f1ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049155 Jul 26 18:40:46.314096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 918/1857] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:46.314566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 940/1858] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:46 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:46.370508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5f95b385-a441-4598-a938-bd5e4bab6724 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:46.372634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5f95b385-a441-4598-a938-bd5e4bab6724 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:46.379061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f95b385-a441-4598-a938-bd5e4bab6724 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:46.379542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f95b385-a441-4598-a938-bd5e4bab6724 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:46.380306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f95b385-a441-4598-a938-bd5e4bab6724 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:46.380741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f95b385-a441-4598-a938-bd5e4bab6724 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:46.410165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5f95b385-a441-4598-a938-bd5e4bab6724 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Jul 26 18:40:46.410714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 919/1859] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:46 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:47.074131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5838a4f4-f79f-456f-8c51-1c9835561080 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:47.077519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5838a4f4-f79f-456f-8c51-1c9835561080 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:47.088129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5838a4f4-f79f-456f-8c51-1c9835561080 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:47.088700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5838a4f4-f79f-456f-8c51-1c9835561080 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:47.089458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5838a4f4-f79f-456f-8c51-1c9835561080 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:47.089885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5838a4f4-f79f-456f-8c51-1c9835561080 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:47.119676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5838a4f4-f79f-456f-8c51-1c9835561080 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052139 Jul 26 18:40:47.120216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 941/1860] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:47 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:47.330363 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-397062e7-2326-4974-a0c9-5ecef42f25fb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:47.331229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2a8dc82f-30a2-4e99-a7e3-0d86d4d54c55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:47.333767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-397062e7-2326-4974-a0c9-5ecef42f25fb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:47.334057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2a8dc82f-30a2-4e99-a7e3-0d86d4d54c55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:47.344568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a8dc82f-30a2-4e99-a7e3-0d86d4d54c55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:47.344844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-397062e7-2326-4974-a0c9-5ecef42f25fb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:47.345303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a8dc82f-30a2-4e99-a7e3-0d86d4d54c55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:47.345546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-397062e7-2326-4974-a0c9-5ecef42f25fb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:47.346542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a8dc82f-30a2-4e99-a7e3-0d86d4d54c55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:47.346787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-397062e7-2326-4974-a0c9-5ecef42f25fb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:47.347302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a8dc82f-30a2-4e99-a7e3-0d86d4d54c55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:47.347542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-397062e7-2326-4974-a0c9-5ecef42f25fb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:47.380721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-397062e7-2326-4974-a0c9-5ecef42f25fb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057042 Jul 26 18:40:47.380977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2a8dc82f-30a2-4e99-a7e3-0d86d4d54c55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057449 Jul 26 18:40:47.381499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 920/1861] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:47 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:47.385516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 942/1862] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:47 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:47.427280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3da3025b-756a-438b-9c14-79719d219c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:47.430738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3da3025b-756a-438b-9c14-79719d219c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:47.440616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3da3025b-756a-438b-9c14-79719d219c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:47.441327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3da3025b-756a-438b-9c14-79719d219c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:47.442587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3da3025b-756a-438b-9c14-79719d219c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:47.443531 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3da3025b-756a-438b-9c14-79719d219c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:47.476068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3da3025b-756a-438b-9c14-79719d219c0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056593 Jul 26 18:40:47.476659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 921/1863] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:47 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:48.133040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6a076b6a-dc16-4e9f-ac53-9df1ec47e5ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:48.135267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6a076b6a-dc16-4e9f-ac53-9df1ec47e5ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:48.141772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6a076b6a-dc16-4e9f-ac53-9df1ec47e5ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:48.142219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6a076b6a-dc16-4e9f-ac53-9df1ec47e5ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:48.142982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6a076b6a-dc16-4e9f-ac53-9df1ec47e5ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:48.143427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6a076b6a-dc16-4e9f-ac53-9df1ec47e5ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:48.173903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6a076b6a-dc16-4e9f-ac53-9df1ec47e5ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045218 Jul 26 18:40:48.174483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 943/1864] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:48 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:48.397994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fdb680ac-bb64-4ec4-a755-90836edb8e11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:48.398968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-968cd2d5-efce-485a-82c3-079bf141fa71 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:48.401204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-968cd2d5-efce-485a-82c3-079bf141fa71 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:48.401343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fdb680ac-bb64-4ec4-a755-90836edb8e11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:48.408175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdb680ac-bb64-4ec4-a755-90836edb8e11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:48.408373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-968cd2d5-efce-485a-82c3-079bf141fa71 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:48.408620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdb680ac-bb64-4ec4-a755-90836edb8e11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:48.408788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-968cd2d5-efce-485a-82c3-079bf141fa71 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:48.409393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-968cd2d5-efce-485a-82c3-079bf141fa71 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:48.409554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdb680ac-bb64-4ec4-a755-90836edb8e11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:48.409815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-968cd2d5-efce-485a-82c3-079bf141fa71 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:48.409984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdb680ac-bb64-4ec4-a755-90836edb8e11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:48.438890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fdb680ac-bb64-4ec4-a755-90836edb8e11 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047879 Jul 26 18:40:48.439467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 944/1865] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:48 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:48.439647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-968cd2d5-efce-485a-82c3-079bf141fa71 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048860 Jul 26 18:40:48.440195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 922/1866] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:48.489269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-49a7d06a-d88c-4d8a-8e9b-312b45f8f1f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:48.491490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-49a7d06a-d88c-4d8a-8e9b-312b45f8f1f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:48.497687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49a7d06a-d88c-4d8a-8e9b-312b45f8f1f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:48.498128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49a7d06a-d88c-4d8a-8e9b-312b45f8f1f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:48.498883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49a7d06a-d88c-4d8a-8e9b-312b45f8f1f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:48.499336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49a7d06a-d88c-4d8a-8e9b-312b45f8f1f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:48.528359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-49a7d06a-d88c-4d8a-8e9b-312b45f8f1f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043034 Jul 26 18:40:48.528861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 945/1867] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:48 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:40:49.190529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6a4c47bf-93c8-49ee-960a-c246950f459f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:49.193960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6a4c47bf-93c8-49ee-960a-c246950f459f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:49.204866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a4c47bf-93c8-49ee-960a-c246950f459f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:49.205604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a4c47bf-93c8-49ee-960a-c246950f459f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:49.206860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a4c47bf-93c8-49ee-960a-c246950f459f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:49.207613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a4c47bf-93c8-49ee-960a-c246950f459f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:49.238596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6a4c47bf-93c8-49ee-960a-c246950f459f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054825 Jul 26 18:40:49.239187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 923/1868] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:49 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:49.456631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f959b9da-66bb-448b-ba66-ac4739b88b2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:49.460250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d86ea57f-b60b-4331-96d7-5e5856b38e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:49.461058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f959b9da-66bb-448b-ba66-ac4739b88b2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:49.464276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d86ea57f-b60b-4331-96d7-5e5856b38e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:49.468721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f959b9da-66bb-448b-ba66-ac4739b88b2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:49.469170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f959b9da-66bb-448b-ba66-ac4739b88b2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:49.469945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f959b9da-66bb-448b-ba66-ac4739b88b2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:49.470379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f959b9da-66bb-448b-ba66-ac4739b88b2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:49.471669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d86ea57f-b60b-4331-96d7-5e5856b38e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:49.472110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d86ea57f-b60b-4331-96d7-5e5856b38e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:49.472871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d86ea57f-b60b-4331-96d7-5e5856b38e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:49.473296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d86ea57f-b60b-4331-96d7-5e5856b38e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:49.499526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f959b9da-66bb-448b-ba66-ac4739b88b2d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049674 Jul 26 18:40:49.500090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 946/1869] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:49 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:40:49.502896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d86ea57f-b60b-4331-96d7-5e5856b38e42 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052784 Jul 26 18:40:49.503479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 924/1870] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:49 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 18:40:49.540588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9eeed752-c19f-4cf3-852f-caca719b4abc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:49.542776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9eeed752-c19f-4cf3-852f-caca719b4abc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:49.548708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9eeed752-c19f-4cf3-852f-caca719b4abc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:49.549130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9eeed752-c19f-4cf3-852f-caca719b4abc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:49.549929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9eeed752-c19f-4cf3-852f-caca719b4abc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:49.550305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9eeed752-c19f-4cf3-852f-caca719b4abc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:49.582216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9eeed752-c19f-4cf3-852f-caca719b4abc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045337 Jul 26 18:40:49.582772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 947/1871] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:49 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:40:50.255671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5897e474-2ca2-4835-bbac-eb57c182baa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:50.259206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5897e474-2ca2-4835-bbac-eb57c182baa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:50.261574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:50.267442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5897e474-2ca2-4835-bbac-eb57c182baa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:50.267882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5897e474-2ca2-4835-bbac-eb57c182baa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:50.268638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5897e474-2ca2-4835-bbac-eb57c182baa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:50.269067 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5897e474-2ca2-4835-bbac-eb57c182baa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:50.298799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5897e474-2ca2-4835-bbac-eb57c182baa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049978 Jul 26 18:40:50.299406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 925/1872] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:50 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:50.514910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0bb83fbf-b623-4eed-997d-04e66fdbf9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:50.516144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-16882125-fc4d-436f-b528-d0553f4e353d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:50.517118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0bb83fbf-b623-4eed-997d-04e66fdbf9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:50.518644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-16882125-fc4d-436f-b528-d0553f4e353d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:50.524330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0bb83fbf-b623-4eed-997d-04e66fdbf9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:50.524800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0bb83fbf-b623-4eed-997d-04e66fdbf9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:50.525627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0bb83fbf-b623-4eed-997d-04e66fdbf9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:50.526074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0bb83fbf-b623-4eed-997d-04e66fdbf9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:50.526460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16882125-fc4d-436f-b528-d0553f4e353d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:50.526909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16882125-fc4d-436f-b528-d0553f4e353d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:50.527715 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16882125-fc4d-436f-b528-d0553f4e353d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:50.528173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-16882125-fc4d-436f-b528-d0553f4e353d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:50.556965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0bb83fbf-b623-4eed-997d-04e66fdbf9ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047252 Jul 26 18:40:50.557540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 948/1873] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:50 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:50.558623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-16882125-fc4d-436f-b528-d0553f4e353d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046525 Jul 26 18:40:50.559205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 926/1874] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:50 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:50.593864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f440d335-68b5-4cf8-b410-e00628d411c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:50.596091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f440d335-68b5-4cf8-b410-e00628d411c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:50.602833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f440d335-68b5-4cf8-b410-e00628d411c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:50.603299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f440d335-68b5-4cf8-b410-e00628d411c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:50.604192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f440d335-68b5-4cf8-b410-e00628d411c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:50.604621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f440d335-68b5-4cf8-b410-e00628d411c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:50.634566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f440d335-68b5-4cf8-b410-e00628d411c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 Jul 26 18:40:50.635145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 949/1875] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:50 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:51.317401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-943d912b-7f6d-4c84-9508-4eb755fc8929 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:51.320977 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-943d912b-7f6d-4c84-9508-4eb755fc8929 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:51.328185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-943d912b-7f6d-4c84-9508-4eb755fc8929 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:51.328632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-943d912b-7f6d-4c84-9508-4eb755fc8929 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:51.329385 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-943d912b-7f6d-4c84-9508-4eb755fc8929 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:51.329810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-943d912b-7f6d-4c84-9508-4eb755fc8929 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:51.361380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-943d912b-7f6d-4c84-9508-4eb755fc8929 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050553 Jul 26 18:40:51.362252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 927/1876] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:51 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:51.572982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7a5386a1-fb3b-464b-b032-8407a965643c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:51.573886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0834b077-40be-40dc-9382-92e75e6fa5ed tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:51.575082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0834b077-40be-40dc-9382-92e75e6fa5ed tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:51.576999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7a5386a1-fb3b-464b-b032-8407a965643c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:51.582676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0834b077-40be-40dc-9382-92e75e6fa5ed tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:51.583594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0834b077-40be-40dc-9382-92e75e6fa5ed tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:51.583932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0834b077-40be-40dc-9382-92e75e6fa5ed tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:51.584357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0834b077-40be-40dc-9382-92e75e6fa5ed tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:51.589266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a5386a1-fb3b-464b-b032-8407a965643c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:51.591319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a5386a1-fb3b-464b-b032-8407a965643c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:51.592135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a5386a1-fb3b-464b-b032-8407a965643c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:51.592578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a5386a1-fb3b-464b-b032-8407a965643c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:51.617808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0834b077-40be-40dc-9382-92e75e6fa5ed tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050262 Jul 26 18:40:51.618582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 928/1877] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:51.624831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7a5386a1-fb3b-464b-b032-8407a965643c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057381 Jul 26 18:40:51.625494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 950/1878] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:51 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:51.646377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a5b9c596-b169-4b41-9547-dd06f5afa16c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:51.649012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a5b9c596-b169-4b41-9547-dd06f5afa16c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:51.655568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5b9c596-b169-4b41-9547-dd06f5afa16c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:51.656013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5b9c596-b169-4b41-9547-dd06f5afa16c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:51.656785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5b9c596-b169-4b41-9547-dd06f5afa16c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:51.657214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5b9c596-b169-4b41-9547-dd06f5afa16c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:51.687897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a5b9c596-b169-4b41-9547-dd06f5afa16c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045813 Jul 26 18:40:51.688463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 929/1879] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:51 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:52.378407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3597065b-2c8b-4d10-85fc-32ede7e4a5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:52.381893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3597065b-2c8b-4d10-85fc-32ede7e4a5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:52.392446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3597065b-2c8b-4d10-85fc-32ede7e4a5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:52.393195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3597065b-2c8b-4d10-85fc-32ede7e4a5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:52.394467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3597065b-2c8b-4d10-85fc-32ede7e4a5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:52.395230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3597065b-2c8b-4d10-85fc-32ede7e4a5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:52.428487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3597065b-2c8b-4d10-85fc-32ede7e4a5d6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056841 Jul 26 18:40:52.429043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 951/1880] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:52 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:52.634725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-30659396-7070-4c7d-94d7-f48796560bf5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:52.637222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-30659396-7070-4c7d-94d7-f48796560bf5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:52.638810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-16e6ee9f-c9a6-46af-9153-20da405e6401 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:52.640954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-16e6ee9f-c9a6-46af-9153-20da405e6401 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:52.643301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:52.644165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30659396-7070-4c7d-94d7-f48796560bf5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:52.644628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30659396-7070-4c7d-94d7-f48796560bf5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:52.645521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30659396-7070-4c7d-94d7-f48796560bf5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:52.645972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30659396-7070-4c7d-94d7-f48796560bf5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:52.649670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16e6ee9f-c9a6-46af-9153-20da405e6401 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:52.650115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16e6ee9f-c9a6-46af-9153-20da405e6401 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:52.651176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16e6ee9f-c9a6-46af-9153-20da405e6401 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:52.651612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16e6ee9f-c9a6-46af-9153-20da405e6401 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:52.675976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-30659396-7070-4c7d-94d7-f48796560bf5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047865 Jul 26 18:40:52.676540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 930/1881] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:52.680150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-16e6ee9f-c9a6-46af-9153-20da405e6401 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045591 Jul 26 18:40:52.680722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 952/1882] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:52 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:52.700234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-167fca17-ebe0-42ab-8517-5697d69f8815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:52.702306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-167fca17-ebe0-42ab-8517-5697d69f8815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:52.708368 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-167fca17-ebe0-42ab-8517-5697d69f8815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:52.708812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-167fca17-ebe0-42ab-8517-5697d69f8815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:52.709567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-167fca17-ebe0-42ab-8517-5697d69f8815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:52.709993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-167fca17-ebe0-42ab-8517-5697d69f8815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:52.738522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-167fca17-ebe0-42ab-8517-5697d69f8815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042212 Jul 26 18:40:52.739051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 931/1883] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:52 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:53.442907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-828ce649-37cc-4624-9c6d-a6e114420f97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:53.445341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-828ce649-37cc-4624-9c6d-a6e114420f97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:53.452091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-828ce649-37cc-4624-9c6d-a6e114420f97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:53.452508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-828ce649-37cc-4624-9c6d-a6e114420f97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:53.453304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-828ce649-37cc-4624-9c6d-a6e114420f97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:53.453743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-828ce649-37cc-4624-9c6d-a6e114420f97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:53.484862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-828ce649-37cc-4624-9c6d-a6e114420f97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046571 Jul 26 18:40:53.485418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 953/1884] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:53 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:53.693084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bb9e0d94-2aef-45a9-8800-63c5623f1e34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:53.696545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-21351fea-745d-41aa-acc7-c7437c8b052b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:53.697270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bb9e0d94-2aef-45a9-8800-63c5623f1e34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:53.700127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-21351fea-745d-41aa-acc7-c7437c8b052b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:53.707793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb9e0d94-2aef-45a9-8800-63c5623f1e34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:53.708518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb9e0d94-2aef-45a9-8800-63c5623f1e34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:53.709816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb9e0d94-2aef-45a9-8800-63c5623f1e34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:53.710548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb9e0d94-2aef-45a9-8800-63c5623f1e34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:53.710908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21351fea-745d-41aa-acc7-c7437c8b052b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:53.711751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21351fea-745d-41aa-acc7-c7437c8b052b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:53.713007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21351fea-745d-41aa-acc7-c7437c8b052b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:53.713603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21351fea-745d-41aa-acc7-c7437c8b052b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:53.714119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:53.742852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-21351fea-745d-41aa-acc7-c7437c8b052b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053087 Jul 26 18:40:53.743144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bb9e0d94-2aef-45a9-8800-63c5623f1e34 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056632 Jul 26 18:40:53.743449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 954/1885] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:53 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:40:53.744068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 932/1886] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:53.753971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-638f64aa-0e6b-4557-a7dd-2c2b425e2a41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:53.756183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-638f64aa-0e6b-4557-a7dd-2c2b425e2a41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:53.762374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-638f64aa-0e6b-4557-a7dd-2c2b425e2a41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:53.762827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-638f64aa-0e6b-4557-a7dd-2c2b425e2a41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:53.763622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-638f64aa-0e6b-4557-a7dd-2c2b425e2a41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:53.764062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-638f64aa-0e6b-4557-a7dd-2c2b425e2a41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:53.789690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:40:53.795012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-638f64aa-0e6b-4557-a7dd-2c2b425e2a41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044816 Jul 26 18:40:53.795702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 955/1887] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:53 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:54.501185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9442527e-f4e8-43b8-956f-9d361ace8f83 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:54.504670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9442527e-f4e8-43b8-956f-9d361ace8f83 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:54.514916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9442527e-f4e8-43b8-956f-9d361ace8f83 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:54.515700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9442527e-f4e8-43b8-956f-9d361ace8f83 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:54.516956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9442527e-f4e8-43b8-956f-9d361ace8f83 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:54.517675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9442527e-f4e8-43b8-956f-9d361ace8f83 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:54.550147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9442527e-f4e8-43b8-956f-9d361ace8f83 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056025 Jul 26 18:40:54.550700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 933/1888] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:54 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:54.761680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9dbc8a04-dc1a-483e-9c38-2ea22d529058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:54.763048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5122120c-09a6-4dce-bca2-6a71ceb60244 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:54.763822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9dbc8a04-dc1a-483e-9c38-2ea22d529058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:54.765448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5122120c-09a6-4dce-bca2-6a71ceb60244 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:54.769996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9dbc8a04-dc1a-483e-9c38-2ea22d529058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:54.770490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9dbc8a04-dc1a-483e-9c38-2ea22d529058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:54.771276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9dbc8a04-dc1a-483e-9c38-2ea22d529058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:54.771707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9dbc8a04-dc1a-483e-9c38-2ea22d529058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:54.772932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5122120c-09a6-4dce-bca2-6a71ceb60244 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:54.773369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5122120c-09a6-4dce-bca2-6a71ceb60244 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:54.774128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5122120c-09a6-4dce-bca2-6a71ceb60244 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:54.774570 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5122120c-09a6-4dce-bca2-6a71ceb60244 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:54.801283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9dbc8a04-dc1a-483e-9c38-2ea22d529058 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046515 Jul 26 18:40:54.802082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 956/1889] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:54 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:54.803451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5122120c-09a6-4dce-bca2-6a71ceb60244 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045243 Jul 26 18:40:54.804027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 934/1890] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:54.810535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fc78d122-8fcf-435a-87b1-742df625362f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:54.812695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fc78d122-8fcf-435a-87b1-742df625362f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:54.818553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc78d122-8fcf-435a-87b1-742df625362f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:54.818995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc78d122-8fcf-435a-87b1-742df625362f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:54.819776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc78d122-8fcf-435a-87b1-742df625362f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:54.820209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc78d122-8fcf-435a-87b1-742df625362f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:54.848364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fc78d122-8fcf-435a-87b1-742df625362f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041504 Jul 26 18:40:54.848870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 957/1891] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:54 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:55.566316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ca04cab7-28f4-48a8-a0da-93cbdc9aa602 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:55.569869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ca04cab7-28f4-48a8-a0da-93cbdc9aa602 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:55.577327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca04cab7-28f4-48a8-a0da-93cbdc9aa602 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:55.577791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca04cab7-28f4-48a8-a0da-93cbdc9aa602 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:55.578548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca04cab7-28f4-48a8-a0da-93cbdc9aa602 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:55.578977 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca04cab7-28f4-48a8-a0da-93cbdc9aa602 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:55.607413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ca04cab7-28f4-48a8-a0da-93cbdc9aa602 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047946 Jul 26 18:40:55.607977 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 935/1892] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:55 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:55.814783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-26665ed8-4989-4b6c-9996-fd985924e1d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:55.817210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-26665ed8-4989-4b6c-9996-fd985924e1d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:55.824725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26665ed8-4989-4b6c-9996-fd985924e1d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:55.825178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26665ed8-4989-4b6c-9996-fd985924e1d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:55.825939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26665ed8-4989-4b6c-9996-fd985924e1d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:55.826372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26665ed8-4989-4b6c-9996-fd985924e1d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:55.856259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-26665ed8-4989-4b6c-9996-fd985924e1d1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046099 Jul 26 18:40:55.856814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 958/1893] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:55 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:55.861349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6774bd1f-9f02-4966-be08-84410ced4998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:55.863513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6774bd1f-9f02-4966-be08-84410ced4998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:55.869648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6774bd1f-9f02-4966-be08-84410ced4998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:55.870092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6774bd1f-9f02-4966-be08-84410ced4998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:55.870876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6774bd1f-9f02-4966-be08-84410ced4998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:55.871328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6774bd1f-9f02-4966-be08-84410ced4998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:55.885823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b7ea0741-fad4-4faf-91d5-3c9f71d1ffa5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:55.888026 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b7ea0741-fad4-4faf-91d5-3c9f71d1ffa5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:55.893961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7ea0741-fad4-4faf-91d5-3c9f71d1ffa5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:55.894395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7ea0741-fad4-4faf-91d5-3c9f71d1ffa5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:55.895175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7ea0741-fad4-4faf-91d5-3c9f71d1ffa5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:55.895634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7ea0741-fad4-4faf-91d5-3c9f71d1ffa5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:55.902167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6774bd1f-9f02-4966-be08-84410ced4998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044345 Jul 26 18:40:55.902732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 959/1894] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:55 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:55.924233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b7ea0741-fad4-4faf-91d5-3c9f71d1ffa5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112273 Jul 26 18:40:55.924781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 936/1895] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:55 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:56.622540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d71a620f-0320-43c3-bd03-08ed75b2069f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:56.624717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d71a620f-0320-43c3-bd03-08ed75b2069f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:56.631116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d71a620f-0320-43c3-bd03-08ed75b2069f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:56.631559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d71a620f-0320-43c3-bd03-08ed75b2069f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:56.632313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d71a620f-0320-43c3-bd03-08ed75b2069f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:56.632806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d71a620f-0320-43c3-bd03-08ed75b2069f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:56.662641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d71a620f-0320-43c3-bd03-08ed75b2069f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044990 Jul 26 18:40:56.663229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 960/1896] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:56 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:56.869385 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6e412fc8-e06a-45f0-9011-cda67d5159a8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:56.871573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6e412fc8-e06a-45f0-9011-cda67d5159a8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:56.878484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e412fc8-e06a-45f0-9011-cda67d5159a8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:56.878860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e412fc8-e06a-45f0-9011-cda67d5159a8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:56.879652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e412fc8-e06a-45f0-9011-cda67d5159a8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:56.880084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e412fc8-e06a-45f0-9011-cda67d5159a8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:56.911367 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6e412fc8-e06a-45f0-9011-cda67d5159a8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046132 Jul 26 18:40:56.912363 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 937/1897] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:56 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:56.918157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f2ec0338-87c7-49e8-8a0d-299a4613e4b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:56.920380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f2ec0338-87c7-49e8-8a0d-299a4613e4b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:56.926819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f2ec0338-87c7-49e8-8a0d-299a4613e4b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:56.927384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f2ec0338-87c7-49e8-8a0d-299a4613e4b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:56.928132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f2ec0338-87c7-49e8-8a0d-299a4613e4b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:56.928567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f2ec0338-87c7-49e8-8a0d-299a4613e4b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:56.935726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-920245e3-7b9f-4de3-bdce-a25c93a00d4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:56.937973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-920245e3-7b9f-4de3-bdce-a25c93a00d4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:56.945536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-920245e3-7b9f-4de3-bdce-a25c93a00d4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:56.946053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-920245e3-7b9f-4de3-bdce-a25c93a00d4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:56.946889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-920245e3-7b9f-4de3-bdce-a25c93a00d4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:56.947425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-920245e3-7b9f-4de3-bdce-a25c93a00d4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:56.960243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f2ec0338-87c7-49e8-8a0d-299a4613e4b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049909 Jul 26 18:40:56.960883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 961/1898] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:56 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:56.983578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-920245e3-7b9f-4de3-bdce-a25c93a00d4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051780 Jul 26 18:40:56.984161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 938/1899] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:56 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:40:57.678454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f0af461a-d940-43e6-8fa9-d2ccc8a69275 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:57.681701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f0af461a-d940-43e6-8fa9-d2ccc8a69275 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:57.688840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f0af461a-d940-43e6-8fa9-d2ccc8a69275 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:57.689317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f0af461a-d940-43e6-8fa9-d2ccc8a69275 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:57.690125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f0af461a-d940-43e6-8fa9-d2ccc8a69275 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:57.690585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f0af461a-d940-43e6-8fa9-d2ccc8a69275 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:57.721605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f0af461a-d940-43e6-8fa9-d2ccc8a69275 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049593 Jul 26 18:40:57.722166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 962/1900] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:57 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:57.928491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fa96c27c-c0db-4701-860f-ea11e38a2a3d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:57.932044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fa96c27c-c0db-4701-860f-ea11e38a2a3d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:57.942318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa96c27c-c0db-4701-860f-ea11e38a2a3d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:57.943088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa96c27c-c0db-4701-860f-ea11e38a2a3d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:57.944366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa96c27c-c0db-4701-860f-ea11e38a2a3d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:57.945081 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa96c27c-c0db-4701-860f-ea11e38a2a3d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:57.972853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aeb683cd-4f58-4449-a769-45d89da60b9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:57.975164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aeb683cd-4f58-4449-a769-45d89da60b9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:57.977070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fa96c27c-c0db-4701-860f-ea11e38a2a3d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055530 Jul 26 18:40:57.977646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 939/1901] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:57 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:57.983625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aeb683cd-4f58-4449-a769-45d89da60b9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:57.984077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aeb683cd-4f58-4449-a769-45d89da60b9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:57.984880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aeb683cd-4f58-4449-a769-45d89da60b9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:57.985317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aeb683cd-4f58-4449-a769-45d89da60b9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:57.996146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0eb2981b-4a2a-45bd-b5b7-2fc91a04c293 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:57.998330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0eb2981b-4a2a-45bd-b5b7-2fc91a04c293 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:58.004622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0eb2981b-4a2a-45bd-b5b7-2fc91a04c293 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:58.005100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0eb2981b-4a2a-45bd-b5b7-2fc91a04c293 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:58.005869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0eb2981b-4a2a-45bd-b5b7-2fc91a04c293 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:58.006300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0eb2981b-4a2a-45bd-b5b7-2fc91a04c293 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:58.015603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aeb683cd-4f58-4449-a769-45d89da60b9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046677 Jul 26 18:40:58.016169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 963/1902] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:57 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:58.035279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0eb2981b-4a2a-45bd-b5b7-2fc91a04c293 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042997 Jul 26 18:40:58.035835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 940/1903] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:57 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:58.738332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d5a5b7b2-6266-4324-af81-0ef1d6f752c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:58.741790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d5a5b7b2-6266-4324-af81-0ef1d6f752c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:58.752897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5a5b7b2-6266-4324-af81-0ef1d6f752c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:58.752897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5a5b7b2-6266-4324-af81-0ef1d6f752c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:58.754236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5a5b7b2-6266-4324-af81-0ef1d6f752c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:58.754971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5a5b7b2-6266-4324-af81-0ef1d6f752c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:58.787317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d5a5b7b2-6266-4324-af81-0ef1d6f752c4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055443 Jul 26 18:40:58.787878 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 964/1904] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:58 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:58.993723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-13a8a965-3ebf-49a1-b654-a9f6e4ba264a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:58.996172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-13a8a965-3ebf-49a1-b654-a9f6e4ba264a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:59.003185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13a8a965-3ebf-49a1-b654-a9f6e4ba264a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:59.003634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13a8a965-3ebf-49a1-b654-a9f6e4ba264a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:59.004394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13a8a965-3ebf-49a1-b654-a9f6e4ba264a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:59.004830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13a8a965-3ebf-49a1-b654-a9f6e4ba264a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:59.028295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-36954ce9-346f-43d7-b225-01f9f7f2704d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:59.030404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-36954ce9-346f-43d7-b225-01f9f7f2704d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:59.034811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-13a8a965-3ebf-49a1-b654-a9f6e4ba264a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047539 Jul 26 18:40:59.035369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 941/1905] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:40:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:40:59.037181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36954ce9-346f-43d7-b225-01f9f7f2704d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:59.037632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36954ce9-346f-43d7-b225-01f9f7f2704d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:59.038397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36954ce9-346f-43d7-b225-01f9f7f2704d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:59.038826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36954ce9-346f-43d7-b225-01f9f7f2704d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:59.047398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-08cac4eb-6df8-4a5f-a36a-b4779730d7f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:59.049617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-08cac4eb-6df8-4a5f-a36a-b4779730d7f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:59.056241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08cac4eb-6df8-4a5f-a36a-b4779730d7f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:59.056795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08cac4eb-6df8-4a5f-a36a-b4779730d7f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:59.057624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08cac4eb-6df8-4a5f-a36a-b4779730d7f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:59.058224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08cac4eb-6df8-4a5f-a36a-b4779730d7f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:59.068522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-36954ce9-346f-43d7-b225-01f9f7f2704d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044319 Jul 26 18:40:59.069073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 965/1906] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:59 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:40:59.087345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-08cac4eb-6df8-4a5f-a36a-b4779730d7f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043639 Jul 26 18:40:59.087897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 942/1907] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:59 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:40:59.801446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2ed1c138-2ea3-4377-b55b-4611302af7e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:40:59.804220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2ed1c138-2ea3-4377-b55b-4611302af7e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:40:59.811655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ed1c138-2ea3-4377-b55b-4611302af7e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:59.812104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ed1c138-2ea3-4377-b55b-4611302af7e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:59.812877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ed1c138-2ea3-4377-b55b-4611302af7e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:40:59.813315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ed1c138-2ea3-4377-b55b-4611302af7e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:40:59.842577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2ed1c138-2ea3-4377-b55b-4611302af7e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046116 Jul 26 18:40:59.843133 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 966/1908] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:40:59 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:00.049534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5b1c8953-980d-41b6-ab1b-511dd5249552 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:00.051776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5b1c8953-980d-41b6-ab1b-511dd5249552 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:00.060199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b1c8953-980d-41b6-ab1b-511dd5249552 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:00.060555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b1c8953-980d-41b6-ab1b-511dd5249552 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:00.061584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b1c8953-980d-41b6-ab1b-511dd5249552 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:00.062182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b1c8953-980d-41b6-ab1b-511dd5249552 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:00.081060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5d837f21-38e7-4921-9c92-b1eaa8a7c530 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:00.084250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5d837f21-38e7-4921-9c92-b1eaa8a7c530 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:00.091285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d837f21-38e7-4921-9c92-b1eaa8a7c530 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:00.091733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d837f21-38e7-4921-9c92-b1eaa8a7c530 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:00.092505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d837f21-38e7-4921-9c92-b1eaa8a7c530 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:00.092899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d837f21-38e7-4921-9c92-b1eaa8a7c530 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:00.094649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5b1c8953-980d-41b6-ab1b-511dd5249552 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050622 Jul 26 18:41:00.095204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 943/1909] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:00 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:00.099737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b91a9706-456b-4632-8a88-cb02a4a39cbb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:00.101866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b91a9706-456b-4632-8a88-cb02a4a39cbb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:00.107994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b91a9706-456b-4632-8a88-cb02a4a39cbb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:00.108433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b91a9706-456b-4632-8a88-cb02a4a39cbb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:00.109192 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b91a9706-456b-4632-8a88-cb02a4a39cbb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:00.109754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b91a9706-456b-4632-8a88-cb02a4a39cbb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:00.122779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5d837f21-38e7-4921-9c92-b1eaa8a7c530 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045646 Jul 26 18:41:00.123382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 967/1910] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:00 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:00.138488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b91a9706-456b-4632-8a88-cb02a4a39cbb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042274 Jul 26 18:41:00.139039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 944/1911] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:00 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:00.859352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a1390bc0-d0a4-4f8f-aabf-7623c2a8ca6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:00.862763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a1390bc0-d0a4-4f8f-aabf-7623c2a8ca6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:00.873196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1390bc0-d0a4-4f8f-aabf-7623c2a8ca6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:00.873910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1390bc0-d0a4-4f8f-aabf-7623c2a8ca6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:00.875256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1390bc0-d0a4-4f8f-aabf-7623c2a8ca6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:00.875968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1390bc0-d0a4-4f8f-aabf-7623c2a8ca6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:00.908869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a1390bc0-d0a4-4f8f-aabf-7623c2a8ca6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056314 Jul 26 18:41:00.909421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 968/1912] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:00 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:01.111567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0c6fc6c3-faac-4684-b308-b61132aca7e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:01.114885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0c6fc6c3-faac-4684-b308-b61132aca7e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:01.123500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c6fc6c3-faac-4684-b308-b61132aca7e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:01.123942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c6fc6c3-faac-4684-b308-b61132aca7e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:01.124698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c6fc6c3-faac-4684-b308-b61132aca7e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:01.125129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c6fc6c3-faac-4684-b308-b61132aca7e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:01.134921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f2ccc183-92ec-401d-96ee-07de26178bc2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:01.137130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f2ccc183-92ec-401d-96ee-07de26178bc2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:01.143705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f2ccc183-92ec-401d-96ee-07de26178bc2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:01.144150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f2ccc183-92ec-401d-96ee-07de26178bc2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:01.145236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f2ccc183-92ec-401d-96ee-07de26178bc2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:01.145667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f2ccc183-92ec-401d-96ee-07de26178bc2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:01.155381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0c6fc6c3-faac-4684-b308-b61132aca7e2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050705 Jul 26 18:41:01.155945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 945/1913] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:01 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:01.160434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e098b0ff-a906-4611-b8d6-444e046fa312 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:01.162559 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e098b0ff-a906-4611-b8d6-444e046fa312 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:01.168471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e098b0ff-a906-4611-b8d6-444e046fa312 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:01.168905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e098b0ff-a906-4611-b8d6-444e046fa312 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:01.169666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e098b0ff-a906-4611-b8d6-444e046fa312 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:01.170081 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e098b0ff-a906-4611-b8d6-444e046fa312 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:01.175910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f2ccc183-92ec-401d-96ee-07de26178bc2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044893 Jul 26 18:41:01.176657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 969/1914] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:01 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:01.199321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e098b0ff-a906-4611-b8d6-444e046fa312 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042011 Jul 26 18:41:01.200219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 946/1915] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:01 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:01.926706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-418802f0-b16d-46b6-81e1-a7ee0342e3e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:01.930017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-418802f0-b16d-46b6-81e1-a7ee0342e3e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:01.937174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-418802f0-b16d-46b6-81e1-a7ee0342e3e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:01.937618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-418802f0-b16d-46b6-81e1-a7ee0342e3e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:01.938371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-418802f0-b16d-46b6-81e1-a7ee0342e3e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:01.938799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-418802f0-b16d-46b6-81e1-a7ee0342e3e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:01.968271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-418802f0-b16d-46b6-81e1-a7ee0342e3e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048909 Jul 26 18:41:01.968810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 970/1916] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:01 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:02.171479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b016e84b-8c60-4dc4-ab32-4221810ba191 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:02.174974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b016e84b-8c60-4dc4-ab32-4221810ba191 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:02.184393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b016e84b-8c60-4dc4-ab32-4221810ba191 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:02.184978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b016e84b-8c60-4dc4-ab32-4221810ba191 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:02.185777 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b016e84b-8c60-4dc4-ab32-4221810ba191 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:02.186222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b016e84b-8c60-4dc4-ab32-4221810ba191 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:02.188859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b142eedc-c9af-480d-be17-2056c68938d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:02.191049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b142eedc-c9af-480d-be17-2056c68938d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:02.197973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b142eedc-c9af-480d-be17-2056c68938d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:02.198416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b142eedc-c9af-480d-be17-2056c68938d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:02.199222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b142eedc-c9af-480d-be17-2056c68938d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:02.199654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b142eedc-c9af-480d-be17-2056c68938d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:02.217153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b016e84b-8c60-4dc4-ab32-4221810ba191 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052397 Jul 26 18:41:02.217727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 947/1917] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:02 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:02.222423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-95533513-a982-458d-875d-3e475274849c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:02.224599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-95533513-a982-458d-875d-3e475274849c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:02.230193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b142eedc-c9af-480d-be17-2056c68938d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045388 Jul 26 18:41:02.230672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95533513-a982-458d-875d-3e475274849c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:02.230785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 971/1918] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:02 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:02.231227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95533513-a982-458d-875d-3e475274849c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:02.232069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95533513-a982-458d-875d-3e475274849c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:02.232502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95533513-a982-458d-875d-3e475274849c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:02.256409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:02.261578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-95533513-a982-458d-875d-3e475274849c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042955 Jul 26 18:41:02.262124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 948/1919] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:02 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:02.983803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-96351924-aefc-45df-8169-9068fcf3b21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:02.986671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-96351924-aefc-45df-8169-9068fcf3b21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:02.995294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96351924-aefc-45df-8169-9068fcf3b21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:02.995891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96351924-aefc-45df-8169-9068fcf3b21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:02.996960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96351924-aefc-45df-8169-9068fcf3b21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:02.997509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96351924-aefc-45df-8169-9068fcf3b21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:03.017298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:03.031334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-96351924-aefc-45df-8169-9068fcf3b21d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053114 Jul 26 18:41:03.031872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 972/1920] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:03.232671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f63c972f-8e8a-45b1-b162-5c9f3469ce92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:03.235309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f63c972f-8e8a-45b1-b162-5c9f3469ce92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:03.243499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-de728c04-8edf-4d79-82fd-cff5ebea65f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:03.244089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f63c972f-8e8a-45b1-b162-5c9f3469ce92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:03.244641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f63c972f-8e8a-45b1-b162-5c9f3469ce92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:03.245580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f63c972f-8e8a-45b1-b162-5c9f3469ce92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:03.246085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-de728c04-8edf-4d79-82fd-cff5ebea65f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:03.246313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f63c972f-8e8a-45b1-b162-5c9f3469ce92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:03.254306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de728c04-8edf-4d79-82fd-cff5ebea65f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:03.254869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de728c04-8edf-4d79-82fd-cff5ebea65f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:03.255880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de728c04-8edf-4d79-82fd-cff5ebea65f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:03.256423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de728c04-8edf-4d79-82fd-cff5ebea65f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:03.279708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f63c972f-8e8a-45b1-b162-5c9f3469ce92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052403 Jul 26 18:41:03.284314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 949/1921] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:03 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:03.284737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0d11d852-bd25-4520-be67-a5f913c2e035 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:03.286842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0d11d852-bd25-4520-be67-a5f913c2e035 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:03.290524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-de728c04-8edf-4d79-82fd-cff5ebea65f0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051549 Jul 26 18:41:03.291437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 973/1922] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:03 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:03.293048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d11d852-bd25-4520-be67-a5f913c2e035 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:03.293493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d11d852-bd25-4520-be67-a5f913c2e035 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:03.294253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d11d852-bd25-4520-be67-a5f913c2e035 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:03.294675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d11d852-bd25-4520-be67-a5f913c2e035 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:03.322215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0d11d852-bd25-4520-be67-a5f913c2e035 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041078 Jul 26 18:41:03.322815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 950/1923] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:03 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:04.044898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-42a1dd01-dba7-4aa5-95bb-9776d75bbc30 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:04.047204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-42a1dd01-dba7-4aa5-95bb-9776d75bbc30 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:04.054327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42a1dd01-dba7-4aa5-95bb-9776d75bbc30 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:04.054779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42a1dd01-dba7-4aa5-95bb-9776d75bbc30 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:04.055585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42a1dd01-dba7-4aa5-95bb-9776d75bbc30 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:04.056022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42a1dd01-dba7-4aa5-95bb-9776d75bbc30 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:04.090528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-42a1dd01-dba7-4aa5-95bb-9776d75bbc30 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050124 Jul 26 18:41:04.091421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 974/1924] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:04 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:04.296587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1a0af953-c653-4b64-8fc3-3e47d7454582 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:04.299891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1a0af953-c653-4b64-8fc3-3e47d7454582 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:04.307503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8810b7af-16fd-4d7e-bbf7-500c558095ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:04.309456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a0af953-c653-4b64-8fc3-3e47d7454582 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:04.309631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8810b7af-16fd-4d7e-bbf7-500c558095ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:04.309902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a0af953-c653-4b64-8fc3-3e47d7454582 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:04.310666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a0af953-c653-4b64-8fc3-3e47d7454582 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:04.311126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a0af953-c653-4b64-8fc3-3e47d7454582 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:04.315829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8810b7af-16fd-4d7e-bbf7-500c558095ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:04.316281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8810b7af-16fd-4d7e-bbf7-500c558095ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:04.317050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8810b7af-16fd-4d7e-bbf7-500c558095ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:04.317487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8810b7af-16fd-4d7e-bbf7-500c558095ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:04.341322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1a0af953-c653-4b64-8fc3-3e47d7454582 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051607 Jul 26 18:41:04.341920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 951/1925] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:04 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:04.346436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e6199cca-fdab-4442-befd-fdca2a40a447 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:04.348581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e6199cca-fdab-4442-befd-fdca2a40a447 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:04.349587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8810b7af-16fd-4d7e-bbf7-500c558095ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048718 Jul 26 18:41:04.350352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 975/1926] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:04 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:04.354568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6199cca-fdab-4442-befd-fdca2a40a447 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:04.355045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6199cca-fdab-4442-befd-fdca2a40a447 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:04.355816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6199cca-fdab-4442-befd-fdca2a40a447 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:04.356244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6199cca-fdab-4442-befd-fdca2a40a447 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:04.385101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e6199cca-fdab-4442-befd-fdca2a40a447 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042094 Jul 26 18:41:04.385642 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 952/1927] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:04 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:05.108088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-47c01f24-cd52-4a41-8863-1aa2de53b82d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:05.111442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-47c01f24-cd52-4a41-8863-1aa2de53b82d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:05.121822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47c01f24-cd52-4a41-8863-1aa2de53b82d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:05.122272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47c01f24-cd52-4a41-8863-1aa2de53b82d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:05.123118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47c01f24-cd52-4a41-8863-1aa2de53b82d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:05.123504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47c01f24-cd52-4a41-8863-1aa2de53b82d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:05.154690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-47c01f24-cd52-4a41-8863-1aa2de53b82d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053608 Jul 26 18:41:05.155262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 976/1928] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:05 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:05.356368 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2d801cbe-481c-41e3-b6ba-16c037ed439f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:05.358587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2d801cbe-481c-41e3-b6ba-16c037ed439f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:05.362192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-577d8fa7-9338-4479-a6c9-f1834c4870c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:05.364340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-577d8fa7-9338-4479-a6c9-f1834c4870c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:05.365392 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d801cbe-481c-41e3-b6ba-16c037ed439f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:05.365843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d801cbe-481c-41e3-b6ba-16c037ed439f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:05.366611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d801cbe-481c-41e3-b6ba-16c037ed439f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:05.367048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2d801cbe-481c-41e3-b6ba-16c037ed439f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:05.370755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-577d8fa7-9338-4479-a6c9-f1834c4870c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:05.371540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-577d8fa7-9338-4479-a6c9-f1834c4870c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:05.372767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-577d8fa7-9338-4479-a6c9-f1834c4870c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:05.373355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-577d8fa7-9338-4479-a6c9-f1834c4870c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:05.397351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2d801cbe-481c-41e3-b6ba-16c037ed439f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046266 Jul 26 18:41:05.398249 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 953/1929] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:05.402789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-96db5989-025b-4f31-85c2-f4b164c161a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:05.403997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-577d8fa7-9338-4479-a6c9-f1834c4870c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045653 Jul 26 18:41:05.404581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 977/1930] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:05 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:05.405749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-96db5989-025b-4f31-85c2-f4b164c161a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:05.414676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96db5989-025b-4f31-85c2-f4b164c161a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:05.415131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96db5989-025b-4f31-85c2-f4b164c161a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:05.416309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96db5989-025b-4f31-85c2-f4b164c161a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:05.416739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96db5989-025b-4f31-85c2-f4b164c161a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:05.447140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-96db5989-025b-4f31-85c2-f4b164c161a8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047845 Jul 26 18:41:05.447785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 954/1931] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:05 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:06.169199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5d1a778b-4c07-45e2-b64c-27760c5ceec4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:06.171361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5d1a778b-4c07-45e2-b64c-27760c5ceec4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:06.178604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d1a778b-4c07-45e2-b64c-27760c5ceec4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:06.179059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d1a778b-4c07-45e2-b64c-27760c5ceec4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:06.179828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d1a778b-4c07-45e2-b64c-27760c5ceec4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:06.180293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d1a778b-4c07-45e2-b64c-27760c5ceec4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:06.209383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5d1a778b-4c07-45e2-b64c-27760c5ceec4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045374 Jul 26 18:41:06.209988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 978/1932] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:06 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:06.413792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-282ccc07-735f-4c18-9dee-98609a19c9ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:06.417250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-282ccc07-735f-4c18-9dee-98609a19c9ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:06.422899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e651f282-0859-47cb-9238-eddb9765a1fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:06.426442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e651f282-0859-47cb-9238-eddb9765a1fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:06.428477 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-282ccc07-735f-4c18-9dee-98609a19c9ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:06.429220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-282ccc07-735f-4c18-9dee-98609a19c9ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:06.430470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-282ccc07-735f-4c18-9dee-98609a19c9ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:06.431229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-282ccc07-735f-4c18-9dee-98609a19c9ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:06.435408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e651f282-0859-47cb-9238-eddb9765a1fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:06.435832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e651f282-0859-47cb-9238-eddb9765a1fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:06.436612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e651f282-0859-47cb-9238-eddb9765a1fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:06.437045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e651f282-0859-47cb-9238-eddb9765a1fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:06.460776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-282ccc07-735f-4c18-9dee-98609a19c9ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053581 Jul 26 18:41:06.461344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 955/1933] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:06 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:06.465983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c932f268-88b1-4625-b556-461a5203776a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:06.466810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e651f282-0859-47cb-9238-eddb9765a1fe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050522 Jul 26 18:41:06.467391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 979/1934] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:06 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:06.468140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c932f268-88b1-4625-b556-461a5203776a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:06.474293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c932f268-88b1-4625-b556-461a5203776a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:06.474908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c932f268-88b1-4625-b556-461a5203776a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:06.475700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c932f268-88b1-4625-b556-461a5203776a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:06.476128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c932f268-88b1-4625-b556-461a5203776a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:06.504345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c932f268-88b1-4625-b556-461a5203776a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042045 Jul 26 18:41:06.504902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 956/1935] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:06 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:07.225964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7d4c8694-c47f-4bc9-b525-c14af4d6884a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:07.229442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7d4c8694-c47f-4bc9-b525-c14af4d6884a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:07.240345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d4c8694-c47f-4bc9-b525-c14af4d6884a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:07.241087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d4c8694-c47f-4bc9-b525-c14af4d6884a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:07.242345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d4c8694-c47f-4bc9-b525-c14af4d6884a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:07.243085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d4c8694-c47f-4bc9-b525-c14af4d6884a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:07.275824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7d4c8694-c47f-4bc9-b525-c14af4d6884a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056392 Jul 26 18:41:07.276801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 980/1936] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:07 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:07.477829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4cd23ec5-4027-4032-9294-c81346dc3dc3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:07.480422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4cd23ec5-4027-4032-9294-c81346dc3dc3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:07.481492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3c9dce72-9869-47b0-90ae-770975ce45d6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:07.483623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3c9dce72-9869-47b0-90ae-770975ce45d6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:07.487979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4cd23ec5-4027-4032-9294-c81346dc3dc3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:07.488431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4cd23ec5-4027-4032-9294-c81346dc3dc3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:07.489199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4cd23ec5-4027-4032-9294-c81346dc3dc3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:07.489634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4cd23ec5-4027-4032-9294-c81346dc3dc3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:07.489807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c9dce72-9869-47b0-90ae-770975ce45d6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:07.490211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c9dce72-9869-47b0-90ae-770975ce45d6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:07.490971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c9dce72-9869-47b0-90ae-770975ce45d6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:07.491576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c9dce72-9869-47b0-90ae-770975ce45d6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:07.519566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4cd23ec5-4027-4032-9294-c81346dc3dc3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048670 Jul 26 18:41:07.520309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 957/1937] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:07.521221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3c9dce72-9869-47b0-90ae-770975ce45d6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044560 Jul 26 18:41:07.521853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 981/1938] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:07 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:07.524954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0038ec4e-aa82-465e-817b-bbe4bf647b3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:07.527102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0038ec4e-aa82-465e-817b-bbe4bf647b3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:07.533079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0038ec4e-aa82-465e-817b-bbe4bf647b3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:07.533527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0038ec4e-aa82-465e-817b-bbe4bf647b3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:07.534288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0038ec4e-aa82-465e-817b-bbe4bf647b3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:07.534718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0038ec4e-aa82-465e-817b-bbe4bf647b3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:07.562931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0038ec4e-aa82-465e-817b-bbe4bf647b3a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 Jul 26 18:41:07.563501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 958/1939] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:07 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:08.290043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c74a0678-5212-4a82-89a0-67b7625ee90c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:08.292886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c74a0678-5212-4a82-89a0-67b7625ee90c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:08.301229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c74a0678-5212-4a82-89a0-67b7625ee90c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:08.301791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c74a0678-5212-4a82-89a0-67b7625ee90c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:08.302749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c74a0678-5212-4a82-89a0-67b7625ee90c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:08.303328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c74a0678-5212-4a82-89a0-67b7625ee90c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:08.336339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c74a0678-5212-4a82-89a0-67b7625ee90c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051288 Jul 26 18:41:08.336933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 982/1940] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:08.536321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fee1ca2a-c097-40e5-a005-309d8b8c2a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:08.537217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-380bb9b0-00e2-40a0-89d0-d3d3c61bed3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:08.539777 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fee1ca2a-c097-40e5-a005-309d8b8c2a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:08.541086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-380bb9b0-00e2-40a0-89d0-d3d3c61bed3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:08.547298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fee1ca2a-c097-40e5-a005-309d8b8c2a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:08.547454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-380bb9b0-00e2-40a0-89d0-d3d3c61bed3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:08.547738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fee1ca2a-c097-40e5-a005-309d8b8c2a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:08.547883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-380bb9b0-00e2-40a0-89d0-d3d3c61bed3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:08.548502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fee1ca2a-c097-40e5-a005-309d8b8c2a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:08.548649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-380bb9b0-00e2-40a0-89d0-d3d3c61bed3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:08.548926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fee1ca2a-c097-40e5-a005-309d8b8c2a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:08.549085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-380bb9b0-00e2-40a0-89d0-d3d3c61bed3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:08.579144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fee1ca2a-c097-40e5-a005-309d8b8c2a1b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049399 Jul 26 18:41:08.579967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 959/1941] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:08 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:08.580082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-380bb9b0-00e2-40a0-89d0-d3d3c61bed3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049316 Jul 26 18:41:08.580605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 983/1942] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:08 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:08.584362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c4f5e5a0-34cc-4ec4-9787-af29336fbd25 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:08.586478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c4f5e5a0-34cc-4ec4-9787-af29336fbd25 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:08.592669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4f5e5a0-34cc-4ec4-9787-af29336fbd25 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:08.593116 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4f5e5a0-34cc-4ec4-9787-af29336fbd25 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:08.593879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4f5e5a0-34cc-4ec4-9787-af29336fbd25 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:08.594311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4f5e5a0-34cc-4ec4-9787-af29336fbd25 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:08.622744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c4f5e5a0-34cc-4ec4-9787-af29336fbd25 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041903 Jul 26 18:41:08.623322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 960/1943] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:08 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:09.353110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2f36c72a-59c4-44c3-a2cd-980f581c74c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:09.355880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2f36c72a-59c4-44c3-a2cd-980f581c74c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:09.364130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f36c72a-59c4-44c3-a2cd-980f581c74c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:09.364657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f36c72a-59c4-44c3-a2cd-980f581c74c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:09.365561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f36c72a-59c4-44c3-a2cd-980f581c74c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:09.366073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f36c72a-59c4-44c3-a2cd-980f581c74c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:09.397004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2f36c72a-59c4-44c3-a2cd-980f581c74c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050651 Jul 26 18:41:09.397880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 984/1944] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:09 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:09.593045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-75afd67f-3cf9-4910-939e-9d9ac05469c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:09.593655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1607cc19-75fc-4453-a20c-8f0f0fa58ff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:09.595226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-75afd67f-3cf9-4910-939e-9d9ac05469c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:09.595385 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1607cc19-75fc-4453-a20c-8f0f0fa58ff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:09.602053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1607cc19-75fc-4453-a20c-8f0f0fa58ff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:09.602506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1607cc19-75fc-4453-a20c-8f0f0fa58ff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:09.603099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75afd67f-3cf9-4910-939e-9d9ac05469c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:09.603346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1607cc19-75fc-4453-a20c-8f0f0fa58ff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:09.603549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75afd67f-3cf9-4910-939e-9d9ac05469c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:09.603745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1607cc19-75fc-4453-a20c-8f0f0fa58ff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:09.604317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75afd67f-3cf9-4910-939e-9d9ac05469c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:09.604753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75afd67f-3cf9-4910-939e-9d9ac05469c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:09.635367 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1607cc19-75fc-4453-a20c-8f0f0fa58ff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046235 Jul 26 18:41:09.635937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 961/1945] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:09 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:09.636101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-75afd67f-3cf9-4910-939e-9d9ac05469c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046780 Jul 26 18:41:09.640498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 985/1946] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:09 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:09.640651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fa332750-58fd-41a7-a509-343f59192d52 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:09.643456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fa332750-58fd-41a7-a509-343f59192d52 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:09.651970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa332750-58fd-41a7-a509-343f59192d52 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:09.652422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa332750-58fd-41a7-a509-343f59192d52 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:09.653185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa332750-58fd-41a7-a509-343f59192d52 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:09.653621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fa332750-58fd-41a7-a509-343f59192d52 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:09.681899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fa332750-58fd-41a7-a509-343f59192d52 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Jul 26 18:41:09.682454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 962/1947] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:09 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:10.414634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c3ac1500-b082-424a-987b-1e32420cf0e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:10.418110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c3ac1500-b082-424a-987b-1e32420cf0e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:10.429211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3ac1500-b082-424a-987b-1e32420cf0e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:10.429962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3ac1500-b082-424a-987b-1e32420cf0e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:10.431268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3ac1500-b082-424a-987b-1e32420cf0e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:10.431951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3ac1500-b082-424a-987b-1e32420cf0e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:10.462286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c3ac1500-b082-424a-987b-1e32420cf0e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054765 Jul 26 18:41:10.463113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 986/1948] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:10 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:10.651980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-38119996-7514-433b-9044-713292664758 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:10.652857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1e3d905b-a9cd-49d9-bf66-70c78bc8bc46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:10.655473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-38119996-7514-433b-9044-713292664758 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:10.655832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1e3d905b-a9cd-49d9-bf66-70c78bc8bc46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:10.665865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-38119996-7514-433b-9044-713292664758 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:10.666653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-38119996-7514-433b-9044-713292664758 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:10.666862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e3d905b-a9cd-49d9-bf66-70c78bc8bc46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:10.667326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-38119996-7514-433b-9044-713292664758 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:10.667469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e3d905b-a9cd-49d9-bf66-70c78bc8bc46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:10.667759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-38119996-7514-433b-9044-713292664758 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:10.668111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e3d905b-a9cd-49d9-bf66-70c78bc8bc46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:10.668678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e3d905b-a9cd-49d9-bf66-70c78bc8bc46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:10.699186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-38119996-7514-433b-9044-713292664758 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054223 Jul 26 18:41:10.699757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 987/1949] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:10 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:10.700970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1e3d905b-a9cd-49d9-bf66-70c78bc8bc46 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056107 Jul 26 18:41:10.701662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 963/1950] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:10 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:10.704246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a1477453-d374-44ae-a324-00c65ca4606e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:10.706376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a1477453-d374-44ae-a324-00c65ca4606e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:10.712479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1477453-d374-44ae-a324-00c65ca4606e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:10.712975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1477453-d374-44ae-a324-00c65ca4606e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:10.713737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1477453-d374-44ae-a324-00c65ca4606e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:10.714191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1477453-d374-44ae-a324-00c65ca4606e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:10.742518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a1477453-d374-44ae-a324-00c65ca4606e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041774 Jul 26 18:41:10.743300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 988/1951] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:11.478828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e67df0fe-994e-4ab0-8575-dbd4dd1c177a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:11.481171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e67df0fe-994e-4ab0-8575-dbd4dd1c177a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:11.487886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e67df0fe-994e-4ab0-8575-dbd4dd1c177a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:11.488358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e67df0fe-994e-4ab0-8575-dbd4dd1c177a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:11.489164 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e67df0fe-994e-4ab0-8575-dbd4dd1c177a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:11.489618 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e67df0fe-994e-4ab0-8575-dbd4dd1c177a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:11.521921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e67df0fe-994e-4ab0-8575-dbd4dd1c177a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049750 Jul 26 18:41:11.522896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 964/1952] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:11.715261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-35cfdda9-3d9c-45e4-835b-e3c3a2a1e74c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:11.715873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-623d9cf0-3ac4-42ae-87aa-ada311e65fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:11.717506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-35cfdda9-3d9c-45e4-835b-e3c3a2a1e74c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:11.717989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-623d9cf0-3ac4-42ae-87aa-ada311e65fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:11.724449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35cfdda9-3d9c-45e4-835b-e3c3a2a1e74c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:11.724636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-623d9cf0-3ac4-42ae-87aa-ada311e65fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:11.724900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35cfdda9-3d9c-45e4-835b-e3c3a2a1e74c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:11.725072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-623d9cf0-3ac4-42ae-87aa-ada311e65fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:11.725664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35cfdda9-3d9c-45e4-835b-e3c3a2a1e74c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:11.725842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-623d9cf0-3ac4-42ae-87aa-ada311e65fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:11.726092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35cfdda9-3d9c-45e4-835b-e3c3a2a1e74c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:11.726262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-623d9cf0-3ac4-42ae-87aa-ada311e65fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:11.730757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:11.740805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:11.757203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-35cfdda9-3d9c-45e4-835b-e3c3a2a1e74c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047520 Jul 26 18:41:11.757782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 989/1953] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:11 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:11.759724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-623d9cf0-3ac4-42ae-87aa-ada311e65fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048955 Jul 26 18:41:11.760442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 965/1954] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:11.762474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6be6404e-06f5-4f77-a6d4-a258057f4762 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:11.764653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6be6404e-06f5-4f77-a6d4-a258057f4762 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:11.770543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6be6404e-06f5-4f77-a6d4-a258057f4762 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:11.770992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6be6404e-06f5-4f77-a6d4-a258057f4762 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:11.771802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6be6404e-06f5-4f77-a6d4-a258057f4762 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:11.772236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6be6404e-06f5-4f77-a6d4-a258057f4762 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:11.801821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6be6404e-06f5-4f77-a6d4-a258057f4762 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043008 Jul 26 18:41:11.802410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 990/1955] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:11 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:12.538998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-75fa0f27-f0fb-4193-9a02-8d89b682bc3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:12.542509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-75fa0f27-f0fb-4193-9a02-8d89b682bc3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:12.552870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-75fa0f27-f0fb-4193-9a02-8d89b682bc3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:12.553605 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-75fa0f27-f0fb-4193-9a02-8d89b682bc3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:12.554831 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-75fa0f27-f0fb-4193-9a02-8d89b682bc3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:12.555582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-75fa0f27-f0fb-4193-9a02-8d89b682bc3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:12.586013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-75fa0f27-f0fb-4193-9a02-8d89b682bc3a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053666 Jul 26 18:41:12.586552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 966/1956] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:12 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:12.770921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-afdc88a1-3144-4d74-8781-c4072be34d6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:12.772377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-94326438-7567-4154-ae52-1a55de32713a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:12.773889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-afdc88a1-3144-4d74-8781-c4072be34d6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:12.775367 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-94326438-7567-4154-ae52-1a55de32713a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:12.781381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afdc88a1-3144-4d74-8781-c4072be34d6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:12.781904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afdc88a1-3144-4d74-8781-c4072be34d6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:12.782820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afdc88a1-3144-4d74-8781-c4072be34d6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:12.783312 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94326438-7567-4154-ae52-1a55de32713a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:12.783517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afdc88a1-3144-4d74-8781-c4072be34d6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:12.783816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94326438-7567-4154-ae52-1a55de32713a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:12.784718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94326438-7567-4154-ae52-1a55de32713a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:12.785240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94326438-7567-4154-ae52-1a55de32713a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:12.814280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-afdc88a1-3144-4d74-8781-c4072be34d6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048059 Jul 26 18:41:12.814859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 991/1957] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:12 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:12.815442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-94326438-7567-4154-ae52-1a55de32713a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047879 Jul 26 18:41:12.816666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 967/1958] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:12 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:12.819411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ca5c7b84-4ed6-4573-abf1-001a0b551ce5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:12.821511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ca5c7b84-4ed6-4573-abf1-001a0b551ce5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:12.827678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca5c7b84-4ed6-4573-abf1-001a0b551ce5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:12.828146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca5c7b84-4ed6-4573-abf1-001a0b551ce5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:12.828901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca5c7b84-4ed6-4573-abf1-001a0b551ce5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:12.829320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca5c7b84-4ed6-4573-abf1-001a0b551ce5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:12.858598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ca5c7b84-4ed6-4573-abf1-001a0b551ce5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042689 Jul 26 18:41:12.859074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 992/1959] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:12 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:13.604889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b8d745eb-31cf-4c7e-b4a6-eb1689c95ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:13.607054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b8d745eb-31cf-4c7e-b4a6-eb1689c95ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:13.615463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b8d745eb-31cf-4c7e-b4a6-eb1689c95ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:13.615463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b8d745eb-31cf-4c7e-b4a6-eb1689c95ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:13.616038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b8d745eb-31cf-4c7e-b4a6-eb1689c95ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:13.616474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b8d745eb-31cf-4c7e-b4a6-eb1689c95ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:13.648226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b8d745eb-31cf-4c7e-b4a6-eb1689c95ad9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049327 Jul 26 18:41:13.648941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 968/1960] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:13 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:13.827068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b246f2da-c18f-481c-92cc-971943a075e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:13.828242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3fdac685-7bf2-4181-a55c-19b1f12341a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:13.829414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b246f2da-c18f-481c-92cc-971943a075e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:13.830519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3fdac685-7bf2-4181-a55c-19b1f12341a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:13.836911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b246f2da-c18f-481c-92cc-971943a075e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:13.837421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b246f2da-c18f-481c-92cc-971943a075e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:13.837608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3fdac685-7bf2-4181-a55c-19b1f12341a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:13.838019 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3fdac685-7bf2-4181-a55c-19b1f12341a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:13.838306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b246f2da-c18f-481c-92cc-971943a075e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:13.838814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b246f2da-c18f-481c-92cc-971943a075e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:13.838956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3fdac685-7bf2-4181-a55c-19b1f12341a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:13.839329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3fdac685-7bf2-4181-a55c-19b1f12341a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:13.870205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3fdac685-7bf2-4181-a55c-19b1f12341a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046221 Jul 26 18:41:13.870776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 969/1961] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:13.871272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b246f2da-c18f-481c-92cc-971943a075e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048699 Jul 26 18:41:13.871999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 993/1962] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:13 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:13.875422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-000e79cf-9cb2-4103-aec1-b56ad7ce486d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:13.877550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-000e79cf-9cb2-4103-aec1-b56ad7ce486d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:13.883736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-000e79cf-9cb2-4103-aec1-b56ad7ce486d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:13.884183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-000e79cf-9cb2-4103-aec1-b56ad7ce486d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:13.884946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-000e79cf-9cb2-4103-aec1-b56ad7ce486d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:13.885383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-000e79cf-9cb2-4103-aec1-b56ad7ce486d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:13.913472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-000e79cf-9cb2-4103-aec1-b56ad7ce486d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041696 Jul 26 18:41:13.914227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 970/1963] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:14.664544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-234068b2-5f6f-49f1-afcf-3dba75b00137 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:14.667902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-234068b2-5f6f-49f1-afcf-3dba75b00137 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:14.678079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-234068b2-5f6f-49f1-afcf-3dba75b00137 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:14.678863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-234068b2-5f6f-49f1-afcf-3dba75b00137 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:14.680630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-234068b2-5f6f-49f1-afcf-3dba75b00137 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:14.680806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-234068b2-5f6f-49f1-afcf-3dba75b00137 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:14.711009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-234068b2-5f6f-49f1-afcf-3dba75b00137 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053279 Jul 26 18:41:14.711607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 994/1964] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:14 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:14.756958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-380826ae-1693-4012-aee9-29c66627eaf6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:14.757449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-380826ae-1693-4012-aee9-29c66627eaf6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:14.763786 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-380826ae-1693-4012-aee9-29c66627eaf6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:14.764233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-380826ae-1693-4012-aee9-29c66627eaf6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:14.764992 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-380826ae-1693-4012-aee9-29c66627eaf6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:14.765420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-380826ae-1693-4012-aee9-29c66627eaf6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:14.804637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b710aff9-c13e-40b0-a486-ba633f7b768a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:14.806918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b710aff9-c13e-40b0-a486-ba633f7b768a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:14.813066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b710aff9-c13e-40b0-a486-ba633f7b768a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:14.813514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b710aff9-c13e-40b0-a486-ba633f7b768a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:14.814275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b710aff9-c13e-40b0-a486-ba633f7b768a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:14.814705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b710aff9-c13e-40b0-a486-ba633f7b768a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:14.844194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b710aff9-c13e-40b0-a486-ba633f7b768a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043773 Jul 26 18:41:14.844839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 995/1965] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:14 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:41:14.883225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2063dde9-61a8-44de-aa91-f2b629dcc74f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:14.885396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2063dde9-61a8-44de-aa91-f2b629dcc74f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:14.891483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2063dde9-61a8-44de-aa91-f2b629dcc74f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:14.891928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2063dde9-61a8-44de-aa91-f2b629dcc74f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:14.892683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2063dde9-61a8-44de-aa91-f2b629dcc74f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:14.893111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2063dde9-61a8-44de-aa91-f2b629dcc74f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:14.912603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-380826ae-1693-4012-aee9-29c66627eaf6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lazy-loading 'services' on Instance uuid fc78286d-d3af-46ed-bc61-506e92fe4a32 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:41:14.923349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2063dde9-61a8-44de-aa91-f2b629dcc74f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043902 Jul 26 18:41:14.924109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 996/1966] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:14 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:14.928620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d3584f88-23d5-4fe6-a3c1-d86db192ab5c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:14.930788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d3584f88-23d5-4fe6-a3c1-d86db192ab5c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:14.936994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3584f88-23d5-4fe6-a3c1-d86db192ab5c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:14.937318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3584f88-23d5-4fe6-a3c1-d86db192ab5c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:14.938073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3584f88-23d5-4fe6-a3c1-d86db192ab5c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:14.938505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3584f88-23d5-4fe6-a3c1-d86db192ab5c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:14.968758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d3584f88-23d5-4fe6-a3c1-d86db192ab5c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043408 Jul 26 18:41:14.969307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 997/1967] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:14 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:14.978947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0d8202ae-6855-4dc9-8f6b-2856abebf836 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:14.981040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0d8202ae-6855-4dc9-8f6b-2856abebf836 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:14.986980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d8202ae-6855-4dc9-8f6b-2856abebf836 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:14.987251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-380826ae-1693-4012-aee9-29c66627eaf6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32/os-volume_attachments/619b2cc9-7b2f-4618-83d0-228f0acc6a9a" status: 202 len: 0 microversion: 2.1 time: 0.234143 Jul 26 18:41:14.987453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d8202ae-6855-4dc9-8f6b-2856abebf836 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:14.988052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 971/1968] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Jul 26 18:41:14 2022] DELETE /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32/os-volume_attachments/619b2cc9-7b2f-4618-83d0-228f0acc6a9a => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:41:14.988261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d8202ae-6855-4dc9-8f6b-2856abebf836 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:14.988646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d8202ae-6855-4dc9-8f6b-2856abebf836 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:15.028630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0d8202ae-6855-4dc9-8f6b-2856abebf836 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058279 Jul 26 18:41:15.033244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 998/1969] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:14 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:15.734885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-35c260c0-8b94-4ed4-818e-81e2fb1107f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:15.737372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-35c260c0-8b94-4ed4-818e-81e2fb1107f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:15.744407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35c260c0-8b94-4ed4-818e-81e2fb1107f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:15.744845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35c260c0-8b94-4ed4-818e-81e2fb1107f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:15.745608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35c260c0-8b94-4ed4-818e-81e2fb1107f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:15.746041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35c260c0-8b94-4ed4-818e-81e2fb1107f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:15.777051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-35c260c0-8b94-4ed4-818e-81e2fb1107f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055948 Jul 26 18:41:15.777610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 972/1970] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:15.860969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-db50c144-2f46-46b2-b0cf-f15b80dd7455 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:15.863959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-db50c144-2f46-46b2-b0cf-f15b80dd7455 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:15.871374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db50c144-2f46-46b2-b0cf-f15b80dd7455 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:15.871846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db50c144-2f46-46b2-b0cf-f15b80dd7455 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:15.872717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db50c144-2f46-46b2-b0cf-f15b80dd7455 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:15.873173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db50c144-2f46-46b2-b0cf-f15b80dd7455 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:15.904168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-db50c144-2f46-46b2-b0cf-f15b80dd7455 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049390 Jul 26 18:41:15.904731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 999/1971] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:15 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:15.935685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d48e984a-8930-4af5-aec3-0e3a42584d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:15.937956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d48e984a-8930-4af5-aec3-0e3a42584d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:15.945455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d48e984a-8930-4af5-aec3-0e3a42584d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:15.945974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d48e984a-8930-4af5-aec3-0e3a42584d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:15.946862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d48e984a-8930-4af5-aec3-0e3a42584d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:15.947523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d48e984a-8930-4af5-aec3-0e3a42584d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:15.977989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d48e984a-8930-4af5-aec3-0e3a42584d80 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046273 Jul 26 18:41:15.978789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 973/1972] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:15 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:15.981004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bc0be6f6-87da-472f-8e31-1e13ea990190 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:15.983326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bc0be6f6-87da-472f-8e31-1e13ea990190 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:15.989682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc0be6f6-87da-472f-8e31-1e13ea990190 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:15.990065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc0be6f6-87da-472f-8e31-1e13ea990190 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:15.990832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc0be6f6-87da-472f-8e31-1e13ea990190 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:15.991300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc0be6f6-87da-472f-8e31-1e13ea990190 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:16.020196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bc0be6f6-87da-472f-8e31-1e13ea990190 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043450 Jul 26 18:41:16.020755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1000/1973] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:15 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:16.041246 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1d9f16ef-9e27-48e3-bfef-7efe22c2b1f1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:16.043405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1d9f16ef-9e27-48e3-bfef-7efe22c2b1f1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:16.049618 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d9f16ef-9e27-48e3-bfef-7efe22c2b1f1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:16.050077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d9f16ef-9e27-48e3-bfef-7efe22c2b1f1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:16.050826 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d9f16ef-9e27-48e3-bfef-7efe22c2b1f1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:16.051293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d9f16ef-9e27-48e3-bfef-7efe22c2b1f1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:16.081042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1d9f16ef-9e27-48e3-bfef-7efe22c2b1f1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Jul 26 18:41:16.081605 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 974/1974] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:16 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:16.791104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9f0a3295-2542-4863-99c9-f22534568d92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:16.793292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9f0a3295-2542-4863-99c9-f22534568d92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:16.804868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9f0a3295-2542-4863-99c9-f22534568d92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:16.805314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9f0a3295-2542-4863-99c9-f22534568d92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:16.806081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9f0a3295-2542-4863-99c9-f22534568d92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:16.806516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9f0a3295-2542-4863-99c9-f22534568d92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:16.836037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9f0a3295-2542-4863-99c9-f22534568d92 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049992 Jul 26 18:41:16.836582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1001/1975] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:16.920452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a126cede-241a-4be1-8e2a-c9f94ff82f9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:16.924100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a126cede-241a-4be1-8e2a-c9f94ff82f9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:16.927232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:16.934214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a126cede-241a-4be1-8e2a-c9f94ff82f9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:16.934663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a126cede-241a-4be1-8e2a-c9f94ff82f9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:16.935448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a126cede-241a-4be1-8e2a-c9f94ff82f9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:16.935882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a126cede-241a-4be1-8e2a-c9f94ff82f9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:16.966400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a126cede-241a-4be1-8e2a-c9f94ff82f9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052597 Jul 26 18:41:16.966948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 975/1976] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:16 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:16.991177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3688102c-3bbd-434d-9c70-32e8b69b6ab7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:16.993522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3688102c-3bbd-434d-9c70-32e8b69b6ab7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:16.996137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:17.004618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3688102c-3bbd-434d-9c70-32e8b69b6ab7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:17.005228 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3688102c-3bbd-434d-9c70-32e8b69b6ab7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:17.006491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3688102c-3bbd-434d-9c70-32e8b69b6ab7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:17.007274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3688102c-3bbd-434d-9c70-32e8b69b6ab7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:17.032952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-63222886-3df2-46c6-9888-c9a6dfc93de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:17.035173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-63222886-3df2-46c6-9888-c9a6dfc93de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:17.041346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63222886-3df2-46c6-9888-c9a6dfc93de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:17.041800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63222886-3df2-46c6-9888-c9a6dfc93de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:17.042568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63222886-3df2-46c6-9888-c9a6dfc93de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:17.043003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63222886-3df2-46c6-9888-c9a6dfc93de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:17.043802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3688102c-3bbd-434d-9c70-32e8b69b6ab7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056611 Jul 26 18:41:17.044370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1002/1977] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:16 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:17.072863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-63222886-3df2-46c6-9888-c9a6dfc93de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Jul 26 18:41:17.073418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 976/1978] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:17 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:17.096082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e108ec8b-9e3a-4e63-8cca-5d6308a3fbf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:17.099425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e108ec8b-9e3a-4e63-8cca-5d6308a3fbf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:17.108562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e108ec8b-9e3a-4e63-8cca-5d6308a3fbf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:17.109186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e108ec8b-9e3a-4e63-8cca-5d6308a3fbf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:17.109973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e108ec8b-9e3a-4e63-8cca-5d6308a3fbf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:17.110410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e108ec8b-9e3a-4e63-8cca-5d6308a3fbf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:17.139868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e108ec8b-9e3a-4e63-8cca-5d6308a3fbf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049676 Jul 26 18:41:17.140418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1003/1979] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:17 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:17.848828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f47e6eaa-340d-4d63-af64-b71628211158 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:17.850933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f47e6eaa-340d-4d63-af64-b71628211158 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:17.857566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f47e6eaa-340d-4d63-af64-b71628211158 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:17.858012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f47e6eaa-340d-4d63-af64-b71628211158 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:17.858766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f47e6eaa-340d-4d63-af64-b71628211158 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:17.859238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f47e6eaa-340d-4d63-af64-b71628211158 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:17.889176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f47e6eaa-340d-4d63-af64-b71628211158 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044426 Jul 26 18:41:17.889717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 977/1980] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:17 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:17.981415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d1f9c92b-5bc5-4c6c-b7e0-34f876279240 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:17.983584 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d1f9c92b-5bc5-4c6c-b7e0-34f876279240 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:17.990155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1f9c92b-5bc5-4c6c-b7e0-34f876279240 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:17.990599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1f9c92b-5bc5-4c6c-b7e0-34f876279240 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:17.991390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1f9c92b-5bc5-4c6c-b7e0-34f876279240 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:17.991996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1f9c92b-5bc5-4c6c-b7e0-34f876279240 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:18.021438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d1f9c92b-5bc5-4c6c-b7e0-34f876279240 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045134 Jul 26 18:41:18.021986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1004/1981] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:17 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:18.056347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5802523f-54fa-427b-95fd-d001c7ad230c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:18.058495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5802523f-54fa-427b-95fd-d001c7ad230c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:18.065183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5802523f-54fa-427b-95fd-d001c7ad230c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:18.065632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5802523f-54fa-427b-95fd-d001c7ad230c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:18.066391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5802523f-54fa-427b-95fd-d001c7ad230c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:18.066821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5802523f-54fa-427b-95fd-d001c7ad230c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:18.085200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6c1052a4-faf0-427f-8d20-286bcebf219b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:18.087370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6c1052a4-faf0-427f-8d20-286bcebf219b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:18.093693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c1052a4-faf0-427f-8d20-286bcebf219b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:18.094143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c1052a4-faf0-427f-8d20-286bcebf219b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:18.094941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c1052a4-faf0-427f-8d20-286bcebf219b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:18.095407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c1052a4-faf0-427f-8d20-286bcebf219b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:18.096646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5802523f-54fa-427b-95fd-d001c7ad230c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044363 Jul 26 18:41:18.097216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 978/1982] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:18 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:18.120882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:18.125212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6c1052a4-faf0-427f-8d20-286bcebf219b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044029 Jul 26 18:41:18.125746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1005/1983] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:18 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:18.152593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7790b9c1-7fb2-4bb9-8199-412e6ec89413 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:18.154772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7790b9c1-7fb2-4bb9-8199-412e6ec89413 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:18.161224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7790b9c1-7fb2-4bb9-8199-412e6ec89413 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:18.161676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7790b9c1-7fb2-4bb9-8199-412e6ec89413 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:18.162440 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7790b9c1-7fb2-4bb9-8199-412e6ec89413 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:18.162880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7790b9c1-7fb2-4bb9-8199-412e6ec89413 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:18.193002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7790b9c1-7fb2-4bb9-8199-412e6ec89413 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Jul 26 18:41:18.193765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 979/1984] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:18 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:18.908471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2fcf45d1-c9aa-46cc-8a91-9c4001e70508 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:18.912022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2fcf45d1-c9aa-46cc-8a91-9c4001e70508 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:18.919910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2fcf45d1-c9aa-46cc-8a91-9c4001e70508 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:18.920354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2fcf45d1-c9aa-46cc-8a91-9c4001e70508 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:18.921109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2fcf45d1-c9aa-46cc-8a91-9c4001e70508 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:18.921580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2fcf45d1-c9aa-46cc-8a91-9c4001e70508 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:18.950933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2fcf45d1-c9aa-46cc-8a91-9c4001e70508 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049839 Jul 26 18:41:18.951541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1006/1985] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:19.037506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dbdbd4cf-8a49-4fae-bce1-46ad46e19e4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:19.040665 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dbdbd4cf-8a49-4fae-bce1-46ad46e19e4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:19.047349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dbdbd4cf-8a49-4fae-bce1-46ad46e19e4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:19.047791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dbdbd4cf-8a49-4fae-bce1-46ad46e19e4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:19.048547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dbdbd4cf-8a49-4fae-bce1-46ad46e19e4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:19.048968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dbdbd4cf-8a49-4fae-bce1-46ad46e19e4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:19.078377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dbdbd4cf-8a49-4fae-bce1-46ad46e19e4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047306 Jul 26 18:41:19.079057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 980/1986] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:19 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:19.109382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-778c03e4-22e8-48d3-9c4e-d416ba59f2f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:19.111571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-778c03e4-22e8-48d3-9c4e-d416ba59f2f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:19.118423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-778c03e4-22e8-48d3-9c4e-d416ba59f2f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:19.118919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-778c03e4-22e8-48d3-9c4e-d416ba59f2f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:19.119755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-778c03e4-22e8-48d3-9c4e-d416ba59f2f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:19.120187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-778c03e4-22e8-48d3-9c4e-d416ba59f2f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:19.139178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c0bf326b-55af-447e-a385-f346ec6b28b0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:19.141323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c0bf326b-55af-447e-a385-f346ec6b28b0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:19.147420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0bf326b-55af-447e-a385-f346ec6b28b0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:19.148182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0bf326b-55af-447e-a385-f346ec6b28b0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:19.148946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0bf326b-55af-447e-a385-f346ec6b28b0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:19.149381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0bf326b-55af-447e-a385-f346ec6b28b0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:19.150613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-778c03e4-22e8-48d3-9c4e-d416ba59f2f9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045195 Jul 26 18:41:19.151220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1007/1987] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:19 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:19.163285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:19.179944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c0bf326b-55af-447e-a385-f346ec6b28b0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 Jul 26 18:41:19.180501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 981/1988] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:19 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:19.205636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-50b9a071-e835-44a8-b448-2262ebb04337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:19.207853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-50b9a071-e835-44a8-b448-2262ebb04337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:19.214198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50b9a071-e835-44a8-b448-2262ebb04337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:19.214641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50b9a071-e835-44a8-b448-2262ebb04337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:19.215428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50b9a071-e835-44a8-b448-2262ebb04337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:19.215861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50b9a071-e835-44a8-b448-2262ebb04337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:19.244822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-50b9a071-e835-44a8-b448-2262ebb04337 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043189 Jul 26 18:41:19.245352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1008/1989] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:19 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:19.964012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b0747364-c4fa-4431-b747-1d479b4e5cc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:19.966075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b0747364-c4fa-4431-b747-1d479b4e5cc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:19.972636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0747364-c4fa-4431-b747-1d479b4e5cc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:19.973079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0747364-c4fa-4431-b747-1d479b4e5cc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:19.973832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0747364-c4fa-4431-b747-1d479b4e5cc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:19.974263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0747364-c4fa-4431-b747-1d479b4e5cc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:20.003858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b0747364-c4fa-4431-b747-1d479b4e5cc5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044138 Jul 26 18:41:20.004402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 982/1990] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:19 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:20.091337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1d4bb02c-91ae-4562-aa09-6d56f5f70318 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:20.093506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1d4bb02c-91ae-4562-aa09-6d56f5f70318 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:20.100103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d4bb02c-91ae-4562-aa09-6d56f5f70318 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:20.100553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d4bb02c-91ae-4562-aa09-6d56f5f70318 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:20.101319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d4bb02c-91ae-4562-aa09-6d56f5f70318 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:20.101755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d4bb02c-91ae-4562-aa09-6d56f5f70318 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:20.131702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1d4bb02c-91ae-4562-aa09-6d56f5f70318 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044519 Jul 26 18:41:20.132341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1009/1991] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:20 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:20.163289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-502e9bcd-7e8a-43e2-a274-e01e8d1bcfb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:20.165448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-502e9bcd-7e8a-43e2-a274-e01e8d1bcfb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:20.172088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-502e9bcd-7e8a-43e2-a274-e01e8d1bcfb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:20.172533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-502e9bcd-7e8a-43e2-a274-e01e8d1bcfb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:20.173294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-502e9bcd-7e8a-43e2-a274-e01e8d1bcfb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:20.173723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-502e9bcd-7e8a-43e2-a274-e01e8d1bcfb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:20.192286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0983b120-3ef0-45c6-a3e4-1f18e8707459 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:20.194470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0983b120-3ef0-45c6-a3e4-1f18e8707459 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:20.200802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0983b120-3ef0-45c6-a3e4-1f18e8707459 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:20.201247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0983b120-3ef0-45c6-a3e4-1f18e8707459 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:20.202053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0983b120-3ef0-45c6-a3e4-1f18e8707459 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:20.202483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0983b120-3ef0-45c6-a3e4-1f18e8707459 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:20.202860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-502e9bcd-7e8a-43e2-a274-e01e8d1bcfb0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043640 Jul 26 18:41:20.203808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 983/1992] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:20.231349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0983b120-3ef0-45c6-a3e4-1f18e8707459 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042838 Jul 26 18:41:20.231825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1010/1993] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:20 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:20.257265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cfaf91b8-0061-43d0-8489-78b07b2ec2b4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:20.259439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cfaf91b8-0061-43d0-8489-78b07b2ec2b4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:20.265726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfaf91b8-0061-43d0-8489-78b07b2ec2b4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:20.266161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfaf91b8-0061-43d0-8489-78b07b2ec2b4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:20.266906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfaf91b8-0061-43d0-8489-78b07b2ec2b4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:20.267367 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfaf91b8-0061-43d0-8489-78b07b2ec2b4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:20.296773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cfaf91b8-0061-43d0-8489-78b07b2ec2b4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043422 Jul 26 18:41:20.297336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 984/1994] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:21.016625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ccec8a6c-7c31-42cd-a457-f1a90e20571b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:21.018694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ccec8a6c-7c31-42cd-a457-f1a90e20571b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:21.025619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccec8a6c-7c31-42cd-a457-f1a90e20571b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:21.026101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccec8a6c-7c31-42cd-a457-f1a90e20571b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:21.026858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccec8a6c-7c31-42cd-a457-f1a90e20571b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:21.027322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccec8a6c-7c31-42cd-a457-f1a90e20571b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:21.056568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ccec8a6c-7c31-42cd-a457-f1a90e20571b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044065 Jul 26 18:41:21.057117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1011/1995] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:21.149430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ceb4b1e8-8460-47fc-a1c6-363b1a99044c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:21.153053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ceb4b1e8-8460-47fc-a1c6-363b1a99044c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:21.163195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ceb4b1e8-8460-47fc-a1c6-363b1a99044c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:21.163935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ceb4b1e8-8460-47fc-a1c6-363b1a99044c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:21.165219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ceb4b1e8-8460-47fc-a1c6-363b1a99044c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:21.165987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ceb4b1e8-8460-47fc-a1c6-363b1a99044c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:21.194913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ceb4b1e8-8460-47fc-a1c6-363b1a99044c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052408 Jul 26 18:41:21.195485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 985/1996] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:21 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:21.217861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8903536a-fc7c-4775-b763-f1824566d6ce tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:21.220875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8903536a-fc7c-4775-b763-f1824566d6ce tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:21.230224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8903536a-fc7c-4775-b763-f1824566d6ce tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:21.230709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8903536a-fc7c-4775-b763-f1824566d6ce tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:21.231506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8903536a-fc7c-4775-b763-f1824566d6ce tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:21.231937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8903536a-fc7c-4775-b763-f1824566d6ce tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:21.243487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ca1a8ee6-c0b0-457e-8787-d4a4abc118d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:21.245615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ca1a8ee6-c0b0-457e-8787-d4a4abc118d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:21.251896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca1a8ee6-c0b0-457e-8787-d4a4abc118d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:21.252343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca1a8ee6-c0b0-457e-8787-d4a4abc118d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:21.253108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca1a8ee6-c0b0-457e-8787-d4a4abc118d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:21.253539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca1a8ee6-c0b0-457e-8787-d4a4abc118d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:21.262679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8903536a-fc7c-4775-b763-f1824566d6ce tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050911 Jul 26 18:41:21.263295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1012/1997] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:21 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:21.283130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ca1a8ee6-c0b0-457e-8787-d4a4abc118d8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043406 Jul 26 18:41:21.283618 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 986/1998] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:21 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:21.311766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-88168a24-239f-495a-a2a2-c7358b5e0b56 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:21.315082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-88168a24-239f-495a-a2a2-c7358b5e0b56 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:21.324807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88168a24-239f-495a-a2a2-c7358b5e0b56 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:21.325251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88168a24-239f-495a-a2a2-c7358b5e0b56 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:21.326000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88168a24-239f-495a-a2a2-c7358b5e0b56 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:21.326454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88168a24-239f-495a-a2a2-c7358b5e0b56 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:21.367104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-88168a24-239f-495a-a2a2-c7358b5e0b56 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061520 Jul 26 18:41:21.371305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1013/1999] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:21 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:22.071234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-29363e97-717b-41be-9246-92df7f56e65f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:22.073712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-29363e97-717b-41be-9246-92df7f56e65f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:22.080226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29363e97-717b-41be-9246-92df7f56e65f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:22.080674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29363e97-717b-41be-9246-92df7f56e65f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:22.081428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29363e97-717b-41be-9246-92df7f56e65f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:22.081859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29363e97-717b-41be-9246-92df7f56e65f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:22.113588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-29363e97-717b-41be-9246-92df7f56e65f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047607 Jul 26 18:41:22.114162 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 987/2000] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:22.211514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c4fc601d-a819-4a54-bf77-90eaeef750eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:22.214369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c4fc601d-a819-4a54-bf77-90eaeef750eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:22.221469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4fc601d-a819-4a54-bf77-90eaeef750eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:22.222111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4fc601d-a819-4a54-bf77-90eaeef750eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:22.222795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4fc601d-a819-4a54-bf77-90eaeef750eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:22.223328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4fc601d-a819-4a54-bf77-90eaeef750eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:22.255227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c4fc601d-a819-4a54-bf77-90eaeef750eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050281 Jul 26 18:41:22.255752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1014/2001] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:22 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:22.277259 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ba07ec4a-75bc-412b-b019-996fb54d7a28 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:22.279428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ba07ec4a-75bc-412b-b019-996fb54d7a28 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:22.286058 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba07ec4a-75bc-412b-b019-996fb54d7a28 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:22.286502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba07ec4a-75bc-412b-b019-996fb54d7a28 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:22.287287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba07ec4a-75bc-412b-b019-996fb54d7a28 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:22.287719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba07ec4a-75bc-412b-b019-996fb54d7a28 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:22.295246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6f0e96bf-a4c4-48f2-8f48-022a22949a9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:22.297368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6f0e96bf-a4c4-48f2-8f48-022a22949a9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:22.303486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f0e96bf-a4c4-48f2-8f48-022a22949a9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:22.303930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f0e96bf-a4c4-48f2-8f48-022a22949a9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:22.304687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f0e96bf-a4c4-48f2-8f48-022a22949a9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:22.305140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f0e96bf-a4c4-48f2-8f48-022a22949a9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:22.317372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ba07ec4a-75bc-412b-b019-996fb54d7a28 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045440 Jul 26 18:41:22.317928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 988/2002] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:22 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:22.334530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6f0e96bf-a4c4-48f2-8f48-022a22949a9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043082 Jul 26 18:41:22.335126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1015/2003] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:22 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:41:22.383644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1921d737-bbc2-4cc4-8654-7c0f7aa86ae1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:22.387104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1921d737-bbc2-4cc4-8654-7c0f7aa86ae1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:22.397106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1921d737-bbc2-4cc4-8654-7c0f7aa86ae1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:22.398197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1921d737-bbc2-4cc4-8654-7c0f7aa86ae1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:22.399451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1921d737-bbc2-4cc4-8654-7c0f7aa86ae1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:22.400341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1921d737-bbc2-4cc4-8654-7c0f7aa86ae1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:22.429711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1921d737-bbc2-4cc4-8654-7c0f7aa86ae1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052725 Jul 26 18:41:22.430293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 989/2004] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:22 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:23.130693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cdb96e99-b9d0-4039-8d7a-5e539beffe5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:23.134086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cdb96e99-b9d0-4039-8d7a-5e539beffe5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:23.144414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cdb96e99-b9d0-4039-8d7a-5e539beffe5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:23.145163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cdb96e99-b9d0-4039-8d7a-5e539beffe5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:23.146423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cdb96e99-b9d0-4039-8d7a-5e539beffe5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:23.147184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cdb96e99-b9d0-4039-8d7a-5e539beffe5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:23.177900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cdb96e99-b9d0-4039-8d7a-5e539beffe5f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054025 Jul 26 18:41:23.178452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1016/2005] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:23 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:23.271597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f015b24d-b2d4-4ba9-9de0-8358f1696437 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:23.275450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f015b24d-b2d4-4ba9-9de0-8358f1696437 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:23.286196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f015b24d-b2d4-4ba9-9de0-8358f1696437 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:23.287198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f015b24d-b2d4-4ba9-9de0-8358f1696437 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:23.288204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f015b24d-b2d4-4ba9-9de0-8358f1696437 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:23.288916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f015b24d-b2d4-4ba9-9de0-8358f1696437 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:23.318487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f015b24d-b2d4-4ba9-9de0-8358f1696437 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053515 Jul 26 18:41:23.319047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 990/2006] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:23 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:23.330199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0a0623f3-ad85-4dd6-9058-4b018a18bee6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:23.332402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0a0623f3-ad85-4dd6-9058-4b018a18bee6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:23.338957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a0623f3-ad85-4dd6-9058-4b018a18bee6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:23.339443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a0623f3-ad85-4dd6-9058-4b018a18bee6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:23.340173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a0623f3-ad85-4dd6-9058-4b018a18bee6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:23.340603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a0623f3-ad85-4dd6-9058-4b018a18bee6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:23.346637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-94da2f29-c37d-4d3b-8d42-b3c9805c8a0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:23.348853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-94da2f29-c37d-4d3b-8d42-b3c9805c8a0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:23.355004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94da2f29-c37d-4d3b-8d42-b3c9805c8a0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:23.355481 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94da2f29-c37d-4d3b-8d42-b3c9805c8a0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:23.356237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94da2f29-c37d-4d3b-8d42-b3c9805c8a0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:23.356665 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94da2f29-c37d-4d3b-8d42-b3c9805c8a0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:23.369853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0a0623f3-ad85-4dd6-9058-4b018a18bee6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043717 Jul 26 18:41:23.370409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1017/2007] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:23 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:23.386337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-94da2f29-c37d-4d3b-8d42-b3c9805c8a0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043160 Jul 26 18:41:23.387120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 991/2008] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:23 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:23.443858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2252fceb-ad1d-4032-9cd0-d4567db8c42b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:23.446053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2252fceb-ad1d-4032-9cd0-d4567db8c42b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:23.452936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2252fceb-ad1d-4032-9cd0-d4567db8c42b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:23.453386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2252fceb-ad1d-4032-9cd0-d4567db8c42b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:23.454143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2252fceb-ad1d-4032-9cd0-d4567db8c42b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:23.454573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2252fceb-ad1d-4032-9cd0-d4567db8c42b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:23.484579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2252fceb-ad1d-4032-9cd0-d4567db8c42b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045382 Jul 26 18:41:23.485112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1018/2009] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:23 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:24.194824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d720d0cd-455a-49c0-b74d-c10a76d6aeb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:24.197905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d720d0cd-455a-49c0-b74d-c10a76d6aeb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:24.204701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d720d0cd-455a-49c0-b74d-c10a76d6aeb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:24.205173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d720d0cd-455a-49c0-b74d-c10a76d6aeb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:24.205970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d720d0cd-455a-49c0-b74d-c10a76d6aeb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:24.206430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d720d0cd-455a-49c0-b74d-c10a76d6aeb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:24.236819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d720d0cd-455a-49c0-b74d-c10a76d6aeb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048683 Jul 26 18:41:24.237374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 992/2010] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:24 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:24.334896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e8397437-9c6b-40a4-9cdd-684b6332c67c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:24.338388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e8397437-9c6b-40a4-9cdd-684b6332c67c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:24.349198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8397437-9c6b-40a4-9cdd-684b6332c67c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:24.349923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8397437-9c6b-40a4-9cdd-684b6332c67c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:24.351197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8397437-9c6b-40a4-9cdd-684b6332c67c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:24.351953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8397437-9c6b-40a4-9cdd-684b6332c67c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:24.382123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e8397437-9c6b-40a4-9cdd-684b6332c67c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053933 Jul 26 18:41:24.382574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c6340b38-b151-4577-a740-cd859a20892c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:24.383160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1019/2011] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:24 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:24.384746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c6340b38-b151-4577-a740-cd859a20892c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:24.393294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c6340b38-b151-4577-a740-cd859a20892c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:24.393742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c6340b38-b151-4577-a740-cd859a20892c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:24.394510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c6340b38-b151-4577-a740-cd859a20892c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:24.394939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c6340b38-b151-4577-a740-cd859a20892c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:24.398145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d3818615-a7e1-4103-835d-8d6bf70e209c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:24.400401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d3818615-a7e1-4103-835d-8d6bf70e209c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:24.406639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3818615-a7e1-4103-835d-8d6bf70e209c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:24.407112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3818615-a7e1-4103-835d-8d6bf70e209c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:24.407879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3818615-a7e1-4103-835d-8d6bf70e209c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:24.408315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3818615-a7e1-4103-835d-8d6bf70e209c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:24.425074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c6340b38-b151-4577-a740-cd859a20892c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046659 Jul 26 18:41:24.425661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 993/2012] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:24.437483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d3818615-a7e1-4103-835d-8d6bf70e209c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043380 Jul 26 18:41:24.438030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1020/2013] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:24 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:24.499893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9a356633-b8c5-4cc2-8c78-ef1b98a93dde tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:24.503456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9a356633-b8c5-4cc2-8c78-ef1b98a93dde tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:24.513626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a356633-b8c5-4cc2-8c78-ef1b98a93dde tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:24.514369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a356633-b8c5-4cc2-8c78-ef1b98a93dde tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:24.515679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a356633-b8c5-4cc2-8c78-ef1b98a93dde tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:24.516401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a356633-b8c5-4cc2-8c78-ef1b98a93dde tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:24.549648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9a356633-b8c5-4cc2-8c78-ef1b98a93dde tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056292 Jul 26 18:41:24.550212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 994/2014] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:24 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:25.252955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4b3c8c48-2451-45ed-8d29-75be349d9ed8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:25.256608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4b3c8c48-2451-45ed-8d29-75be349d9ed8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:25.266985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b3c8c48-2451-45ed-8d29-75be349d9ed8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:25.267780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b3c8c48-2451-45ed-8d29-75be349d9ed8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:25.269094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b3c8c48-2451-45ed-8d29-75be349d9ed8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:25.269776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b3c8c48-2451-45ed-8d29-75be349d9ed8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:25.301945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4b3c8c48-2451-45ed-8d29-75be349d9ed8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055645 Jul 26 18:41:25.302492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1021/2015] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:25 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:25.399000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aeb23a6e-9af7-4b54-af6a-e098758e5ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:25.401986 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aeb23a6e-9af7-4b54-af6a-e098758e5ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:25.409490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aeb23a6e-9af7-4b54-af6a-e098758e5ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:25.409979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aeb23a6e-9af7-4b54-af6a-e098758e5ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:25.410828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aeb23a6e-9af7-4b54-af6a-e098758e5ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:25.411329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aeb23a6e-9af7-4b54-af6a-e098758e5ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:25.438028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5f1122cb-77ed-45a3-976f-df9fb9bc7dd4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:25.440196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5f1122cb-77ed-45a3-976f-df9fb9bc7dd4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:25.443529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aeb23a6e-9af7-4b54-af6a-e098758e5ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051492 Jul 26 18:41:25.444262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 995/2016] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:25 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:25.447166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f1122cb-77ed-45a3-976f-df9fb9bc7dd4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:25.447619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f1122cb-77ed-45a3-976f-df9fb9bc7dd4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:25.448396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f1122cb-77ed-45a3-976f-df9fb9bc7dd4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:25.448864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f1122cb-77ed-45a3-976f-df9fb9bc7dd4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:25.451232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-599b7f87-708c-428f-96cd-a27522bd3c01 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:25.454151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-599b7f87-708c-428f-96cd-a27522bd3c01 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:25.461097 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-599b7f87-708c-428f-96cd-a27522bd3c01 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:25.461520 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-599b7f87-708c-428f-96cd-a27522bd3c01 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:25.462294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-599b7f87-708c-428f-96cd-a27522bd3c01 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:25.462846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-599b7f87-708c-428f-96cd-a27522bd3c01 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:25.474835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:25.488169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5f1122cb-77ed-45a3-976f-df9fb9bc7dd4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054141 Jul 26 18:41:25.488733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1022/2017] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:25.492353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-599b7f87-708c-428f-96cd-a27522bd3c01 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046556 Jul 26 18:41:25.493011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 996/2018] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:25 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:25.565537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-95ce5f04-dc04-4a7f-96bc-89550b476351 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:25.568961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-95ce5f04-dc04-4a7f-96bc-89550b476351 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:25.576370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95ce5f04-dc04-4a7f-96bc-89550b476351 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:25.576818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95ce5f04-dc04-4a7f-96bc-89550b476351 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:25.577588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95ce5f04-dc04-4a7f-96bc-89550b476351 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:25.578022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95ce5f04-dc04-4a7f-96bc-89550b476351 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:25.607739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-95ce5f04-dc04-4a7f-96bc-89550b476351 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048750 Jul 26 18:41:25.608312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1023/2019] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:25 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:41:26.318634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-29c46261-52ca-4352-8d3c-350acfa579c0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:26.322241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-29c46261-52ca-4352-8d3c-350acfa579c0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:26.329349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29c46261-52ca-4352-8d3c-350acfa579c0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:26.329838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29c46261-52ca-4352-8d3c-350acfa579c0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:26.330668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29c46261-52ca-4352-8d3c-350acfa579c0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:26.331180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29c46261-52ca-4352-8d3c-350acfa579c0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:26.361744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-29c46261-52ca-4352-8d3c-350acfa579c0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049681 Jul 26 18:41:26.362272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 997/2020] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:26 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:26.460229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b334b90f-8872-4cc7-97fe-fd2311394e1e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:26.463766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b334b90f-8872-4cc7-97fe-fd2311394e1e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:26.474788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b334b90f-8872-4cc7-97fe-fd2311394e1e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:26.475578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b334b90f-8872-4cc7-97fe-fd2311394e1e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:26.476833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b334b90f-8872-4cc7-97fe-fd2311394e1e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:26.477553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b334b90f-8872-4cc7-97fe-fd2311394e1e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:26.500759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-45a48649-a2c7-4601-ab6a-ab40bfd1cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:26.502917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-45a48649-a2c7-4601-ab6a-ab40bfd1cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:26.507770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b334b90f-8872-4cc7-97fe-fd2311394e1e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054210 Jul 26 18:41:26.508378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1024/2021] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:26 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:26.509924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45a48649-a2c7-4601-ab6a-ab40bfd1cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:26.510375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45a48649-a2c7-4601-ab6a-ab40bfd1cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:26.511150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45a48649-a2c7-4601-ab6a-ab40bfd1cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:26.511607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45a48649-a2c7-4601-ab6a-ab40bfd1cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:26.513165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-734633d0-95dd-4ce5-8b9d-6d6717bc9780 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:26.514116 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:26.515438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-734633d0-95dd-4ce5-8b9d-6d6717bc9780 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:26.521450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-734633d0-95dd-4ce5-8b9d-6d6717bc9780 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:26.521898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-734633d0-95dd-4ce5-8b9d-6d6717bc9780 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:26.522973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-734633d0-95dd-4ce5-8b9d-6d6717bc9780 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:26.523436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-734633d0-95dd-4ce5-8b9d-6d6717bc9780 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:26.542900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-45a48649-a2c7-4601-ab6a-ab40bfd1cf9d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046263 Jul 26 18:41:26.543514 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 998/2022] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:26.552257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-734633d0-95dd-4ce5-8b9d-6d6717bc9780 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042924 Jul 26 18:41:26.552807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1025/2023] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:26 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:26.622837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5a03a2b9-2857-47e8-9215-7841e96e7f7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:26.625315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5a03a2b9-2857-47e8-9215-7841e96e7f7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:26.632561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a03a2b9-2857-47e8-9215-7841e96e7f7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:26.633091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a03a2b9-2857-47e8-9215-7841e96e7f7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:26.633980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a03a2b9-2857-47e8-9215-7841e96e7f7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:26.634486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a03a2b9-2857-47e8-9215-7841e96e7f7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:26.666618 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5a03a2b9-2857-47e8-9215-7841e96e7f7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048981 Jul 26 18:41:26.667213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 999/2024] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:26 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:27.377535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9925b33f-4c42-4774-aa3e-3818ab33941d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:27.381183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9925b33f-4c42-4774-aa3e-3818ab33941d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:27.391559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9925b33f-4c42-4774-aa3e-3818ab33941d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:27.392314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9925b33f-4c42-4774-aa3e-3818ab33941d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:27.393592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9925b33f-4c42-4774-aa3e-3818ab33941d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:27.394318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9925b33f-4c42-4774-aa3e-3818ab33941d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:27.425760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9925b33f-4c42-4774-aa3e-3818ab33941d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054839 Jul 26 18:41:27.426303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1026/2025] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:27 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:27.524466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-466cfb21-c392-497b-a029-8f60a6e514bf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:27.526876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-466cfb21-c392-497b-a029-8f60a6e514bf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:27.533747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-466cfb21-c392-497b-a029-8f60a6e514bf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:27.534217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-466cfb21-c392-497b-a029-8f60a6e514bf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:27.535048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-466cfb21-c392-497b-a029-8f60a6e514bf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:27.535511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-466cfb21-c392-497b-a029-8f60a6e514bf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:27.555958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7be75513-9dff-4d02-b75b-14587bceb899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:27.558410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7be75513-9dff-4d02-b75b-14587bceb899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:27.565473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7be75513-9dff-4d02-b75b-14587bceb899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:27.565925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7be75513-9dff-4d02-b75b-14587bceb899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:27.566249 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-466cfb21-c392-497b-a029-8f60a6e514bf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048860 Jul 26 18:41:27.566693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7be75513-9dff-4d02-b75b-14587bceb899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:27.566830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1000/2026] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:27 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:27.567160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7be75513-9dff-4d02-b75b-14587bceb899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:27.571405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ee39435f-fe1d-47d7-b464-98c412d962b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:27.573491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ee39435f-fe1d-47d7-b464-98c412d962b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:27.579663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee39435f-fe1d-47d7-b464-98c412d962b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:27.580074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee39435f-fe1d-47d7-b464-98c412d962b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:27.580833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee39435f-fe1d-47d7-b464-98c412d962b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:27.581259 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ee39435f-fe1d-47d7-b464-98c412d962b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:27.599153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7be75513-9dff-4d02-b75b-14587bceb899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047351 Jul 26 18:41:27.599717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1027/2027] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:27 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:27.610488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ee39435f-fe1d-47d7-b464-98c412d962b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042669 Jul 26 18:41:27.611066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1001/2028] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:27 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:27.682435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3a6afa50-3555-4c19-9f8d-e68ff1fe7ccb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:27.685028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3a6afa50-3555-4c19-9f8d-e68ff1fe7ccb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:27.692724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a6afa50-3555-4c19-9f8d-e68ff1fe7ccb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:27.693267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a6afa50-3555-4c19-9f8d-e68ff1fe7ccb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:27.694205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a6afa50-3555-4c19-9f8d-e68ff1fe7ccb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:27.694740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a6afa50-3555-4c19-9f8d-e68ff1fe7ccb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:27.727878 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3a6afa50-3555-4c19-9f8d-e68ff1fe7ccb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051913 Jul 26 18:41:27.728601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1028/2029] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:28.442448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b37efeac-ab9b-4599-94d6-43c9837b7036 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:28.445958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b37efeac-ab9b-4599-94d6-43c9837b7036 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:28.456349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b37efeac-ab9b-4599-94d6-43c9837b7036 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:28.457081 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b37efeac-ab9b-4599-94d6-43c9837b7036 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:28.458318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b37efeac-ab9b-4599-94d6-43c9837b7036 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:28.459069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b37efeac-ab9b-4599-94d6-43c9837b7036 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:28.490604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b37efeac-ab9b-4599-94d6-43c9837b7036 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054771 Jul 26 18:41:28.491177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1002/2030] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:28 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:28.583059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-35f153c7-0e01-40e3-9056-c7d85f1cdc4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:28.586536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-35f153c7-0e01-40e3-9056-c7d85f1cdc4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:28.597578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35f153c7-0e01-40e3-9056-c7d85f1cdc4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:28.598354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35f153c7-0e01-40e3-9056-c7d85f1cdc4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:28.599651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35f153c7-0e01-40e3-9056-c7d85f1cdc4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:28.600364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35f153c7-0e01-40e3-9056-c7d85f1cdc4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:28.611293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a20056b1-6b36-4749-b4fb-95b8f0e6655c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:28.613435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a20056b1-6b36-4749-b4fb-95b8f0e6655c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:28.620454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a20056b1-6b36-4749-b4fb-95b8f0e6655c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:28.620901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a20056b1-6b36-4749-b4fb-95b8f0e6655c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:28.621698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a20056b1-6b36-4749-b4fb-95b8f0e6655c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:28.622099 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a20056b1-6b36-4749-b4fb-95b8f0e6655c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:28.630994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-35f153c7-0e01-40e3-9056-c7d85f1cdc4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054453 Jul 26 18:41:28.635582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1029/2031] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:28 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:28.639406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-afa3236c-dc3c-44a8-a24d-c8b78b9ca27b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:28.641514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-afa3236c-dc3c-44a8-a24d-c8b78b9ca27b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:28.647418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afa3236c-dc3c-44a8-a24d-c8b78b9ca27b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:28.648171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afa3236c-dc3c-44a8-a24d-c8b78b9ca27b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:28.648914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afa3236c-dc3c-44a8-a24d-c8b78b9ca27b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:28.649342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-afa3236c-dc3c-44a8-a24d-c8b78b9ca27b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:28.652508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a20056b1-6b36-4749-b4fb-95b8f0e6655c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045168 Jul 26 18:41:28.653042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1003/2032] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:28.678416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-afa3236c-dc3c-44a8-a24d-c8b78b9ca27b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045832 Jul 26 18:41:28.678955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1030/2033] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:28 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:28.744645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a348100b-b9ce-4fdb-9da6-f28cf9cc7715 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:28.748095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a348100b-b9ce-4fdb-9da6-f28cf9cc7715 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:28.758472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a348100b-b9ce-4fdb-9da6-f28cf9cc7715 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:28.759308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a348100b-b9ce-4fdb-9da6-f28cf9cc7715 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:28.760239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a348100b-b9ce-4fdb-9da6-f28cf9cc7715 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:28.760672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a348100b-b9ce-4fdb-9da6-f28cf9cc7715 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:28.790974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a348100b-b9ce-4fdb-9da6-f28cf9cc7715 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052920 Jul 26 18:41:28.791584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1004/2034] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:28 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:29.507617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0a541cc9-531e-4d08-9d73-807984961109 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:29.510571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0a541cc9-531e-4d08-9d73-807984961109 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:29.517337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a541cc9-531e-4d08-9d73-807984961109 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:29.517778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a541cc9-531e-4d08-9d73-807984961109 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:29.518523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a541cc9-531e-4d08-9d73-807984961109 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:29.518954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a541cc9-531e-4d08-9d73-807984961109 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:29.551833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0a541cc9-531e-4d08-9d73-807984961109 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050992 Jul 26 18:41:29.552391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1031/2035] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:29 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:29.646848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b6192047-5fcd-4696-8ceb-71716822068b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:29.650638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b6192047-5fcd-4696-8ceb-71716822068b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:29.657596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b6192047-5fcd-4696-8ceb-71716822068b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:29.658043 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b6192047-5fcd-4696-8ceb-71716822068b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:29.658798 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b6192047-5fcd-4696-8ceb-71716822068b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:29.659271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b6192047-5fcd-4696-8ceb-71716822068b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:29.664677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5a349a8b-00e9-43c5-bf4d-c63f32e751f2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:29.666838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5a349a8b-00e9-43c5-bf4d-c63f32e751f2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:29.673682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a349a8b-00e9-43c5-bf4d-c63f32e751f2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:29.674127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a349a8b-00e9-43c5-bf4d-c63f32e751f2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:29.674894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a349a8b-00e9-43c5-bf4d-c63f32e751f2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:29.675366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a349a8b-00e9-43c5-bf4d-c63f32e751f2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:29.689870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b6192047-5fcd-4696-8ceb-71716822068b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049567 Jul 26 18:41:29.690439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1005/2036] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:29 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:29.694995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b9b3e410-13d9-471c-b50d-8000563cb791 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:29.697053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b9b3e410-13d9-471c-b50d-8000563cb791 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:29.703125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9b3e410-13d9-471c-b50d-8000563cb791 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:29.703491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9b3e410-13d9-471c-b50d-8000563cb791 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:29.704248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9b3e410-13d9-471c-b50d-8000563cb791 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:29.704681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9b3e410-13d9-471c-b50d-8000563cb791 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:29.705526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5a349a8b-00e9-43c5-bf4d-c63f32e751f2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044834 Jul 26 18:41:29.706096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1032/2037] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:29.733485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b9b3e410-13d9-471c-b50d-8000563cb791 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042056 Jul 26 18:41:29.734025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1006/2038] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:29 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:29.804655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-883a88c7-3bd1-45a6-b74c-c045776de54b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:29.807160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-883a88c7-3bd1-45a6-b74c-c045776de54b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:29.813289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-883a88c7-3bd1-45a6-b74c-c045776de54b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:29.813757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-883a88c7-3bd1-45a6-b74c-c045776de54b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:29.814568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-883a88c7-3bd1-45a6-b74c-c045776de54b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:29.815042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-883a88c7-3bd1-45a6-b74c-c045776de54b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:29.845007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-883a88c7-3bd1-45a6-b74c-c045776de54b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044934 Jul 26 18:41:29.845577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1033/2039] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:29 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:30.570412 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f7995410-3ba5-4cbe-ba8f-d6c8902f06d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:30.574010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f7995410-3ba5-4cbe-ba8f-d6c8902f06d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:30.584278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7995410-3ba5-4cbe-ba8f-d6c8902f06d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:30.585012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7995410-3ba5-4cbe-ba8f-d6c8902f06d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:30.586295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7995410-3ba5-4cbe-ba8f-d6c8902f06d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:30.587012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7995410-3ba5-4cbe-ba8f-d6c8902f06d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:30.616884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f7995410-3ba5-4cbe-ba8f-d6c8902f06d8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053110 Jul 26 18:41:30.617424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1007/2040] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:30 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:30.706125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-71da8bd3-8ab0-42f2-aba1-2450d6484186 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:30.709605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-71da8bd3-8ab0-42f2-aba1-2450d6484186 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:30.717677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71da8bd3-8ab0-42f2-aba1-2450d6484186 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:30.718124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71da8bd3-8ab0-42f2-aba1-2450d6484186 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:30.718378 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0508438b-8d6f-4dfa-ae4a-86816b1bb850 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:30.718897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71da8bd3-8ab0-42f2-aba1-2450d6484186 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:30.719361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71da8bd3-8ab0-42f2-aba1-2450d6484186 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:30.720565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0508438b-8d6f-4dfa-ae4a-86816b1bb850 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:30.727400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0508438b-8d6f-4dfa-ae4a-86816b1bb850 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:30.727854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0508438b-8d6f-4dfa-ae4a-86816b1bb850 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:30.728705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0508438b-8d6f-4dfa-ae4a-86816b1bb850 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:30.729132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0508438b-8d6f-4dfa-ae4a-86816b1bb850 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:30.762909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0508438b-8d6f-4dfa-ae4a-86816b1bb850 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048275 Jul 26 18:41:30.763776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1008/2041] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:30.768744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1fef3e45-6ac6-487b-8987-cac0cd2ff2ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:30.770947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1fef3e45-6ac6-487b-8987-cac0cd2ff2ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:30.778087 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1fef3e45-6ac6-487b-8987-cac0cd2ff2ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:30.778530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1fef3e45-6ac6-487b-8987-cac0cd2ff2ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:30.779335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1fef3e45-6ac6-487b-8987-cac0cd2ff2ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:30.779763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1fef3e45-6ac6-487b-8987-cac0cd2ff2ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:30.816009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1fef3e45-6ac6-487b-8987-cac0cd2ff2ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051103 Jul 26 18:41:30.816599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1009/2042] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:30 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:30.858162 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f75ec6ad-8054-4f46-ae00-3d6d22e626d9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:30.860315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f75ec6ad-8054-4f46-ae00-3d6d22e626d9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:30.867054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f75ec6ad-8054-4f46-ae00-3d6d22e626d9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:30.867506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f75ec6ad-8054-4f46-ae00-3d6d22e626d9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:30.868283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f75ec6ad-8054-4f46-ae00-3d6d22e626d9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:30.868727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f75ec6ad-8054-4f46-ae00-3d6d22e626d9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:30.901159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f75ec6ad-8054-4f46-ae00-3d6d22e626d9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Jul 26 18:41:30.901959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1010/2043] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:30 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:30.903809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-71da8bd3-8ab0-42f2-aba1-2450d6484186 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204411 Jul 26 18:41:30.908148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1034/2044] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:30 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:31.630177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-09a510ed-ff5b-4b9e-aff7-d18241976683 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:31.632476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-09a510ed-ff5b-4b9e-aff7-d18241976683 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:31.639205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09a510ed-ff5b-4b9e-aff7-d18241976683 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:31.639688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09a510ed-ff5b-4b9e-aff7-d18241976683 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:31.640453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09a510ed-ff5b-4b9e-aff7-d18241976683 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:31.640886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09a510ed-ff5b-4b9e-aff7-d18241976683 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:31.670024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-09a510ed-ff5b-4b9e-aff7-d18241976683 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Jul 26 18:41:31.670561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1011/2045] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:31 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:31.781655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d2f82ff1-9438-4fbc-ae79-b8071efa4af5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:31.784285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d2f82ff1-9438-4fbc-ae79-b8071efa4af5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:31.792333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2f82ff1-9438-4fbc-ae79-b8071efa4af5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:31.792781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2f82ff1-9438-4fbc-ae79-b8071efa4af5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:31.793536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2f82ff1-9438-4fbc-ae79-b8071efa4af5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:31.793966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2f82ff1-9438-4fbc-ae79-b8071efa4af5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:31.823452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d2f82ff1-9438-4fbc-ae79-b8071efa4af5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050609 Jul 26 18:41:31.824136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1035/2046] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:31.828882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8ce79147-2dea-4eab-a983-0a088aff0e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:31.831081 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8ce79147-2dea-4eab-a983-0a088aff0e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:31.837774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ce79147-2dea-4eab-a983-0a088aff0e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:31.838220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ce79147-2dea-4eab-a983-0a088aff0e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:31.838983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ce79147-2dea-4eab-a983-0a088aff0e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:31.839442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ce79147-2dea-4eab-a983-0a088aff0e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:31.869290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8ce79147-2dea-4eab-a983-0a088aff0e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044406 Jul 26 18:41:31.869855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1012/2047] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:31 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:31.913906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0f17cec2-f66d-4f22-b166-8f1c3f00a858 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:31.915683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1b50f465-036d-421c-93d1-ca124bac6444 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:31.916106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f17cec2-f66d-4f22-b166-8f1c3f00a858 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:31.917768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1b50f465-036d-421c-93d1-ca124bac6444 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:31.922538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f17cec2-f66d-4f22-b166-8f1c3f00a858 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:31.922988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f17cec2-f66d-4f22-b166-8f1c3f00a858 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:31.923784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f17cec2-f66d-4f22-b166-8f1c3f00a858 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:31.923998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b50f465-036d-421c-93d1-ca124bac6444 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:31.924185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f17cec2-f66d-4f22-b166-8f1c3f00a858 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:31.924442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b50f465-036d-421c-93d1-ca124bac6444 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:31.925178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b50f465-036d-421c-93d1-ca124bac6444 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:31.925604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b50f465-036d-421c-93d1-ca124bac6444 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:31.954257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0f17cec2-f66d-4f22-b166-8f1c3f00a858 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044315 Jul 26 18:41:31.955057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1036/2048] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:31 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:31.957674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1b50f465-036d-421c-93d1-ca124bac6444 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045687 Jul 26 18:41:31.958212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1013/2049] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:31 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:32.686670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f68f8802-ecfd-4e55-b4bd-a0c95759a628 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:32.689976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f68f8802-ecfd-4e55-b4bd-a0c95759a628 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:32.699614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f68f8802-ecfd-4e55-b4bd-a0c95759a628 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:32.700138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f68f8802-ecfd-4e55-b4bd-a0c95759a628 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:32.701242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f68f8802-ecfd-4e55-b4bd-a0c95759a628 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:32.701799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f68f8802-ecfd-4e55-b4bd-a0c95759a628 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:32.734859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f68f8802-ecfd-4e55-b4bd-a0c95759a628 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054739 Jul 26 18:41:32.735432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1037/2050] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:32 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:32.838843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-02c5673c-d397-4335-b7cc-5aba87b65cc0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:32.841952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-02c5673c-d397-4335-b7cc-5aba87b65cc0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:32.851818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02c5673c-d397-4335-b7cc-5aba87b65cc0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:32.852480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02c5673c-d397-4335-b7cc-5aba87b65cc0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:32.853659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02c5673c-d397-4335-b7cc-5aba87b65cc0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:32.854316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02c5673c-d397-4335-b7cc-5aba87b65cc0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:32.881421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b384331c-81d4-4eb9-9798-90b28526faf0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:32.882609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:32.883716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b384331c-81d4-4eb9-9798-90b28526faf0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:32.889195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-02c5673c-d397-4335-b7cc-5aba87b65cc0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056292 Jul 26 18:41:32.889747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1014/2051] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:32 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:32.891042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b384331c-81d4-4eb9-9798-90b28526faf0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:32.891494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b384331c-81d4-4eb9-9798-90b28526faf0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:32.892255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b384331c-81d4-4eb9-9798-90b28526faf0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:32.892680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b384331c-81d4-4eb9-9798-90b28526faf0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:32.929855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b384331c-81d4-4eb9-9798-90b28526faf0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052336 Jul 26 18:41:32.930443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1038/2052] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:32 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:32.969186 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d599c281-28dc-4133-9ad9-1839b9ba8ad3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:32.970674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8ab22c83-61de-4745-b8fe-5b4025f531a6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:32.971349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d599c281-28dc-4133-9ad9-1839b9ba8ad3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:32.972842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8ab22c83-61de-4745-b8fe-5b4025f531a6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:32.977737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d599c281-28dc-4133-9ad9-1839b9ba8ad3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:32.978290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d599c281-28dc-4133-9ad9-1839b9ba8ad3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:32.978946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ab22c83-61de-4745-b8fe-5b4025f531a6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:32.979112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d599c281-28dc-4133-9ad9-1839b9ba8ad3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:32.979465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ab22c83-61de-4745-b8fe-5b4025f531a6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:32.979577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d599c281-28dc-4133-9ad9-1839b9ba8ad3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:32.980222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ab22c83-61de-4745-b8fe-5b4025f531a6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:32.980653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ab22c83-61de-4745-b8fe-5b4025f531a6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:32.984342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:33.008315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d599c281-28dc-4133-9ad9-1839b9ba8ad3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044042 Jul 26 18:41:33.012826 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1015/2053] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:32 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:33.013255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8ab22c83-61de-4745-b8fe-5b4025f531a6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044075 Jul 26 18:41:33.013255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1039/2054] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:33.751825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d7a0d6b3-8c1f-4174-8dd5-b5540e0492e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:33.756668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d7a0d6b3-8c1f-4174-8dd5-b5540e0492e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:33.764404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7a0d6b3-8c1f-4174-8dd5-b5540e0492e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:33.764851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7a0d6b3-8c1f-4174-8dd5-b5540e0492e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:33.765617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7a0d6b3-8c1f-4174-8dd5-b5540e0492e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:33.766052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7a0d6b3-8c1f-4174-8dd5-b5540e0492e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:33.796832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d7a0d6b3-8c1f-4174-8dd5-b5540e0492e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051666 Jul 26 18:41:33.797390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1016/2055] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:33 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:33.905941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-39609ba3-9f02-4854-b2c7-aabddcee62e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:33.909278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-39609ba3-9f02-4854-b2c7-aabddcee62e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:33.918125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39609ba3-9f02-4854-b2c7-aabddcee62e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:33.918567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39609ba3-9f02-4854-b2c7-aabddcee62e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:33.919351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39609ba3-9f02-4854-b2c7-aabddcee62e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:33.919778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39609ba3-9f02-4854-b2c7-aabddcee62e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:33.944246 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7454bd4a-2d92-471d-a92a-989690c7d171 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:33.946424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7454bd4a-2d92-471d-a92a-989690c7d171 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:33.950422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-39609ba3-9f02-4854-b2c7-aabddcee62e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051216 Jul 26 18:41:33.950954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1040/2056] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:33.953394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7454bd4a-2d92-471d-a92a-989690c7d171 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:33.953850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7454bd4a-2d92-471d-a92a-989690c7d171 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:33.954623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7454bd4a-2d92-471d-a92a-989690c7d171 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:33.955057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7454bd4a-2d92-471d-a92a-989690c7d171 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:33.984085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7454bd4a-2d92-471d-a92a-989690c7d171 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Jul 26 18:41:33.984647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1017/2057] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:33 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:34.020778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-46d09d21-bccc-41f6-aa4e-c1f2d7e4847e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:34.023198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-407db393-331b-426c-8ef8-0597420b34e5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:34.023345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-46d09d21-bccc-41f6-aa4e-c1f2d7e4847e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:34.025298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-407db393-331b-426c-8ef8-0597420b34e5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:34.030246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-46d09d21-bccc-41f6-aa4e-c1f2d7e4847e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:34.030689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-46d09d21-bccc-41f6-aa4e-c1f2d7e4847e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:34.031339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-407db393-331b-426c-8ef8-0597420b34e5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:34.031610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-46d09d21-bccc-41f6-aa4e-c1f2d7e4847e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:34.031790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-407db393-331b-426c-8ef8-0597420b34e5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:34.032038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-46d09d21-bccc-41f6-aa4e-c1f2d7e4847e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:34.032552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-407db393-331b-426c-8ef8-0597420b34e5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:34.032985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-407db393-331b-426c-8ef8-0597420b34e5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:34.062274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-46d09d21-bccc-41f6-aa4e-c1f2d7e4847e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045464 Jul 26 18:41:34.062599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-407db393-331b-426c-8ef8-0597420b34e5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043461 Jul 26 18:41:34.064943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1041/2058] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:34 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:41:34.065084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1018/2059] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:34 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:34.810950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0e3696c5-c0fd-4a63-992b-dedb30b8cc9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:34.813656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0e3696c5-c0fd-4a63-992b-dedb30b8cc9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:34.821540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e3696c5-c0fd-4a63-992b-dedb30b8cc9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:34.822179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e3696c5-c0fd-4a63-992b-dedb30b8cc9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:34.822941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e3696c5-c0fd-4a63-992b-dedb30b8cc9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:34.823403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e3696c5-c0fd-4a63-992b-dedb30b8cc9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:34.852108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0e3696c5-c0fd-4a63-992b-dedb30b8cc9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046121 Jul 26 18:41:34.852864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1042/2060] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:34 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:34.964400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-56515576-ecbb-4282-885d-9e6019794084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:34.966587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-56515576-ecbb-4282-885d-9e6019794084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:34.973656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56515576-ecbb-4282-885d-9e6019794084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:34.974105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56515576-ecbb-4282-885d-9e6019794084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:34.974876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56515576-ecbb-4282-885d-9e6019794084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:34.975341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56515576-ecbb-4282-885d-9e6019794084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:34.996198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-36f4c097-076c-4de2-ae1e-2ae3d4b619b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:34.998370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-36f4c097-076c-4de2-ae1e-2ae3d4b619b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:35.005620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36f4c097-076c-4de2-ae1e-2ae3d4b619b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:35.005796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-56515576-ecbb-4282-885d-9e6019794084 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047058 Jul 26 18:41:35.006316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1019/2061] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:34 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:35.006495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36f4c097-076c-4de2-ae1e-2ae3d4b619b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:35.007450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36f4c097-076c-4de2-ae1e-2ae3d4b619b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:35.007878 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36f4c097-076c-4de2-ae1e-2ae3d4b619b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:35.042033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-36f4c097-076c-4de2-ae1e-2ae3d4b619b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050009 Jul 26 18:41:35.042586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1043/2062] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:34 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:35.074010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-439cfd56-fe76-4cbe-81ec-c602ab6b9ae2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:35.074449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b06d4d7a-1aa2-4b0a-a284-984f8c9f5438 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:35.076188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-439cfd56-fe76-4cbe-81ec-c602ab6b9ae2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:35.076558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b06d4d7a-1aa2-4b0a-a284-984f8c9f5438 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:35.082321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-439cfd56-fe76-4cbe-81ec-c602ab6b9ae2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:35.082486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b06d4d7a-1aa2-4b0a-a284-984f8c9f5438 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:35.082764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-439cfd56-fe76-4cbe-81ec-c602ab6b9ae2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:35.082896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b06d4d7a-1aa2-4b0a-a284-984f8c9f5438 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:35.083557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-439cfd56-fe76-4cbe-81ec-c602ab6b9ae2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:35.083689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b06d4d7a-1aa2-4b0a-a284-984f8c9f5438 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:35.083985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-439cfd56-fe76-4cbe-81ec-c602ab6b9ae2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:35.084104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b06d4d7a-1aa2-4b0a-a284-984f8c9f5438 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:35.112584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-439cfd56-fe76-4cbe-81ec-c602ab6b9ae2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042503 Jul 26 18:41:35.113131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1020/2063] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:35 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:35.114552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b06d4d7a-1aa2-4b0a-a284-984f8c9f5438 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Jul 26 18:41:35.115104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1044/2064] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:41:35.869143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-443ab192-dcee-46fe-a9f2-5ea8b3fab131 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:35.871731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-443ab192-dcee-46fe-a9f2-5ea8b3fab131 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:35.879731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-443ab192-dcee-46fe-a9f2-5ea8b3fab131 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:35.880286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-443ab192-dcee-46fe-a9f2-5ea8b3fab131 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:35.881225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-443ab192-dcee-46fe-a9f2-5ea8b3fab131 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:35.881795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-443ab192-dcee-46fe-a9f2-5ea8b3fab131 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:35.914273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-443ab192-dcee-46fe-a9f2-5ea8b3fab131 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052071 Jul 26 18:41:35.914805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1021/2065] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:35 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:36.021133 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b8e23fcb-ec52-4b8a-beb7-778cb6921daa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:36.024044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b8e23fcb-ec52-4b8a-beb7-778cb6921daa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:36.031870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8e23fcb-ec52-4b8a-beb7-778cb6921daa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:36.032393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8e23fcb-ec52-4b8a-beb7-778cb6921daa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:36.033543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8e23fcb-ec52-4b8a-beb7-778cb6921daa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:36.034047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8e23fcb-ec52-4b8a-beb7-778cb6921daa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:36.054552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7694e27e-93ed-4b0c-b417-57c3caf449cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:36.056739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7694e27e-93ed-4b0c-b417-57c3caf449cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:36.063716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7694e27e-93ed-4b0c-b417-57c3caf449cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:36.064166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7694e27e-93ed-4b0c-b417-57c3caf449cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:36.064947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7694e27e-93ed-4b0c-b417-57c3caf449cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:36.065389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7694e27e-93ed-4b0c-b417-57c3caf449cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:36.067917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b8e23fcb-ec52-4b8a-beb7-778cb6921daa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052473 Jul 26 18:41:36.068758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1045/2066] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:36 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:36.096427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7694e27e-93ed-4b0c-b417-57c3caf449cc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045835 Jul 26 18:41:36.096980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1022/2067] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:36 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:36.125611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1ce4ded0-9393-439e-8d72-50a3ef3c37b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:36.126709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eb1c31f7-9a63-4b78-ba9a-2da32407cd8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:36.127718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1ce4ded0-9393-439e-8d72-50a3ef3c37b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:36.128919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eb1c31f7-9a63-4b78-ba9a-2da32407cd8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:36.134034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ce4ded0-9393-439e-8d72-50a3ef3c37b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:36.134582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ce4ded0-9393-439e-8d72-50a3ef3c37b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:36.134884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb1c31f7-9a63-4b78-ba9a-2da32407cd8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:36.135372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb1c31f7-9a63-4b78-ba9a-2da32407cd8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:36.135481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ce4ded0-9393-439e-8d72-50a3ef3c37b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:36.135827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ce4ded0-9393-439e-8d72-50a3ef3c37b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:36.136133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb1c31f7-9a63-4b78-ba9a-2da32407cd8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:36.136567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb1c31f7-9a63-4b78-ba9a-2da32407cd8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:36.165076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1ce4ded0-9393-439e-8d72-50a3ef3c37b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043797 Jul 26 18:41:36.165722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1046/2068] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:36 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:36.166161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eb1c31f7-9a63-4b78-ba9a-2da32407cd8e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043431 Jul 26 18:41:36.166793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1023/2069] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:36 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:36.926770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8e77bc96-c39a-4da1-b508-d44c3c5a2409 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:36.929005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8e77bc96-c39a-4da1-b508-d44c3c5a2409 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:36.935833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e77bc96-c39a-4da1-b508-d44c3c5a2409 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:36.936274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e77bc96-c39a-4da1-b508-d44c3c5a2409 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:36.937035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e77bc96-c39a-4da1-b508-d44c3c5a2409 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:36.937467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e77bc96-c39a-4da1-b508-d44c3c5a2409 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:36.967615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8e77bc96-c39a-4da1-b508-d44c3c5a2409 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Jul 26 18:41:36.968136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1047/2070] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:36 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:37.085078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d221e439-2645-41f1-806c-0d57692236fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:37.088439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d221e439-2645-41f1-806c-0d57692236fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:37.100159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d221e439-2645-41f1-806c-0d57692236fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:37.100984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d221e439-2645-41f1-806c-0d57692236fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:37.102200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d221e439-2645-41f1-806c-0d57692236fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:37.102927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d221e439-2645-41f1-806c-0d57692236fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:37.109180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e19afe26-2c55-45df-982c-d88da28bf148 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:37.111389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e19afe26-2c55-45df-982c-d88da28bf148 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:37.118262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e19afe26-2c55-45df-982c-d88da28bf148 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:37.118823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e19afe26-2c55-45df-982c-d88da28bf148 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:37.119627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e19afe26-2c55-45df-982c-d88da28bf148 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:37.120053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e19afe26-2c55-45df-982c-d88da28bf148 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:37.133112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d221e439-2645-41f1-806c-0d57692236fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054961 Jul 26 18:41:37.133677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1024/2071] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:37.149881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e19afe26-2c55-45df-982c-d88da28bf148 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Jul 26 18:41:37.150521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1048/2072] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:37 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:37.177423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ac6de630-d9ad-44dd-b378-a376df7490fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:37.177626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0f8f9d3e-1201-4f3f-b59d-0d56d05ec2b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:37.179554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ac6de630-d9ad-44dd-b378-a376df7490fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:37.179726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0f8f9d3e-1201-4f3f-b59d-0d56d05ec2b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:37.182655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:37.185823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac6de630-d9ad-44dd-b378-a376df7490fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:37.186259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac6de630-d9ad-44dd-b378-a376df7490fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:37.186393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f8f9d3e-1201-4f3f-b59d-0d56d05ec2b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:37.186827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f8f9d3e-1201-4f3f-b59d-0d56d05ec2b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:37.187012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac6de630-d9ad-44dd-b378-a376df7490fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:37.187547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac6de630-d9ad-44dd-b378-a376df7490fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:37.187659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f8f9d3e-1201-4f3f-b59d-0d56d05ec2b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:37.188098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f8f9d3e-1201-4f3f-b59d-0d56d05ec2b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:37.216722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ac6de630-d9ad-44dd-b378-a376df7490fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 Jul 26 18:41:37.217088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0f8f9d3e-1201-4f3f-b59d-0d56d05ec2b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043391 Jul 26 18:41:37.217794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1049/2073] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:37 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:41:37.217921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1025/2074] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:37 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:37.983457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7357c9c7-4f62-4ab0-8cb6-488ed72f8d57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:37.986922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7357c9c7-4f62-4ab0-8cb6-488ed72f8d57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:37.995993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7357c9c7-4f62-4ab0-8cb6-488ed72f8d57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:37.996433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7357c9c7-4f62-4ab0-8cb6-488ed72f8d57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:37.997185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7357c9c7-4f62-4ab0-8cb6-488ed72f8d57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:37.997608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7357c9c7-4f62-4ab0-8cb6-488ed72f8d57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:38.027342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7357c9c7-4f62-4ab0-8cb6-488ed72f8d57 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050600 Jul 26 18:41:38.027896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1050/2075] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:37 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:38.146578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-acb00d37-3391-46bd-bb93-d688a8543329 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:38.149304 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-acb00d37-3391-46bd-bb93-d688a8543329 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:38.157259 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-acb00d37-3391-46bd-bb93-d688a8543329 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:38.157758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-acb00d37-3391-46bd-bb93-d688a8543329 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:38.158597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-acb00d37-3391-46bd-bb93-d688a8543329 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:38.159052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-acb00d37-3391-46bd-bb93-d688a8543329 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:38.164692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-91bc6ca3-ee36-4b55-81c1-b0ed8accad29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:38.167097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-91bc6ca3-ee36-4b55-81c1-b0ed8accad29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:38.174481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91bc6ca3-ee36-4b55-81c1-b0ed8accad29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:38.174985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91bc6ca3-ee36-4b55-81c1-b0ed8accad29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:38.175895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91bc6ca3-ee36-4b55-81c1-b0ed8accad29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:38.176396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91bc6ca3-ee36-4b55-81c1-b0ed8accad29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:38.190610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-acb00d37-3391-46bd-bb93-d688a8543329 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048454 Jul 26 18:41:38.191214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1026/2076] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:38.206897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-91bc6ca3-ee36-4b55-81c1-b0ed8accad29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046580 Jul 26 18:41:38.207487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1051/2077] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:38 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:38.228159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-74aa0211-24a8-46a3-8895-a22d601b6c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:38.228572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-98df1440-3fd2-486c-ba13-cbca2fbd79d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:38.230285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-74aa0211-24a8-46a3-8895-a22d601b6c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:38.230655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-98df1440-3fd2-486c-ba13-cbca2fbd79d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:38.232461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:38.236541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-74aa0211-24a8-46a3-8895-a22d601b6c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:38.236916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-74aa0211-24a8-46a3-8895-a22d601b6c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:38.237681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-74aa0211-24a8-46a3-8895-a22d601b6c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:38.238104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-74aa0211-24a8-46a3-8895-a22d601b6c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:38.238269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98df1440-3fd2-486c-ba13-cbca2fbd79d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:38.238706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98df1440-3fd2-486c-ba13-cbca2fbd79d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:38.239555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98df1440-3fd2-486c-ba13-cbca2fbd79d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:38.239989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98df1440-3fd2-486c-ba13-cbca2fbd79d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:38.267791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-74aa0211-24a8-46a3-8895-a22d601b6c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043533 Jul 26 18:41:38.268346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1027/2078] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:38 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:41:38.270048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-98df1440-3fd2-486c-ba13-cbca2fbd79d1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045315 Jul 26 18:41:38.270605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1052/2079] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:38 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:39.044499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4a07c804-413e-484a-8d93-07c37d5f7703 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:39.047845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4a07c804-413e-484a-8d93-07c37d5f7703 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:39.058203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a07c804-413e-484a-8d93-07c37d5f7703 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:39.058929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a07c804-413e-484a-8d93-07c37d5f7703 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:39.060224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a07c804-413e-484a-8d93-07c37d5f7703 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:39.060944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a07c804-413e-484a-8d93-07c37d5f7703 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:39.095716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4a07c804-413e-484a-8d93-07c37d5f7703 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058191 Jul 26 18:41:39.096280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1028/2080] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:39 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:39.207682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-137e0e6d-cb4e-433e-808b-3f76989011d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:39.211098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-137e0e6d-cb4e-433e-808b-3f76989011d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:39.222166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-137e0e6d-cb4e-433e-808b-3f76989011d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:39.222896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-137e0e6d-cb4e-433e-808b-3f76989011d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:39.223888 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a913f146-741f-4381-9f56-45df35c6eb0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:39.224630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-137e0e6d-cb4e-433e-808b-3f76989011d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:39.224928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-137e0e6d-cb4e-433e-808b-3f76989011d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:39.227366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a913f146-741f-4381-9f56-45df35c6eb0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:39.234366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a913f146-741f-4381-9f56-45df35c6eb0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:39.234816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a913f146-741f-4381-9f56-45df35c6eb0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:39.235598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a913f146-741f-4381-9f56-45df35c6eb0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:39.236021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a913f146-741f-4381-9f56-45df35c6eb0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:39.255821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-137e0e6d-cb4e-433e-808b-3f76989011d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054977 Jul 26 18:41:39.256408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1053/2081] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 18:41:39.265514 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a913f146-741f-4381-9f56-45df35c6eb0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048185 Jul 26 18:41:39.266057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1029/2082] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:39 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:39.279874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-44485091-6771-48d0-9566-1d031d690bc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:39.281350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ad058f44-b59f-443b-9102-a8dff8c1c955 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:39.282056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-44485091-6771-48d0-9566-1d031d690bc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:39.283470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ad058f44-b59f-443b-9102-a8dff8c1c955 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:39.288179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44485091-6771-48d0-9566-1d031d690bc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:39.288627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44485091-6771-48d0-9566-1d031d690bc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:39.289394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44485091-6771-48d0-9566-1d031d690bc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:39.289497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad058f44-b59f-443b-9102-a8dff8c1c955 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:39.289828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44485091-6771-48d0-9566-1d031d690bc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:39.289936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad058f44-b59f-443b-9102-a8dff8c1c955 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:39.290759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad058f44-b59f-443b-9102-a8dff8c1c955 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:39.291371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad058f44-b59f-443b-9102-a8dff8c1c955 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:39.318456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-44485091-6771-48d0-9566-1d031d690bc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042233 Jul 26 18:41:39.318909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1054/2083] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:39 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:39.319774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ad058f44-b59f-443b-9102-a8dff8c1c955 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041997 Jul 26 18:41:39.320342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1030/2084] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:39 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:40.111853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-71618181-395b-41a1-a36b-37b18c8b377b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:40.115089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-71618181-395b-41a1-a36b-37b18c8b377b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:40.124439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71618181-395b-41a1-a36b-37b18c8b377b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:40.125013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71618181-395b-41a1-a36b-37b18c8b377b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:40.125878 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71618181-395b-41a1-a36b-37b18c8b377b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:40.126442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71618181-395b-41a1-a36b-37b18c8b377b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:40.159446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:40.164402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-71618181-395b-41a1-a36b-37b18c8b377b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058971 Jul 26 18:41:40.164956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1055/2085] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:40 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:40.272606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-791ce96d-427b-4b0f-a9ca-db76a9663a0e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:40.275986 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-791ce96d-427b-4b0f-a9ca-db76a9663a0e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:40.279441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-38a0b34a-d58a-4718-83ae-da5273dee353 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:40.281566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-38a0b34a-d58a-4718-83ae-da5273dee353 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:40.282901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-791ce96d-427b-4b0f-a9ca-db76a9663a0e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:40.283372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-791ce96d-427b-4b0f-a9ca-db76a9663a0e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:40.284152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-791ce96d-427b-4b0f-a9ca-db76a9663a0e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:40.284569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-791ce96d-427b-4b0f-a9ca-db76a9663a0e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:40.288382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-38a0b34a-d58a-4718-83ae-da5273dee353 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:40.288830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-38a0b34a-d58a-4718-83ae-da5273dee353 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:40.289772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-38a0b34a-d58a-4718-83ae-da5273dee353 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:40.290198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-38a0b34a-d58a-4718-83ae-da5273dee353 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:40.298445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:40.314977 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-791ce96d-427b-4b0f-a9ca-db76a9663a0e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049034 Jul 26 18:41:40.315702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1031/2086] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:40 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:40.320177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-38a0b34a-d58a-4718-83ae-da5273dee353 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044609 Jul 26 18:41:40.320736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1056/2087] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:40 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:40.329596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4d856e5b-4d9b-4a5c-97a7-015eba0530ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:40.331469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e5afe0f1-5223-45b2-8dc7-8c6768c013dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:40.331796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4d856e5b-4d9b-4a5c-97a7-015eba0530ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:40.333604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e5afe0f1-5223-45b2-8dc7-8c6768c013dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:40.338028 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d856e5b-4d9b-4a5c-97a7-015eba0530ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:40.338500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d856e5b-4d9b-4a5c-97a7-015eba0530ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:40.339259 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d856e5b-4d9b-4a5c-97a7-015eba0530ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:40.339681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d856e5b-4d9b-4a5c-97a7-015eba0530ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:40.339846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5afe0f1-5223-45b2-8dc7-8c6768c013dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:40.340170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5afe0f1-5223-45b2-8dc7-8c6768c013dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:40.340931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5afe0f1-5223-45b2-8dc7-8c6768c013dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:40.341365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5afe0f1-5223-45b2-8dc7-8c6768c013dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:40.368325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4d856e5b-4d9b-4a5c-97a7-015eba0530ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042353 Jul 26 18:41:40.368866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1032/2088] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:40 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:40.369592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e5afe0f1-5223-45b2-8dc7-8c6768c013dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041782 Jul 26 18:41:40.370134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1057/2089] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:40 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:41.181931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1499690a-41c4-4455-b2ab-7497ec65420e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:41.184789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1499690a-41c4-4455-b2ab-7497ec65420e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:41.192806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1499690a-41c4-4455-b2ab-7497ec65420e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:41.193368 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1499690a-41c4-4455-b2ab-7497ec65420e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:41.194328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1499690a-41c4-4455-b2ab-7497ec65420e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:41.194902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1499690a-41c4-4455-b2ab-7497ec65420e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:41.228447 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1499690a-41c4-4455-b2ab-7497ec65420e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053326 Jul 26 18:41:41.229002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1033/2090] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:41 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:41.332060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f6b0d90b-1611-49c3-badd-d313a07f21c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:41.335646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f6b0d90b-1611-49c3-badd-d313a07f21c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:41.337203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ba21917c-791b-44d1-861d-515ab3976362 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:41.341284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ba21917c-791b-44d1-861d-515ab3976362 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:41.346789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6b0d90b-1611-49c3-badd-d313a07f21c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:41.347588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6b0d90b-1611-49c3-badd-d313a07f21c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:41.348855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6b0d90b-1611-49c3-badd-d313a07f21c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:41.349660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6b0d90b-1611-49c3-badd-d313a07f21c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:41.351548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba21917c-791b-44d1-861d-515ab3976362 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:41.352528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba21917c-791b-44d1-861d-515ab3976362 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:41.353635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba21917c-791b-44d1-861d-515ab3976362 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:41.354304 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba21917c-791b-44d1-861d-515ab3976362 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:41.382656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f6b0d90b-1611-49c3-badd-d313a07f21c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057270 Jul 26 18:41:41.383274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1058/2091] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:41 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:41.384848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ba21917c-791b-44d1-861d-515ab3976362 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054971 Jul 26 18:41:41.385586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1034/2092] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:41 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:41.387969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b936935c-c97b-43db-b5c1-109a95966394 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:41.390130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b936935c-c97b-43db-b5c1-109a95966394 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:41.393749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d846c07b-1ea4-4489-aa45-b84de6590038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:41.395889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d846c07b-1ea4-4489-aa45-b84de6590038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:41.396164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b936935c-c97b-43db-b5c1-109a95966394 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:41.396603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b936935c-c97b-43db-b5c1-109a95966394 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:41.397365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b936935c-c97b-43db-b5c1-109a95966394 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:41.398120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b936935c-c97b-43db-b5c1-109a95966394 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:41.402196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d846c07b-1ea4-4489-aa45-b84de6590038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:41.402637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d846c07b-1ea4-4489-aa45-b84de6590038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:41.403400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d846c07b-1ea4-4489-aa45-b84de6590038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:41.403827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d846c07b-1ea4-4489-aa45-b84de6590038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:41.426972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b936935c-c97b-43db-b5c1-109a95966394 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042641 Jul 26 18:41:41.427794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1059/2093] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:41 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:41.431610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d846c07b-1ea4-4489-aa45-b84de6590038 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041378 Jul 26 18:41:41.432220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1035/2094] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:41 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:42.245026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aa3da7c8-4f7e-44d5-931d-9b35406ea692 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:42.248625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aa3da7c8-4f7e-44d5-931d-9b35406ea692 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:42.259371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa3da7c8-4f7e-44d5-931d-9b35406ea692 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:42.259818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa3da7c8-4f7e-44d5-931d-9b35406ea692 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:42.260590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa3da7c8-4f7e-44d5-931d-9b35406ea692 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:42.261029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa3da7c8-4f7e-44d5-931d-9b35406ea692 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:42.291954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aa3da7c8-4f7e-44d5-931d-9b35406ea692 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053623 Jul 26 18:41:42.292507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1060/2095] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:42 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:42.399314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-78866332-3925-4d77-aeb5-747cbc38e3a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:42.400339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e1012a6e-a9ec-4bfd-9b0e-9b10180b6ec0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:42.401511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-78866332-3925-4d77-aeb5-747cbc38e3a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:42.403777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e1012a6e-a9ec-4bfd-9b0e-9b10180b6ec0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:42.409236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78866332-3925-4d77-aeb5-747cbc38e3a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:42.409688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78866332-3925-4d77-aeb5-747cbc38e3a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:42.410449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78866332-3925-4d77-aeb5-747cbc38e3a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:42.410750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1012a6e-a9ec-4bfd-9b0e-9b10180b6ec0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:42.410916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78866332-3925-4d77-aeb5-747cbc38e3a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:42.411232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1012a6e-a9ec-4bfd-9b0e-9b10180b6ec0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:42.411990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1012a6e-a9ec-4bfd-9b0e-9b10180b6ec0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:42.412417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1012a6e-a9ec-4bfd-9b0e-9b10180b6ec0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:42.440931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-78866332-3925-4d77-aeb5-747cbc38e3a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048215 Jul 26 18:41:42.441599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1036/2096] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:42.443467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e1012a6e-a9ec-4bfd-9b0e-9b10180b6ec0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049093 Jul 26 18:41:42.447970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1061/2097] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:42 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:42.448127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b44caa24-872c-41a3-b82d-69c668908a90 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:42.448529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b44caa24-872c-41a3-b82d-69c668908a90 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:42.451421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ba2fad4d-cd60-4e56-9331-4086576eca58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:42.453530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ba2fad4d-cd60-4e56-9331-4086576eca58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:42.454749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b44caa24-872c-41a3-b82d-69c668908a90 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:42.455235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b44caa24-872c-41a3-b82d-69c668908a90 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:42.456000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b44caa24-872c-41a3-b82d-69c668908a90 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:42.456436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b44caa24-872c-41a3-b82d-69c668908a90 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:42.459939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba2fad4d-cd60-4e56-9331-4086576eca58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:42.460377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba2fad4d-cd60-4e56-9331-4086576eca58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:42.461114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba2fad4d-cd60-4e56-9331-4086576eca58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:42.461541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba2fad4d-cd60-4e56-9331-4086576eca58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:42.488871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b44caa24-872c-41a3-b82d-69c668908a90 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046240 Jul 26 18:41:42.489433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1037/2098] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:42 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:42.489762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ba2fad4d-cd60-4e56-9331-4086576eca58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 Jul 26 18:41:42.490631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1062/2099] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:42 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:43.308073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-83b63e87-f9af-4adc-82d3-71cebd4efb71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:43.310181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-83b63e87-f9af-4adc-82d3-71cebd4efb71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:43.316758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83b63e87-f9af-4adc-82d3-71cebd4efb71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:43.317195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83b63e87-f9af-4adc-82d3-71cebd4efb71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:43.318012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83b63e87-f9af-4adc-82d3-71cebd4efb71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:43.318439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83b63e87-f9af-4adc-82d3-71cebd4efb71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:43.350481 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-83b63e87-f9af-4adc-82d3-71cebd4efb71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048521 Jul 26 18:41:43.351050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1038/2100] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:43 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:43.457531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aed2236b-a347-43a7-82a0-c4e820b0f886 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:43.458659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cdb9123c-87a9-464e-9875-5086d9686a71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:43.461000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aed2236b-a347-43a7-82a0-c4e820b0f886 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:43.462258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cdb9123c-87a9-464e-9875-5086d9686a71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:43.468415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aed2236b-a347-43a7-82a0-c4e820b0f886 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:43.468862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aed2236b-a347-43a7-82a0-c4e820b0f886 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:43.469113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cdb9123c-87a9-464e-9875-5086d9686a71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:43.469545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cdb9123c-87a9-464e-9875-5086d9686a71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:43.469703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aed2236b-a347-43a7-82a0-c4e820b0f886 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:43.470037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aed2236b-a347-43a7-82a0-c4e820b0f886 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:43.470299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cdb9123c-87a9-464e-9875-5086d9686a71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:43.470738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cdb9123c-87a9-464e-9875-5086d9686a71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:43.499536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aed2236b-a347-43a7-82a0-c4e820b0f886 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048599 Jul 26 18:41:43.500088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1063/2101] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:43.501956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cdb9123c-87a9-464e-9875-5086d9686a71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049633 Jul 26 18:41:43.506364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1039/2102] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:43 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:43.506516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d67dc066-7dd2-4995-b9bd-9078077cae86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:43.506783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d67dc066-7dd2-4995-b9bd-9078077cae86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:43.510376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f7a7b371-025e-4350-b40a-9e0f2793b248 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:43.512507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f7a7b371-025e-4350-b40a-9e0f2793b248 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:43.512652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d67dc066-7dd2-4995-b9bd-9078077cae86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:43.513088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d67dc066-7dd2-4995-b9bd-9078077cae86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:43.513839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d67dc066-7dd2-4995-b9bd-9078077cae86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:43.514262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d67dc066-7dd2-4995-b9bd-9078077cae86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:43.518689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7a7b371-025e-4350-b40a-9e0f2793b248 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:43.519185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7a7b371-025e-4350-b40a-9e0f2793b248 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:43.519946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7a7b371-025e-4350-b40a-9e0f2793b248 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:43.520379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7a7b371-025e-4350-b40a-9e0f2793b248 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:43.543618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d67dc066-7dd2-4995-b9bd-9078077cae86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042527 Jul 26 18:41:43.544370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1064/2103] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:43.549089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f7a7b371-025e-4350-b40a-9e0f2793b248 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045549 Jul 26 18:41:43.549629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1040/2104] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:43 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:44.367199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3d6c4bfd-e2de-47ae-8b93-cc963de1b6c9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:44.371103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3d6c4bfd-e2de-47ae-8b93-cc963de1b6c9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:44.381008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d6c4bfd-e2de-47ae-8b93-cc963de1b6c9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:44.381758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d6c4bfd-e2de-47ae-8b93-cc963de1b6c9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:44.383049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d6c4bfd-e2de-47ae-8b93-cc963de1b6c9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:44.383894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d6c4bfd-e2de-47ae-8b93-cc963de1b6c9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:44.413868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3d6c4bfd-e2de-47ae-8b93-cc963de1b6c9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053388 Jul 26 18:41:44.414421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1065/2105] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:44 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:44.516176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0cc64864-e192-4f5b-b968-04e6d75a85b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:44.517858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f262ca2d-0ade-41be-bba6-a8efac3aa2d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:44.520031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0cc64864-e192-4f5b-b968-04e6d75a85b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:44.521285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f262ca2d-0ade-41be-bba6-a8efac3aa2d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:44.532333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cc64864-e192-4f5b-b968-04e6d75a85b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:44.532876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f262ca2d-0ade-41be-bba6-a8efac3aa2d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:44.533132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cc64864-e192-4f5b-b968-04e6d75a85b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:44.533641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f262ca2d-0ade-41be-bba6-a8efac3aa2d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:44.534225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cc64864-e192-4f5b-b968-04e6d75a85b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:44.534952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0cc64864-e192-4f5b-b968-04e6d75a85b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:44.535232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f262ca2d-0ade-41be-bba6-a8efac3aa2d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:44.535919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f262ca2d-0ade-41be-bba6-a8efac3aa2d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:44.569090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f262ca2d-0ade-41be-bba6-a8efac3aa2d7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057673 Jul 26 18:41:44.569661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1066/2106] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:44 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:44.570231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0cc64864-e192-4f5b-b968-04e6d75a85b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060843 Jul 26 18:41:44.574319 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1041/2107] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:44 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:44.574487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7246c2a4-3967-4d7c-9f76-091ebdf04822 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:44.575626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a14f6efc-1f0b-41b7-9bda-5eb6c1c3e453 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:44.576371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7246c2a4-3967-4d7c-9f76-091ebdf04822 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:44.577728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a14f6efc-1f0b-41b7-9bda-5eb6c1c3e453 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:44.582522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7246c2a4-3967-4d7c-9f76-091ebdf04822 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:44.582967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7246c2a4-3967-4d7c-9f76-091ebdf04822 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:44.583764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7246c2a4-3967-4d7c-9f76-091ebdf04822 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:44.583980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a14f6efc-1f0b-41b7-9bda-5eb6c1c3e453 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:44.584172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7246c2a4-3967-4d7c-9f76-091ebdf04822 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:44.584430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a14f6efc-1f0b-41b7-9bda-5eb6c1c3e453 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:44.585201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a14f6efc-1f0b-41b7-9bda-5eb6c1c3e453 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:44.585635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a14f6efc-1f0b-41b7-9bda-5eb6c1c3e453 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:44.613419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7246c2a4-3967-4d7c-9f76-091ebdf04822 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042728 Jul 26 18:41:44.613946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1067/2108] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:44 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:44.614348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a14f6efc-1f0b-41b7-9bda-5eb6c1c3e453 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042263 Jul 26 18:41:44.614902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1042/2109] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:44 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:45.430630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-971db1b7-ddc2-4673-9084-e8b6559a6d53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:45.433553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-971db1b7-ddc2-4673-9084-e8b6559a6d53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:45.441434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-971db1b7-ddc2-4673-9084-e8b6559a6d53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:45.441979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-971db1b7-ddc2-4673-9084-e8b6559a6d53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:45.442915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-971db1b7-ddc2-4673-9084-e8b6559a6d53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:45.443506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-971db1b7-ddc2-4673-9084-e8b6559a6d53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:45.477866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-971db1b7-ddc2-4673-9084-e8b6559a6d53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053778 Jul 26 18:41:45.478428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1068/2110] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:45 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:45.587225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-540fa8ba-028c-4e27-9a5f-147c2cba77e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:45.588350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6f70fdea-b113-49de-9ba0-cb8edceee390 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:45.589545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-540fa8ba-028c-4e27-9a5f-147c2cba77e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:45.590516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6f70fdea-b113-49de-9ba0-cb8edceee390 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:45.596106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-540fa8ba-028c-4e27-9a5f-147c2cba77e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:45.596555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-540fa8ba-028c-4e27-9a5f-147c2cba77e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:45.596769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f70fdea-b113-49de-9ba0-cb8edceee390 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:45.597213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f70fdea-b113-49de-9ba0-cb8edceee390 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:45.597333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-540fa8ba-028c-4e27-9a5f-147c2cba77e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:45.597734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-540fa8ba-028c-4e27-9a5f-147c2cba77e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:45.597970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f70fdea-b113-49de-9ba0-cb8edceee390 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:45.598432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f70fdea-b113-49de-9ba0-cb8edceee390 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:45.627201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-540fa8ba-028c-4e27-9a5f-147c2cba77e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046863 Jul 26 18:41:45.627783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1043/2111] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:45 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:45.628395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6f70fdea-b113-49de-9ba0-cb8edceee390 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046552 Jul 26 18:41:45.633253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1069/2112] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:45.633426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-36fb6fb2-c101-4ff2-92e7-0ece1ec7c203 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:45.634336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-36fb6fb2-c101-4ff2-92e7-0ece1ec7c203 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:45.636593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d0b0ff9a-37c6-4ed9-b40c-155028c1dfe5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:45.638692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d0b0ff9a-37c6-4ed9-b40c-155028c1dfe5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:45.640329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-36fb6fb2-c101-4ff2-92e7-0ece1ec7c203 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:45.640769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-36fb6fb2-c101-4ff2-92e7-0ece1ec7c203 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:45.641521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-36fb6fb2-c101-4ff2-92e7-0ece1ec7c203 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:45.641939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-36fb6fb2-c101-4ff2-92e7-0ece1ec7c203 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:45.645219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0b0ff9a-37c6-4ed9-b40c-155028c1dfe5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:45.645658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0b0ff9a-37c6-4ed9-b40c-155028c1dfe5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:45.646405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0b0ff9a-37c6-4ed9-b40c-155028c1dfe5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:45.646831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0b0ff9a-37c6-4ed9-b40c-155028c1dfe5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:45.672379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-36fb6fb2-c101-4ff2-92e7-0ece1ec7c203 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Jul 26 18:41:45.672919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1044/2113] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:45 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:45.678986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d0b0ff9a-37c6-4ed9-b40c-155028c1dfe5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048962 Jul 26 18:41:45.679575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1070/2114] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:45 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:46.494089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-434a96da-670f-4c6b-94ef-9723a14f3986 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:46.497519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-434a96da-670f-4c6b-94ef-9723a14f3986 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:46.507867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-434a96da-670f-4c6b-94ef-9723a14f3986 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:46.508602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-434a96da-670f-4c6b-94ef-9723a14f3986 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:46.509679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-434a96da-670f-4c6b-94ef-9723a14f3986 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:46.510104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-434a96da-670f-4c6b-94ef-9723a14f3986 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:46.540228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-434a96da-670f-4c6b-94ef-9723a14f3986 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052767 Jul 26 18:41:46.541064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1045/2115] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:46 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:46.639942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f9dddd39-70b6-4088-929a-8c607a010a59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:46.640792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-333dc471-d24c-43cf-97a3-0767169c9d83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:46.642107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f9dddd39-70b6-4088-929a-8c607a010a59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:46.642964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-333dc471-d24c-43cf-97a3-0767169c9d83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:46.649392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9dddd39-70b6-4088-929a-8c607a010a59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:46.649844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9dddd39-70b6-4088-929a-8c607a010a59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:46.650055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-333dc471-d24c-43cf-97a3-0767169c9d83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:46.650530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-333dc471-d24c-43cf-97a3-0767169c9d83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:46.650684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9dddd39-70b6-4088-929a-8c607a010a59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:46.651046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9dddd39-70b6-4088-929a-8c607a010a59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:46.651318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-333dc471-d24c-43cf-97a3-0767169c9d83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:46.651747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-333dc471-d24c-43cf-97a3-0767169c9d83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:46.681157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-333dc471-d24c-43cf-97a3-0767169c9d83 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044270 Jul 26 18:41:46.681370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f9dddd39-70b6-4088-929a-8c607a010a59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045159 Jul 26 18:41:46.681770 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1046/2117] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:46.681965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1071/2117] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:46 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:46.686293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0dcefe14-73a1-4eac-b6cd-8584d50d1bce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:46.688932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0dcefe14-73a1-4eac-b6cd-8584d50d1bce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:46.691492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-02e4c6a7-6113-467d-bc82-cfa12d51a899 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:46.693673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-02e4c6a7-6113-467d-bc82-cfa12d51a899 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:46.694809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0dcefe14-73a1-4eac-b6cd-8584d50d1bce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:46.695291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0dcefe14-73a1-4eac-b6cd-8584d50d1bce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:46.696050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0dcefe14-73a1-4eac-b6cd-8584d50d1bce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:46.696480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0dcefe14-73a1-4eac-b6cd-8584d50d1bce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:46.699727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02e4c6a7-6113-467d-bc82-cfa12d51a899 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:46.700174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02e4c6a7-6113-467d-bc82-cfa12d51a899 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:46.700931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02e4c6a7-6113-467d-bc82-cfa12d51a899 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:46.701365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02e4c6a7-6113-467d-bc82-cfa12d51a899 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:46.713128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:46.726347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0dcefe14-73a1-4eac-b6cd-8584d50d1bce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043595 Jul 26 18:41:46.726902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1072/2118] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:46 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:46.729795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-02e4c6a7-6113-467d-bc82-cfa12d51a899 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042250 Jul 26 18:41:46.730360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1047/2119] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:46 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:47.556976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d4996f86-790d-4169-8848-5afb04d6c8b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:47.560452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d4996f86-790d-4169-8848-5afb04d6c8b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:47.570733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4996f86-790d-4169-8848-5afb04d6c8b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:47.571531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4996f86-790d-4169-8848-5afb04d6c8b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:47.572477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4996f86-790d-4169-8848-5afb04d6c8b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:47.572910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4996f86-790d-4169-8848-5afb04d6c8b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:47.603135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d4996f86-790d-4169-8848-5afb04d6c8b8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052698 Jul 26 18:41:47.603890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1073/2120] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:47 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:47.697693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-187cf0bb-758a-4872-bfd1-81ed228e3e61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:47.701170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-187cf0bb-758a-4872-bfd1-81ed228e3e61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:47.701450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-96a68d46-8e9c-48b8-8daa-81c61e9577be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:47.704813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-96a68d46-8e9c-48b8-8daa-81c61e9577be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:47.712364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-187cf0bb-758a-4872-bfd1-81ed228e3e61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:47.712799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-187cf0bb-758a-4872-bfd1-81ed228e3e61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:47.713558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-187cf0bb-758a-4872-bfd1-81ed228e3e61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:47.713983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-187cf0bb-758a-4872-bfd1-81ed228e3e61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:47.714401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96a68d46-8e9c-48b8-8daa-81c61e9577be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:47.714840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96a68d46-8e9c-48b8-8daa-81c61e9577be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:47.715622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96a68d46-8e9c-48b8-8daa-81c61e9577be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:47.716144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96a68d46-8e9c-48b8-8daa-81c61e9577be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:47.716390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:47.746460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-96a68d46-8e9c-48b8-8daa-81c61e9577be tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051575 Jul 26 18:41:47.747341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1074/2121] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:47 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:47.751429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-187cf0bb-758a-4872-bfd1-81ed228e3e61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060345 Jul 26 18:41:47.751917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3472f110-2b08-4a63-953b-fb224fac7ed4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:47.752081 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1048/2122] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:47 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:47.754081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3472f110-2b08-4a63-953b-fb224fac7ed4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:47.756786 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-89ef19b4-5f09-4579-ab5b-beeb5c3eeb39 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:47.758889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-89ef19b4-5f09-4579-ab5b-beeb5c3eeb39 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:47.760218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3472f110-2b08-4a63-953b-fb224fac7ed4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:47.760666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3472f110-2b08-4a63-953b-fb224fac7ed4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:47.761428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3472f110-2b08-4a63-953b-fb224fac7ed4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:47.761856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3472f110-2b08-4a63-953b-fb224fac7ed4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:47.765315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-89ef19b4-5f09-4579-ab5b-beeb5c3eeb39 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:47.765766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-89ef19b4-5f09-4579-ab5b-beeb5c3eeb39 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:47.766520 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-89ef19b4-5f09-4579-ab5b-beeb5c3eeb39 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:47.766951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-89ef19b4-5f09-4579-ab5b-beeb5c3eeb39 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:47.791198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3472f110-2b08-4a63-953b-fb224fac7ed4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042793 Jul 26 18:41:47.791981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1075/2123] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:47 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:47.799529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-89ef19b4-5f09-4579-ab5b-beeb5c3eeb39 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046323 Jul 26 18:41:47.800071 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1049/2124] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:47 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:48.620063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-32c9cabf-2959-4e66-af1e-59179367c219 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:48.622840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-32c9cabf-2959-4e66-af1e-59179367c219 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:48.632198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32c9cabf-2959-4e66-af1e-59179367c219 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:48.632869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32c9cabf-2959-4e66-af1e-59179367c219 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:48.633713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32c9cabf-2959-4e66-af1e-59179367c219 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:48.634185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32c9cabf-2959-4e66-af1e-59179367c219 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:48.668235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-32c9cabf-2959-4e66-af1e-59179367c219 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054405 Jul 26 18:41:48.668808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1076/2125] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:48 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:48.762104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6954847a-f6d8-490c-b937-5af33290e7d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:48.764071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-df45bd4e-9973-4368-9e50-9f5520b9b301 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:48.764522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6954847a-f6d8-490c-b937-5af33290e7d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:48.766194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-df45bd4e-9973-4368-9e50-9f5520b9b301 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:48.771269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6954847a-f6d8-490c-b937-5af33290e7d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:48.771710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6954847a-f6d8-490c-b937-5af33290e7d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:48.772467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6954847a-f6d8-490c-b937-5af33290e7d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:48.773228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6954847a-f6d8-490c-b937-5af33290e7d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:48.773371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df45bd4e-9973-4368-9e50-9f5520b9b301 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:48.773779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df45bd4e-9973-4368-9e50-9f5520b9b301 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:48.774562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df45bd4e-9973-4368-9e50-9f5520b9b301 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:48.774998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df45bd4e-9973-4368-9e50-9f5520b9b301 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:48.803583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6954847a-f6d8-490c-b937-5af33290e7d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046794 Jul 26 18:41:48.804145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1050/2126] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:48 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:48.804864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-df45bd4e-9973-4368-9e50-9f5520b9b301 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044681 Jul 26 18:41:48.806724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1077/2127] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:48.810591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-37ef6100-8069-4897-b429-61fb8054dec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:48.812802 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-37ef6100-8069-4897-b429-61fb8054dec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:48.812948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-92d0498e-bc9c-47dc-80dd-4973147b1c35 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:48.815038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-92d0498e-bc9c-47dc-80dd-4973147b1c35 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:48.819250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-37ef6100-8069-4897-b429-61fb8054dec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:48.819844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-37ef6100-8069-4897-b429-61fb8054dec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:48.820596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-37ef6100-8069-4897-b429-61fb8054dec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:48.821020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-37ef6100-8069-4897-b429-61fb8054dec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:48.821468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92d0498e-bc9c-47dc-80dd-4973147b1c35 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:48.821970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92d0498e-bc9c-47dc-80dd-4973147b1c35 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:48.822846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92d0498e-bc9c-47dc-80dd-4973147b1c35 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:48.823199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92d0498e-bc9c-47dc-80dd-4973147b1c35 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:48.851595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-37ef6100-8069-4897-b429-61fb8054dec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046384 Jul 26 18:41:48.851866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-92d0498e-bc9c-47dc-80dd-4973147b1c35 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 Jul 26 18:41:48.852155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1051/2128] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:48 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:48.852267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1078/2129] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:48 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:49.687575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1d10ed8f-cc5d-4f5f-82ba-9fe1f13a52a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:49.691279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1d10ed8f-cc5d-4f5f-82ba-9fe1f13a52a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:49.700007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d10ed8f-cc5d-4f5f-82ba-9fe1f13a52a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:49.700452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d10ed8f-cc5d-4f5f-82ba-9fe1f13a52a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:49.701233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d10ed8f-cc5d-4f5f-82ba-9fe1f13a52a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:49.701671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d10ed8f-cc5d-4f5f-82ba-9fe1f13a52a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:49.732719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1d10ed8f-cc5d-4f5f-82ba-9fe1f13a52a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051867 Jul 26 18:41:49.733278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1052/2130] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:49 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:49.816590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6c91252e-758b-4923-a6a6-20facd41016b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:49.818324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-272e4fe8-5257-4f0b-9fae-309f0552f888 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:49.819115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6c91252e-758b-4923-a6a6-20facd41016b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:49.820626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-272e4fe8-5257-4f0b-9fae-309f0552f888 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:49.826097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c91252e-758b-4923-a6a6-20facd41016b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:49.826564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c91252e-758b-4923-a6a6-20facd41016b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:49.827406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c91252e-758b-4923-a6a6-20facd41016b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:49.827552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-272e4fe8-5257-4f0b-9fae-309f0552f888 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:49.827834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c91252e-758b-4923-a6a6-20facd41016b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:49.828004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-272e4fe8-5257-4f0b-9fae-309f0552f888 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:49.828589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-272e4fe8-5257-4f0b-9fae-309f0552f888 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:49.829017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-272e4fe8-5257-4f0b-9fae-309f0552f888 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:49.858011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-272e4fe8-5257-4f0b-9fae-309f0552f888 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044553 Jul 26 18:41:49.858276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6c91252e-758b-4923-a6a6-20facd41016b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Jul 26 18:41:49.859388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1053/2131] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:49 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:49.859544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1079/2132] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:49 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:49.864850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-94d7fd58-d5ad-4128-b4df-9f0a82f28ca1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:49.866242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-24ecd226-5a29-4cd1-86df-15c6ff7e1950 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:49.866957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-94d7fd58-d5ad-4128-b4df-9f0a82f28ca1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:49.868483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-24ecd226-5a29-4cd1-86df-15c6ff7e1950 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:49.873341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94d7fd58-d5ad-4128-b4df-9f0a82f28ca1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:49.873781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94d7fd58-d5ad-4128-b4df-9f0a82f28ca1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:49.874534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94d7fd58-d5ad-4128-b4df-9f0a82f28ca1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:49.874651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24ecd226-5a29-4cd1-86df-15c6ff7e1950 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:49.874959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94d7fd58-d5ad-4128-b4df-9f0a82f28ca1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:49.875162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24ecd226-5a29-4cd1-86df-15c6ff7e1950 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:49.875920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24ecd226-5a29-4cd1-86df-15c6ff7e1950 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:49.876352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24ecd226-5a29-4cd1-86df-15c6ff7e1950 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:49.904107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-94d7fd58-d5ad-4128-b4df-9f0a82f28ca1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042922 Jul 26 18:41:49.904658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1054/2133] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:49 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:49.904929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-24ecd226-5a29-4cd1-86df-15c6ff7e1950 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043430 Jul 26 18:41:49.905446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1080/2134] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:49 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:50.748256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e47d3360-5737-4bad-9dbd-38288e61feb8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:50.750404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e47d3360-5737-4bad-9dbd-38288e61feb8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:50.756805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e47d3360-5737-4bad-9dbd-38288e61feb8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:50.757269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e47d3360-5737-4bad-9dbd-38288e61feb8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:50.758021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e47d3360-5737-4bad-9dbd-38288e61feb8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:50.758449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e47d3360-5737-4bad-9dbd-38288e61feb8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:50.788284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e47d3360-5737-4bad-9dbd-38288e61feb8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Jul 26 18:41:50.789108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1055/2135] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:50 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:50.873584 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1a169a6c-60b3-4fa1-ad5e-a5b647402758 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:50.874254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c5544923-ed79-4a72-b7e8-2e0649117404 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:50.876670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1a169a6c-60b3-4fa1-ad5e-a5b647402758 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:50.876909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c5544923-ed79-4a72-b7e8-2e0649117404 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:50.885658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5544923-ed79-4a72-b7e8-2e0649117404 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:50.885896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a169a6c-60b3-4fa1-ad5e-a5b647402758 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:50.886224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a169a6c-60b3-4fa1-ad5e-a5b647402758 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:50.886399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5544923-ed79-4a72-b7e8-2e0649117404 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:50.887303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5544923-ed79-4a72-b7e8-2e0649117404 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:50.887494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a169a6c-60b3-4fa1-ad5e-a5b647402758 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:50.887877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a169a6c-60b3-4fa1-ad5e-a5b647402758 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:50.888061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5544923-ed79-4a72-b7e8-2e0649117404 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:50.920558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1a169a6c-60b3-4fa1-ad5e-a5b647402758 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052739 Jul 26 18:41:50.921283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1081/2136] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:50 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:50.921842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c5544923-ed79-4a72-b7e8-2e0649117404 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053360 Jul 26 18:41:50.926331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1056/2137] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:50 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:50.926486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2dd216f3-ecb3-493b-a4ae-7983b8c2f910 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:50.927163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9bb01595-fad6-4139-ab54-d9e4103e5fe6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:50.927722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2dd216f3-ecb3-493b-a4ae-7983b8c2f910 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:50.929251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9bb01595-fad6-4139-ab54-d9e4103e5fe6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:50.933830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2dd216f3-ecb3-493b-a4ae-7983b8c2f910 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:50.934265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2dd216f3-ecb3-493b-a4ae-7983b8c2f910 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:50.935056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2dd216f3-ecb3-493b-a4ae-7983b8c2f910 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:50.935461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9bb01595-fad6-4139-ab54-d9e4103e5fe6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:50.935577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2dd216f3-ecb3-493b-a4ae-7983b8c2f910 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:50.935911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9bb01595-fad6-4139-ab54-d9e4103e5fe6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:50.936670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9bb01595-fad6-4139-ab54-d9e4103e5fe6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:50.937107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9bb01595-fad6-4139-ab54-d9e4103e5fe6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:50.964152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2dd216f3-ecb3-493b-a4ae-7983b8c2f910 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042030 Jul 26 18:41:50.964939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1082/2138] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:50 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:50.966398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9bb01595-fad6-4139-ab54-d9e4103e5fe6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042937 Jul 26 18:41:50.967102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1057/2139] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:50 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:51.802846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fbdd3bef-fe4f-4c67-9e93-251323473155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:51.805915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fbdd3bef-fe4f-4c67-9e93-251323473155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:51.812271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fbdd3bef-fe4f-4c67-9e93-251323473155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:51.812722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fbdd3bef-fe4f-4c67-9e93-251323473155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:51.813484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fbdd3bef-fe4f-4c67-9e93-251323473155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:51.813921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fbdd3bef-fe4f-4c67-9e93-251323473155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:51.843699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fbdd3bef-fe4f-4c67-9e93-251323473155 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045700 Jul 26 18:41:51.844250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1083/2140] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:51 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:51.934198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c168bd4f-0a2d-487a-bb95-878455fdb4da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:51.938034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c168bd4f-0a2d-487a-bb95-878455fdb4da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:51.938171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7585e4b5-c7c9-4d0b-a2cb-617fa401f933 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:51.940972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7585e4b5-c7c9-4d0b-a2cb-617fa401f933 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:51.946401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c168bd4f-0a2d-487a-bb95-878455fdb4da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:51.948330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c168bd4f-0a2d-487a-bb95-878455fdb4da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:51.949176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7585e4b5-c7c9-4d0b-a2cb-617fa401f933 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:51.949340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c168bd4f-0a2d-487a-bb95-878455fdb4da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:51.949623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7585e4b5-c7c9-4d0b-a2cb-617fa401f933 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:51.949772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c168bd4f-0a2d-487a-bb95-878455fdb4da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:51.950491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7585e4b5-c7c9-4d0b-a2cb-617fa401f933 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:51.950817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7585e4b5-c7c9-4d0b-a2cb-617fa401f933 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:51.981278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c168bd4f-0a2d-487a-bb95-878455fdb4da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051598 Jul 26 18:41:51.981860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7585e4b5-c7c9-4d0b-a2cb-617fa401f933 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049566 Jul 26 18:41:51.982166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1058/2141] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:51.982553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1084/2142] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:51 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:51.987087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bcabc330-01df-45bb-9c42-142f2298d587 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:51.989390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bcabc330-01df-45bb-9c42-142f2298d587 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:51.990662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3234380e-c3f1-4f79-9e30-5fe5a4d8adf5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:51.992845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3234380e-c3f1-4f79-9e30-5fe5a4d8adf5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:51.995587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bcabc330-01df-45bb-9c42-142f2298d587 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:51.996037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bcabc330-01df-45bb-9c42-142f2298d587 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:51.996807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bcabc330-01df-45bb-9c42-142f2298d587 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:51.997246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bcabc330-01df-45bb-9c42-142f2298d587 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:51.999198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3234380e-c3f1-4f79-9e30-5fe5a4d8adf5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:51.999644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3234380e-c3f1-4f79-9e30-5fe5a4d8adf5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:52.000398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3234380e-c3f1-4f79-9e30-5fe5a4d8adf5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:52.000834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3234380e-c3f1-4f79-9e30-5fe5a4d8adf5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:52.026072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bcabc330-01df-45bb-9c42-142f2298d587 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042541 Jul 26 18:41:52.026536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1085/2143] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:51 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:52.030007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3234380e-c3f1-4f79-9e30-5fe5a4d8adf5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043055 Jul 26 18:41:52.030558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1059/2144] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:52.857257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9b4e4fc8-78f1-49d6-822b-b51cf99e10d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:52.859443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9b4e4fc8-78f1-49d6-822b-b51cf99e10d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:52.866011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9b4e4fc8-78f1-49d6-822b-b51cf99e10d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:52.866456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9b4e4fc8-78f1-49d6-822b-b51cf99e10d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:52.867276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9b4e4fc8-78f1-49d6-822b-b51cf99e10d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:52.867708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9b4e4fc8-78f1-49d6-822b-b51cf99e10d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:52.896914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9b4e4fc8-78f1-49d6-822b-b51cf99e10d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043899 Jul 26 18:41:52.897461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1086/2145] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:52 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:52.996162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c6281c18-187d-464c-85f7-7060d5fbd31b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:52.996824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7064322d-412b-4f19-a571-19a93e291094 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:52.998340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c6281c18-187d-464c-85f7-7060d5fbd31b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:52.998629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7064322d-412b-4f19-a571-19a93e291094 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:53.005328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6281c18-187d-464c-85f7-7060d5fbd31b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:53.005484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7064322d-412b-4f19-a571-19a93e291094 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:53.005679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6281c18-187d-464c-85f7-7060d5fbd31b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:53.005809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7064322d-412b-4f19-a571-19a93e291094 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:53.006463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6281c18-187d-464c-85f7-7060d5fbd31b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:53.006610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7064322d-412b-4f19-a571-19a93e291094 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:53.006894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6281c18-187d-464c-85f7-7060d5fbd31b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:53.007085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7064322d-412b-4f19-a571-19a93e291094 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:53.036972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7064322d-412b-4f19-a571-19a93e291094 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045520 Jul 26 18:41:53.037549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1060/2146] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Jul 26 18:41:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:41:53.038598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c6281c18-187d-464c-85f7-7060d5fbd31b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047297 Jul 26 18:41:53.039157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1087/2147] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:52 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:53.043673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c8664fd9-3250-4aa8-855b-c75f3b77aef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:53.045146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7a0bc8c3-cb14-4539-9e5b-d9f54b77bbcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:53.045786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c8664fd9-3250-4aa8-855b-c75f3b77aef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:53.047288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7a0bc8c3-cb14-4539-9e5b-d9f54b77bbcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:53.051831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8664fd9-3250-4aa8-855b-c75f3b77aef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:53.052278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8664fd9-3250-4aa8-855b-c75f3b77aef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:53.053042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8664fd9-3250-4aa8-855b-c75f3b77aef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:53.053472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8664fd9-3250-4aa8-855b-c75f3b77aef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:53.053576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a0bc8c3-cb14-4539-9e5b-d9f54b77bbcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:53.054031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a0bc8c3-cb14-4539-9e5b-d9f54b77bbcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:53.054818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a0bc8c3-cb14-4539-9e5b-d9f54b77bbcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:53.055289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a0bc8c3-cb14-4539-9e5b-d9f54b77bbcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:53.082879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c8664fd9-3250-4aa8-855b-c75f3b77aef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042674 Jul 26 18:41:53.083437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1088/2148] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:53 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:53.084451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7a0bc8c3-cb14-4539-9e5b-d9f54b77bbcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045912 Jul 26 18:41:53.085031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1061/2149] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:53 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:53.914088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0a22657d-91f4-4891-82a4-0ffff90c4b29 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:53.917514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0a22657d-91f4-4891-82a4-0ffff90c4b29 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:53.927905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a22657d-91f4-4891-82a4-0ffff90c4b29 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:53.928650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a22657d-91f4-4891-82a4-0ffff90c4b29 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:53.929902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a22657d-91f4-4891-82a4-0ffff90c4b29 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:53.930624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a22657d-91f4-4891-82a4-0ffff90c4b29 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:53.934482 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:53.959486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0a22657d-91f4-4891-82a4-0ffff90c4b29 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052223 Jul 26 18:41:53.960037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1089/2150] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:53 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:54.053478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-98ca5a40-49eb-4e00-98a8-0f9e7cb0c16b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:41:54.054387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-134157d4-436a-4567-9f1a-1fe38c322071 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:54.057239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-98ca5a40-49eb-4e00-98a8-0f9e7cb0c16b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:54.057504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-134157d4-436a-4567-9f1a-1fe38c322071 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:54.068213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98ca5a40-49eb-4e00-98a8-0f9e7cb0c16b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:54.068957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98ca5a40-49eb-4e00-98a8-0f9e7cb0c16b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:54.069499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-134157d4-436a-4567-9f1a-1fe38c322071 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:54.070218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98ca5a40-49eb-4e00-98a8-0f9e7cb0c16b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:54.070487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-134157d4-436a-4567-9f1a-1fe38c322071 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:54.070941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98ca5a40-49eb-4e00-98a8-0f9e7cb0c16b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:54.071683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-134157d4-436a-4567-9f1a-1fe38c322071 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:54.072110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-134157d4-436a-4567-9f1a-1fe38c322071 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:54.104199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-134157d4-436a-4567-9f1a-1fe38c322071 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056445 Jul 26 18:41:54.104901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1090/2151] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:54 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:54.109393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-80083fe5-ffe9-483a-9e19-4f7f3ea7f0e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:54.111527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-80083fe5-ffe9-483a-9e19-4f7f3ea7f0e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:54.117402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80083fe5-ffe9-483a-9e19-4f7f3ea7f0e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:54.117846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80083fe5-ffe9-483a-9e19-4f7f3ea7f0e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:54.118626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80083fe5-ffe9-483a-9e19-4f7f3ea7f0e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:54.119079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80083fe5-ffe9-483a-9e19-4f7f3ea7f0e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:54.147147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-80083fe5-ffe9-483a-9e19-4f7f3ea7f0e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041218 Jul 26 18:41:54.147690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1091/2152] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:54 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:54.152356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5cde9068-6ad3-4d51-a70f-a031e42b4973 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:54.154393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5cde9068-6ad3-4d51-a70f-a031e42b4973 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:54.159892 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cde9068-6ad3-4d51-a70f-a031e42b4973 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:54.160364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cde9068-6ad3-4d51-a70f-a031e42b4973 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:54.161094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cde9068-6ad3-4d51-a70f-a031e42b4973 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:54.161516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cde9068-6ad3-4d51-a70f-a031e42b4973 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:54.169950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-98ca5a40-49eb-4e00-98a8-0f9e7cb0c16b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "POST /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/action" status: 200 len: 37674 microversion: 2.20 time: 0.122701 Jul 26 18:41:54.170523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1062/2153] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Jul 26 18:41:54 2022] POST /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384/action => generated 37674 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:41:54.191119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5cde9068-6ad3-4d51-a70f-a031e42b4973 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042083 Jul 26 18:41:54.191766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1092/2154] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:54.977052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-68644107-8636-4a0e-a34c-6466da5d1330 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:54.979867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-68644107-8636-4a0e-a34c-6466da5d1330 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:54.988170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68644107-8636-4a0e-a34c-6466da5d1330 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:54.988701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68644107-8636-4a0e-a34c-6466da5d1330 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:54.989549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68644107-8636-4a0e-a34c-6466da5d1330 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:54.990035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68644107-8636-4a0e-a34c-6466da5d1330 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:55.024135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-68644107-8636-4a0e-a34c-6466da5d1330 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054132 Jul 26 18:41:55.024638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1063/2155] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:54 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:55.120151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-58b2df50-263c-492d-a593-48b203fbf1f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:55.122413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-58b2df50-263c-492d-a593-48b203fbf1f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:55.129196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-58b2df50-263c-492d-a593-48b203fbf1f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:55.129639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-58b2df50-263c-492d-a593-48b203fbf1f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:55.130400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-58b2df50-263c-492d-a593-48b203fbf1f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:55.130830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-58b2df50-263c-492d-a593-48b203fbf1f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:55.159921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aa8c4557-559a-4e4a-9315-896dac8eb4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:55.161861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-58b2df50-263c-492d-a593-48b203fbf1f9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048134 Jul 26 18:41:55.162040 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aa8c4557-559a-4e4a-9315-896dac8eb4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:55.162399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1093/2156] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:55 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:55.168954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa8c4557-559a-4e4a-9315-896dac8eb4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:55.169403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa8c4557-559a-4e4a-9315-896dac8eb4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:55.170170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa8c4557-559a-4e4a-9315-896dac8eb4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:55.170603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa8c4557-559a-4e4a-9315-896dac8eb4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:55.199708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aa8c4557-559a-4e4a-9315-896dac8eb4b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043698 Jul 26 18:41:55.200256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1064/2157] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:55.203932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-00c1e5d0-2852-4f54-ad04-5ebac2737d88 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:55.206114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-00c1e5d0-2852-4f54-ad04-5ebac2737d88 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:55.212284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00c1e5d0-2852-4f54-ad04-5ebac2737d88 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:55.212724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00c1e5d0-2852-4f54-ad04-5ebac2737d88 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:55.213478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00c1e5d0-2852-4f54-ad04-5ebac2737d88 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:55.213905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00c1e5d0-2852-4f54-ad04-5ebac2737d88 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:55.244310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-00c1e5d0-2852-4f54-ad04-5ebac2737d88 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043640 Jul 26 18:41:55.244455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1094/2158] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:55 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:41:56.040753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b79ce737-3d68-4564-acb7-172eebc8dc93 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:56.044261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b79ce737-3d68-4564-acb7-172eebc8dc93 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:56.055355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b79ce737-3d68-4564-acb7-172eebc8dc93 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:56.056107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b79ce737-3d68-4564-acb7-172eebc8dc93 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:56.056898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b79ce737-3d68-4564-acb7-172eebc8dc93 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:56.057327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b79ce737-3d68-4564-acb7-172eebc8dc93 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:56.059798 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:41:56.087467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b79ce737-3d68-4564-acb7-172eebc8dc93 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053313 Jul 26 18:41:56.088033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1065/2159] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:56 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:56.177935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7b36c215-f197-4529-9fb9-0a504a90b14d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:56.181381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7b36c215-f197-4529-9fb9-0a504a90b14d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:56.189120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b36c215-f197-4529-9fb9-0a504a90b14d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:56.189613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b36c215-f197-4529-9fb9-0a504a90b14d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:56.190440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b36c215-f197-4529-9fb9-0a504a90b14d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:56.190920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b36c215-f197-4529-9fb9-0a504a90b14d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:56.212763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6a4cf8a2-40b2-426c-8be1-d4fafe25d834 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:56.214903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6a4cf8a2-40b2-426c-8be1-d4fafe25d834 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:56.221586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a4cf8a2-40b2-426c-8be1-d4fafe25d834 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:56.222040 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a4cf8a2-40b2-426c-8be1-d4fafe25d834 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:56.222548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7b36c215-f197-4529-9fb9-0a504a90b14d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051286 Jul 26 18:41:56.222800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a4cf8a2-40b2-426c-8be1-d4fafe25d834 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:56.223214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1095/2160] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:56 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:56.223390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a4cf8a2-40b2-426c-8be1-d4fafe25d834 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:56.252727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6a4cf8a2-40b2-426c-8be1-d4fafe25d834 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044476 Jul 26 18:41:56.253254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1066/2161] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:56 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:56.255718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cf780c1c-5431-4e37-a4fc-37975abafb53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:56.257874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cf780c1c-5431-4e37-a4fc-37975abafb53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:56.264385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf780c1c-5431-4e37-a4fc-37975abafb53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:56.264857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf780c1c-5431-4e37-a4fc-37975abafb53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:56.265623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf780c1c-5431-4e37-a4fc-37975abafb53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:56.266054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf780c1c-5431-4e37-a4fc-37975abafb53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:56.295686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cf780c1c-5431-4e37-a4fc-37975abafb53 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043723 Jul 26 18:41:56.296242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1096/2162] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:56 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:41:57.104275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eb79f541-e3a5-4a2e-aefa-19d4768c7cb9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:57.107773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eb79f541-e3a5-4a2e-aefa-19d4768c7cb9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:57.118744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb79f541-e3a5-4a2e-aefa-19d4768c7cb9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:57.119537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb79f541-e3a5-4a2e-aefa-19d4768c7cb9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:57.120791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb79f541-e3a5-4a2e-aefa-19d4768c7cb9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:57.121602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb79f541-e3a5-4a2e-aefa-19d4768c7cb9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:57.157110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eb79f541-e3a5-4a2e-aefa-19d4768c7cb9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059586 Jul 26 18:41:57.157661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1067/2163] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:57 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:57.239354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ce8d85c3-b908-41da-ab65-6a16bbc52ae8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:57.242840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ce8d85c3-b908-41da-ab65-6a16bbc52ae8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:57.253776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce8d85c3-b908-41da-ab65-6a16bbc52ae8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:57.254516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce8d85c3-b908-41da-ab65-6a16bbc52ae8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:57.255834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce8d85c3-b908-41da-ab65-6a16bbc52ae8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:57.256565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce8d85c3-b908-41da-ab65-6a16bbc52ae8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:57.265455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-af795dbd-f1ed-4bc7-b897-126858841a29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:57.267616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-af795dbd-f1ed-4bc7-b897-126858841a29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:57.274609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af795dbd-f1ed-4bc7-b897-126858841a29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:57.274774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af795dbd-f1ed-4bc7-b897-126858841a29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:57.275678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af795dbd-f1ed-4bc7-b897-126858841a29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:57.275963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af795dbd-f1ed-4bc7-b897-126858841a29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:57.287829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ce8d85c3-b908-41da-ab65-6a16bbc52ae8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055077 Jul 26 18:41:57.288592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1097/2164] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:57 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:57.307044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-af795dbd-f1ed-4bc7-b897-126858841a29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Jul 26 18:41:57.307765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1068/2165] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:57 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:57.308593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9ed3b996-b7fe-41f0-9879-ff7a8bd223fc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:41:57.310751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9ed3b996-b7fe-41f0-9879-ff7a8bd223fc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:57.316898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ed3b996-b7fe-41f0-9879-ff7a8bd223fc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:57.317339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ed3b996-b7fe-41f0-9879-ff7a8bd223fc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:57.318097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ed3b996-b7fe-41f0-9879-ff7a8bd223fc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:57.318529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ed3b996-b7fe-41f0-9879-ff7a8bd223fc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:57.410166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9ed3b996-b7fe-41f0-9879-ff7a8bd223fc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "POST /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/action" status: 200 len: 82546 microversion: 2.1 time: 0.105054 Jul 26 18:41:57.410861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1098/2166] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:41:57 2022] POST /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/action => generated 82546 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 18:41:57.428219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c2b09793-06ce-43c7-8bdc-244d6b3510f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:57.428742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c2b09793-06ce-43c7-8bdc-244d6b3510f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:57.435369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2b09793-06ce-43c7-8bdc-244d6b3510f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:57.435819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2b09793-06ce-43c7-8bdc-244d6b3510f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:57.436569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2b09793-06ce-43c7-8bdc-244d6b3510f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:57.436998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2b09793-06ce-43c7-8bdc-244d6b3510f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:57.519189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.objects.instance [None req-c2b09793-06ce-43c7-8bdc-244d6b3510f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lazy-loading 'services' on Instance uuid 9982c007-1157-4c63-93e8-3733712f06e0 {{(pid=117997) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 18:41:57.574215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.wsgi [None req-c2b09793-06ce-43c7-8bdc-244d6b3510f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d3948d0-58cb-41b9-90d0-689c844603a8) Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c2b09793-06ce-43c7-8bdc-244d6b3510f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Request method failure captured: Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: request: DELETE /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments/d265e72f-c895-4778-91cc-5cbed9088144 HTTP/1.1 Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Accept: application/json Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Accept-Encoding: identity Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Connection: close Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Content-Length: 0 Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Content-Type: application/json Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Host: 10.222.0.27 Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Openstack-System-Scope: None Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: User-Agent: python-urllib3/1.26.10 Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Auth-Token: gAAAAABi4DK2f7i3SqbSKcA1SpM8T4n-ynNPsQpe3M4i4IZmEZvsQriuPRRFHqBA9lL-tNTDBRLdNSqi9vpM2R9EIj_AEnfldi9i5GJA_QiT2u8SlMsQqVgMg_m6BI8c73iGIMyjvvewYDGxKNR20o7ktyE-4lrLnop0oWWuTLW5A_3WJqSYEfs Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Domain-Id: None Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Domain-Name: None Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Identity-Status: Confirmed Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Is-Admin-Project: True Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Domain-Id: default Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Domain-Name: Default Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Id: ce7168da907a4465b0e919131bb0373e Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Project-Name: tempest-TestMinimumBasicScenario-1678954881 Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Role: reader,member Jul 26 18:41:57.584308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Roles: reader,member Jul 26 18:41:57.585863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ce7168da907a4465b0e919131bb0373e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ce7168da907a4465b0e919131bb0373e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ce7168da907a4465b0e919131bb0373e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ce7168da907a4465b0e919131bb0373e"}]}] Jul 26 18:41:57.585863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant: tempest-TestMinimumBasicScenario-1678954881 Jul 26 18:41:57.585863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant-Id: ce7168da907a4465b0e919131bb0373e Jul 26 18:41:57.585863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1678954881 Jul 26 18:41:57.585863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User: tempest-TestMinimumBasicScenario-1678954881-project Jul 26 18:41:57.585863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Domain-Id: default Jul 26 18:41:57.585863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Domain-Name: Default Jul 26 18:41:57.585863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Id: 54c4e94a090544d7a977dabe32884f98 Jul 26 18:41:57.585863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: X-User-Name: tempest-TestMinimumBasicScenario-1678954881-project Jul 26 18:41:57.585863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: method: > Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d3948d0-58cb-41b9-90d0-689c844603a8) Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: action_args: {'server_id': '9982c007-1157-4c63-93e8-3733712f06e0', 'id': 'd265e72f-c895-4778-91cc-5cbed9088144'} Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 26 18:41:57.586668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d3948d0-58cb-41b9-90d0-689c844603a8) Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 18:41:57.588137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d3948d0-58cb-41b9-90d0-689c844603a8) Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:41:57.589768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d3948d0-58cb-41b9-90d0-689c844603a8) Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:41:57.591369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d3948d0-58cb-41b9-90d0-689c844603a8) Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d3948d0-58cb-41b9-90d0-689c844603a8) Jul 26 18:41:57.592729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: ERROR nova.api.openstack.wsgi Jul 26 18:41:57.596747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c2b09793-06ce-43c7-8bdc-244d6b3510f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d3948d0-58cb-41b9-90d0-689c844603a8) {{(pid=117997) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:41:57.596747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c2b09793-06ce-43c7-8bdc-244d6b3510f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments/d265e72f-c895-4778-91cc-5cbed9088144" status: 400 len: 269 microversion: 2.1 time: 0.161513 Jul 26 18:41:57.596747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1069/2167] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Jul 26 18:41:57 2022] DELETE /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0/os-volume_attachments/d265e72f-c895-4778-91cc-5cbed9088144 => generated 269 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 18:41:58.174760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a828a10c-a6b4-4548-9e1c-286d22dfbb9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:58.178430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a828a10c-a6b4-4548-9e1c-286d22dfbb9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:58.186863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a828a10c-a6b4-4548-9e1c-286d22dfbb9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:58.187362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a828a10c-a6b4-4548-9e1c-286d22dfbb9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:58.188123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a828a10c-a6b4-4548-9e1c-286d22dfbb9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:58.188557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a828a10c-a6b4-4548-9e1c-286d22dfbb9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:58.219198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a828a10c-a6b4-4548-9e1c-286d22dfbb9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051685 Jul 26 18:41:58.219738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1099/2168] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:58 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:58.300462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2e64fd2b-9090-4cae-a481-0d6ca6cfa013 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:58.302726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2e64fd2b-9090-4cae-a481-0d6ca6cfa013 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:58.310078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e64fd2b-9090-4cae-a481-0d6ca6cfa013 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:58.310530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e64fd2b-9090-4cae-a481-0d6ca6cfa013 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:58.311328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e64fd2b-9090-4cae-a481-0d6ca6cfa013 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:58.311769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e64fd2b-9090-4cae-a481-0d6ca6cfa013 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:58.319637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b35279d7-5fe1-44c0-9ac7-3d278854fe35 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:58.321834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b35279d7-5fe1-44c0-9ac7-3d278854fe35 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:58.328816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b35279d7-5fe1-44c0-9ac7-3d278854fe35 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:58.329063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b35279d7-5fe1-44c0-9ac7-3d278854fe35 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:58.329810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b35279d7-5fe1-44c0-9ac7-3d278854fe35 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:58.330238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b35279d7-5fe1-44c0-9ac7-3d278854fe35 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:58.341459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2e64fd2b-9090-4cae-a481-0d6ca6cfa013 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045590 Jul 26 18:41:58.342291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1070/2169] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:58 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:58.364121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b35279d7-5fe1-44c0-9ac7-3d278854fe35 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048433 Jul 26 18:41:58.364804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1100/2170] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:58 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:59.236106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5011f224-16e4-48f6-b60d-a2b25c479a2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:59.239621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5011f224-16e4-48f6-b60d-a2b25c479a2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:59.249680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5011f224-16e4-48f6-b60d-a2b25c479a2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:59.250411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5011f224-16e4-48f6-b60d-a2b25c479a2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:59.251702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5011f224-16e4-48f6-b60d-a2b25c479a2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:59.252375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5011f224-16e4-48f6-b60d-a2b25c479a2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:59.284858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5011f224-16e4-48f6-b60d-a2b25c479a2a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055477 Jul 26 18:41:59.285411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1071/2171] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:59 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:59.354681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2187672b-e0b7-4734-ab32-63c0ff5d184f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:59.356893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2187672b-e0b7-4734-ab32-63c0ff5d184f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:59.363896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2187672b-e0b7-4734-ab32-63c0ff5d184f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:59.364352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2187672b-e0b7-4734-ab32-63c0ff5d184f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:59.365104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2187672b-e0b7-4734-ab32-63c0ff5d184f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:59.365536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2187672b-e0b7-4734-ab32-63c0ff5d184f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:59.376849 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a221d31b-06bd-4f44-a59e-03f75d23e829 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:41:59.379165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a221d31b-06bd-4f44-a59e-03f75d23e829 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:41:59.386142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a221d31b-06bd-4f44-a59e-03f75d23e829 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:59.386585 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a221d31b-06bd-4f44-a59e-03f75d23e829 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:59.387373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a221d31b-06bd-4f44-a59e-03f75d23e829 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:41:59.387802 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a221d31b-06bd-4f44-a59e-03f75d23e829 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:41:59.395601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2187672b-e0b7-4734-ab32-63c0ff5d184f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045199 Jul 26 18:41:59.396234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1101/2172] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:59 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:41:59.417549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a221d31b-06bd-4f44-a59e-03f75d23e829 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044609 Jul 26 18:41:59.418091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1072/2173] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:41:59 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:00.301740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-eeff7705-728d-49d9-a5bb-afda08b100c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:00.305196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-eeff7705-728d-49d9-a5bb-afda08b100c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:00.309035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:42:00.318437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eeff7705-728d-49d9-a5bb-afda08b100c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:00.319231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eeff7705-728d-49d9-a5bb-afda08b100c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:00.320501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eeff7705-728d-49d9-a5bb-afda08b100c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:00.321292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eeff7705-728d-49d9-a5bb-afda08b100c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:00.352771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-eeff7705-728d-49d9-a5bb-afda08b100c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057754 Jul 26 18:42:00.353323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1102/2174] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:00 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:00.411944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5cfa2ef7-c8eb-4503-add3-7068f5fbd517 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:00.415502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5cfa2ef7-c8eb-4503-add3-7068f5fbd517 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:00.426689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5cfa2ef7-c8eb-4503-add3-7068f5fbd517 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:00.427502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5cfa2ef7-c8eb-4503-add3-7068f5fbd517 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:00.428799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5cfa2ef7-c8eb-4503-add3-7068f5fbd517 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:00.429479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5cfa2ef7-c8eb-4503-add3-7068f5fbd517 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:00.432571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3b256f8b-c614-4ea2-a0f9-9a30e093f685 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:00.434699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3b256f8b-c614-4ea2-a0f9-9a30e093f685 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:00.440924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b256f8b-c614-4ea2-a0f9-9a30e093f685 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:00.441363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b256f8b-c614-4ea2-a0f9-9a30e093f685 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:00.442116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b256f8b-c614-4ea2-a0f9-9a30e093f685 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:00.442545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b256f8b-c614-4ea2-a0f9-9a30e093f685 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:00.459737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5cfa2ef7-c8eb-4503-add3-7068f5fbd517 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054434 Jul 26 18:42:00.460304 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1073/2175] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:00 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:00.472211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3b256f8b-c614-4ea2-a0f9-9a30e093f685 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045099 Jul 26 18:42:00.472758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1103/2176] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:00 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:01.369333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7e952827-91ef-4151-95b9-8ba24736e1b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:01.371620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7e952827-91ef-4151-95b9-8ba24736e1b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:01.378001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e952827-91ef-4151-95b9-8ba24736e1b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:01.378444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e952827-91ef-4151-95b9-8ba24736e1b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:01.379244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e952827-91ef-4151-95b9-8ba24736e1b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:01.379674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e952827-91ef-4151-95b9-8ba24736e1b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:01.408746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7e952827-91ef-4151-95b9-8ba24736e1b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046099 Jul 26 18:42:01.409307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1074/2177] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:01 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:01.476405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4f18412f-528a-48ae-b1ed-97650ea90e16 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:01.479178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4f18412f-528a-48ae-b1ed-97650ea90e16 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:01.484198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-488b6f55-4b50-4dae-a81e-a3d7e6bc867e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:01.486325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-488b6f55-4b50-4dae-a81e-a3d7e6bc867e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:01.486466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f18412f-528a-48ae-b1ed-97650ea90e16 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:01.486819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f18412f-528a-48ae-b1ed-97650ea90e16 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:01.487602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f18412f-528a-48ae-b1ed-97650ea90e16 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:01.488012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f18412f-528a-48ae-b1ed-97650ea90e16 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:01.489684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:42:01.493795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-488b6f55-4b50-4dae-a81e-a3d7e6bc867e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:01.494235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-488b6f55-4b50-4dae-a81e-a3d7e6bc867e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:01.494993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-488b6f55-4b50-4dae-a81e-a3d7e6bc867e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:01.495451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-488b6f55-4b50-4dae-a81e-a3d7e6bc867e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:01.518645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4f18412f-528a-48ae-b1ed-97650ea90e16 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048827 Jul 26 18:42:01.519215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1104/2178] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:01 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:01.526052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-488b6f55-4b50-4dae-a81e-a3d7e6bc867e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045684 Jul 26 18:42:01.526632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1075/2179] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:01 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:42:02.425340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-435eb46a-2e5e-4501-b91f-c3a2566ff7bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:02.428845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-435eb46a-2e5e-4501-b91f-c3a2566ff7bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:02.439810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-435eb46a-2e5e-4501-b91f-c3a2566ff7bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:02.440514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-435eb46a-2e5e-4501-b91f-c3a2566ff7bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:02.441812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-435eb46a-2e5e-4501-b91f-c3a2566ff7bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:02.442536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-435eb46a-2e5e-4501-b91f-c3a2566ff7bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:02.472676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-435eb46a-2e5e-4501-b91f-c3a2566ff7bf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053944 Jul 26 18:42:02.473215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1105/2180] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:02.535596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8bfe0b08-3afe-4f4e-ba49-9f6dbad19bd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:02.539095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8bfe0b08-3afe-4f4e-ba49-9f6dbad19bd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:02.541070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a28c6ccb-7f7a-492a-ae60-2ce36f7141a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:02.543191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a28c6ccb-7f7a-492a-ae60-2ce36f7141a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:02.546459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8bfe0b08-3afe-4f4e-ba49-9f6dbad19bd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:02.546913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8bfe0b08-3afe-4f4e-ba49-9f6dbad19bd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:02.547704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8bfe0b08-3afe-4f4e-ba49-9f6dbad19bd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:02.548130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8bfe0b08-3afe-4f4e-ba49-9f6dbad19bd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:02.549193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a28c6ccb-7f7a-492a-ae60-2ce36f7141a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:02.549636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a28c6ccb-7f7a-492a-ae60-2ce36f7141a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:02.550374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a28c6ccb-7f7a-492a-ae60-2ce36f7141a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:02.550796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a28c6ccb-7f7a-492a-ae60-2ce36f7141a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:02.554406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:42:02.580415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a28c6ccb-7f7a-492a-ae60-2ce36f7141a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045345 Jul 26 18:42:02.581012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1106/2181] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:02 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:02.582218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8bfe0b08-3afe-4f4e-ba49-9f6dbad19bd6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053465 Jul 26 18:42:02.582789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1076/2182] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:02 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:03.489688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-63804f73-80dd-4436-852e-07d42cb5bfbb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:03.493283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-63804f73-80dd-4436-852e-07d42cb5bfbb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:03.500621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-63804f73-80dd-4436-852e-07d42cb5bfbb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:03.501083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-63804f73-80dd-4436-852e-07d42cb5bfbb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:03.501871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-63804f73-80dd-4436-852e-07d42cb5bfbb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:03.502318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-63804f73-80dd-4436-852e-07d42cb5bfbb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:03.533051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-63804f73-80dd-4436-852e-07d42cb5bfbb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050083 Jul 26 18:42:03.533607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1107/2183] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:03 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:03.596540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-98b1da6b-99d8-4a37-af66-d1b629fa07a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:03.597427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0c935186-f393-4e80-8b93-049299d839c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:03.600144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-98b1da6b-99d8-4a37-af66-d1b629fa07a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:03.601236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0c935186-f393-4e80-8b93-049299d839c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:03.610675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98b1da6b-99d8-4a37-af66-d1b629fa07a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:03.611263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c935186-f393-4e80-8b93-049299d839c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:03.611512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98b1da6b-99d8-4a37-af66-d1b629fa07a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:03.612024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c935186-f393-4e80-8b93-049299d839c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:03.612756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98b1da6b-99d8-4a37-af66-d1b629fa07a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:03.613302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c935186-f393-4e80-8b93-049299d839c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:03.613540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98b1da6b-99d8-4a37-af66-d1b629fa07a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:03.614075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c935186-f393-4e80-8b93-049299d839c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:03.644979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-98b1da6b-99d8-4a37-af66-d1b629fa07a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054885 Jul 26 18:42:03.645771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1077/2184] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:03 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:03.646184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0c935186-f393-4e80-8b93-049299d839c1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054805 Jul 26 18:42:03.646975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1108/2185] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:03 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:04.549928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d0505bda-b1c9-4782-a057-f7250af03170 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:04.553450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d0505bda-b1c9-4782-a057-f7250af03170 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:04.563700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0505bda-b1c9-4782-a057-f7250af03170 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:04.564454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0505bda-b1c9-4782-a057-f7250af03170 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:04.566187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0505bda-b1c9-4782-a057-f7250af03170 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:04.566922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0505bda-b1c9-4782-a057-f7250af03170 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:04.598826 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d0505bda-b1c9-4782-a057-f7250af03170 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055580 Jul 26 18:42:04.599475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1078/2186] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:04 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:04.661533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d4a2050e-1458-4916-ae48-50560dcb2dcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:04.662700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-147f77f7-5646-43fa-9865-1705b334c9d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:04.664795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d4a2050e-1458-4916-ae48-50560dcb2dcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:04.665749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-147f77f7-5646-43fa-9865-1705b334c9d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:04.671825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4a2050e-1458-4916-ae48-50560dcb2dcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:04.672276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4a2050e-1458-4916-ae48-50560dcb2dcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:04.672444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-147f77f7-5646-43fa-9865-1705b334c9d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:04.672908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-147f77f7-5646-43fa-9865-1705b334c9d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:04.673053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4a2050e-1458-4916-ae48-50560dcb2dcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:04.673465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4a2050e-1458-4916-ae48-50560dcb2dcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:04.673630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-147f77f7-5646-43fa-9865-1705b334c9d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:04.674366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-147f77f7-5646-43fa-9865-1705b334c9d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:04.704046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d4a2050e-1458-4916-ae48-50560dcb2dcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048890 Jul 26 18:42:04.704636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1109/2187] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:04 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:04.709279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-147f77f7-5646-43fa-9865-1705b334c9d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052757 Jul 26 18:42:04.709871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1079/2188] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:04 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:05.614515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-63de53f1-44a7-4e94-9731-819a0ee1b5aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:05.618019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-63de53f1-44a7-4e94-9731-819a0ee1b5aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:05.624745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-63de53f1-44a7-4e94-9731-819a0ee1b5aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:05.625185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-63de53f1-44a7-4e94-9731-819a0ee1b5aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:05.625940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-63de53f1-44a7-4e94-9731-819a0ee1b5aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:05.626374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-63de53f1-44a7-4e94-9731-819a0ee1b5aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:05.655957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-63de53f1-44a7-4e94-9731-819a0ee1b5aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048122 Jul 26 18:42:05.656486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1110/2189] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:05 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:05.720200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dec3acd7-5e2f-46d5-b4dd-05661af7e9e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:05.723937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dec3acd7-5e2f-46d5-b4dd-05661af7e9e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:05.725144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a1d2d4e8-bb7d-4ddb-ad57-da409727de14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:05.728574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a1d2d4e8-bb7d-4ddb-ad57-da409727de14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:05.734738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dec3acd7-5e2f-46d5-b4dd-05661af7e9e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:05.735555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dec3acd7-5e2f-46d5-b4dd-05661af7e9e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:05.736809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dec3acd7-5e2f-46d5-b4dd-05661af7e9e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:05.737527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dec3acd7-5e2f-46d5-b4dd-05661af7e9e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:05.739244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1d2d4e8-bb7d-4ddb-ad57-da409727de14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:05.739955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1d2d4e8-bb7d-4ddb-ad57-da409727de14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:05.741238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1d2d4e8-bb7d-4ddb-ad57-da409727de14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:05.741953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1d2d4e8-bb7d-4ddb-ad57-da409727de14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:05.769218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dec3acd7-5e2f-46d5-b4dd-05661af7e9e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055682 Jul 26 18:42:05.769792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1080/2190] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:05 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:05.772635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a1d2d4e8-bb7d-4ddb-ad57-da409727de14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053849 Jul 26 18:42:05.773485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1111/2191] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:05 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:06.679343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bd3a18de-847d-4bc0-b501-4e829724f2f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:06.682185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bd3a18de-847d-4bc0-b501-4e829724f2f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:06.688695 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bd3a18de-847d-4bc0-b501-4e829724f2f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:06.689140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bd3a18de-847d-4bc0-b501-4e829724f2f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:06.689903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bd3a18de-847d-4bc0-b501-4e829724f2f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:06.690332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bd3a18de-847d-4bc0-b501-4e829724f2f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:06.709820 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:42:06.726735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bd3a18de-847d-4bc0-b501-4e829724f2f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056569 Jul 26 18:42:06.727478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1081/2192] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:06 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:06.782247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-708faeb5-1888-4b11-8d9a-d313431074ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:06.784356 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7bc14482-00c2-4949-a6cd-0b5fe17fee27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:06.784750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-708faeb5-1888-4b11-8d9a-d313431074ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:06.786643 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7bc14482-00c2-4949-a6cd-0b5fe17fee27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:06.791422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-708faeb5-1888-4b11-8d9a-d313431074ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:06.791868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-708faeb5-1888-4b11-8d9a-d313431074ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:06.792631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-708faeb5-1888-4b11-8d9a-d313431074ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:06.793054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-708faeb5-1888-4b11-8d9a-d313431074ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:06.793552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bc14482-00c2-4949-a6cd-0b5fe17fee27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:06.793994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bc14482-00c2-4949-a6cd-0b5fe17fee27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:06.794767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bc14482-00c2-4949-a6cd-0b5fe17fee27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:06.795247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bc14482-00c2-4949-a6cd-0b5fe17fee27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:06.822459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-708faeb5-1888-4b11-8d9a-d313431074ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Jul 26 18:42:06.823038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1112/2193] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:06 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:06.824919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7bc14482-00c2-4949-a6cd-0b5fe17fee27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Jul 26 18:42:06.825805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1082/2194] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:06 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:07.744225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1b46ff2d-d976-4f6b-9425-1c79389f5a32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:07.747742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1b46ff2d-d976-4f6b-9425-1c79389f5a32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:07.761552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b46ff2d-d976-4f6b-9425-1c79389f5a32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:07.762003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b46ff2d-d976-4f6b-9425-1c79389f5a32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:07.762805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b46ff2d-d976-4f6b-9425-1c79389f5a32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:07.763682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b46ff2d-d976-4f6b-9425-1c79389f5a32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:07.802807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1b46ff2d-d976-4f6b-9425-1c79389f5a32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065524 Jul 26 18:42:07.803670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1113/2195] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:07 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:07.835058 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2b95a3aa-2602-40d4-bca1-d06eecdfd54d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:07.837177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-26aac8d6-9837-47ef-991c-9f8d6163f5e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:07.837337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2b95a3aa-2602-40d4-bca1-d06eecdfd54d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:07.839287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-26aac8d6-9837-47ef-991c-9f8d6163f5e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:07.844240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b95a3aa-2602-40d4-bca1-d06eecdfd54d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:07.844691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b95a3aa-2602-40d4-bca1-d06eecdfd54d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:07.845428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26aac8d6-9837-47ef-991c-9f8d6163f5e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:07.845574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b95a3aa-2602-40d4-bca1-d06eecdfd54d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:07.845871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26aac8d6-9837-47ef-991c-9f8d6163f5e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:07.846015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2b95a3aa-2602-40d4-bca1-d06eecdfd54d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:07.846605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26aac8d6-9837-47ef-991c-9f8d6163f5e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:07.847048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26aac8d6-9837-47ef-991c-9f8d6163f5e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:07.876424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2b95a3aa-2602-40d4-bca1-d06eecdfd54d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045172 Jul 26 18:42:07.876658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-26aac8d6-9837-47ef-991c-9f8d6163f5e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042915 Jul 26 18:42:07.877105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1083/2196] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:07 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:07.877237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1114/2197] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:07 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:08.815939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6f03db55-529e-440a-a56b-25a67fdd09d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:08.818061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6f03db55-529e-440a-a56b-25a67fdd09d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:08.824801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f03db55-529e-440a-a56b-25a67fdd09d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:08.825251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f03db55-529e-440a-a56b-25a67fdd09d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:08.826036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f03db55-529e-440a-a56b-25a67fdd09d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:08.826441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f03db55-529e-440a-a56b-25a67fdd09d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:08.855938 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6f03db55-529e-440a-a56b-25a67fdd09d2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044027 Jul 26 18:42:08.856624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1084/2198] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:08.888610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3dd31f90-b6a7-4ba0-a6c6-9e810b90fa2a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:08.888950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cf2ced81-4dac-4221-a2fb-aa3cda31268b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:08.890775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3dd31f90-b6a7-4ba0-a6c6-9e810b90fa2a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:08.891062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cf2ced81-4dac-4221-a2fb-aa3cda31268b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:08.897158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dd31f90-b6a7-4ba0-a6c6-9e810b90fa2a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:08.897607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dd31f90-b6a7-4ba0-a6c6-9e810b90fa2a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:08.897781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf2ced81-4dac-4221-a2fb-aa3cda31268b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:08.898549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf2ced81-4dac-4221-a2fb-aa3cda31268b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:08.898695 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dd31f90-b6a7-4ba0-a6c6-9e810b90fa2a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:08.899116 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dd31f90-b6a7-4ba0-a6c6-9e810b90fa2a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:08.899350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf2ced81-4dac-4221-a2fb-aa3cda31268b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:08.899794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf2ced81-4dac-4221-a2fb-aa3cda31268b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:08.929407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3dd31f90-b6a7-4ba0-a6c6-9e810b90fa2a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044488 Jul 26 18:42:08.929657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cf2ced81-4dac-4221-a2fb-aa3cda31268b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Jul 26 18:42:08.930188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1085/2199] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:08 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:08.930321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1115/2200] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:08 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:09.871749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-121fbe10-9f5a-42ac-844c-c266848d89ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:09.874670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-121fbe10-9f5a-42ac-844c-c266848d89ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:09.884412 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-121fbe10-9f5a-42ac-844c-c266848d89ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:09.884859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-121fbe10-9f5a-42ac-844c-c266848d89ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:09.885671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-121fbe10-9f5a-42ac-844c-c266848d89ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:09.886104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-121fbe10-9f5a-42ac-844c-c266848d89ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:09.915544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-121fbe10-9f5a-42ac-844c-c266848d89ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050206 Jul 26 18:42:09.916100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1086/2201] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:09 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:09.941397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-367e3ea0-012f-47e2-b133-d2e96871c5d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:09.941643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bbe79bdb-431d-405a-ac80-4fe9d0bf18b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:09.943681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bbe79bdb-431d-405a-ac80-4fe9d0bf18b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:09.943850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-367e3ea0-012f-47e2-b133-d2e96871c5d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:09.950182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bbe79bdb-431d-405a-ac80-4fe9d0bf18b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:09.950365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-367e3ea0-012f-47e2-b133-d2e96871c5d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:09.950619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bbe79bdb-431d-405a-ac80-4fe9d0bf18b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:09.950770 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-367e3ea0-012f-47e2-b133-d2e96871c5d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:09.951432 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-367e3ea0-012f-47e2-b133-d2e96871c5d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:09.951546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bbe79bdb-431d-405a-ac80-4fe9d0bf18b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:09.951857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-367e3ea0-012f-47e2-b133-d2e96871c5d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:09.951964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bbe79bdb-431d-405a-ac80-4fe9d0bf18b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:09.980307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-367e3ea0-012f-47e2-b133-d2e96871c5d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042656 Jul 26 18:42:09.980904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1087/2202] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:09 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:09.981166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bbe79bdb-431d-405a-ac80-4fe9d0bf18b4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043397 Jul 26 18:42:09.981789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1116/2203] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:09 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:10.931544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b412cffe-1a75-457c-be03-a7beaf925345 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:10.933630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b412cffe-1a75-457c-be03-a7beaf925345 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:10.940851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b412cffe-1a75-457c-be03-a7beaf925345 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:10.941297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b412cffe-1a75-457c-be03-a7beaf925345 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:10.942055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b412cffe-1a75-457c-be03-a7beaf925345 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:10.942488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b412cffe-1a75-457c-be03-a7beaf925345 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:10.973005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b412cffe-1a75-457c-be03-a7beaf925345 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047921 Jul 26 18:42:10.973553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1088/2204] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:10 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:10.992859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3bd86175-f8a4-471f-974b-8aa25f826ae6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:10.993151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-82913e19-7385-4739-a300-d38fe4f8f8e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:10.995052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3bd86175-f8a4-471f-974b-8aa25f826ae6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:10.995197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-82913e19-7385-4739-a300-d38fe4f8f8e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:11.001213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bd86175-f8a4-471f-974b-8aa25f826ae6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:11.001659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bd86175-f8a4-471f-974b-8aa25f826ae6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:11.001814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82913e19-7385-4739-a300-d38fe4f8f8e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:11.002173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82913e19-7385-4739-a300-d38fe4f8f8e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:11.002413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bd86175-f8a4-471f-974b-8aa25f826ae6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:11.002845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bd86175-f8a4-471f-974b-8aa25f826ae6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:11.003003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82913e19-7385-4739-a300-d38fe4f8f8e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:11.003665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82913e19-7385-4739-a300-d38fe4f8f8e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:11.032634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3bd86175-f8a4-471f-974b-8aa25f826ae6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043426 Jul 26 18:42:11.033233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1089/2205] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:10 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:11.034006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-82913e19-7385-4739-a300-d38fe4f8f8e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044901 Jul 26 18:42:11.034730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1117/2206] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:10 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:11.992698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-806a37e2-806b-4ac5-b19c-db80c31817da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:11.996956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-806a37e2-806b-4ac5-b19c-db80c31817da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:12.008953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-806a37e2-806b-4ac5-b19c-db80c31817da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:12.009332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-806a37e2-806b-4ac5-b19c-db80c31817da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:12.010100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-806a37e2-806b-4ac5-b19c-db80c31817da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:12.010527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-806a37e2-806b-4ac5-b19c-db80c31817da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:12.041486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-806a37e2-806b-4ac5-b19c-db80c31817da tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055814 Jul 26 18:42:12.042044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1090/2207] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:12.045376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-314d8248-eba0-4cea-b8a0-c03ab92b3e9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:12.046600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-441d51a3-379b-4e06-8f30-84a7ca4ee3ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:12.047534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-314d8248-eba0-4cea-b8a0-c03ab92b3e9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:12.048720 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-441d51a3-379b-4e06-8f30-84a7ca4ee3ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:12.054321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-314d8248-eba0-4cea-b8a0-c03ab92b3e9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:12.054769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-314d8248-eba0-4cea-b8a0-c03ab92b3e9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:12.055234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-441d51a3-379b-4e06-8f30-84a7ca4ee3ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:12.055545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-314d8248-eba0-4cea-b8a0-c03ab92b3e9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:12.055659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-441d51a3-379b-4e06-8f30-84a7ca4ee3ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:12.055972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-314d8248-eba0-4cea-b8a0-c03ab92b3e9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:12.056407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-441d51a3-379b-4e06-8f30-84a7ca4ee3ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:12.056841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-441d51a3-379b-4e06-8f30-84a7ca4ee3ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:12.085876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-314d8248-eba0-4cea-b8a0-c03ab92b3e9f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044331 Jul 26 18:42:12.086410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1118/2208] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:12 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:12.087875 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-441d51a3-379b-4e06-8f30-84a7ca4ee3ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044867 Jul 26 18:42:12.088629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1091/2209] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:12 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:13.054164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d42cab50-9be9-4c28-96af-68d98f88182a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:13.056346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d42cab50-9be9-4c28-96af-68d98f88182a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:13.063304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d42cab50-9be9-4c28-96af-68d98f88182a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:13.063753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d42cab50-9be9-4c28-96af-68d98f88182a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:13.064523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d42cab50-9be9-4c28-96af-68d98f88182a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:13.064955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d42cab50-9be9-4c28-96af-68d98f88182a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:13.096158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d42cab50-9be9-4c28-96af-68d98f88182a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045805 Jul 26 18:42:13.096967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1119/2210] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:13 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:13.098021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6700150c-d59f-4021-839d-b8c7d6c68d9c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:13.100392 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6700150c-d59f-4021-839d-b8c7d6c68d9c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:13.103675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ec57752e-867f-4fab-8fbb-b2b79d5e86d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:42:13.105797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ec57752e-867f-4fab-8fbb-b2b79d5e86d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:13.107761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6700150c-d59f-4021-839d-b8c7d6c68d9c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:13.108207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6700150c-d59f-4021-839d-b8c7d6c68d9c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:13.108959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6700150c-d59f-4021-839d-b8c7d6c68d9c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:13.109416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6700150c-d59f-4021-839d-b8c7d6c68d9c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:13.111872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec57752e-867f-4fab-8fbb-b2b79d5e86d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:13.112317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec57752e-867f-4fab-8fbb-b2b79d5e86d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:13.113069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec57752e-867f-4fab-8fbb-b2b79d5e86d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:13.113504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec57752e-867f-4fab-8fbb-b2b79d5e86d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:13.138729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6700150c-d59f-4021-839d-b8c7d6c68d9c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044623 Jul 26 18:42:13.139366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1092/2211] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:13 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:13.202034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ec57752e-867f-4fab-8fbb-b2b79d5e86d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "POST /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/action" status: 200 len: 41135 microversion: 2.1 time: 0.103500 Jul 26 18:42:13.202618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1120/2212] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:42:13 2022] POST /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31/action => generated 41135 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:42:14.112279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2257f663-c15e-4b6a-b782-a45592f21d21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:14.115780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2257f663-c15e-4b6a-b782-a45592f21d21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:14.123006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2257f663-c15e-4b6a-b782-a45592f21d21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:14.123478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2257f663-c15e-4b6a-b782-a45592f21d21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:14.124245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2257f663-c15e-4b6a-b782-a45592f21d21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:14.124680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2257f663-c15e-4b6a-b782-a45592f21d21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:14.152142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e16e5c16-969d-4aa5-884f-4c2dc89d8dc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:14.154391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2257f663-c15e-4b6a-b782-a45592f21d21 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048832 Jul 26 18:42:14.154552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e16e5c16-969d-4aa5-884f-4c2dc89d8dc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:14.154958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1093/2213] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:14 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:14.161872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e16e5c16-969d-4aa5-884f-4c2dc89d8dc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:14.162306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e16e5c16-969d-4aa5-884f-4c2dc89d8dc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:14.163081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e16e5c16-969d-4aa5-884f-4c2dc89d8dc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:14.163513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e16e5c16-969d-4aa5-884f-4c2dc89d8dc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:14.193279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e16e5c16-969d-4aa5-884f-4c2dc89d8dc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045829 Jul 26 18:42:14.193817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1121/2214] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:14 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:15.170993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3bf55e5e-6fc9-4d43-ac4f-fbb74c4db281 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:15.174565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3bf55e5e-6fc9-4d43-ac4f-fbb74c4db281 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:15.187082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bf55e5e-6fc9-4d43-ac4f-fbb74c4db281 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:15.187859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bf55e5e-6fc9-4d43-ac4f-fbb74c4db281 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:15.189116 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bf55e5e-6fc9-4d43-ac4f-fbb74c4db281 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:15.189828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3bf55e5e-6fc9-4d43-ac4f-fbb74c4db281 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:15.205752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-eb34edc8-49ae-4b56-92f6-44e6273c6257 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:15.207967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-eb34edc8-49ae-4b56-92f6-44e6273c6257 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:15.214684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb34edc8-49ae-4b56-92f6-44e6273c6257 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:15.215166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb34edc8-49ae-4b56-92f6-44e6273c6257 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:15.215927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb34edc8-49ae-4b56-92f6-44e6273c6257 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:15.216363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb34edc8-49ae-4b56-92f6-44e6273c6257 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:15.222318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3bf55e5e-6fc9-4d43-ac4f-fbb74c4db281 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058000 Jul 26 18:42:15.222901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1094/2215] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:15.246527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-eb34edc8-49ae-4b56-92f6-44e6273c6257 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044754 Jul 26 18:42:15.247071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1122/2216] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:15 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:16.238476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a378c556-21b9-499e-b25e-90ebb5085045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:16.242051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a378c556-21b9-499e-b25e-90ebb5085045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:16.252877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a378c556-21b9-499e-b25e-90ebb5085045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:16.253803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a378c556-21b9-499e-b25e-90ebb5085045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:16.254848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a378c556-21b9-499e-b25e-90ebb5085045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:16.255618 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a378c556-21b9-499e-b25e-90ebb5085045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:16.260677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5c276c3e-29cf-4ccd-a3c7-607289fad2eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:16.262801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5c276c3e-29cf-4ccd-a3c7-607289fad2eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:16.269714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c276c3e-29cf-4ccd-a3c7-607289fad2eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:16.270164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c276c3e-29cf-4ccd-a3c7-607289fad2eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:16.270960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c276c3e-29cf-4ccd-a3c7-607289fad2eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:16.271437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c276c3e-29cf-4ccd-a3c7-607289fad2eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:16.276241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:42:16.287322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a378c556-21b9-499e-b25e-90ebb5085045 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055402 Jul 26 18:42:16.287877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1095/2217] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:16.301616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5c276c3e-29cf-4ccd-a3c7-607289fad2eb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046257 Jul 26 18:42:16.302140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1123/2218] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:16 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:17.279514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:42:17.280599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 18:42:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:42:17.305758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2f458579-1b5c-402a-9e5d-4fa88fe090b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:17.307978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2f458579-1b5c-402a-9e5d-4fa88fe090b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:17.313904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f41b1397-e7a1-436f-a5a7-b3bcb4f6af8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:17.314936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f458579-1b5c-402a-9e5d-4fa88fe090b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:17.315420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f458579-1b5c-402a-9e5d-4fa88fe090b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:17.316105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f41b1397-e7a1-436f-a5a7-b3bcb4f6af8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:17.316273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f458579-1b5c-402a-9e5d-4fa88fe090b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:17.316600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f458579-1b5c-402a-9e5d-4fa88fe090b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:17.322980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f41b1397-e7a1-436f-a5a7-b3bcb4f6af8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:17.323468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f41b1397-e7a1-436f-a5a7-b3bcb4f6af8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:17.324234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f41b1397-e7a1-436f-a5a7-b3bcb4f6af8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:17.324676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f41b1397-e7a1-436f-a5a7-b3bcb4f6af8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:17.346115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2f458579-1b5c-402a-9e5d-4fa88fe090b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048429 Jul 26 18:42:17.346668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1096/2219] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:17 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:17.354488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f41b1397-e7a1-436f-a5a7-b3bcb4f6af8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044562 Jul 26 18:42:17.355067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1124/2220] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:17 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:18.362732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7f11395d-772e-4a99-9376-8898b68cd53e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:18.366222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7f11395d-772e-4a99-9376-8898b68cd53e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:18.369757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-07f4e2f1-fa6c-418a-aa8f-143395f61c63 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:18.373335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-07f4e2f1-fa6c-418a-aa8f-143395f61c63 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:18.375739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f11395d-772e-4a99-9376-8898b68cd53e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:18.376184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f11395d-772e-4a99-9376-8898b68cd53e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:18.376954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f11395d-772e-4a99-9376-8898b68cd53e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:18.377347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f11395d-772e-4a99-9376-8898b68cd53e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:18.379931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07f4e2f1-fa6c-418a-aa8f-143395f61c63 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:18.380374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07f4e2f1-fa6c-418a-aa8f-143395f61c63 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:18.381128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07f4e2f1-fa6c-418a-aa8f-143395f61c63 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:18.381681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07f4e2f1-fa6c-418a-aa8f-143395f61c63 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:18.407320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7f11395d-772e-4a99-9376-8898b68cd53e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051198 Jul 26 18:42:18.407878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1097/2221] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:18.411160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-07f4e2f1-fa6c-418a-aa8f-143395f61c63 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048051 Jul 26 18:42:18.411912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1125/2222] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:18 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:19.424283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0be0a1dd-6a9e-45a7-9cc2-a8b6708af1d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:19.427194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-831ccc13-f7b1-432e-88e2-7e1a3a64f751 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:19.427914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0be0a1dd-6a9e-45a7-9cc2-a8b6708af1d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:19.430624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-831ccc13-f7b1-432e-88e2-7e1a3a64f751 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:19.438863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0be0a1dd-6a9e-45a7-9cc2-a8b6708af1d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:19.439464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0be0a1dd-6a9e-45a7-9cc2-a8b6708af1d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:19.440730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0be0a1dd-6a9e-45a7-9cc2-a8b6708af1d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:19.441346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-831ccc13-f7b1-432e-88e2-7e1a3a64f751 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:19.441593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0be0a1dd-6a9e-45a7-9cc2-a8b6708af1d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:19.442097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-831ccc13-f7b1-432e-88e2-7e1a3a64f751 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:19.443418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-831ccc13-f7b1-432e-88e2-7e1a3a64f751 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:19.444120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-831ccc13-f7b1-432e-88e2-7e1a3a64f751 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:19.445352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:42:19.474733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-831ccc13-f7b1-432e-88e2-7e1a3a64f751 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054205 Jul 26 18:42:19.475329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1126/2223] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:19 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:19.475497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0be0a1dd-6a9e-45a7-9cc2-a8b6708af1d1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057704 Jul 26 18:42:19.476256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1098/2224] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:19 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:20.491335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7c11450d-0960-479f-8bfc-d6902f1cc5c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:20.494173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7c11450d-0960-479f-8bfc-d6902f1cc5c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:20.495163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1c2e02ce-41c7-41b0-b46d-ac7dfe93941b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:20.497407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1c2e02ce-41c7-41b0-b46d-ac7dfe93941b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:20.500713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c11450d-0960-479f-8bfc-d6902f1cc5c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:20.501166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c11450d-0960-479f-8bfc-d6902f1cc5c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:20.501931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c11450d-0960-479f-8bfc-d6902f1cc5c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:20.502361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c11450d-0960-479f-8bfc-d6902f1cc5c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:20.504022 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c2e02ce-41c7-41b0-b46d-ac7dfe93941b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:20.504470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c2e02ce-41c7-41b0-b46d-ac7dfe93941b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:20.505219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c2e02ce-41c7-41b0-b46d-ac7dfe93941b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:20.505653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c2e02ce-41c7-41b0-b46d-ac7dfe93941b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:20.532861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7c11450d-0960-479f-8bfc-d6902f1cc5c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047918 Jul 26 18:42:20.533637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1127/2225] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:20 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:20.536256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1c2e02ce-41c7-41b0-b46d-ac7dfe93941b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046811 Jul 26 18:42:20.536811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1099/2226] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:20 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:21.549772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-56f9abe2-84f5-4f99-9174-8acb3c238fe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:21.553094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bfcf060b-08f0-4c7c-aa72-9411db686c8d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:21.553820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-56f9abe2-84f5-4f99-9174-8acb3c238fe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:21.556577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bfcf060b-08f0-4c7c-aa72-9411db686c8d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:21.564192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-56f9abe2-84f5-4f99-9174-8acb3c238fe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:21.564958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-56f9abe2-84f5-4f99-9174-8acb3c238fe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:21.566256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-56f9abe2-84f5-4f99-9174-8acb3c238fe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:21.566973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-56f9abe2-84f5-4f99-9174-8acb3c238fe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:21.567529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfcf060b-08f0-4c7c-aa72-9411db686c8d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:21.568271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfcf060b-08f0-4c7c-aa72-9411db686c8d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:21.569616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfcf060b-08f0-4c7c-aa72-9411db686c8d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:21.570748 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfcf060b-08f0-4c7c-aa72-9411db686c8d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:21.598984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-56f9abe2-84f5-4f99-9174-8acb3c238fe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055900 Jul 26 18:42:21.603087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1128/2227] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:21 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:21.604301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bfcf060b-08f0-4c7c-aa72-9411db686c8d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058211 Jul 26 18:42:21.604853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1100/2228] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:22.614008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ecf47b0d-0ab5-418c-9227-9669c2288e57 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:22.616682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ecf47b0d-0ab5-418c-9227-9669c2288e57 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:22.616890 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e01097c9-4aa6-419e-a44a-b9e5d376d05c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:22.619291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e01097c9-4aa6-419e-a44a-b9e5d376d05c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:22.624022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ecf47b0d-0ab5-418c-9227-9669c2288e57 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:22.624470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ecf47b0d-0ab5-418c-9227-9669c2288e57 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:22.625244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ecf47b0d-0ab5-418c-9227-9669c2288e57 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:22.625676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ecf47b0d-0ab5-418c-9227-9669c2288e57 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:22.626245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e01097c9-4aa6-419e-a44a-b9e5d376d05c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:22.626686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e01097c9-4aa6-419e-a44a-b9e5d376d05c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:22.627482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e01097c9-4aa6-419e-a44a-b9e5d376d05c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:22.627915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e01097c9-4aa6-419e-a44a-b9e5d376d05c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:22.655174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ecf47b0d-0ab5-418c-9227-9669c2288e57 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046212 Jul 26 18:42:22.655733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1129/2229] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:22 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:22.656435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e01097c9-4aa6-419e-a44a-b9e5d376d05c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044445 Jul 26 18:42:22.656980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1101/2230] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:23.668129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1dc9373e-b24b-41e5-90cd-cb9e0591a346 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:23.668722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-481fb381-67fb-4e5c-b56a-747040a4dc50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:23.670287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1dc9373e-b24b-41e5-90cd-cb9e0591a346 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:23.670823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-481fb381-67fb-4e5c-b56a-747040a4dc50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:23.677254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1dc9373e-b24b-41e5-90cd-cb9e0591a346 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:23.677704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1dc9373e-b24b-41e5-90cd-cb9e0591a346 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:23.677869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-481fb381-67fb-4e5c-b56a-747040a4dc50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:23.678283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-481fb381-67fb-4e5c-b56a-747040a4dc50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:23.678443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1dc9373e-b24b-41e5-90cd-cb9e0591a346 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:23.678882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1dc9373e-b24b-41e5-90cd-cb9e0591a346 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:23.679077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-481fb381-67fb-4e5c-b56a-747040a4dc50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:23.679607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-481fb381-67fb-4e5c-b56a-747040a4dc50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:23.708598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1dc9373e-b24b-41e5-90cd-cb9e0591a346 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Jul 26 18:42:23.709438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1130/2231] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:23 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:23.712754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-481fb381-67fb-4e5c-b56a-747040a4dc50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047903 Jul 26 18:42:23.713324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1102/2232] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:23 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:24.725452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7f385ecb-b9a1-4d54-9f9f-1ea9e5321018 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:24.728317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f09f8b5f-8c52-4e1d-ba08-f5816f75a2c1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:24.728777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7f385ecb-b9a1-4d54-9f9f-1ea9e5321018 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:24.730414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f09f8b5f-8c52-4e1d-ba08-f5816f75a2c1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:24.735452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f385ecb-b9a1-4d54-9f9f-1ea9e5321018 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:24.735898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f385ecb-b9a1-4d54-9f9f-1ea9e5321018 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:24.736659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f385ecb-b9a1-4d54-9f9f-1ea9e5321018 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:24.737083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f385ecb-b9a1-4d54-9f9f-1ea9e5321018 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:24.737459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f09f8b5f-8c52-4e1d-ba08-f5816f75a2c1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:24.738041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f09f8b5f-8c52-4e1d-ba08-f5816f75a2c1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:24.738847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f09f8b5f-8c52-4e1d-ba08-f5816f75a2c1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:24.739318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f09f8b5f-8c52-4e1d-ba08-f5816f75a2c1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:24.766733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7f385ecb-b9a1-4d54-9f9f-1ea9e5321018 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047962 Jul 26 18:42:24.767401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1131/2233] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:24 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:24.769440 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f09f8b5f-8c52-4e1d-ba08-f5816f75a2c1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047193 Jul 26 18:42:24.770003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1103/2234] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:24 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:25.781941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bc98c4b3-f91b-4df7-805e-e66efd18c8b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:25.784323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-48cde651-952c-48fc-962c-4f712eb5243b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:25.784874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bc98c4b3-f91b-4df7-805e-e66efd18c8b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:25.786921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-48cde651-952c-48fc-962c-4f712eb5243b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:25.793545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc98c4b3-f91b-4df7-805e-e66efd18c8b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:25.794101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc98c4b3-f91b-4df7-805e-e66efd18c8b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:25.795070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc98c4b3-f91b-4df7-805e-e66efd18c8b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:25.795374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-48cde651-952c-48fc-962c-4f712eb5243b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:25.795569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc98c4b3-f91b-4df7-805e-e66efd18c8b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:25.795931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-48cde651-952c-48fc-962c-4f712eb5243b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:25.796869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-48cde651-952c-48fc-962c-4f712eb5243b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:25.797394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-48cde651-952c-48fc-962c-4f712eb5243b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:25.826989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bc98c4b3-f91b-4df7-805e-e66efd18c8b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050287 Jul 26 18:42:25.827576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1132/2235] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:25 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:25.828301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-48cde651-952c-48fc-962c-4f712eb5243b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049164 Jul 26 18:42:25.828936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1104/2236] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:25 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:26.843777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6dd53662-5d56-4c26-9968-f081482c29fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:26.844918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e3eb2742-7ae7-4b55-aed2-d8f255c13e7e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:26.847260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6dd53662-5d56-4c26-9968-f081482c29fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:26.848398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e3eb2742-7ae7-4b55-aed2-d8f255c13e7e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:26.856067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6dd53662-5d56-4c26-9968-f081482c29fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:26.856503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3eb2742-7ae7-4b55-aed2-d8f255c13e7e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:26.856668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6dd53662-5d56-4c26-9968-f081482c29fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:26.856960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3eb2742-7ae7-4b55-aed2-d8f255c13e7e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:26.857270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6dd53662-5d56-4c26-9968-f081482c29fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:26.857703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6dd53662-5d56-4c26-9968-f081482c29fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:26.857860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3eb2742-7ae7-4b55-aed2-d8f255c13e7e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:26.858129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3eb2742-7ae7-4b55-aed2-d8f255c13e7e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:26.888088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e3eb2742-7ae7-4b55-aed2-d8f255c13e7e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049651 Jul 26 18:42:26.888626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1105/2237] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:26 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:26.888783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6dd53662-5d56-4c26-9968-f081482c29fd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051755 Jul 26 18:42:26.889321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1133/2238] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:26 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:27.905592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d95d4e79-ad7c-41cc-a036-ad16b9fbe148 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:27.906448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c0b4d151-a34d-48b7-aa88-9beaa2618c6c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:27.909157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c0b4d151-a34d-48b7-aa88-9beaa2618c6c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:27.909449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d95d4e79-ad7c-41cc-a036-ad16b9fbe148 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:27.919493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d95d4e79-ad7c-41cc-a036-ad16b9fbe148 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:27.919870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c0b4d151-a34d-48b7-aa88-9beaa2618c6c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:27.920242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d95d4e79-ad7c-41cc-a036-ad16b9fbe148 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:27.920603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c0b4d151-a34d-48b7-aa88-9beaa2618c6c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:27.921538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d95d4e79-ad7c-41cc-a036-ad16b9fbe148 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:27.921895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c0b4d151-a34d-48b7-aa88-9beaa2618c6c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:27.922283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d95d4e79-ad7c-41cc-a036-ad16b9fbe148 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:27.922542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c0b4d151-a34d-48b7-aa88-9beaa2618c6c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:27.954854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d95d4e79-ad7c-41cc-a036-ad16b9fbe148 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056698 Jul 26 18:42:27.955453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1106/2239] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:27 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:27.955610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c0b4d151-a34d-48b7-aa88-9beaa2618c6c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056348 Jul 26 18:42:27.955993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1134/2240] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:27 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:28.971496 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9b3a7fca-d579-4a08-93e1-c8e8cea2e700 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:28.972423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-832c3610-c0b9-436c-86df-f599011c3371 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:28.974935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9b3a7fca-d579-4a08-93e1-c8e8cea2e700 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:28.975226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-832c3610-c0b9-436c-86df-f599011c3371 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:28.982688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b3a7fca-d579-4a08-93e1-c8e8cea2e700 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:28.982904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-832c3610-c0b9-436c-86df-f599011c3371 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:28.983165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-832c3610-c0b9-436c-86df-f599011c3371 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:28.983324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b3a7fca-d579-4a08-93e1-c8e8cea2e700 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:28.983930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b3a7fca-d579-4a08-93e1-c8e8cea2e700 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:28.984077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-832c3610-c0b9-436c-86df-f599011c3371 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:28.984362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-832c3610-c0b9-436c-86df-f599011c3371 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:28.984519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b3a7fca-d579-4a08-93e1-c8e8cea2e700 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:29.014094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-832c3610-c0b9-436c-86df-f599011c3371 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048995 Jul 26 18:42:29.014355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9b3a7fca-d579-4a08-93e1-c8e8cea2e700 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049353 Jul 26 18:42:29.014909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1107/2241] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:28 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:29.015556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1135/2242] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:28 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:30.029765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-19a03c4f-84e5-4580-80fe-0b48aee2ee8c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:30.030441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f88459fa-a0b1-44f3-9500-2e5db3055437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:30.032379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f88459fa-a0b1-44f3-9500-2e5db3055437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:30.032588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-19a03c4f-84e5-4580-80fe-0b48aee2ee8c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:30.040202 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f88459fa-a0b1-44f3-9500-2e5db3055437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:30.040436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-19a03c4f-84e5-4580-80fe-0b48aee2ee8c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:30.040732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f88459fa-a0b1-44f3-9500-2e5db3055437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:30.040928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-19a03c4f-84e5-4580-80fe-0b48aee2ee8c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:30.041623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f88459fa-a0b1-44f3-9500-2e5db3055437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:30.041772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-19a03c4f-84e5-4580-80fe-0b48aee2ee8c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:30.042140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f88459fa-a0b1-44f3-9500-2e5db3055437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:30.042264 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-19a03c4f-84e5-4580-80fe-0b48aee2ee8c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:30.073532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f88459fa-a0b1-44f3-9500-2e5db3055437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048362 Jul 26 18:42:30.073942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-19a03c4f-84e5-4580-80fe-0b48aee2ee8c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048855 Jul 26 18:42:30.074128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1136/2243] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:30 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:30.074553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1108/2244] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:30 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:31.088807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e34e679e-c381-4196-afd1-587efec8b61c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:31.089400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6920cfe1-126d-42cb-ae4b-cbd6a2301ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:31.090960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6920cfe1-126d-42cb-ae4b-cbd6a2301ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:31.091129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e34e679e-c381-4196-afd1-587efec8b61c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:31.093349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=70 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:42:31.097973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6920cfe1-126d-42cb-ae4b-cbd6a2301ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:31.098448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6920cfe1-126d-42cb-ae4b-cbd6a2301ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:31.099236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e34e679e-c381-4196-afd1-587efec8b61c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:31.099355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6920cfe1-126d-42cb-ae4b-cbd6a2301ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:31.099668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6920cfe1-126d-42cb-ae4b-cbd6a2301ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:31.099819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e34e679e-c381-4196-afd1-587efec8b61c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:31.100434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e34e679e-c381-4196-afd1-587efec8b61c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:31.100862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e34e679e-c381-4196-afd1-587efec8b61c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:31.130168 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6920cfe1-126d-42cb-ae4b-cbd6a2301ae1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046794 Jul 26 18:42:31.130698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e34e679e-c381-4196-afd1-587efec8b61c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047398 Jul 26 18:42:31.130901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1109/2245] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:31 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:31.131291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1137/2246] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:31 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:32.146616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8183a3ff-7c9d-48a5-b94f-e26f39ba6244 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:32.147625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9c53726f-05c2-4ccd-ab26-0bcbfb5d4878 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:32.150489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8183a3ff-7c9d-48a5-b94f-e26f39ba6244 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:32.150759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9c53726f-05c2-4ccd-ab26-0bcbfb5d4878 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:32.154301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=70 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:42:32.161346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c53726f-05c2-4ccd-ab26-0bcbfb5d4878 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:32.162096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c53726f-05c2-4ccd-ab26-0bcbfb5d4878 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:32.163441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c53726f-05c2-4ccd-ab26-0bcbfb5d4878 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:32.163873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8183a3ff-7c9d-48a5-b94f-e26f39ba6244 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:32.164119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c53726f-05c2-4ccd-ab26-0bcbfb5d4878 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:32.164677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8183a3ff-7c9d-48a5-b94f-e26f39ba6244 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:32.165451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8183a3ff-7c9d-48a5-b94f-e26f39ba6244 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:32.165874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8183a3ff-7c9d-48a5-b94f-e26f39ba6244 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:32.194761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9c53726f-05c2-4ccd-ab26-0bcbfb5d4878 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054554 Jul 26 18:42:32.195363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1138/2247] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:32 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:32.195535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8183a3ff-7c9d-48a5-b94f-e26f39ba6244 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055383 Jul 26 18:42:32.196145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1110/2248] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:33.211875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0b058f0b-bc06-4261-be6c-c816e65c9719 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:33.212443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5a80d164-28bf-4951-ba9d-410c5a057dca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:33.213934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5a80d164-28bf-4951-ba9d-410c5a057dca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:33.214078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0b058f0b-bc06-4261-be6c-c816e65c9719 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:33.220736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b058f0b-bc06-4261-be6c-c816e65c9719 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:33.221060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a80d164-28bf-4951-ba9d-410c5a057dca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:33.221259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b058f0b-bc06-4261-be6c-c816e65c9719 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:33.221605 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a80d164-28bf-4951-ba9d-410c5a057dca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:33.221977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b058f0b-bc06-4261-be6c-c816e65c9719 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:33.222380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a80d164-28bf-4951-ba9d-410c5a057dca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:33.222527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b058f0b-bc06-4261-be6c-c816e65c9719 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:33.222812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a80d164-28bf-4951-ba9d-410c5a057dca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:33.247958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:42:33.252577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5a80d164-28bf-4951-ba9d-410c5a057dca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047329 Jul 26 18:42:33.253373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1111/2249] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:33 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:33.253509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0b058f0b-bc06-4261-be6c-c816e65c9719 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048164 Jul 26 18:42:33.253986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1139/2250] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:33 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:34.269287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0c4fa1ca-4459-4cd2-b89f-1364088634da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:34.270346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-85d9a045-e3a5-4e29-b69c-3590ba237d13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:34.272801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0c4fa1ca-4459-4cd2-b89f-1364088634da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:34.273421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-85d9a045-e3a5-4e29-b69c-3590ba237d13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:34.283784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85d9a045-e3a5-4e29-b69c-3590ba237d13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:34.284696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85d9a045-e3a5-4e29-b69c-3590ba237d13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:34.285804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85d9a045-e3a5-4e29-b69c-3590ba237d13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:34.286533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85d9a045-e3a5-4e29-b69c-3590ba237d13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:34.287344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c4fa1ca-4459-4cd2-b89f-1364088634da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:34.288091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c4fa1ca-4459-4cd2-b89f-1364088634da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:34.289363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c4fa1ca-4459-4cd2-b89f-1364088634da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:34.289971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c4fa1ca-4459-4cd2-b89f-1364088634da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:34.319043 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-85d9a045-e3a5-4e29-b69c-3590ba237d13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056419 Jul 26 18:42:34.319439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0c4fa1ca-4459-4cd2-b89f-1364088634da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056598 Jul 26 18:42:34.320158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1140/2252] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:34 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:34.320297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1112/2252] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:34 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:34.557167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:42:34.557357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 18:42:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:42:35.334570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e960c60e-d3b1-4e1a-ad8d-bbbe21df702f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:35.335411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-048b9c23-c36d-41a8-97a8-7cc5fdca1c9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:35.337374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e960c60e-d3b1-4e1a-ad8d-bbbe21df702f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:35.337695 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-048b9c23-c36d-41a8-97a8-7cc5fdca1c9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:35.344334 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-048b9c23-c36d-41a8-97a8-7cc5fdca1c9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:35.344532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e960c60e-d3b1-4e1a-ad8d-bbbe21df702f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:35.344779 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-048b9c23-c36d-41a8-97a8-7cc5fdca1c9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:35.344943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e960c60e-d3b1-4e1a-ad8d-bbbe21df702f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:35.345534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-048b9c23-c36d-41a8-97a8-7cc5fdca1c9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:35.345683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e960c60e-d3b1-4e1a-ad8d-bbbe21df702f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:35.345958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-048b9c23-c36d-41a8-97a8-7cc5fdca1c9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:35.346106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e960c60e-d3b1-4e1a-ad8d-bbbe21df702f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:35.375740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-048b9c23-c36d-41a8-97a8-7cc5fdca1c9e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046865 Jul 26 18:42:35.376099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e960c60e-d3b1-4e1a-ad8d-bbbe21df702f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048075 Jul 26 18:42:35.377377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1113/2253] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:35.377558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1141/2254] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:35 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:36.392291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-acf6fe92-1ff3-48be-bbaf-c42624bfca9c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:36.393147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-23f8f75b-45ce-4e1d-b49e-445422d68a97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:36.395702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-acf6fe92-1ff3-48be-bbaf-c42624bfca9c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:36.396266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-23f8f75b-45ce-4e1d-b49e-445422d68a97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:36.406967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-acf6fe92-1ff3-48be-bbaf-c42624bfca9c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:36.407420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23f8f75b-45ce-4e1d-b49e-445422d68a97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:36.407722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-acf6fe92-1ff3-48be-bbaf-c42624bfca9c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:36.408168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23f8f75b-45ce-4e1d-b49e-445422d68a97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:36.409033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-acf6fe92-1ff3-48be-bbaf-c42624bfca9c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:36.409424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23f8f75b-45ce-4e1d-b49e-445422d68a97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:36.409754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-acf6fe92-1ff3-48be-bbaf-c42624bfca9c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:36.410143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23f8f75b-45ce-4e1d-b49e-445422d68a97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:36.436247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:42:36.441200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-23f8f75b-45ce-4e1d-b49e-445422d68a97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054974 Jul 26 18:42:36.441741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1142/2255] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:36 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:36.442962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-acf6fe92-1ff3-48be-bbaf-c42624bfca9c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057592 Jul 26 18:42:36.443543 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1114/2256] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:36 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:37.458645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-acc8073e-26ed-48d5-a1e0-fb8452d9d892 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:37.459650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7d724dfc-f858-4fcb-819c-9567af70d887 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:37.462374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-acc8073e-26ed-48d5-a1e0-fb8452d9d892 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:37.463184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7d724dfc-f858-4fcb-819c-9567af70d887 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:37.473706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d724dfc-f858-4fcb-819c-9567af70d887 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:37.474407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d724dfc-f858-4fcb-819c-9567af70d887 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:37.474663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-acc8073e-26ed-48d5-a1e0-fb8452d9d892 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:37.475388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-acc8073e-26ed-48d5-a1e0-fb8452d9d892 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:37.475673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d724dfc-f858-4fcb-819c-9567af70d887 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:37.476416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d724dfc-f858-4fcb-819c-9567af70d887 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:37.476657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-acc8073e-26ed-48d5-a1e0-fb8452d9d892 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:37.477341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-acc8073e-26ed-48d5-a1e0-fb8452d9d892 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:37.506028 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7d724dfc-f858-4fcb-819c-9567af70d887 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053423 Jul 26 18:42:37.506594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1115/2257] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:37 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:37.507123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-acc8073e-26ed-48d5-a1e0-fb8452d9d892 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055284 Jul 26 18:42:37.507725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1143/2258] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:37 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:38.522855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-54e013e9-1c61-491b-a96c-137aa94d45f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:38.524093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8de6bc2e-7252-4a41-8088-69ac8f4eb1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:38.525692 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-54e013e9-1c61-491b-a96c-137aa94d45f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:38.525856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8de6bc2e-7252-4a41-8088-69ac8f4eb1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:38.532559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8de6bc2e-7252-4a41-8088-69ac8f4eb1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:38.532721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-54e013e9-1c61-491b-a96c-137aa94d45f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:38.533033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-54e013e9-1c61-491b-a96c-137aa94d45f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:38.533212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8de6bc2e-7252-4a41-8088-69ac8f4eb1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:38.533791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8de6bc2e-7252-4a41-8088-69ac8f4eb1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:38.534133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-54e013e9-1c61-491b-a96c-137aa94d45f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:38.534283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8de6bc2e-7252-4a41-8088-69ac8f4eb1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:38.534563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-54e013e9-1c61-491b-a96c-137aa94d45f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:38.565604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8de6bc2e-7252-4a41-8088-69ac8f4eb1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048890 Jul 26 18:42:38.565896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-54e013e9-1c61-491b-a96c-137aa94d45f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049577 Jul 26 18:42:38.566560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1116/2260] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:38 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:38.566698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1144/2260] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:38 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:39.581884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-55ef91a4-704d-41cb-8ee8-ba89349c5437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:39.582740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2b54003d-0299-4ac1-818c-177233a77b99 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:39.585342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-55ef91a4-704d-41cb-8ee8-ba89349c5437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:39.586182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2b54003d-0299-4ac1-818c-177233a77b99 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:39.596574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b54003d-0299-4ac1-818c-177233a77b99 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:39.596865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55ef91a4-704d-41cb-8ee8-ba89349c5437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:39.597317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b54003d-0299-4ac1-818c-177233a77b99 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:39.597581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55ef91a4-704d-41cb-8ee8-ba89349c5437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:39.598624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b54003d-0299-4ac1-818c-177233a77b99 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:39.598869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55ef91a4-704d-41cb-8ee8-ba89349c5437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:39.599409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b54003d-0299-4ac1-818c-177233a77b99 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:39.599676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55ef91a4-704d-41cb-8ee8-ba89349c5437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:39.630706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2b54003d-0299-4ac1-818c-177233a77b99 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055338 Jul 26 18:42:39.631301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1145/2261] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:39 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:39.631463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-55ef91a4-704d-41cb-8ee8-ba89349c5437 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055914 Jul 26 18:42:39.632092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1117/2262] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:39 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:40.647345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3978d586-c5f8-40aa-a02c-6e96b7ee0e86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:40.648513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7cfbf899-c2b7-4cad-b94f-8c64ad556af9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:40.650361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7cfbf899-c2b7-4cad-b94f-8c64ad556af9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:40.650507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3978d586-c5f8-40aa-a02c-6e96b7ee0e86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:40.657336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7cfbf899-c2b7-4cad-b94f-8c64ad556af9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:40.658273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7cfbf899-c2b7-4cad-b94f-8c64ad556af9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:40.658622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3978d586-c5f8-40aa-a02c-6e96b7ee0e86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:40.659064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7cfbf899-c2b7-4cad-b94f-8c64ad556af9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:40.659205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3978d586-c5f8-40aa-a02c-6e96b7ee0e86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:40.659488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7cfbf899-c2b7-4cad-b94f-8c64ad556af9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:40.659984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3978d586-c5f8-40aa-a02c-6e96b7ee0e86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:40.660421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3978d586-c5f8-40aa-a02c-6e96b7ee0e86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:40.691976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3978d586-c5f8-40aa-a02c-6e96b7ee0e86 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051219 Jul 26 18:42:40.692339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7cfbf899-c2b7-4cad-b94f-8c64ad556af9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051564 Jul 26 18:42:40.696512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1146/2263] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:40 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:40.696669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1118/2264] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:40 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:41.703900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-298146a1-bf75-4244-92a2-56a834040a5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:41.704578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ca3793e5-881d-4806-b25e-875abcd6df30 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:41.706055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ca3793e5-881d-4806-b25e-875abcd6df30 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:41.706200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-298146a1-bf75-4244-92a2-56a834040a5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:41.713012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-298146a1-bf75-4244-92a2-56a834040a5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:41.713478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-298146a1-bf75-4244-92a2-56a834040a5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:41.713728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca3793e5-881d-4806-b25e-875abcd6df30 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:41.714155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca3793e5-881d-4806-b25e-875abcd6df30 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:41.714287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-298146a1-bf75-4244-92a2-56a834040a5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:41.714628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-298146a1-bf75-4244-92a2-56a834040a5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:41.714937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca3793e5-881d-4806-b25e-875abcd6df30 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:41.715427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca3793e5-881d-4806-b25e-875abcd6df30 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:41.744871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ca3793e5-881d-4806-b25e-875abcd6df30 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044843 Jul 26 18:42:41.746238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1147/2265] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:41 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:41.749054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-298146a1-bf75-4244-92a2-56a834040a5c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049070 Jul 26 18:42:41.749646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1119/2266] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:41 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:42.761591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2b7fb3cb-79ff-4ab1-96e6-c25bc6ccef51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:42.765183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e8bf012c-7914-41d6-9f5b-366b4c4325db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:42.766547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2b7fb3cb-79ff-4ab1-96e6-c25bc6ccef51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:42.768825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e8bf012c-7914-41d6-9f5b-366b4c4325db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:42.777925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8bf012c-7914-41d6-9f5b-366b4c4325db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:42.778138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b7fb3cb-79ff-4ab1-96e6-c25bc6ccef51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:42.778375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8bf012c-7914-41d6-9f5b-366b4c4325db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:42.778530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b7fb3cb-79ff-4ab1-96e6-c25bc6ccef51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:42.779168 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8bf012c-7914-41d6-9f5b-366b4c4325db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:42.779319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b7fb3cb-79ff-4ab1-96e6-c25bc6ccef51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:42.779605 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8bf012c-7914-41d6-9f5b-366b4c4325db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:42.779769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b7fb3cb-79ff-4ab1-96e6-c25bc6ccef51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:42.810260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e8bf012c-7914-41d6-9f5b-366b4c4325db tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051412 Jul 26 18:42:42.810495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2b7fb3cb-79ff-4ab1-96e6-c25bc6ccef51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055690 Jul 26 18:42:42.811118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1120/2267] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:42 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:42.811372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1148/2268] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:42 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:43.823349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9fd737b3-2ee4-48e7-80d5-3b300a61a06b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:43.825036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7593d3ef-bc2d-4fd5-89fb-75a5bbb8ef99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:43.825521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9fd737b3-2ee4-48e7-80d5-3b300a61a06b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:43.827207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7593d3ef-bc2d-4fd5-89fb-75a5bbb8ef99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:43.832665 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9fd737b3-2ee4-48e7-80d5-3b300a61a06b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:43.833113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9fd737b3-2ee4-48e7-80d5-3b300a61a06b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:43.833882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9fd737b3-2ee4-48e7-80d5-3b300a61a06b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:43.834027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7593d3ef-bc2d-4fd5-89fb-75a5bbb8ef99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:43.834299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9fd737b3-2ee4-48e7-80d5-3b300a61a06b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:43.834568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7593d3ef-bc2d-4fd5-89fb-75a5bbb8ef99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:43.835916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7593d3ef-bc2d-4fd5-89fb-75a5bbb8ef99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:43.837006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7593d3ef-bc2d-4fd5-89fb-75a5bbb8ef99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:43.866798 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9fd737b3-2ee4-48e7-80d5-3b300a61a06b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047390 Jul 26 18:42:43.867444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1121/2269] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:43.868646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7593d3ef-bc2d-4fd5-89fb-75a5bbb8ef99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048847 Jul 26 18:42:43.868646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1149/2270] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:43 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:42:44.880195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9f1e1288-689d-4b7d-a9f2-41c403d2b8b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:44.881009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2e10029a-5cac-404f-abd4-c2222da6388a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:44.882349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9f1e1288-689d-4b7d-a9f2-41c403d2b8b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:44.883253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2e10029a-5cac-404f-abd4-c2222da6388a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:44.889768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f1e1288-689d-4b7d-a9f2-41c403d2b8b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:44.889950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e10029a-5cac-404f-abd4-c2222da6388a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:44.890225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f1e1288-689d-4b7d-a9f2-41c403d2b8b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:44.890393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e10029a-5cac-404f-abd4-c2222da6388a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:44.890993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f1e1288-689d-4b7d-a9f2-41c403d2b8b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:44.891167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e10029a-5cac-404f-abd4-c2222da6388a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:44.891456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f1e1288-689d-4b7d-a9f2-41c403d2b8b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:44.891631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e10029a-5cac-404f-abd4-c2222da6388a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:44.921400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9f1e1288-689d-4b7d-a9f2-41c403d2b8b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Jul 26 18:42:44.921668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2e10029a-5cac-404f-abd4-c2222da6388a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044327 Jul 26 18:42:44.922197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1122/2271] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:44 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:44.922344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1150/2272] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:44 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:45.933472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c0a96444-bb9f-4cb0-a3ac-29a9ed1f19cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:45.934030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0b957a06-5fd2-405a-aa29-4b931e7d8cad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:45.936041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0b957a06-5fd2-405a-aa29-4b931e7d8cad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:45.936348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c0a96444-bb9f-4cb0-a3ac-29a9ed1f19cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:45.942962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0a96444-bb9f-4cb0-a3ac-29a9ed1f19cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:45.943225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b957a06-5fd2-405a-aa29-4b931e7d8cad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:45.943440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b957a06-5fd2-405a-aa29-4b931e7d8cad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:45.943568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0a96444-bb9f-4cb0-a3ac-29a9ed1f19cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:45.944162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b957a06-5fd2-405a-aa29-4b931e7d8cad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:45.944314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0a96444-bb9f-4cb0-a3ac-29a9ed1f19cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:45.944689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b957a06-5fd2-405a-aa29-4b931e7d8cad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:45.944840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c0a96444-bb9f-4cb0-a3ac-29a9ed1f19cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:45.976179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0b957a06-5fd2-405a-aa29-4b931e7d8cad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046256 Jul 26 18:42:45.976736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1151/2273] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:45 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:45.977604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c0a96444-bb9f-4cb0-a3ac-29a9ed1f19cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047976 Jul 26 18:42:45.978163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1123/2274] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:45 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:46.992763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a2acaa39-eb1e-4669-8dd1-51b0a4c9d0ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:46.993873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6626fd04-c719-4f78-9301-c20ba6ba0d41 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:46.996216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a2acaa39-eb1e-4669-8dd1-51b0a4c9d0ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:46.997340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6626fd04-c719-4f78-9301-c20ba6ba0d41 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:47.007079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2acaa39-eb1e-4669-8dd1-51b0a4c9d0ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:47.007850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2acaa39-eb1e-4669-8dd1-51b0a4c9d0ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:47.008199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6626fd04-c719-4f78-9301-c20ba6ba0d41 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:47.008594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6626fd04-c719-4f78-9301-c20ba6ba0d41 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:47.008761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2acaa39-eb1e-4669-8dd1-51b0a4c9d0ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:47.009185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2acaa39-eb1e-4669-8dd1-51b0a4c9d0ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:47.009339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6626fd04-c719-4f78-9301-c20ba6ba0d41 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:47.009741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6626fd04-c719-4f78-9301-c20ba6ba0d41 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:47.039509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a2acaa39-eb1e-4669-8dd1-51b0a4c9d0ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053334 Jul 26 18:42:47.040217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1152/2275] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:46 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:47.040606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6626fd04-c719-4f78-9301-c20ba6ba0d41 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053241 Jul 26 18:42:47.041164 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1124/2276] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:46 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:48.055841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-630c0eec-b2eb-4bb6-8918-30768c14bd54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:48.056399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bfbd1bc7-05a3-4e39-9ba2-8e943cbb2a00 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:48.057981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-630c0eec-b2eb-4bb6-8918-30768c14bd54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:48.058488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bfbd1bc7-05a3-4e39-9ba2-8e943cbb2a00 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:48.064823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-630c0eec-b2eb-4bb6-8918-30768c14bd54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:48.065297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-630c0eec-b2eb-4bb6-8918-30768c14bd54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:48.065447 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfbd1bc7-05a3-4e39-9ba2-8e943cbb2a00 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:48.065744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfbd1bc7-05a3-4e39-9ba2-8e943cbb2a00 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:48.066055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-630c0eec-b2eb-4bb6-8918-30768c14bd54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:48.066469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-630c0eec-b2eb-4bb6-8918-30768c14bd54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:48.066597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfbd1bc7-05a3-4e39-9ba2-8e943cbb2a00 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:48.066903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfbd1bc7-05a3-4e39-9ba2-8e943cbb2a00 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:48.096490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-630c0eec-b2eb-4bb6-8918-30768c14bd54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047151 Jul 26 18:42:48.097048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1153/2277] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:48 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:48.097217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bfbd1bc7-05a3-4e39-9ba2-8e943cbb2a00 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046768 Jul 26 18:42:48.097662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1125/2278] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:48 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:49.113231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-29689a79-03aa-45af-aebf-d4bdb7580d20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:49.114278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aa86cf8a-0c68-4fbc-bc2c-223865d2a19a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:49.116583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-29689a79-03aa-45af-aebf-d4bdb7580d20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:49.116833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aa86cf8a-0c68-4fbc-bc2c-223865d2a19a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:49.123873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa86cf8a-0c68-4fbc-bc2c-223865d2a19a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:49.124064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29689a79-03aa-45af-aebf-d4bdb7580d20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:49.124321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa86cf8a-0c68-4fbc-bc2c-223865d2a19a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:49.124480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29689a79-03aa-45af-aebf-d4bdb7580d20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:49.125077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa86cf8a-0c68-4fbc-bc2c-223865d2a19a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:49.125242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29689a79-03aa-45af-aebf-d4bdb7580d20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:49.125500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa86cf8a-0c68-4fbc-bc2c-223865d2a19a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:49.125678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29689a79-03aa-45af-aebf-d4bdb7580d20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:49.155739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aa86cf8a-0c68-4fbc-bc2c-223865d2a19a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049222 Jul 26 18:42:49.156003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-29689a79-03aa-45af-aebf-d4bdb7580d20 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049207 Jul 26 18:42:49.160190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1126/2279] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:49 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:49.160350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1154/2280] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:49 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:50.172419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-851bbc89-383f-43f8-8b40-724ebded2b1c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:50.173883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cee97847-9777-42b4-acc4-2c9b2429e97f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:50.176782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-851bbc89-383f-43f8-8b40-724ebded2b1c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:50.177749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cee97847-9777-42b4-acc4-2c9b2429e97f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:50.187679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-851bbc89-383f-43f8-8b40-724ebded2b1c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:50.188436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-851bbc89-383f-43f8-8b40-724ebded2b1c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:50.188706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cee97847-9777-42b4-acc4-2c9b2429e97f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:50.189628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cee97847-9777-42b4-acc4-2c9b2429e97f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:50.189877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-851bbc89-383f-43f8-8b40-724ebded2b1c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:50.190682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-851bbc89-383f-43f8-8b40-724ebded2b1c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:50.190923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cee97847-9777-42b4-acc4-2c9b2429e97f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:50.191642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cee97847-9777-42b4-acc4-2c9b2429e97f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:50.222381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-851bbc89-383f-43f8-8b40-724ebded2b1c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056797 Jul 26 18:42:50.222947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1127/2281] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:50 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:50.227150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cee97847-9777-42b4-acc4-2c9b2429e97f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056292 Jul 26 18:42:50.227150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1155/2282] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:50 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:51.235969 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-975c2952-7110-4b2c-8f42-fda09181ebe9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:51.237043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2be7b5aa-8538-43fd-a678-0768ceb649fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:51.238350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-975c2952-7110-4b2c-8f42-fda09181ebe9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:51.239415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2be7b5aa-8538-43fd-a678-0768ceb649fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:51.245951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-975c2952-7110-4b2c-8f42-fda09181ebe9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:51.246394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-975c2952-7110-4b2c-8f42-fda09181ebe9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:51.246551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2be7b5aa-8538-43fd-a678-0768ceb649fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:51.246999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2be7b5aa-8538-43fd-a678-0768ceb649fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:51.247203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-975c2952-7110-4b2c-8f42-fda09181ebe9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:51.247598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-975c2952-7110-4b2c-8f42-fda09181ebe9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:51.247752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2be7b5aa-8538-43fd-a678-0768ceb649fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:51.248206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2be7b5aa-8538-43fd-a678-0768ceb649fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:51.265645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:42:51.277654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-975c2952-7110-4b2c-8f42-fda09181ebe9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046128 Jul 26 18:42:51.278445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1128/2283] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:51.283189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2be7b5aa-8538-43fd-a678-0768ceb649fd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050421 Jul 26 18:42:51.284008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1156/2284] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:51 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:52.295095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-70f9ab0e-e7f9-46ed-966e-12f330f8777c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:52.298547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-70f9ab0e-e7f9-46ed-966e-12f330f8777c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:52.301319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-479bc056-fb5b-4aa6-802f-19cf7b502dec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:52.304989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-479bc056-fb5b-4aa6-802f-19cf7b502dec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:52.309288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70f9ab0e-e7f9-46ed-966e-12f330f8777c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:52.310032 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70f9ab0e-e7f9-46ed-966e-12f330f8777c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:52.311329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70f9ab0e-e7f9-46ed-966e-12f330f8777c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:52.312047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70f9ab0e-e7f9-46ed-966e-12f330f8777c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:52.316083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-479bc056-fb5b-4aa6-802f-19cf7b502dec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:52.316887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-479bc056-fb5b-4aa6-802f-19cf7b502dec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:52.318145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-479bc056-fb5b-4aa6-802f-19cf7b502dec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:52.318958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-479bc056-fb5b-4aa6-802f-19cf7b502dec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:52.346005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-70f9ab0e-e7f9-46ed-966e-12f330f8777c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057746 Jul 26 18:42:52.346569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1129/2285] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:52 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:52.349484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-479bc056-fb5b-4aa6-802f-19cf7b502dec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054698 Jul 26 18:42:52.350031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1157/2286] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:52 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:53.366029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-741f0db4-9693-4963-9ed2-f5f7a9fad7f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:53.366951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a0cd1992-edd8-49e5-a223-279663e47cfb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:53.368832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-741f0db4-9693-4963-9ed2-f5f7a9fad7f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:53.369929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a0cd1992-edd8-49e5-a223-279663e47cfb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:53.375551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-741f0db4-9693-4963-9ed2-f5f7a9fad7f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:53.375988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-741f0db4-9693-4963-9ed2-f5f7a9fad7f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:53.376358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0cd1992-edd8-49e5-a223-279663e47cfb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:53.376759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-741f0db4-9693-4963-9ed2-f5f7a9fad7f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:53.376871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0cd1992-edd8-49e5-a223-279663e47cfb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:53.377187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-741f0db4-9693-4963-9ed2-f5f7a9fad7f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:53.377559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0cd1992-edd8-49e5-a223-279663e47cfb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:53.377991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0cd1992-edd8-49e5-a223-279663e47cfb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:53.408795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-741f0db4-9693-4963-9ed2-f5f7a9fad7f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052526 Jul 26 18:42:53.409071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a0cd1992-edd8-49e5-a223-279663e47cfb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049320 Jul 26 18:42:53.416999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1158/2288] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:53 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:53.417164 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1130/2288] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:53 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:54.422537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-67f021eb-2cab-4236-a77e-f4311417079c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:54.424773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-67f021eb-2cab-4236-a77e-f4311417079c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:54.425510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b1c0cd63-8671-46c7-86ce-f84349b98ffd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:54.427861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b1c0cd63-8671-46c7-86ce-f84349b98ffd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:54.432246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-67f021eb-2cab-4236-a77e-f4311417079c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:54.432717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-67f021eb-2cab-4236-a77e-f4311417079c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:54.434442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-67f021eb-2cab-4236-a77e-f4311417079c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:54.434894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-67f021eb-2cab-4236-a77e-f4311417079c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:54.435840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b1c0cd63-8671-46c7-86ce-f84349b98ffd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:54.436317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b1c0cd63-8671-46c7-86ce-f84349b98ffd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:54.437127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b1c0cd63-8671-46c7-86ce-f84349b98ffd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:54.437580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b1c0cd63-8671-46c7-86ce-f84349b98ffd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:54.451915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:42:54.466024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-67f021eb-2cab-4236-a77e-f4311417079c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047878 Jul 26 18:42:54.466583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1159/2289] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:54 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:54.468880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b1c0cd63-8671-46c7-86ce-f84349b98ffd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047896 Jul 26 18:42:54.469437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1131/2290] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:54 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:55.479603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3a51e870-8131-4645-bbca-ea84060abeaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:55.481486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-60ed87d8-adc4-443d-ba68-0718438b287a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:55.481894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3a51e870-8131-4645-bbca-ea84060abeaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:55.483643 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-60ed87d8-adc4-443d-ba68-0718438b287a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:55.488589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a51e870-8131-4645-bbca-ea84060abeaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:55.489037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a51e870-8131-4645-bbca-ea84060abeaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:55.489796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a51e870-8131-4645-bbca-ea84060abeaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:55.490227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a51e870-8131-4645-bbca-ea84060abeaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:55.491216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60ed87d8-adc4-443d-ba68-0718438b287a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:55.491677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60ed87d8-adc4-443d-ba68-0718438b287a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:55.492486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60ed87d8-adc4-443d-ba68-0718438b287a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:55.492915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-60ed87d8-adc4-443d-ba68-0718438b287a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:55.519790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3a51e870-8131-4645-bbca-ea84060abeaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044954 Jul 26 18:42:55.520346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1160/2291] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:55 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:55.522020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-60ed87d8-adc4-443d-ba68-0718438b287a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044367 Jul 26 18:42:55.522583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1132/2292] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:56.537270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5c5ce24f-6f1c-4d68-aa3f-57d49d71cc55 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:56.538457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-196c7d73-dfc4-4fd8-9dff-ba7dd8594a69 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:56.540635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5c5ce24f-6f1c-4d68-aa3f-57d49d71cc55 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:56.542081 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-196c7d73-dfc4-4fd8-9dff-ba7dd8594a69 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:56.551678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c5ce24f-6f1c-4d68-aa3f-57d49d71cc55 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:56.552423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c5ce24f-6f1c-4d68-aa3f-57d49d71cc55 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:56.552694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-196c7d73-dfc4-4fd8-9dff-ba7dd8594a69 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:56.553375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-196c7d73-dfc4-4fd8-9dff-ba7dd8594a69 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:56.553635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c5ce24f-6f1c-4d68-aa3f-57d49d71cc55 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:56.554390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c5ce24f-6f1c-4d68-aa3f-57d49d71cc55 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:56.554713 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-196c7d73-dfc4-4fd8-9dff-ba7dd8594a69 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:56.555243 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-196c7d73-dfc4-4fd8-9dff-ba7dd8594a69 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:56.584185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-196c7d73-dfc4-4fd8-9dff-ba7dd8594a69 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052241 Jul 26 18:42:56.584448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5c5ce24f-6f1c-4d68-aa3f-57d49d71cc55 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054002 Jul 26 18:42:56.584750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1133/2294] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:56 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:56.585014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1161/2294] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:56 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:57.601077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-18471859-348f-44c3-b470-168432994152 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:57.602028 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-11b77fc7-ef95-4916-a2fd-47ac4fc2451f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:57.603454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-18471859-348f-44c3-b470-168432994152 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:57.603615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-11b77fc7-ef95-4916-a2fd-47ac4fc2451f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:57.609920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11b77fc7-ef95-4916-a2fd-47ac4fc2451f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:57.610236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18471859-348f-44c3-b470-168432994152 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:57.610392 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11b77fc7-ef95-4916-a2fd-47ac4fc2451f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:57.610685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18471859-348f-44c3-b470-168432994152 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:57.611144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11b77fc7-ef95-4916-a2fd-47ac4fc2451f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:57.611441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18471859-348f-44c3-b470-168432994152 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:57.611554 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11b77fc7-ef95-4916-a2fd-47ac4fc2451f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:57.611893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18471859-348f-44c3-b470-168432994152 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:57.641322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-11b77fc7-ef95-4916-a2fd-47ac4fc2451f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047232 Jul 26 18:42:57.641478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-18471859-348f-44c3-b470-168432994152 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047216 Jul 26 18:42:57.641896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1134/2296] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:57 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:57.642030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1162/2296] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:57 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:58.654287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f3a7fedc-7e5a-455e-b75c-ffd82eb13b3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:58.654845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fe86972b-a9a0-42d2-b3bd-b41f35cfeecd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:58.656537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f3a7fedc-7e5a-455e-b75c-ffd82eb13b3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:58.657594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fe86972b-a9a0-42d2-b3bd-b41f35cfeecd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:58.663576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3a7fedc-7e5a-455e-b75c-ffd82eb13b3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:58.663815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe86972b-a9a0-42d2-b3bd-b41f35cfeecd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:58.664022 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3a7fedc-7e5a-455e-b75c-ffd82eb13b3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:58.664279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe86972b-a9a0-42d2-b3bd-b41f35cfeecd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:58.664785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3a7fedc-7e5a-455e-b75c-ffd82eb13b3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:58.665013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe86972b-a9a0-42d2-b3bd-b41f35cfeecd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:58.665197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3a7fedc-7e5a-455e-b75c-ffd82eb13b3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:58.665439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe86972b-a9a0-42d2-b3bd-b41f35cfeecd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:58.697765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f3a7fedc-7e5a-455e-b75c-ffd82eb13b3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047577 Jul 26 18:42:58.697947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fe86972b-a9a0-42d2-b3bd-b41f35cfeecd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 Jul 26 18:42:58.698532 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1135/2297] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:58 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:58.702354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1163/2298] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:58 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:59.714449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-498ca178-7e91-49af-890d-de46777c15dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:59.715373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-006d368b-5d86-4d27-a4d2-ed945e94a924 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:42:59.717937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-498ca178-7e91-49af-890d-de46777c15dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:59.718428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-006d368b-5d86-4d27-a4d2-ed945e94a924 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:42:59.728359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-006d368b-5d86-4d27-a4d2-ed945e94a924 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:59.728639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-498ca178-7e91-49af-890d-de46777c15dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:59.728760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-498ca178-7e91-49af-890d-de46777c15dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:59.728856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-006d368b-5d86-4d27-a4d2-ed945e94a924 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:59.729544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-006d368b-5d86-4d27-a4d2-ed945e94a924 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:59.729696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-498ca178-7e91-49af-890d-de46777c15dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:42:59.729967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-006d368b-5d86-4d27-a4d2-ed945e94a924 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:59.730127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-498ca178-7e91-49af-890d-de46777c15dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:42:59.759963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-006d368b-5d86-4d27-a4d2-ed945e94a924 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052463 Jul 26 18:42:59.760171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-498ca178-7e91-49af-890d-de46777c15dd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052530 Jul 26 18:42:59.760757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1164/2300] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:59 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:42:59.760906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1136/2300] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:42:59 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:00.776275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7df9133e-9637-4b78-8d9d-0ec3859e3e2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:00.776780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-08d3b4d3-527d-4b91-913b-3a80be998097 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:00.778385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7df9133e-9637-4b78-8d9d-0ec3859e3e2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:00.778636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-08d3b4d3-527d-4b91-913b-3a80be998097 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:00.785735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7df9133e-9637-4b78-8d9d-0ec3859e3e2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:00.785973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08d3b4d3-527d-4b91-913b-3a80be998097 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:00.786218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08d3b4d3-527d-4b91-913b-3a80be998097 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:00.786335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7df9133e-9637-4b78-8d9d-0ec3859e3e2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:00.786964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08d3b4d3-527d-4b91-913b-3a80be998097 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:00.787435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08d3b4d3-527d-4b91-913b-3a80be998097 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:00.787598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7df9133e-9637-4b78-8d9d-0ec3859e3e2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:00.787881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7df9133e-9637-4b78-8d9d-0ec3859e3e2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:00.818313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7df9133e-9637-4b78-8d9d-0ec3859e3e2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047869 Jul 26 18:43:00.818817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-08d3b4d3-527d-4b91-913b-3a80be998097 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048476 Jul 26 18:43:00.818998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1165/2301] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:00 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:00.823237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1137/2302] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:00 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:01.835087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9f3c1993-a0cb-4c6d-8cf9-667e4a694139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:01.835891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6929eb7f-74f5-463e-8ded-061314bd65ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:01.838364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6929eb7f-74f5-463e-8ded-061314bd65ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:01.838724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9f3c1993-a0cb-4c6d-8cf9-667e4a694139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:01.842075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=58 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:43:01.849456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6929eb7f-74f5-463e-8ded-061314bd65ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:01.850188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6929eb7f-74f5-463e-8ded-061314bd65ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:01.851307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9f3c1993-a0cb-4c6d-8cf9-667e4a694139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:01.851551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6929eb7f-74f5-463e-8ded-061314bd65ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:01.852053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9f3c1993-a0cb-4c6d-8cf9-667e4a694139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:01.852266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6929eb7f-74f5-463e-8ded-061314bd65ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:01.853306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9f3c1993-a0cb-4c6d-8cf9-667e4a694139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:01.854027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9f3c1993-a0cb-4c6d-8cf9-667e4a694139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:01.882200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6929eb7f-74f5-463e-8ded-061314bd65ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053777 Jul 26 18:43:01.882779 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1138/2303] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:01 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:01.883943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9f3c1993-a0cb-4c6d-8cf9-667e4a694139 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055654 Jul 26 18:43:01.884502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1166/2304] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:01 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:02.898944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-061f21ce-db31-43a8-97e8-1ba866acb03f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:02.899846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-79cfa2fc-b1d3-482f-9992-463bfa35e835 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:02.902482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-061f21ce-db31-43a8-97e8-1ba866acb03f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:02.903092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-79cfa2fc-b1d3-482f-9992-463bfa35e835 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:02.906184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=58 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:43:02.914088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79cfa2fc-b1d3-482f-9992-463bfa35e835 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:02.914829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79cfa2fc-b1d3-482f-9992-463bfa35e835 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:02.915526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-061f21ce-db31-43a8-97e8-1ba866acb03f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:02.916138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79cfa2fc-b1d3-482f-9992-463bfa35e835 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:02.916384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-061f21ce-db31-43a8-97e8-1ba866acb03f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:02.916856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79cfa2fc-b1d3-482f-9992-463bfa35e835 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:02.917664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-061f21ce-db31-43a8-97e8-1ba866acb03f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:02.918342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-061f21ce-db31-43a8-97e8-1ba866acb03f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:02.947738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-79cfa2fc-b1d3-482f-9992-463bfa35e835 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055023 Jul 26 18:43:02.948302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1167/2305] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:02.948953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-061f21ce-db31-43a8-97e8-1ba866acb03f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057103 Jul 26 18:43:02.949717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1139/2306] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:02 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:03.961509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e8f05b5a-138e-4c26-a490-31610f273772 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:03.962089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-836e365a-e111-4cf2-b79c-96288677b0af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:03.963773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e8f05b5a-138e-4c26-a490-31610f273772 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:03.964223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-836e365a-e111-4cf2-b79c-96288677b0af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:03.970916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8f05b5a-138e-4c26-a490-31610f273772 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:03.971132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-836e365a-e111-4cf2-b79c-96288677b0af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:03.971389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8f05b5a-138e-4c26-a490-31610f273772 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:03.971579 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-836e365a-e111-4cf2-b79c-96288677b0af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:03.972143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8f05b5a-138e-4c26-a490-31610f273772 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:03.972371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-836e365a-e111-4cf2-b79c-96288677b0af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:03.972519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8f05b5a-138e-4c26-a490-31610f273772 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:03.972796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-836e365a-e111-4cf2-b79c-96288677b0af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:04.002952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-836e365a-e111-4cf2-b79c-96288677b0af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045154 Jul 26 18:43:04.003731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e8f05b5a-138e-4c26-a490-31610f273772 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046414 Jul 26 18:43:04.004288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1140/2308] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:03 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:04.004445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1168/2308] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:03 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:05.016836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f8c60731-0d90-4fab-8ba1-7f42b48f3083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:05.017524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ad45798c-6cc5-4885-a294-a840fdca28ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:05.018977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f8c60731-0d90-4fab-8ba1-7f42b48f3083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:05.019175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ad45798c-6cc5-4885-a294-a840fdca28ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:05.026554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8c60731-0d90-4fab-8ba1-7f42b48f3083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:05.026734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad45798c-6cc5-4885-a294-a840fdca28ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:05.027043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8c60731-0d90-4fab-8ba1-7f42b48f3083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:05.027221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad45798c-6cc5-4885-a294-a840fdca28ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:05.027849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8c60731-0d90-4fab-8ba1-7f42b48f3083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:05.028004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad45798c-6cc5-4885-a294-a840fdca28ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:05.028299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8c60731-0d90-4fab-8ba1-7f42b48f3083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:05.028476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad45798c-6cc5-4885-a294-a840fdca28ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:05.059454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f8c60731-0d90-4fab-8ba1-7f42b48f3083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046781 Jul 26 18:43:05.059750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ad45798c-6cc5-4885-a294-a840fdca28ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046825 Jul 26 18:43:05.062881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1141/2310] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:05 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:05.063079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1169/2310] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:05 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:06.075569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1f2c93eb-7114-4930-a69c-3724547598d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:06.076453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-69ba00dc-8048-47cd-85de-1a66a33ee10d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:06.078909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1f2c93eb-7114-4930-a69c-3724547598d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:06.080103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-69ba00dc-8048-47cd-85de-1a66a33ee10d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:06.089572 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f2c93eb-7114-4930-a69c-3724547598d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:06.090019 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f2c93eb-7114-4930-a69c-3724547598d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:06.090378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69ba00dc-8048-47cd-85de-1a66a33ee10d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:06.090783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f2c93eb-7114-4930-a69c-3724547598d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:06.090942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69ba00dc-8048-47cd-85de-1a66a33ee10d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:06.091262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f2c93eb-7114-4930-a69c-3724547598d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:06.091604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69ba00dc-8048-47cd-85de-1a66a33ee10d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:06.092037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69ba00dc-8048-47cd-85de-1a66a33ee10d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:06.121511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1f2c93eb-7114-4930-a69c-3724547598d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052794 Jul 26 18:43:06.122046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-69ba00dc-8048-47cd-85de-1a66a33ee10d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052364 Jul 26 18:43:06.122197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1142/2311] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:06 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:06.122564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1170/2312] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:06 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:07.137341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6d75c52f-926c-418e-87a7-11bfef29be56 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:07.137937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1a2a1485-795c-482e-a754-0cb0ac091c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:07.139512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6d75c52f-926c-418e-87a7-11bfef29be56 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:07.139660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1a2a1485-795c-482e-a754-0cb0ac091c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:07.146515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a2a1485-795c-482e-a754-0cb0ac091c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:07.146694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d75c52f-926c-418e-87a7-11bfef29be56 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:07.146960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a2a1485-795c-482e-a754-0cb0ac091c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:07.147168 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d75c52f-926c-418e-87a7-11bfef29be56 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:07.147753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a2a1485-795c-482e-a754-0cb0ac091c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:07.147900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d75c52f-926c-418e-87a7-11bfef29be56 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:07.148553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a2a1485-795c-482e-a754-0cb0ac091c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:07.148710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d75c52f-926c-418e-87a7-11bfef29be56 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:07.178329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1a2a1485-795c-482e-a754-0cb0ac091c27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046828 Jul 26 18:43:07.178642 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6d75c52f-926c-418e-87a7-11bfef29be56 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047029 Jul 26 18:43:07.178836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1171/2313] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:07 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:07.182766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1143/2314] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:07 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:08.194780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-23aac66a-2ac2-4ead-ac5c-48e3878a9f75 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:08.195723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-de40943a-53e5-4df5-9860-dcba080b03da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:08.198258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-23aac66a-2ac2-4ead-ac5c-48e3878a9f75 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:08.198596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-de40943a-53e5-4df5-9860-dcba080b03da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:08.209637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de40943a-53e5-4df5-9860-dcba080b03da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:08.210191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23aac66a-2ac2-4ead-ac5c-48e3878a9f75 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:08.210757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de40943a-53e5-4df5-9860-dcba080b03da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:08.211061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23aac66a-2ac2-4ead-ac5c-48e3878a9f75 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:08.212214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de40943a-53e5-4df5-9860-dcba080b03da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:08.212473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23aac66a-2ac2-4ead-ac5c-48e3878a9f75 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:08.212922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de40943a-53e5-4df5-9860-dcba080b03da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:08.213191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23aac66a-2ac2-4ead-ac5c-48e3878a9f75 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:08.243461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-23aac66a-2ac2-4ead-ac5c-48e3878a9f75 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055236 Jul 26 18:43:08.243736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-de40943a-53e5-4df5-9860-dcba080b03da tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055304 Jul 26 18:43:08.244035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1172/2315] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:08.244386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1144/2316] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:08 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:09.260062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3ea68fe3-6082-4c85-8768-3945aa444749 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:09.260934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8d898d9b-ac4e-4dd4-ab13-4b36ffdd2401 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:09.263456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3ea68fe3-6082-4c85-8768-3945aa444749 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:09.263761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8d898d9b-ac4e-4dd4-ab13-4b36ffdd2401 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:09.274923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d898d9b-ac4e-4dd4-ab13-4b36ffdd2401 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:09.275524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3ea68fe3-6082-4c85-8768-3945aa444749 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:09.275865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d898d9b-ac4e-4dd4-ab13-4b36ffdd2401 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:09.276282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3ea68fe3-6082-4c85-8768-3945aa444749 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:09.277021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d898d9b-ac4e-4dd4-ab13-4b36ffdd2401 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:09.277328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3ea68fe3-6082-4c85-8768-3945aa444749 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:09.277485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d898d9b-ac4e-4dd4-ab13-4b36ffdd2401 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:09.277764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3ea68fe3-6082-4c85-8768-3945aa444749 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:09.281471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:43:09.307150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8d898d9b-ac4e-4dd4-ab13-4b36ffdd2401 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053556 Jul 26 18:43:09.307558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3ea68fe3-6082-4c85-8768-3945aa444749 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054122 Jul 26 18:43:09.307708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1145/2317] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:09 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:43:09.308702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1173/2318] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:09 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:10.324184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5c06ac15-38c8-44c1-8871-5c4181c24878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:10.325088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5fd0bc36-8b7c-4ba4-bd77-804492207121 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:10.326661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5c06ac15-38c8-44c1-8871-5c4181c24878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:10.327062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5fd0bc36-8b7c-4ba4-bd77-804492207121 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:10.333716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c06ac15-38c8-44c1-8871-5c4181c24878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:10.334155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fd0bc36-8b7c-4ba4-bd77-804492207121 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:10.334329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c06ac15-38c8-44c1-8871-5c4181c24878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:10.334612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fd0bc36-8b7c-4ba4-bd77-804492207121 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:10.334932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c06ac15-38c8-44c1-8871-5c4181c24878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:10.335388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fd0bc36-8b7c-4ba4-bd77-804492207121 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:10.335535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c06ac15-38c8-44c1-8871-5c4181c24878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:10.335865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fd0bc36-8b7c-4ba4-bd77-804492207121 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:10.365635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5c06ac15-38c8-44c1-8871-5c4181c24878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048176 Jul 26 18:43:10.365939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5fd0bc36-8b7c-4ba4-bd77-804492207121 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048151 Jul 26 18:43:10.366131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1146/2319] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:10 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:10.366744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1174/2320] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:10 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:11.378690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ecc19e8a-a71a-45dc-a31c-42dc7e37fa6d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:11.379260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b10d5eaf-7d1c-41bc-b0ce-6d7c4846e8ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:11.380881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b10d5eaf-7d1c-41bc-b0ce-6d7c4846e8ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:11.381017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ecc19e8a-a71a-45dc-a31c-42dc7e37fa6d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:11.387749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ecc19e8a-a71a-45dc-a31c-42dc7e37fa6d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:11.387918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b10d5eaf-7d1c-41bc-b0ce-6d7c4846e8ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:11.388211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ecc19e8a-a71a-45dc-a31c-42dc7e37fa6d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:11.388342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b10d5eaf-7d1c-41bc-b0ce-6d7c4846e8ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:11.388965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ecc19e8a-a71a-45dc-a31c-42dc7e37fa6d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:11.389076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b10d5eaf-7d1c-41bc-b0ce-6d7c4846e8ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:11.389390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ecc19e8a-a71a-45dc-a31c-42dc7e37fa6d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:11.389491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b10d5eaf-7d1c-41bc-b0ce-6d7c4846e8ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:11.419759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ecc19e8a-a71a-45dc-a31c-42dc7e37fa6d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045106 Jul 26 18:43:11.420014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b10d5eaf-7d1c-41bc-b0ce-6d7c4846e8ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045189 Jul 26 18:43:11.420370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1147/2321] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:11 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:11.423173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1175/2322] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:12.437036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-995ff3df-cdae-4809-9d2e-e42d53de2ed3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:12.438836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d8154f5e-a2d5-4154-80df-31d1e99f2b69 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:12.440700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-995ff3df-cdae-4809-9d2e-e42d53de2ed3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:12.442274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d8154f5e-a2d5-4154-80df-31d1e99f2b69 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:12.450859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-995ff3df-cdae-4809-9d2e-e42d53de2ed3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:12.451333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-995ff3df-cdae-4809-9d2e-e42d53de2ed3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:12.452045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8154f5e-a2d5-4154-80df-31d1e99f2b69 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:12.452217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-995ff3df-cdae-4809-9d2e-e42d53de2ed3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:12.452497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8154f5e-a2d5-4154-80df-31d1e99f2b69 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:12.452663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-995ff3df-cdae-4809-9d2e-e42d53de2ed3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:12.453282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8154f5e-a2d5-4154-80df-31d1e99f2b69 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:12.453692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d8154f5e-a2d5-4154-80df-31d1e99f2b69 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:12.454822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:43:12.483869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d8154f5e-a2d5-4154-80df-31d1e99f2b69 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051388 Jul 26 18:43:12.484106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-995ff3df-cdae-4809-9d2e-e42d53de2ed3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054107 Jul 26 18:43:12.487823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1176/2323] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:12 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:12.487983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1148/2323] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:12 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:13.499312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b3494662-e80b-4b7b-891d-14d300bf9a34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:13.500701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3d1c757a-8143-4836-bf4c-22c4ec65e0fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:13.501543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b3494662-e80b-4b7b-891d-14d300bf9a34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:13.502827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3d1c757a-8143-4836-bf4c-22c4ec65e0fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:13.508188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3494662-e80b-4b7b-891d-14d300bf9a34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:13.508638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3494662-e80b-4b7b-891d-14d300bf9a34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:13.509402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3494662-e80b-4b7b-891d-14d300bf9a34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:13.509550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d1c757a-8143-4836-bf4c-22c4ec65e0fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:13.509833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3494662-e80b-4b7b-891d-14d300bf9a34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:13.509996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d1c757a-8143-4836-bf4c-22c4ec65e0fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:13.510739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d1c757a-8143-4836-bf4c-22c4ec65e0fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:13.511171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d1c757a-8143-4836-bf4c-22c4ec65e0fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:13.540295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b3494662-e80b-4b7b-891d-14d300bf9a34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046996 Jul 26 18:43:13.540773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1177/2325] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:13 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:13.541656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3d1c757a-8143-4836-bf4c-22c4ec65e0fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046222 Jul 26 18:43:13.542212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1149/2326] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:13 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:14.557285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-92c7a763-e86b-457c-987a-f9570d58eb5b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:14.558244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5958b7da-fc4e-4fa7-9b31-7a87bff90bd9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:14.560697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-92c7a763-e86b-457c-987a-f9570d58eb5b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:14.560958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5958b7da-fc4e-4fa7-9b31-7a87bff90bd9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:14.571450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5958b7da-fc4e-4fa7-9b31-7a87bff90bd9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:14.571754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92c7a763-e86b-457c-987a-f9570d58eb5b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:14.572206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5958b7da-fc4e-4fa7-9b31-7a87bff90bd9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:14.572505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92c7a763-e86b-457c-987a-f9570d58eb5b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:14.573457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92c7a763-e86b-457c-987a-f9570d58eb5b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:14.573703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5958b7da-fc4e-4fa7-9b31-7a87bff90bd9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:14.574159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92c7a763-e86b-457c-987a-f9570d58eb5b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:14.574406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5958b7da-fc4e-4fa7-9b31-7a87bff90bd9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:14.605200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-92c7a763-e86b-457c-987a-f9570d58eb5b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054813 Jul 26 18:43:14.606054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1178/2327] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:14 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:43:14.606277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5958b7da-fc4e-4fa7-9b31-7a87bff90bd9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055584 Jul 26 18:43:14.606839 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1150/2328] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:14 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:15.622895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1cca09ef-1326-4bcd-ab16-596cf9ec3a91 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:15.623998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-821bd610-44a0-48fc-8268-45141ecf6dee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:15.625329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1cca09ef-1326-4bcd-ab16-596cf9ec3a91 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:15.626667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-821bd610-44a0-48fc-8268-45141ecf6dee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:15.631664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1cca09ef-1326-4bcd-ab16-596cf9ec3a91 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:15.632056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1cca09ef-1326-4bcd-ab16-596cf9ec3a91 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:15.632808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1cca09ef-1326-4bcd-ab16-596cf9ec3a91 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:15.633103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-821bd610-44a0-48fc-8268-45141ecf6dee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:15.633241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1cca09ef-1326-4bcd-ab16-596cf9ec3a91 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:15.633557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-821bd610-44a0-48fc-8268-45141ecf6dee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:15.634304 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-821bd610-44a0-48fc-8268-45141ecf6dee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:15.634728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-821bd610-44a0-48fc-8268-45141ecf6dee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:15.662559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1cca09ef-1326-4bcd-ab16-596cf9ec3a91 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046546 Jul 26 18:43:15.663062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1179/2329] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:15.664401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-821bd610-44a0-48fc-8268-45141ecf6dee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048490 Jul 26 18:43:15.664943 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1151/2330] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:15 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:16.679291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cfcc9109-67db-4775-945f-4f528ab17bf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:16.680428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-94936e54-6041-45b2-85fe-bd40b322d320 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:16.683880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cfcc9109-67db-4775-945f-4f528ab17bf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:16.684177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-94936e54-6041-45b2-85fe-bd40b322d320 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:16.691570 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94936e54-6041-45b2-85fe-bd40b322d320 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:16.691750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfcc9109-67db-4775-945f-4f528ab17bf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:16.692017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94936e54-6041-45b2-85fe-bd40b322d320 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:16.692196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfcc9109-67db-4775-945f-4f528ab17bf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:16.692764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94936e54-6041-45b2-85fe-bd40b322d320 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:16.692936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfcc9109-67db-4775-945f-4f528ab17bf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:16.693186 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-94936e54-6041-45b2-85fe-bd40b322d320 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:16.693325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfcc9109-67db-4775-945f-4f528ab17bf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:16.723083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-94936e54-6041-45b2-85fe-bd40b322d320 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049130 Jul 26 18:43:16.723672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1152/2331] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:16 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:16.724395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cfcc9109-67db-4775-945f-4f528ab17bf5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051777 Jul 26 18:43:16.725119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1180/2332] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:17.738017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a02b6866-410e-498a-a84f-4d19c9f33a25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:17.739511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-853d9983-6a9a-42c5-a77e-76b16575ed13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:17.740802 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a02b6866-410e-498a-a84f-4d19c9f33a25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:17.742103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-853d9983-6a9a-42c5-a77e-76b16575ed13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:17.749238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a02b6866-410e-498a-a84f-4d19c9f33a25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:17.750105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a02b6866-410e-498a-a84f-4d19c9f33a25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:17.750455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-853d9983-6a9a-42c5-a77e-76b16575ed13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:17.750719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a02b6866-410e-498a-a84f-4d19c9f33a25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:17.751053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-853d9983-6a9a-42c5-a77e-76b16575ed13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:17.751285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a02b6866-410e-498a-a84f-4d19c9f33a25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:17.752005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-853d9983-6a9a-42c5-a77e-76b16575ed13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:17.752581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-853d9983-6a9a-42c5-a77e-76b16575ed13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:17.786793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a02b6866-410e-498a-a84f-4d19c9f33a25 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051579 Jul 26 18:43:17.786793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1153/2333] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:17 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:17.787136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-853d9983-6a9a-42c5-a77e-76b16575ed13 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051163 Jul 26 18:43:17.787136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1181/2334] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:17 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:18.799739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6d408efe-cca3-4519-914e-bfad077d80db tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:18.801517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6e984962-1292-44a6-b48a-6d1b4ca47274 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:18.803185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6d408efe-cca3-4519-914e-bfad077d80db tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:18.804927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6e984962-1292-44a6-b48a-6d1b4ca47274 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:18.813802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6e984962-1292-44a6-b48a-6d1b4ca47274 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:18.814239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6e984962-1292-44a6-b48a-6d1b4ca47274 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:18.814391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d408efe-cca3-4519-914e-bfad077d80db tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:18.814997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6e984962-1292-44a6-b48a-6d1b4ca47274 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:18.815165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d408efe-cca3-4519-914e-bfad077d80db tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:18.815455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6e984962-1292-44a6-b48a-6d1b4ca47274 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:18.816286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d408efe-cca3-4519-914e-bfad077d80db tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:18.816727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d408efe-cca3-4519-914e-bfad077d80db tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:18.848566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6d408efe-cca3-4519-914e-bfad077d80db tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055402 Jul 26 18:43:18.849155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1154/2335] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:18 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:18.850245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6e984962-1292-44a6-b48a-6d1b4ca47274 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055148 Jul 26 18:43:18.850802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1182/2336] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:19.861048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a6f049a8-dcee-469e-812b-4b4ca2e2ac51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:19.861890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-53112c99-4fcb-430c-8cbf-d4506b531634 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:19.863275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a6f049a8-dcee-469e-812b-4b4ca2e2ac51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:19.864022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-53112c99-4fcb-430c-8cbf-d4506b531634 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:19.870073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6f049a8-dcee-469e-812b-4b4ca2e2ac51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:19.870550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6f049a8-dcee-469e-812b-4b4ca2e2ac51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:19.870704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53112c99-4fcb-430c-8cbf-d4506b531634 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:19.871181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53112c99-4fcb-430c-8cbf-d4506b531634 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:19.871326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6f049a8-dcee-469e-812b-4b4ca2e2ac51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:19.871760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6f049a8-dcee-469e-812b-4b4ca2e2ac51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:19.871959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53112c99-4fcb-430c-8cbf-d4506b531634 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:19.872394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-53112c99-4fcb-430c-8cbf-d4506b531634 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:19.901833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a6f049a8-dcee-469e-812b-4b4ca2e2ac51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044809 Jul 26 18:43:19.902055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-53112c99-4fcb-430c-8cbf-d4506b531634 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044218 Jul 26 18:43:19.902635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1155/2337] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:19 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:19.906566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1183/2338] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:19 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:20.915367 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f51cbad6-8f5e-4330-a8cc-ce069b23cfcc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:20.915963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8f650e55-46aa-454f-a967-ee01da519b8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:20.917512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f51cbad6-8f5e-4330-a8cc-ce069b23cfcc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:20.917670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8f650e55-46aa-454f-a967-ee01da519b8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:20.925036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f51cbad6-8f5e-4330-a8cc-ce069b23cfcc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:20.925257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f650e55-46aa-454f-a967-ee01da519b8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:20.925457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f51cbad6-8f5e-4330-a8cc-ce069b23cfcc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:20.925581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f650e55-46aa-454f-a967-ee01da519b8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:20.926237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f51cbad6-8f5e-4330-a8cc-ce069b23cfcc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:20.926404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f650e55-46aa-454f-a967-ee01da519b8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:20.926662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f51cbad6-8f5e-4330-a8cc-ce069b23cfcc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:20.926827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f650e55-46aa-454f-a967-ee01da519b8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:20.957510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f51cbad6-8f5e-4330-a8cc-ce069b23cfcc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046168 Jul 26 18:43:20.957912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8f650e55-46aa-454f-a967-ee01da519b8a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046597 Jul 26 18:43:20.958075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1156/2339] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:20 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:20.958550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1184/2340] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:20 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:21.970158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2f818526-c349-40e8-a565-b2590243ddce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:21.970772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-322df4e0-dabe-48b6-bc3f-9ef6b995a207 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:21.972380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2f818526-c349-40e8-a565-b2590243ddce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:21.972527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-322df4e0-dabe-48b6-bc3f-9ef6b995a207 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:21.979205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-322df4e0-dabe-48b6-bc3f-9ef6b995a207 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:21.979651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-322df4e0-dabe-48b6-bc3f-9ef6b995a207 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:21.980181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f818526-c349-40e8-a565-b2590243ddce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:21.980417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-322df4e0-dabe-48b6-bc3f-9ef6b995a207 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:21.980633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f818526-c349-40e8-a565-b2590243ddce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:21.980854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-322df4e0-dabe-48b6-bc3f-9ef6b995a207 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:21.981401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f818526-c349-40e8-a565-b2590243ddce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:21.981846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f818526-c349-40e8-a565-b2590243ddce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:22.012024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-322df4e0-dabe-48b6-bc3f-9ef6b995a207 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045690 Jul 26 18:43:22.012896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1185/2341] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:21 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:43:22.015680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2f818526-c349-40e8-a565-b2590243ddce tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049523 Jul 26 18:43:22.016336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1157/2342] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:43:23.029105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a5e39f38-5c6a-4839-8348-c47d7207ff06 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:23.032531 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-73b4d660-fdaa-4b91-a9a6-31b14fc50ff2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:43:23.033296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a5e39f38-5c6a-4839-8348-c47d7207ff06 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:23.035987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-73b4d660-fdaa-4b91-a9a6-31b14fc50ff2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:23.044554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5e39f38-5c6a-4839-8348-c47d7207ff06 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:23.045322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5e39f38-5c6a-4839-8348-c47d7207ff06 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:23.046070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73b4d660-fdaa-4b91-a9a6-31b14fc50ff2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:23.046244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5e39f38-5c6a-4839-8348-c47d7207ff06 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:23.046479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5e39f38-5c6a-4839-8348-c47d7207ff06 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:23.046595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73b4d660-fdaa-4b91-a9a6-31b14fc50ff2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:23.047291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73b4d660-fdaa-4b91-a9a6-31b14fc50ff2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:23.047722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73b4d660-fdaa-4b91-a9a6-31b14fc50ff2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:23.075940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a5e39f38-5c6a-4839-8348-c47d7207ff06 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053956 Jul 26 18:43:23.076610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1186/2343] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:23 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:23.145834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-73b4d660-fdaa-4b91-a9a6-31b14fc50ff2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "POST /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/action" status: 200 len: 76208 microversion: 2.1 time: 0.119572 Jul 26 18:43:23.146431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1158/2344] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:43:23 2022] POST /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2/action => generated 76208 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 18:43:24.088526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f4a2f589-f569-4b32-ad60-8a88bbe9101e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:24.090662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f4a2f589-f569-4b32-ad60-8a88bbe9101e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:24.097570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4a2f589-f569-4b32-ad60-8a88bbe9101e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:24.098007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4a2f589-f569-4b32-ad60-8a88bbe9101e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:24.098754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4a2f589-f569-4b32-ad60-8a88bbe9101e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:24.099215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4a2f589-f569-4b32-ad60-8a88bbe9101e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:24.128362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f4a2f589-f569-4b32-ad60-8a88bbe9101e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043781 Jul 26 18:43:24.128929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1187/2345] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:24 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:25.145071 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6c9cd422-7585-418a-9e3a-cf19ad7c6b53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:25.148484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6c9cd422-7585-418a-9e3a-cf19ad7c6b53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:25.156032 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c9cd422-7585-418a-9e3a-cf19ad7c6b53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:25.156565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c9cd422-7585-418a-9e3a-cf19ad7c6b53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:25.157321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c9cd422-7585-418a-9e3a-cf19ad7c6b53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:25.157746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c9cd422-7585-418a-9e3a-cf19ad7c6b53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:25.187552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6c9cd422-7585-418a-9e3a-cf19ad7c6b53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048620 Jul 26 18:43:25.188121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1159/2346] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:25 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:26.200118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fe85ef66-b7f8-42cb-9b74-909fe082d862 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:26.202277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fe85ef66-b7f8-42cb-9b74-909fe082d862 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:26.209340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe85ef66-b7f8-42cb-9b74-909fe082d862 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:26.209790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe85ef66-b7f8-42cb-9b74-909fe082d862 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:26.210551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe85ef66-b7f8-42cb-9b74-909fe082d862 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:26.210987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe85ef66-b7f8-42cb-9b74-909fe082d862 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:26.240480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fe85ef66-b7f8-42cb-9b74-909fe082d862 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Jul 26 18:43:26.241026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1188/2347] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:26 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:27.254045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1dec16c4-a30d-4181-a0ab-0417247a0376 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:27.256220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1dec16c4-a30d-4181-a0ab-0417247a0376 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:27.263086 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1dec16c4-a30d-4181-a0ab-0417247a0376 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:27.263575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1dec16c4-a30d-4181-a0ab-0417247a0376 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:27.264322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1dec16c4-a30d-4181-a0ab-0417247a0376 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:27.264748 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1dec16c4-a30d-4181-a0ab-0417247a0376 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:27.295325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1dec16c4-a30d-4181-a0ab-0417247a0376 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045137 Jul 26 18:43:27.295922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1160/2348] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:27 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:28.310435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4de73e82-053f-4f02-bebf-a10afa1e8d23 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:28.312750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4de73e82-053f-4f02-bebf-a10afa1e8d23 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:28.320482 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4de73e82-053f-4f02-bebf-a10afa1e8d23 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:28.320947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4de73e82-053f-4f02-bebf-a10afa1e8d23 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:28.321722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4de73e82-053f-4f02-bebf-a10afa1e8d23 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:28.322179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4de73e82-053f-4f02-bebf-a10afa1e8d23 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:28.349962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:43:28.354762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4de73e82-053f-4f02-bebf-a10afa1e8d23 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048422 Jul 26 18:43:28.355386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1189/2349] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:28 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:29.371773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-249f5f0c-ba2f-4a0c-97bf-311c86641a37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:29.374380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-249f5f0c-ba2f-4a0c-97bf-311c86641a37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:29.381582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-249f5f0c-ba2f-4a0c-97bf-311c86641a37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:29.382034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-249f5f0c-ba2f-4a0c-97bf-311c86641a37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:29.382801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-249f5f0c-ba2f-4a0c-97bf-311c86641a37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:29.383308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-249f5f0c-ba2f-4a0c-97bf-311c86641a37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:29.413341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-249f5f0c-ba2f-4a0c-97bf-311c86641a37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048662 Jul 26 18:43:29.413897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1161/2350] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:29 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:30.430449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d5966011-8e65-4839-9b7d-ac9c37afa7dd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:30.433829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d5966011-8e65-4839-9b7d-ac9c37afa7dd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:30.444721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5966011-8e65-4839-9b7d-ac9c37afa7dd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:30.445462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5966011-8e65-4839-9b7d-ac9c37afa7dd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:30.446717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5966011-8e65-4839-9b7d-ac9c37afa7dd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:30.447486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5966011-8e65-4839-9b7d-ac9c37afa7dd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:30.478506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d5966011-8e65-4839-9b7d-ac9c37afa7dd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055299 Jul 26 18:43:30.479052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1190/2351] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:30 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:31.494979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ca971560-5ee3-4004-bd54-6740fbc91e42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:31.498429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ca971560-5ee3-4004-bd54-6740fbc91e42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:31.505254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca971560-5ee3-4004-bd54-6740fbc91e42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:31.505694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca971560-5ee3-4004-bd54-6740fbc91e42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:31.506443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca971560-5ee3-4004-bd54-6740fbc91e42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:31.506869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca971560-5ee3-4004-bd54-6740fbc91e42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:31.536503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ca971560-5ee3-4004-bd54-6740fbc91e42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048084 Jul 26 18:43:31.537067 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1162/2352] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:31 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:32.552799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2689549f-0dce-4c18-9d3b-1b49330dde26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:32.556334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2689549f-0dce-4c18-9d3b-1b49330dde26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:32.560006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=50 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:43:32.568864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2689549f-0dce-4c18-9d3b-1b49330dde26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:32.569609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2689549f-0dce-4c18-9d3b-1b49330dde26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:32.570870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2689549f-0dce-4c18-9d3b-1b49330dde26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:32.571632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2689549f-0dce-4c18-9d3b-1b49330dde26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:32.603373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2689549f-0dce-4c18-9d3b-1b49330dde26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056708 Jul 26 18:43:32.603522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1191/2353] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:33.619937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7c93d609-5bfc-4cb1-9c84-802a24f4bb87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:33.623322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7c93d609-5bfc-4cb1-9c84-802a24f4bb87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:33.626022 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=48 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:43:33.632313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c93d609-5bfc-4cb1-9c84-802a24f4bb87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:33.632816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c93d609-5bfc-4cb1-9c84-802a24f4bb87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:33.633660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c93d609-5bfc-4cb1-9c84-802a24f4bb87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:33.634145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c93d609-5bfc-4cb1-9c84-802a24f4bb87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:33.666523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7c93d609-5bfc-4cb1-9c84-802a24f4bb87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053307 Jul 26 18:43:33.667094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1163/2354] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:33 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:34.683497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-078c83a8-5856-4f83-80c4-6a79f82c6feb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:34.686370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-078c83a8-5856-4f83-80c4-6a79f82c6feb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:34.693152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-078c83a8-5856-4f83-80c4-6a79f82c6feb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:34.693610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-078c83a8-5856-4f83-80c4-6a79f82c6feb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:34.694404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-078c83a8-5856-4f83-80c4-6a79f82c6feb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:34.694849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-078c83a8-5856-4f83-80c4-6a79f82c6feb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:34.725625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-078c83a8-5856-4f83-80c4-6a79f82c6feb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049116 Jul 26 18:43:34.726226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1192/2355] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:34 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:35.742206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a9333112-9174-46f7-9c95-08c4c21ab76e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:35.745864 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a9333112-9174-46f7-9c95-08c4c21ab76e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:35.757016 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a9333112-9174-46f7-9c95-08c4c21ab76e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:35.757755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a9333112-9174-46f7-9c95-08c4c21ab76e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:35.759010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a9333112-9174-46f7-9c95-08c4c21ab76e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:35.759727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a9333112-9174-46f7-9c95-08c4c21ab76e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:35.791614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a9333112-9174-46f7-9c95-08c4c21ab76e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056057 Jul 26 18:43:35.792196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1164/2356] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:36.805216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e9181c2f-1845-43ad-8f50-e6b5bd306aa8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:36.807626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e9181c2f-1845-43ad-8f50-e6b5bd306aa8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:36.816638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9181c2f-1845-43ad-8f50-e6b5bd306aa8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:36.817067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9181c2f-1845-43ad-8f50-e6b5bd306aa8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:36.817841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9181c2f-1845-43ad-8f50-e6b5bd306aa8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:36.818275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9181c2f-1845-43ad-8f50-e6b5bd306aa8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:36.849203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e9181c2f-1845-43ad-8f50-e6b5bd306aa8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048515 Jul 26 18:43:36.849943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1193/2357] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:36 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:37.865914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c20c315d-03ac-40ff-a488-2caf82759864 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:37.869430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c20c315d-03ac-40ff-a488-2caf82759864 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:37.880515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c20c315d-03ac-40ff-a488-2caf82759864 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:37.881250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c20c315d-03ac-40ff-a488-2caf82759864 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:37.882505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c20c315d-03ac-40ff-a488-2caf82759864 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:37.883264 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c20c315d-03ac-40ff-a488-2caf82759864 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:37.889360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:43:37.916434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c20c315d-03ac-40ff-a488-2caf82759864 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057179 Jul 26 18:43:37.917353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1165/2358] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:37 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:38.932988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-27aef913-0a3f-47be-bf78-cf3ea0527415 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:38.936064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-27aef913-0a3f-47be-bf78-cf3ea0527415 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:38.943052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27aef913-0a3f-47be-bf78-cf3ea0527415 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:38.943515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27aef913-0a3f-47be-bf78-cf3ea0527415 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:38.944272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27aef913-0a3f-47be-bf78-cf3ea0527415 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:38.944708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27aef913-0a3f-47be-bf78-cf3ea0527415 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:38.974060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-27aef913-0a3f-47be-bf78-cf3ea0527415 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047696 Jul 26 18:43:38.974620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1194/2359] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:38 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:39.990584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-47c522f7-c668-44d8-aade-5ad0eee47740 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:39.994172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-47c522f7-c668-44d8-aade-5ad0eee47740 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:40.005901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47c522f7-c668-44d8-aade-5ad0eee47740 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:40.006629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47c522f7-c668-44d8-aade-5ad0eee47740 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:40.007910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47c522f7-c668-44d8-aade-5ad0eee47740 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:40.009161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47c522f7-c668-44d8-aade-5ad0eee47740 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:40.039937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-47c522f7-c668-44d8-aade-5ad0eee47740 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055898 Jul 26 18:43:40.040492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1166/2360] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:39 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:41.056569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5f5ca38f-ef96-4dc7-a593-da3f18e66f0e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:41.060132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5f5ca38f-ef96-4dc7-a593-da3f18e66f0e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:41.071078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f5ca38f-ef96-4dc7-a593-da3f18e66f0e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:41.071829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f5ca38f-ef96-4dc7-a593-da3f18e66f0e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:41.073035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f5ca38f-ef96-4dc7-a593-da3f18e66f0e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:41.073800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f5ca38f-ef96-4dc7-a593-da3f18e66f0e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:41.104596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5f5ca38f-ef96-4dc7-a593-da3f18e66f0e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054801 Jul 26 18:43:41.105166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1195/2361] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:41 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:42.121565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f396f25d-db63-4b7f-97d5-3acba22ea3d1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:42.124315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f396f25d-db63-4b7f-97d5-3acba22ea3d1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:42.131937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f396f25d-db63-4b7f-97d5-3acba22ea3d1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:42.132883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f396f25d-db63-4b7f-97d5-3acba22ea3d1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:42.133661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f396f25d-db63-4b7f-97d5-3acba22ea3d1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:42.134128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f396f25d-db63-4b7f-97d5-3acba22ea3d1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:42.164991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f396f25d-db63-4b7f-97d5-3acba22ea3d1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050044 Jul 26 18:43:42.165558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1167/2362] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:42 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:43.181182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-50b9cea4-2763-41fc-bb53-5c2687aae249 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:43.184552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-50b9cea4-2763-41fc-bb53-5c2687aae249 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:43.195882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50b9cea4-2763-41fc-bb53-5c2687aae249 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:43.196201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50b9cea4-2763-41fc-bb53-5c2687aae249 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:43.197457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50b9cea4-2763-41fc-bb53-5c2687aae249 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:43.198190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50b9cea4-2763-41fc-bb53-5c2687aae249 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:43.231052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-50b9cea4-2763-41fc-bb53-5c2687aae249 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056663 Jul 26 18:43:43.231661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1196/2363] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:44.243804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3d18bfe8-bea0-41bd-a7da-77447eb6c6ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:44.245967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3d18bfe8-bea0-41bd-a7da-77447eb6c6ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:44.252975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d18bfe8-bea0-41bd-a7da-77447eb6c6ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:44.253392 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d18bfe8-bea0-41bd-a7da-77447eb6c6ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:44.254149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d18bfe8-bea0-41bd-a7da-77447eb6c6ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:44.254580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d18bfe8-bea0-41bd-a7da-77447eb6c6ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:44.284536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3d18bfe8-bea0-41bd-a7da-77447eb6c6ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044689 Jul 26 18:43:44.285101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1168/2364] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:44 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:45.301555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d2d78dd8-b93b-4f85-bd46-eaa662257208 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:45.304979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d2d78dd8-b93b-4f85-bd46-eaa662257208 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:45.316425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2d78dd8-b93b-4f85-bd46-eaa662257208 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:45.317336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2d78dd8-b93b-4f85-bd46-eaa662257208 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:45.318743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2d78dd8-b93b-4f85-bd46-eaa662257208 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:45.319886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d2d78dd8-b93b-4f85-bd46-eaa662257208 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:45.352141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d2d78dd8-b93b-4f85-bd46-eaa662257208 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057428 Jul 26 18:43:45.352711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1197/2365] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:45 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:46.367505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-24f8047b-af00-47eb-bf4e-e1b69be8ba26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:46.369929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-24f8047b-af00-47eb-bf4e-e1b69be8ba26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:46.377732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24f8047b-af00-47eb-bf4e-e1b69be8ba26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:46.378175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24f8047b-af00-47eb-bf4e-e1b69be8ba26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:46.378930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24f8047b-af00-47eb-bf4e-e1b69be8ba26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:46.380626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24f8047b-af00-47eb-bf4e-e1b69be8ba26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:46.410697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-24f8047b-af00-47eb-bf4e-e1b69be8ba26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047697 Jul 26 18:43:46.411383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1169/2366] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:46 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:47.424580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2db3bd7d-8543-4a4a-b4d7-4971b36a7e39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:47.426884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2db3bd7d-8543-4a4a-b4d7-4971b36a7e39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:47.434500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2db3bd7d-8543-4a4a-b4d7-4971b36a7e39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:47.435011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2db3bd7d-8543-4a4a-b4d7-4971b36a7e39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:47.435915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2db3bd7d-8543-4a4a-b4d7-4971b36a7e39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:47.436413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2db3bd7d-8543-4a4a-b4d7-4971b36a7e39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:47.466683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2db3bd7d-8543-4a4a-b4d7-4971b36a7e39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046803 Jul 26 18:43:47.467263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1198/2367] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:47 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:48.483399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-00ae6c7a-a1d3-4450-91f7-ebee60a6d8bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:48.485949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-00ae6c7a-a1d3-4450-91f7-ebee60a6d8bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:48.492845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00ae6c7a-a1d3-4450-91f7-ebee60a6d8bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:48.493298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00ae6c7a-a1d3-4450-91f7-ebee60a6d8bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:48.494055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00ae6c7a-a1d3-4450-91f7-ebee60a6d8bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:48.494493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00ae6c7a-a1d3-4450-91f7-ebee60a6d8bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:48.524202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-00ae6c7a-a1d3-4450-91f7-ebee60a6d8bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047428 Jul 26 18:43:48.524747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1170/2368] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:48 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:49.541455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2a72afd0-056c-43c0-94e9-1f7508a45ae7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:49.544949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2a72afd0-056c-43c0-94e9-1f7508a45ae7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:49.555957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a72afd0-056c-43c0-94e9-1f7508a45ae7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:49.556689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a72afd0-056c-43c0-94e9-1f7508a45ae7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:49.557931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a72afd0-056c-43c0-94e9-1f7508a45ae7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:49.558647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a72afd0-056c-43c0-94e9-1f7508a45ae7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:49.589495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2a72afd0-056c-43c0-94e9-1f7508a45ae7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054635 Jul 26 18:43:49.590065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1199/2369] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:49 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:50.604507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-042e50f3-c0ed-4aca-ab8b-b95f8d0492d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:50.606654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-042e50f3-c0ed-4aca-ab8b-b95f8d0492d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:50.614467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-042e50f3-c0ed-4aca-ab8b-b95f8d0492d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:50.614919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-042e50f3-c0ed-4aca-ab8b-b95f8d0492d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:50.615721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-042e50f3-c0ed-4aca-ab8b-b95f8d0492d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:50.616154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-042e50f3-c0ed-4aca-ab8b-b95f8d0492d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:50.653483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-042e50f3-c0ed-4aca-ab8b-b95f8d0492d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054707 Jul 26 18:43:50.654047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1171/2370] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:50 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:51.668741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e472cde7-c770-406a-a511-bb2f745a3fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:51.670677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e472cde7-c770-406a-a511-bb2f745a3fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:51.677909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e472cde7-c770-406a-a511-bb2f745a3fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:51.678356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e472cde7-c770-406a-a511-bb2f745a3fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:51.679160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e472cde7-c770-406a-a511-bb2f745a3fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:51.679598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e472cde7-c770-406a-a511-bb2f745a3fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:51.709858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e472cde7-c770-406a-a511-bb2f745a3fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045477 Jul 26 18:43:51.710439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1200/2371] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:52.726959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-55f18391-7c01-4a72-8b70-2db90c60a951 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:52.730466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-55f18391-7c01-4a72-8b70-2db90c60a951 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:52.739061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55f18391-7c01-4a72-8b70-2db90c60a951 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:52.739530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55f18391-7c01-4a72-8b70-2db90c60a951 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:52.740300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55f18391-7c01-4a72-8b70-2db90c60a951 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:52.740732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55f18391-7c01-4a72-8b70-2db90c60a951 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:52.772570 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-55f18391-7c01-4a72-8b70-2db90c60a951 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052515 Jul 26 18:43:52.773644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1172/2372] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:52 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:53.785917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-68b5da41-074e-4758-8549-a8dbec331ef9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:53.788177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-68b5da41-074e-4758-8549-a8dbec331ef9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:53.795374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68b5da41-074e-4758-8549-a8dbec331ef9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:53.795823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68b5da41-074e-4758-8549-a8dbec331ef9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:53.796586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68b5da41-074e-4758-8549-a8dbec331ef9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:53.797019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68b5da41-074e-4758-8549-a8dbec331ef9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:53.826795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-68b5da41-074e-4758-8549-a8dbec331ef9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044922 Jul 26 18:43:53.831081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1201/2373] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:53 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:54.317668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:43:54.318522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:43:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:43:54.840470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-950c0ff7-f3b6-4846-bb4b-fb3577773042 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:54.842795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-950c0ff7-f3b6-4846-bb4b-fb3577773042 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:54.850452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-950c0ff7-f3b6-4846-bb4b-fb3577773042 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:54.850907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-950c0ff7-f3b6-4846-bb4b-fb3577773042 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:54.851708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-950c0ff7-f3b6-4846-bb4b-fb3577773042 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:54.852150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-950c0ff7-f3b6-4846-bb4b-fb3577773042 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:54.882613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-950c0ff7-f3b6-4846-bb4b-fb3577773042 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046762 Jul 26 18:43:54.883210 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1173/2374] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:54 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:55.895706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4899df10-735b-4f23-ba3c-857202ce2e37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:55.898794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4899df10-735b-4f23-ba3c-857202ce2e37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:55.910029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4899df10-735b-4f23-ba3c-857202ce2e37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:55.910491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4899df10-735b-4f23-ba3c-857202ce2e37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:55.911560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4899df10-735b-4f23-ba3c-857202ce2e37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:55.912189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4899df10-735b-4f23-ba3c-857202ce2e37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:55.947369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4899df10-735b-4f23-ba3c-857202ce2e37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055547 Jul 26 18:43:55.947898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1202/2375] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:56.961925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f5ad846e-ac94-4c7b-86d6-7ad7036c52e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:56.964726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f5ad846e-ac94-4c7b-86d6-7ad7036c52e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:56.973076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5ad846e-ac94-4c7b-86d6-7ad7036c52e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:56.973550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5ad846e-ac94-4c7b-86d6-7ad7036c52e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:56.974279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5ad846e-ac94-4c7b-86d6-7ad7036c52e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:56.974707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f5ad846e-ac94-4c7b-86d6-7ad7036c52e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:57.004476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f5ad846e-ac94-4c7b-86d6-7ad7036c52e8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048067 Jul 26 18:43:57.005060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1174/2376] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:56 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:58.019803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ea02c802-b935-401b-b32a-d9fdb33c8726 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:58.021968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ea02c802-b935-401b-b32a-d9fdb33c8726 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:58.029582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea02c802-b935-401b-b32a-d9fdb33c8726 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:58.030029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea02c802-b935-401b-b32a-d9fdb33c8726 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:58.030786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea02c802-b935-401b-b32a-d9fdb33c8726 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:58.031282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea02c802-b935-401b-b32a-d9fdb33c8726 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:58.064132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ea02c802-b935-401b-b32a-d9fdb33c8726 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049804 Jul 26 18:43:58.064691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1203/2377] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:58 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:43:59.079355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e2c3d615-fe36-4455-b585-d00791da2a07 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:43:59.081481 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e2c3d615-fe36-4455-b585-d00791da2a07 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:43:59.088219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e2c3d615-fe36-4455-b585-d00791da2a07 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:59.088670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e2c3d615-fe36-4455-b585-d00791da2a07 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:59.089428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e2c3d615-fe36-4455-b585-d00791da2a07 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:43:59.089855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e2c3d615-fe36-4455-b585-d00791da2a07 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:43:59.119768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e2c3d615-fe36-4455-b585-d00791da2a07 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044685 Jul 26 18:43:59.120334 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1175/2378] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:43:59 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:00.136440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bf71a372-f6a1-4a78-88fa-33c95df8e8ac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:00.139863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bf71a372-f6a1-4a78-88fa-33c95df8e8ac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:00.147671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf71a372-f6a1-4a78-88fa-33c95df8e8ac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:00.148116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf71a372-f6a1-4a78-88fa-33c95df8e8ac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:00.149186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf71a372-f6a1-4a78-88fa-33c95df8e8ac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:00.149617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf71a372-f6a1-4a78-88fa-33c95df8e8ac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:00.179396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bf71a372-f6a1-4a78-88fa-33c95df8e8ac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049627 Jul 26 18:44:00.179993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1204/2379] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:00 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:01.196045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-08844dbe-4ac7-40fb-94a5-163b8072f37a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:01.199666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-08844dbe-4ac7-40fb-94a5-163b8072f37a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:01.208386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08844dbe-4ac7-40fb-94a5-163b8072f37a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:01.208833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08844dbe-4ac7-40fb-94a5-163b8072f37a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:01.209587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08844dbe-4ac7-40fb-94a5-163b8072f37a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:01.210016 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08844dbe-4ac7-40fb-94a5-163b8072f37a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:01.239743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-08844dbe-4ac7-40fb-94a5-163b8072f37a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050255 Jul 26 18:44:01.240309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1176/2380] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:01 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:02.254350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ef95072b-d8ba-4d33-a082-e11e4052bd7d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:02.256776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ef95072b-d8ba-4d33-a082-e11e4052bd7d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:02.264929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef95072b-d8ba-4d33-a082-e11e4052bd7d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:02.265442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef95072b-d8ba-4d33-a082-e11e4052bd7d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:02.266380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef95072b-d8ba-4d33-a082-e11e4052bd7d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:02.266901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef95072b-d8ba-4d33-a082-e11e4052bd7d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:02.269674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=91 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:44:02.298999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ef95072b-d8ba-4d33-a082-e11e4052bd7d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050270 Jul 26 18:44:02.299575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1205/2381] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:02 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:44:02.439974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:44:02.440803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:44:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:44:03.315645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9b3179fc-425a-4e8f-a7ac-c741ba2ca6d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:03.319003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9b3179fc-425a-4e8f-a7ac-c741ba2ca6d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:03.329831 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b3179fc-425a-4e8f-a7ac-c741ba2ca6d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:03.330276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b3179fc-425a-4e8f-a7ac-c741ba2ca6d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:03.331053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b3179fc-425a-4e8f-a7ac-c741ba2ca6d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:03.331499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b3179fc-425a-4e8f-a7ac-c741ba2ca6d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:03.361295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9b3179fc-425a-4e8f-a7ac-c741ba2ca6d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052336 Jul 26 18:44:03.361861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1177/2382] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:03 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:04.377566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6c86602b-a0b1-4280-89ed-e1573c9b5a85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:04.380398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6c86602b-a0b1-4280-89ed-e1573c9b5a85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:04.382982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=30 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:44:04.390616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c86602b-a0b1-4280-89ed-e1573c9b5a85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:04.391318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c86602b-a0b1-4280-89ed-e1573c9b5a85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:04.392318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c86602b-a0b1-4280-89ed-e1573c9b5a85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:04.392890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c86602b-a0b1-4280-89ed-e1573c9b5a85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:04.427042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6c86602b-a0b1-4280-89ed-e1573c9b5a85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055967 Jul 26 18:44:04.427606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1206/2383] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:04 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:05.443183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bfa410bf-d5e8-4f02-ac2e-c26d28611653 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:05.446487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bfa410bf-d5e8-4f02-ac2e-c26d28611653 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:05.450174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=30 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:44:05.457166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfa410bf-d5e8-4f02-ac2e-c26d28611653 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:05.457653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfa410bf-d5e8-4f02-ac2e-c26d28611653 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:05.458442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfa410bf-d5e8-4f02-ac2e-c26d28611653 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:05.458926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfa410bf-d5e8-4f02-ac2e-c26d28611653 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:05.489878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bfa410bf-d5e8-4f02-ac2e-c26d28611653 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053389 Jul 26 18:44:05.490348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1178/2384] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:05 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:06.505478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ed4147d2-f8ed-48c5-ab5d-221ccfe9d29a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:06.508308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ed4147d2-f8ed-48c5-ab5d-221ccfe9d29a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:06.517168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed4147d2-f8ed-48c5-ab5d-221ccfe9d29a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:06.517763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed4147d2-f8ed-48c5-ab5d-221ccfe9d29a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:06.518763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed4147d2-f8ed-48c5-ab5d-221ccfe9d29a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:06.519380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed4147d2-f8ed-48c5-ab5d-221ccfe9d29a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:06.552261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ed4147d2-f8ed-48c5-ab5d-221ccfe9d29a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052497 Jul 26 18:44:06.552819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1207/2385] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:06 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:07.568702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c02b1cbd-e820-4eae-938e-58c88bc609f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:07.572343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c02b1cbd-e820-4eae-938e-58c88bc609f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:07.585170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c02b1cbd-e820-4eae-938e-58c88bc609f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:07.586065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c02b1cbd-e820-4eae-938e-58c88bc609f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:07.587679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c02b1cbd-e820-4eae-938e-58c88bc609f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:07.588415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c02b1cbd-e820-4eae-938e-58c88bc609f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:07.621502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c02b1cbd-e820-4eae-938e-58c88bc609f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059475 Jul 26 18:44:07.622865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1179/2386] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:07 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:08.633056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-44bf0591-f9ab-488a-927d-bc83d62dd9ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:08.635243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-44bf0591-f9ab-488a-927d-bc83d62dd9ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:08.642625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44bf0591-f9ab-488a-927d-bc83d62dd9ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:08.642979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44bf0591-f9ab-488a-927d-bc83d62dd9ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:08.643765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44bf0591-f9ab-488a-927d-bc83d62dd9ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:08.644193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44bf0591-f9ab-488a-927d-bc83d62dd9ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:08.674284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-44bf0591-f9ab-488a-927d-bc83d62dd9ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045180 Jul 26 18:44:08.675082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1208/2387] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:08 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:09.690366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4cde246a-ec2e-47b0-9e78-a86dc9778008 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:09.692581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4cde246a-ec2e-47b0-9e78-a86dc9778008 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:09.699703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4cde246a-ec2e-47b0-9e78-a86dc9778008 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:09.700158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4cde246a-ec2e-47b0-9e78-a86dc9778008 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:09.700919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4cde246a-ec2e-47b0-9e78-a86dc9778008 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:09.701356 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4cde246a-ec2e-47b0-9e78-a86dc9778008 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:09.703732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=90 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:44:09.732708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4cde246a-ec2e-47b0-9e78-a86dc9778008 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048643 Jul 26 18:44:09.733501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1180/2388] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:09 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:10.745592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7147fca6-19ca-4976-a739-ed98427f9ab1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:10.748363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7147fca6-19ca-4976-a739-ed98427f9ab1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:10.757722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7147fca6-19ca-4976-a739-ed98427f9ab1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:10.758353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7147fca6-19ca-4976-a739-ed98427f9ab1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:10.759484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7147fca6-19ca-4976-a739-ed98427f9ab1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:10.760099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7147fca6-19ca-4976-a739-ed98427f9ab1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:10.794601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7147fca6-19ca-4976-a739-ed98427f9ab1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052999 Jul 26 18:44:10.800246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1209/2389] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:10 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:11.808647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-53fb41c4-6072-42f2-9f04-35a50e142cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:11.810890 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-53fb41c4-6072-42f2-9f04-35a50e142cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:11.817536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53fb41c4-6072-42f2-9f04-35a50e142cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:11.817996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53fb41c4-6072-42f2-9f04-35a50e142cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:11.818828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53fb41c4-6072-42f2-9f04-35a50e142cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:11.819285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53fb41c4-6072-42f2-9f04-35a50e142cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:11.848605 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-53fb41c4-6072-42f2-9f04-35a50e142cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044221 Jul 26 18:44:11.849141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1181/2390] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:11 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:12.865586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dc871359-0a2a-4a52-903f-013a6dab227e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:12.868311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dc871359-0a2a-4a52-903f-013a6dab227e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:12.875950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dc871359-0a2a-4a52-903f-013a6dab227e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:12.876440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dc871359-0a2a-4a52-903f-013a6dab227e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:12.877271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dc871359-0a2a-4a52-903f-013a6dab227e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:12.877749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dc871359-0a2a-4a52-903f-013a6dab227e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:12.910210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dc871359-0a2a-4a52-903f-013a6dab227e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051205 Jul 26 18:44:12.910830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1210/2391] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:12 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:13.926738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5e662473-c1e7-42e9-acb8-c84d1c969128 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:13.929916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5e662473-c1e7-42e9-acb8-c84d1c969128 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:13.937509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e662473-c1e7-42e9-acb8-c84d1c969128 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:13.937947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e662473-c1e7-42e9-acb8-c84d1c969128 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:13.938785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e662473-c1e7-42e9-acb8-c84d1c969128 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:13.939306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e662473-c1e7-42e9-acb8-c84d1c969128 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:13.972470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5e662473-c1e7-42e9-acb8-c84d1c969128 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052365 Jul 26 18:44:13.973260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1182/2392] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:13 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:14.988609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1714a2d0-9135-4b79-b232-68c0fd5dbf53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:14.992155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1714a2d0-9135-4b79-b232-68c0fd5dbf53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:15.003293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1714a2d0-9135-4b79-b232-68c0fd5dbf53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:15.003935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1714a2d0-9135-4b79-b232-68c0fd5dbf53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:15.005167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1714a2d0-9135-4b79-b232-68c0fd5dbf53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:15.005873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1714a2d0-9135-4b79-b232-68c0fd5dbf53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:15.036928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1714a2d0-9135-4b79-b232-68c0fd5dbf53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054804 Jul 26 18:44:15.037941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1211/2393] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:14 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:16.052774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-627658f4-e29c-438e-ad0d-decc81403cb9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:16.056025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-627658f4-e29c-438e-ad0d-decc81403cb9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:16.066120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-627658f4-e29c-438e-ad0d-decc81403cb9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:16.066804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-627658f4-e29c-438e-ad0d-decc81403cb9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:16.068009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-627658f4-e29c-438e-ad0d-decc81403cb9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:16.068669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-627658f4-e29c-438e-ad0d-decc81403cb9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:16.099006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-627658f4-e29c-438e-ad0d-decc81403cb9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052378 Jul 26 18:44:16.099757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1183/2394] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:16 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:17.115799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6a9a7a1c-ecfb-4430-940a-394cde116ef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:17.118252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6a9a7a1c-ecfb-4430-940a-394cde116ef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:17.125072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6a9a7a1c-ecfb-4430-940a-394cde116ef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:17.125524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6a9a7a1c-ecfb-4430-940a-394cde116ef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:17.126288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6a9a7a1c-ecfb-4430-940a-394cde116ef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:17.126724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6a9a7a1c-ecfb-4430-940a-394cde116ef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:17.157099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6a9a7a1c-ecfb-4430-940a-394cde116ef2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047944 Jul 26 18:44:17.157657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1212/2395] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:17 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:17.737079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:44:17.737274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 18:44:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:44:18.173916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f955458c-2924-477d-a624-252388691c4f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:18.177425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f955458c-2924-477d-a624-252388691c4f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:18.188817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f955458c-2924-477d-a624-252388691c4f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:18.189621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f955458c-2924-477d-a624-252388691c4f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:18.190926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f955458c-2924-477d-a624-252388691c4f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:18.191678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f955458c-2924-477d-a624-252388691c4f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:18.222698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f955458c-2924-477d-a624-252388691c4f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055420 Jul 26 18:44:18.223307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1184/2396] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:18 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:19.239621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-014e8c6f-d61e-4579-abe7-ae94073939ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:19.242545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-014e8c6f-d61e-4579-abe7-ae94073939ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:19.251192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-014e8c6f-d61e-4579-abe7-ae94073939ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:19.251638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-014e8c6f-d61e-4579-abe7-ae94073939ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:19.252439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-014e8c6f-d61e-4579-abe7-ae94073939ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:19.252865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-014e8c6f-d61e-4579-abe7-ae94073939ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:19.283919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-014e8c6f-d61e-4579-abe7-ae94073939ed tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050834 Jul 26 18:44:19.284469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1213/2397] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:19 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:20.300512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2f683074-11bd-471c-9c87-f21b61f3741d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:20.304082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2f683074-11bd-471c-9c87-f21b61f3741d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:20.315038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f683074-11bd-471c-9c87-f21b61f3741d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:20.315854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f683074-11bd-471c-9c87-f21b61f3741d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:20.317113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f683074-11bd-471c-9c87-f21b61f3741d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:20.317838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f683074-11bd-471c-9c87-f21b61f3741d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:20.348117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2f683074-11bd-471c-9c87-f21b61f3741d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054319 Jul 26 18:44:20.348663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1185/2398] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:20 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:21.364666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a85014e5-ab55-4934-af8a-85a32a9eb757 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:21.367461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a85014e5-ab55-4934-af8a-85a32a9eb757 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:21.374513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a85014e5-ab55-4934-af8a-85a32a9eb757 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:21.374976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a85014e5-ab55-4934-af8a-85a32a9eb757 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:21.375885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a85014e5-ab55-4934-af8a-85a32a9eb757 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:21.376347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a85014e5-ab55-4934-af8a-85a32a9eb757 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:21.406338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a85014e5-ab55-4934-af8a-85a32a9eb757 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048262 Jul 26 18:44:21.406899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1214/2399] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:21 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:22.422618 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-290c66c3-9744-4a69-bcc2-455bad188a71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:22.426154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-290c66c3-9744-4a69-bcc2-455bad188a71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:22.434328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-290c66c3-9744-4a69-bcc2-455bad188a71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:22.434797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-290c66c3-9744-4a69-bcc2-455bad188a71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:22.435588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-290c66c3-9744-4a69-bcc2-455bad188a71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:22.436020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-290c66c3-9744-4a69-bcc2-455bad188a71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:22.465670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-290c66c3-9744-4a69-bcc2-455bad188a71 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049729 Jul 26 18:44:22.466250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1186/2400] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:22 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:23.481066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8123ac2f-002e-472b-b84f-8486888d77b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:23.484647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8123ac2f-002e-472b-b84f-8486888d77b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:23.495714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8123ac2f-002e-472b-b84f-8486888d77b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:23.496455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8123ac2f-002e-472b-b84f-8486888d77b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:23.497834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8123ac2f-002e-472b-b84f-8486888d77b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:23.498593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8123ac2f-002e-472b-b84f-8486888d77b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:23.532671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8123ac2f-002e-472b-b84f-8486888d77b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058496 Jul 26 18:44:23.533249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1215/2401] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:23 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:24.545178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1c6a2199-a474-49e4-a871-32e64074924f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:24.547396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1c6a2199-a474-49e4-a871-32e64074924f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:24.554521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c6a2199-a474-49e4-a871-32e64074924f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:24.555009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c6a2199-a474-49e4-a871-32e64074924f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:24.555783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c6a2199-a474-49e4-a871-32e64074924f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:24.556216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c6a2199-a474-49e4-a871-32e64074924f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:24.586702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1c6a2199-a474-49e4-a871-32e64074924f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045462 Jul 26 18:44:24.587303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1187/2402] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:24 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:25.602461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9648405e-1157-4e4c-a3b0-24e04b31ebdc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:25.605229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9648405e-1157-4e4c-a3b0-24e04b31ebdc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:25.613989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9648405e-1157-4e4c-a3b0-24e04b31ebdc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:25.614545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9648405e-1157-4e4c-a3b0-24e04b31ebdc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:25.615628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9648405e-1157-4e4c-a3b0-24e04b31ebdc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:25.616164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9648405e-1157-4e4c-a3b0-24e04b31ebdc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:25.650547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9648405e-1157-4e4c-a3b0-24e04b31ebdc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054277 Jul 26 18:44:25.651185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1216/2403] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:25 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:26.666574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7fefaa59-130f-4298-a54c-ece9e279d187 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:26.669769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7fefaa59-130f-4298-a54c-ece9e279d187 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:26.680261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fefaa59-130f-4298-a54c-ece9e279d187 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:26.680700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fefaa59-130f-4298-a54c-ece9e279d187 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:26.681492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fefaa59-130f-4298-a54c-ece9e279d187 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:26.682208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fefaa59-130f-4298-a54c-ece9e279d187 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:26.714144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7fefaa59-130f-4298-a54c-ece9e279d187 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054248 Jul 26 18:44:26.714823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1188/2404] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:26 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:27.728104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-143d503f-f926-4e23-a32f-b17f78b248b0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:27.730222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-143d503f-f926-4e23-a32f-b17f78b248b0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:27.737046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-143d503f-f926-4e23-a32f-b17f78b248b0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:27.737479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-143d503f-f926-4e23-a32f-b17f78b248b0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:27.738237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-143d503f-f926-4e23-a32f-b17f78b248b0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:27.738671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-143d503f-f926-4e23-a32f-b17f78b248b0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:27.772064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-143d503f-f926-4e23-a32f-b17f78b248b0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049725 Jul 26 18:44:27.772729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1217/2405] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:27 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:28.784714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b239459e-905e-4cbb-9cc8-836d76df47c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:28.786902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b239459e-905e-4cbb-9cc8-836d76df47c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:28.793608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b239459e-905e-4cbb-9cc8-836d76df47c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:28.794065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b239459e-905e-4cbb-9cc8-836d76df47c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:28.794807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b239459e-905e-4cbb-9cc8-836d76df47c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:28.795290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b239459e-905e-4cbb-9cc8-836d76df47c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:28.824993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b239459e-905e-4cbb-9cc8-836d76df47c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044218 Jul 26 18:44:28.825760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1189/2406] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:28 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:29.837119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b3e8cd88-a587-44f0-9da8-4806dfe672f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:29.840057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b3e8cd88-a587-44f0-9da8-4806dfe672f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:29.847275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3e8cd88-a587-44f0-9da8-4806dfe672f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:29.848194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3e8cd88-a587-44f0-9da8-4806dfe672f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:29.849287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3e8cd88-a587-44f0-9da8-4806dfe672f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:29.849767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3e8cd88-a587-44f0-9da8-4806dfe672f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:29.879932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b3e8cd88-a587-44f0-9da8-4806dfe672f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046750 Jul 26 18:44:29.880486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1218/2407] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:29 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:30.892363 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9667ffb8-6b20-4b30-8960-fa71aa7d4aab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:30.894530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9667ffb8-6b20-4b30-8960-fa71aa7d4aab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:30.901498 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9667ffb8-6b20-4b30-8960-fa71aa7d4aab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:30.901947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9667ffb8-6b20-4b30-8960-fa71aa7d4aab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:30.902732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9667ffb8-6b20-4b30-8960-fa71aa7d4aab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:30.903190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9667ffb8-6b20-4b30-8960-fa71aa7d4aab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:30.933440 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9667ffb8-6b20-4b30-8960-fa71aa7d4aab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045064 Jul 26 18:44:30.934006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1190/2408] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:30 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:31.946081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0fb3f4ef-7ab1-4fd9-9457-67c844447f43 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:31.948363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0fb3f4ef-7ab1-4fd9-9457-67c844447f43 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:31.955085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0fb3f4ef-7ab1-4fd9-9457-67c844447f43 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:31.955545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0fb3f4ef-7ab1-4fd9-9457-67c844447f43 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:31.956315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0fb3f4ef-7ab1-4fd9-9457-67c844447f43 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:31.956752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0fb3f4ef-7ab1-4fd9-9457-67c844447f43 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:31.986233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0fb3f4ef-7ab1-4fd9-9457-67c844447f43 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Jul 26 18:44:31.987099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1219/2409] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:31 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:32.999283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f2534c2b-2819-4dbb-8256-fce15096b4bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:33.001448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f2534c2b-2819-4dbb-8256-fce15096b4bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:33.008182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2534c2b-2819-4dbb-8256-fce15096b4bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:33.008621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2534c2b-2819-4dbb-8256-fce15096b4bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:33.009558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2534c2b-2819-4dbb-8256-fce15096b4bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:33.009985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2534c2b-2819-4dbb-8256-fce15096b4bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:33.040326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f2534c2b-2819-4dbb-8256-fce15096b4bb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045654 Jul 26 18:44:33.041057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1191/2410] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:34.053386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8fbecbd5-9b69-40be-a606-0ee152b1bcd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:34.055551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8fbecbd5-9b69-40be-a606-0ee152b1bcd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:34.061859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fbecbd5-9b69-40be-a606-0ee152b1bcd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:34.062309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fbecbd5-9b69-40be-a606-0ee152b1bcd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:34.063074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fbecbd5-9b69-40be-a606-0ee152b1bcd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:34.063535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fbecbd5-9b69-40be-a606-0ee152b1bcd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:34.065862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=90 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:44:34.094044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8fbecbd5-9b69-40be-a606-0ee152b1bcd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044709 Jul 26 18:44:34.094591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1220/2411] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:34 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:35.106446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7818f56f-fcc5-401b-92e2-11084a028211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:35.108748 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7818f56f-fcc5-401b-92e2-11084a028211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:35.115578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7818f56f-fcc5-401b-92e2-11084a028211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:35.116029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7818f56f-fcc5-401b-92e2-11084a028211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:35.116798 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7818f56f-fcc5-401b-92e2-11084a028211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:35.117233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7818f56f-fcc5-401b-92e2-11084a028211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:35.148814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7818f56f-fcc5-401b-92e2-11084a028211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045971 Jul 26 18:44:35.149352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1192/2412] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:36.165418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-36903ca6-eb6c-4343-871f-c93f520e7a4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:36.167598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-36903ca6-eb6c-4343-871f-c93f520e7a4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:36.169918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=30 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:44:36.175610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36903ca6-eb6c-4343-871f-c93f520e7a4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:36.176053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36903ca6-eb6c-4343-871f-c93f520e7a4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:36.176814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36903ca6-eb6c-4343-871f-c93f520e7a4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:36.177855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36903ca6-eb6c-4343-871f-c93f520e7a4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:36.220656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-36903ca6-eb6c-4343-871f-c93f520e7a4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061831 Jul 26 18:44:36.221554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1221/2413] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:36 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:37.237994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1cabd45f-8c7d-4d32-a763-21e32c232a98 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:37.241656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1cabd45f-8c7d-4d32-a763-21e32c232a98 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:37.244703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=30 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:44:37.251838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1cabd45f-8c7d-4d32-a763-21e32c232a98 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:37.252289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1cabd45f-8c7d-4d32-a763-21e32c232a98 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:37.253056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1cabd45f-8c7d-4d32-a763-21e32c232a98 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:37.253519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1cabd45f-8c7d-4d32-a763-21e32c232a98 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:37.283922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1cabd45f-8c7d-4d32-a763-21e32c232a98 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052528 Jul 26 18:44:37.284509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1193/2414] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:37 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:38.297046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4215a064-a2e7-422c-bbbe-5c5c74228442 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:38.299422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4215a064-a2e7-422c-bbbe-5c5c74228442 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:38.306516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4215a064-a2e7-422c-bbbe-5c5c74228442 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:38.306984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4215a064-a2e7-422c-bbbe-5c5c74228442 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:38.307816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4215a064-a2e7-422c-bbbe-5c5c74228442 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:38.308273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4215a064-a2e7-422c-bbbe-5c5c74228442 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:38.341429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4215a064-a2e7-422c-bbbe-5c5c74228442 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048800 Jul 26 18:44:38.342161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1222/2415] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:38 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:39.357873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3459fc14-669f-4f5a-82f9-da0bb5da0584 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:39.361374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3459fc14-669f-4f5a-82f9-da0bb5da0584 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:39.371207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3459fc14-669f-4f5a-82f9-da0bb5da0584 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:39.371657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3459fc14-669f-4f5a-82f9-da0bb5da0584 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:39.372425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3459fc14-669f-4f5a-82f9-da0bb5da0584 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:39.372860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3459fc14-669f-4f5a-82f9-da0bb5da0584 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:39.403946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3459fc14-669f-4f5a-82f9-da0bb5da0584 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052658 Jul 26 18:44:39.407077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1194/2416] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:39 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:40.420126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-815cf559-d300-48f1-b3d7-b161d09bd2c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:40.422148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-815cf559-d300-48f1-b3d7-b161d09bd2c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:40.430145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-815cf559-d300-48f1-b3d7-b161d09bd2c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:40.430713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-815cf559-d300-48f1-b3d7-b161d09bd2c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:40.431723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-815cf559-d300-48f1-b3d7-b161d09bd2c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:40.432310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-815cf559-d300-48f1-b3d7-b161d09bd2c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:40.465412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-815cf559-d300-48f1-b3d7-b161d09bd2c7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051812 Jul 26 18:44:40.466034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1223/2417] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:40 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:41.480054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1c7582ac-3ce4-474a-b6fe-b45ea7be5abb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:41.482212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1c7582ac-3ce4-474a-b6fe-b45ea7be5abb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:41.489141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c7582ac-3ce4-474a-b6fe-b45ea7be5abb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:41.489575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c7582ac-3ce4-474a-b6fe-b45ea7be5abb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:41.490337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c7582ac-3ce4-474a-b6fe-b45ea7be5abb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:41.490766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c7582ac-3ce4-474a-b6fe-b45ea7be5abb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:41.493146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=90 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:44:41.521400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1c7582ac-3ce4-474a-b6fe-b45ea7be5abb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046436 Jul 26 18:44:41.521976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1195/2418] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:41 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:42.537708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-69c80f10-0842-49a1-bf2b-2b1402a48332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:42.541386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-69c80f10-0842-49a1-bf2b-2b1402a48332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:42.551779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69c80f10-0842-49a1-bf2b-2b1402a48332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:42.552515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69c80f10-0842-49a1-bf2b-2b1402a48332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:42.553756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69c80f10-0842-49a1-bf2b-2b1402a48332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:42.554762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69c80f10-0842-49a1-bf2b-2b1402a48332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:42.586882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-69c80f10-0842-49a1-bf2b-2b1402a48332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055994 Jul 26 18:44:42.587554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1224/2419] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:42 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:43.603973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3571c4e1-b25b-445b-870b-4bc697ba1964 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:43.607502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3571c4e1-b25b-445b-870b-4bc697ba1964 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:43.618327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3571c4e1-b25b-445b-870b-4bc697ba1964 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:43.619107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3571c4e1-b25b-445b-870b-4bc697ba1964 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:43.620383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3571c4e1-b25b-445b-870b-4bc697ba1964 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:43.621077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3571c4e1-b25b-445b-870b-4bc697ba1964 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:43.658719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3571c4e1-b25b-445b-870b-4bc697ba1964 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061268 Jul 26 18:44:43.659807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1196/2420] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:44.676185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b9f0b45c-4058-4e63-aa8e-b9ca0df5c1b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:44.679501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b9f0b45c-4058-4e63-aa8e-b9ca0df5c1b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:44.687407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9f0b45c-4058-4e63-aa8e-b9ca0df5c1b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:44.687886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9f0b45c-4058-4e63-aa8e-b9ca0df5c1b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:44.688656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9f0b45c-4058-4e63-aa8e-b9ca0df5c1b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:44.689074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9f0b45c-4058-4e63-aa8e-b9ca0df5c1b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:44.721657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b9f0b45c-4058-4e63-aa8e-b9ca0df5c1b3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052377 Jul 26 18:44:44.722194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1225/2421] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:44 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:45.734643 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-52e4350a-acff-4e3d-a99f-3c9916024773 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:45.736828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-52e4350a-acff-4e3d-a99f-3c9916024773 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:45.745759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52e4350a-acff-4e3d-a99f-3c9916024773 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:45.745759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52e4350a-acff-4e3d-a99f-3c9916024773 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:45.745759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52e4350a-acff-4e3d-a99f-3c9916024773 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:45.745759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52e4350a-acff-4e3d-a99f-3c9916024773 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:45.775957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-52e4350a-acff-4e3d-a99f-3c9916024773 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045315 Jul 26 18:44:45.776550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1197/2422] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:45 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:46.789233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3da0a313-3628-479e-a6c0-a5445d7fa7b1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:46.791785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3da0a313-3628-479e-a6c0-a5445d7fa7b1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:46.798674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3da0a313-3628-479e-a6c0-a5445d7fa7b1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:46.799150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3da0a313-3628-479e-a6c0-a5445d7fa7b1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:46.799909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3da0a313-3628-479e-a6c0-a5445d7fa7b1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:46.800340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3da0a313-3628-479e-a6c0-a5445d7fa7b1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:46.829964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3da0a313-3628-479e-a6c0-a5445d7fa7b1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045401 Jul 26 18:44:46.830519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1226/2423] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:46 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:44:47.844588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cd7bc57e-ab00-4c1f-b7d0-0abcf772e1f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:47.847209 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cd7bc57e-ab00-4c1f-b7d0-0abcf772e1f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:47.857161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd7bc57e-ab00-4c1f-b7d0-0abcf772e1f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:47.857757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd7bc57e-ab00-4c1f-b7d0-0abcf772e1f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:47.858711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd7bc57e-ab00-4c1f-b7d0-0abcf772e1f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:47.859301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd7bc57e-ab00-4c1f-b7d0-0abcf772e1f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:47.891550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cd7bc57e-ab00-4c1f-b7d0-0abcf772e1f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052043 Jul 26 18:44:47.892441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1198/2424] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:47 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:48.904671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d67ed09b-276f-49a4-9570-acec5808f65b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:48.906717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d67ed09b-276f-49a4-9570-acec5808f65b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:48.913536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d67ed09b-276f-49a4-9570-acec5808f65b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:48.913981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d67ed09b-276f-49a4-9570-acec5808f65b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:48.914731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d67ed09b-276f-49a4-9570-acec5808f65b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:48.915275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d67ed09b-276f-49a4-9570-acec5808f65b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:48.945201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d67ed09b-276f-49a4-9570-acec5808f65b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Jul 26 18:44:48.945737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1227/2425] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:48 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:49.960561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-78e0e4ba-be93-4d88-8a4a-d8934f0d493b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:49.963165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-78e0e4ba-be93-4d88-8a4a-d8934f0d493b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:49.970100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78e0e4ba-be93-4d88-8a4a-d8934f0d493b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:49.970538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78e0e4ba-be93-4d88-8a4a-d8934f0d493b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:49.971322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78e0e4ba-be93-4d88-8a4a-d8934f0d493b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:49.971727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78e0e4ba-be93-4d88-8a4a-d8934f0d493b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:50.001471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-78e0e4ba-be93-4d88-8a4a-d8934f0d493b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046139 Jul 26 18:44:50.006018 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1199/2426] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:49 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:51.017928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c374729f-5349-45fe-bdcc-55a326c6ccd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:51.021386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c374729f-5349-45fe-bdcc-55a326c6ccd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:51.032761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c374729f-5349-45fe-bdcc-55a326c6ccd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:51.033510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c374729f-5349-45fe-bdcc-55a326c6ccd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:51.034765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c374729f-5349-45fe-bdcc-55a326c6ccd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:51.035562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c374729f-5349-45fe-bdcc-55a326c6ccd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:51.067568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c374729f-5349-45fe-bdcc-55a326c6ccd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056235 Jul 26 18:44:51.068119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1228/2427] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:52.084292 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-50ecaa61-9158-458c-ad25-8fdb050c6929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:52.087756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-50ecaa61-9158-458c-ad25-8fdb050c6929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:52.095138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50ecaa61-9158-458c-ad25-8fdb050c6929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:52.095589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50ecaa61-9158-458c-ad25-8fdb050c6929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:52.096337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50ecaa61-9158-458c-ad25-8fdb050c6929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:52.096766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50ecaa61-9158-458c-ad25-8fdb050c6929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:52.128242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-50ecaa61-9158-458c-ad25-8fdb050c6929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050609 Jul 26 18:44:52.129156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1200/2428] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:52 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:53.144173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8bb52443-a84c-4efd-be23-324d29ce1f32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:53.147508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8bb52443-a84c-4efd-be23-324d29ce1f32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:53.155830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8bb52443-a84c-4efd-be23-324d29ce1f32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:53.156284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8bb52443-a84c-4efd-be23-324d29ce1f32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:53.157040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8bb52443-a84c-4efd-be23-324d29ce1f32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:53.157473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8bb52443-a84c-4efd-be23-324d29ce1f32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:53.187929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8bb52443-a84c-4efd-be23-324d29ce1f32 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050625 Jul 26 18:44:53.188487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1229/2429] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:53 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:54.201631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b2f9e768-2fb1-4525-b459-675566611a13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:54.203818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b2f9e768-2fb1-4525-b459-675566611a13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:54.210744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2f9e768-2fb1-4525-b459-675566611a13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:54.211228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2f9e768-2fb1-4525-b459-675566611a13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:54.211993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2f9e768-2fb1-4525-b459-675566611a13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:54.212429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2f9e768-2fb1-4525-b459-675566611a13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:54.242115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b2f9e768-2fb1-4525-b459-675566611a13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 Jul 26 18:44:54.242675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1201/2430] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:54 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:55.259197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1ea579b3-a00c-4c81-989e-55f347ea33dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:55.262706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1ea579b3-a00c-4c81-989e-55f347ea33dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:55.273971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ea579b3-a00c-4c81-989e-55f347ea33dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:55.274705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ea579b3-a00c-4c81-989e-55f347ea33dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:55.275925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ea579b3-a00c-4c81-989e-55f347ea33dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:55.276358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ea579b3-a00c-4c81-989e-55f347ea33dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:55.306477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1ea579b3-a00c-4c81-989e-55f347ea33dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053772 Jul 26 18:44:55.307196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1230/2431] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:56.324375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-35a30d4e-0574-40ba-b7bd-9c3d102f2d48 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:56.327262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-35a30d4e-0574-40ba-b7bd-9c3d102f2d48 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:56.336132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35a30d4e-0574-40ba-b7bd-9c3d102f2d48 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:56.336734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35a30d4e-0574-40ba-b7bd-9c3d102f2d48 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:56.337879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35a30d4e-0574-40ba-b7bd-9c3d102f2d48 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:56.338400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35a30d4e-0574-40ba-b7bd-9c3d102f2d48 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:56.372381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-35a30d4e-0574-40ba-b7bd-9c3d102f2d48 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054974 Jul 26 18:44:56.373212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1202/2432] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:56 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:57.389212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e441060d-9732-4e27-9e62-bcb1c1579db8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:57.392630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e441060d-9732-4e27-9e62-bcb1c1579db8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:57.402927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e441060d-9732-4e27-9e62-bcb1c1579db8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:57.403419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e441060d-9732-4e27-9e62-bcb1c1579db8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:57.404170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e441060d-9732-4e27-9e62-bcb1c1579db8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:57.404642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e441060d-9732-4e27-9e62-bcb1c1579db8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:57.435487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e441060d-9732-4e27-9e62-bcb1c1579db8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053054 Jul 26 18:44:57.436418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1231/2433] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:57 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:58.449061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-34eec19b-0ab2-48a3-bc98-dfa5a536907a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:58.451988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-34eec19b-0ab2-48a3-bc98-dfa5a536907a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:58.461322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34eec19b-0ab2-48a3-bc98-dfa5a536907a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:58.461905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34eec19b-0ab2-48a3-bc98-dfa5a536907a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:58.462922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34eec19b-0ab2-48a3-bc98-dfa5a536907a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:58.463593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34eec19b-0ab2-48a3-bc98-dfa5a536907a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:58.493900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-34eec19b-0ab2-48a3-bc98-dfa5a536907a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049598 Jul 26 18:44:58.494493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1203/2434] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:58 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:44:59.510576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a29b1ca8-ae12-48c5-8118-309fe566621e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:44:59.514041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a29b1ca8-ae12-48c5-8118-309fe566621e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:44:59.525231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a29b1ca8-ae12-48c5-8118-309fe566621e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:59.525915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a29b1ca8-ae12-48c5-8118-309fe566621e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:59.527043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a29b1ca8-ae12-48c5-8118-309fe566621e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:44:59.527533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a29b1ca8-ae12-48c5-8118-309fe566621e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:44:59.556363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a29b1ca8-ae12-48c5-8118-309fe566621e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052480 Jul 26 18:44:59.556894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1232/2435] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:44:59 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:00.573007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f08d4b83-f39c-45a2-ad0f-4a1d1dc5e20d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:00.576499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f08d4b83-f39c-45a2-ad0f-4a1d1dc5e20d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:00.588227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f08d4b83-f39c-45a2-ad0f-4a1d1dc5e20d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:00.589075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f08d4b83-f39c-45a2-ad0f-4a1d1dc5e20d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:00.590435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f08d4b83-f39c-45a2-ad0f-4a1d1dc5e20d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:00.591949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f08d4b83-f39c-45a2-ad0f-4a1d1dc5e20d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:00.624721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f08d4b83-f39c-45a2-ad0f-4a1d1dc5e20d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058288 Jul 26 18:45:00.625299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1204/2436] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:00 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:01.639800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6c3f1203-a810-4671-99e8-e9f02c3d0ce8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:01.642407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6c3f1203-a810-4671-99e8-e9f02c3d0ce8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:01.651924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c3f1203-a810-4671-99e8-e9f02c3d0ce8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:01.652448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c3f1203-a810-4671-99e8-e9f02c3d0ce8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:01.653526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c3f1203-a810-4671-99e8-e9f02c3d0ce8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:01.654100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c3f1203-a810-4671-99e8-e9f02c3d0ce8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:01.688697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6c3f1203-a810-4671-99e8-e9f02c3d0ce8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052856 Jul 26 18:45:01.688697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1233/2437] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:01 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:02.703529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-10c299f4-294a-4bcf-8f1c-df2b9885072c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:02.706953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-10c299f4-294a-4bcf-8f1c-df2b9885072c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:02.716422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10c299f4-294a-4bcf-8f1c-df2b9885072c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:02.716863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10c299f4-294a-4bcf-8f1c-df2b9885072c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:02.717618 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10c299f4-294a-4bcf-8f1c-df2b9885072c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:02.718044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10c299f4-294a-4bcf-8f1c-df2b9885072c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:02.747267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-10c299f4-294a-4bcf-8f1c-df2b9885072c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050242 Jul 26 18:45:02.748181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1205/2438] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:02 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:03.760067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-16d1d63b-2c39-42bd-80eb-3890a4c0d84e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:03.762314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-16d1d63b-2c39-42bd-80eb-3890a4c0d84e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:03.769020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16d1d63b-2c39-42bd-80eb-3890a4c0d84e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:03.769464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16d1d63b-2c39-42bd-80eb-3890a4c0d84e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:03.770221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16d1d63b-2c39-42bd-80eb-3890a4c0d84e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:03.770654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16d1d63b-2c39-42bd-80eb-3890a4c0d84e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:03.800869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-16d1d63b-2c39-42bd-80eb-3890a4c0d84e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044981 Jul 26 18:45:03.801440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1234/2439] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:03 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:04.813995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d91b050c-5836-483e-b0c2-da32675a90c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:04.816179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d91b050c-5836-483e-b0c2-da32675a90c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:04.823057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d91b050c-5836-483e-b0c2-da32675a90c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:04.823535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d91b050c-5836-483e-b0c2-da32675a90c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:04.824285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d91b050c-5836-483e-b0c2-da32675a90c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:04.824712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d91b050c-5836-483e-b0c2-da32675a90c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:04.854779 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d91b050c-5836-483e-b0c2-da32675a90c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044689 Jul 26 18:45:04.855309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1206/2440] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:04 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:05.871236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c017f4c9-4648-407b-8b2a-fb828f68cdb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:05.873871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c017f4c9-4648-407b-8b2a-fb828f68cdb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:05.882260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c017f4c9-4648-407b-8b2a-fb828f68cdb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:05.882815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c017f4c9-4648-407b-8b2a-fb828f68cdb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:05.883796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c017f4c9-4648-407b-8b2a-fb828f68cdb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:05.884336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c017f4c9-4648-407b-8b2a-fb828f68cdb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:05.886936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=90 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:45:05.916378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c017f4c9-4648-407b-8b2a-fb828f68cdb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051584 Jul 26 18:45:05.917022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1235/2441] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:05 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:06.933055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cd61aca4-cf9d-449a-8fda-cf576cca330e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:06.936559 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cd61aca4-cf9d-449a-8fda-cf576cca330e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:06.947539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd61aca4-cf9d-449a-8fda-cf576cca330e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:06.948224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd61aca4-cf9d-449a-8fda-cf576cca330e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:06.948976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd61aca4-cf9d-449a-8fda-cf576cca330e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:06.949404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd61aca4-cf9d-449a-8fda-cf576cca330e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:06.979414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cd61aca4-cf9d-449a-8fda-cf576cca330e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052818 Jul 26 18:45:06.979975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1207/2442] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:06 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:07.996183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-357a2cbd-7730-4444-aa23-4b59906381d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:07.999563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-357a2cbd-7730-4444-aa23-4b59906381d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:08.003175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=30 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:45:08.013145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-357a2cbd-7730-4444-aa23-4b59906381d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:08.013145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-357a2cbd-7730-4444-aa23-4b59906381d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:08.014365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-357a2cbd-7730-4444-aa23-4b59906381d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:08.015091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-357a2cbd-7730-4444-aa23-4b59906381d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:08.050899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-357a2cbd-7730-4444-aa23-4b59906381d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061478 Jul 26 18:45:08.051497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1236/2443] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:07 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:09.067584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0a308efd-05ad-4459-b01e-614773f314f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:09.070879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0a308efd-05ad-4459-b01e-614773f314f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:09.074027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=30 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:45:09.079758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a308efd-05ad-4459-b01e-614773f314f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:09.080194 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a308efd-05ad-4459-b01e-614773f314f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:09.080960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a308efd-05ad-4459-b01e-614773f314f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:09.081407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a308efd-05ad-4459-b01e-614773f314f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:09.110823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0a308efd-05ad-4459-b01e-614773f314f2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050077 Jul 26 18:45:09.111427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1208/2444] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:09 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:10.127308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-db3ddcbf-ec0f-42b7-a667-dfb8aac3cc3c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:10.130773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-db3ddcbf-ec0f-42b7-a667-dfb8aac3cc3c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:10.141884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db3ddcbf-ec0f-42b7-a667-dfb8aac3cc3c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:10.142629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db3ddcbf-ec0f-42b7-a667-dfb8aac3cc3c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:10.143965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db3ddcbf-ec0f-42b7-a667-dfb8aac3cc3c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:10.144701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db3ddcbf-ec0f-42b7-a667-dfb8aac3cc3c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:10.178280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-db3ddcbf-ec0f-42b7-a667-dfb8aac3cc3c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057584 Jul 26 18:45:10.178848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1237/2445] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:10 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:11.195109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7a411379-0189-43aa-8bf5-77e41c9d550f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:11.198358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7a411379-0189-43aa-8bf5-77e41c9d550f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:11.205723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a411379-0189-43aa-8bf5-77e41c9d550f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:11.206173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a411379-0189-43aa-8bf5-77e41c9d550f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:11.206900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a411379-0189-43aa-8bf5-77e41c9d550f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:11.207375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a411379-0189-43aa-8bf5-77e41c9d550f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:11.237523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7a411379-0189-43aa-8bf5-77e41c9d550f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050173 Jul 26 18:45:11.238299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1209/2446] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:11 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:12.254091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bb6e5c44-bc56-4678-b681-68414e826b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:12.257568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bb6e5c44-bc56-4678-b681-68414e826b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:12.268439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb6e5c44-bc56-4678-b681-68414e826b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:12.269168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb6e5c44-bc56-4678-b681-68414e826b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:12.270691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb6e5c44-bc56-4678-b681-68414e826b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:12.271464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb6e5c44-bc56-4678-b681-68414e826b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:12.303528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bb6e5c44-bc56-4678-b681-68414e826b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056016 Jul 26 18:45:12.304102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1238/2447] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:12 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:13.446876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8d1f148c-a00a-43e9-b56b-fae39c5d81d3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:13.449083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8d1f148c-a00a-43e9-b56b-fae39c5d81d3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:13.455166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d1f148c-a00a-43e9-b56b-fae39c5d81d3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:13.455609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d1f148c-a00a-43e9-b56b-fae39c5d81d3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:13.456355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d1f148c-a00a-43e9-b56b-fae39c5d81d3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:13.456779 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d1f148c-a00a-43e9-b56b-fae39c5d81d3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:13.460290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=90 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:45:13.485998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8d1f148c-a00a-43e9-b56b-fae39c5d81d3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172619 Jul 26 18:45:13.486573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1210/2448] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:13 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:14.498192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4ef2f548-a7ea-4ae8-8f29-cc5d3d455ebc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:14.500353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4ef2f548-a7ea-4ae8-8f29-cc5d3d455ebc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:14.507057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ef2f548-a7ea-4ae8-8f29-cc5d3d455ebc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:14.507530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ef2f548-a7ea-4ae8-8f29-cc5d3d455ebc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:14.508285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ef2f548-a7ea-4ae8-8f29-cc5d3d455ebc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:14.508718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ef2f548-a7ea-4ae8-8f29-cc5d3d455ebc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:14.538320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4ef2f548-a7ea-4ae8-8f29-cc5d3d455ebc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044116 Jul 26 18:45:14.538856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1239/2449] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:14 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:15.549910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6f36f777-dad4-464f-a398-f883f010a0e6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:15.552651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6f36f777-dad4-464f-a398-f883f010a0e6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:15.559518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f36f777-dad4-464f-a398-f883f010a0e6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:15.559963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f36f777-dad4-464f-a398-f883f010a0e6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:15.560711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f36f777-dad4-464f-a398-f883f010a0e6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:15.561131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f36f777-dad4-464f-a398-f883f010a0e6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:15.590589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6f36f777-dad4-464f-a398-f883f010a0e6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044509 Jul 26 18:45:15.591303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1211/2450] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:15 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:16.603459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a0a9a196-05c4-4213-ba33-a0685d6e7e59 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:16.605583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a0a9a196-05c4-4213-ba33-a0685d6e7e59 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:16.621625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0a9a196-05c4-4213-ba33-a0685d6e7e59 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:16.622073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0a9a196-05c4-4213-ba33-a0685d6e7e59 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:16.622843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0a9a196-05c4-4213-ba33-a0685d6e7e59 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:16.623304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0a9a196-05c4-4213-ba33-a0685d6e7e59 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:16.652794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a0a9a196-05c4-4213-ba33-a0685d6e7e59 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053347 Jul 26 18:45:16.653355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1240/2451] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:16 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:17.665308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c4b9a692-d488-4dde-801e-bd6e188d33f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:17.667518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c4b9a692-d488-4dde-801e-bd6e188d33f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:17.674054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4b9a692-d488-4dde-801e-bd6e188d33f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:17.674504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4b9a692-d488-4dde-801e-bd6e188d33f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:17.675295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4b9a692-d488-4dde-801e-bd6e188d33f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:17.675735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4b9a692-d488-4dde-801e-bd6e188d33f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:17.705124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c4b9a692-d488-4dde-801e-bd6e188d33f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Jul 26 18:45:17.705725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1212/2452] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:17 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:18.717725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cb56e8ef-c52f-4485-8b52-96f5761dae97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:18.719972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cb56e8ef-c52f-4485-8b52-96f5761dae97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:18.726593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb56e8ef-c52f-4485-8b52-96f5761dae97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:18.727053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb56e8ef-c52f-4485-8b52-96f5761dae97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:18.727803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb56e8ef-c52f-4485-8b52-96f5761dae97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:18.728419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb56e8ef-c52f-4485-8b52-96f5761dae97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:18.768009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cb56e8ef-c52f-4485-8b52-96f5761dae97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054314 Jul 26 18:45:18.768749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1241/2453] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:18 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:19.780400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0b345092-d8dc-44dd-8009-12318daa7bc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:19.782933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0b345092-d8dc-44dd-8009-12318daa7bc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:19.789778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b345092-d8dc-44dd-8009-12318daa7bc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:19.790225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b345092-d8dc-44dd-8009-12318daa7bc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:19.790998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b345092-d8dc-44dd-8009-12318daa7bc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:19.791460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b345092-d8dc-44dd-8009-12318daa7bc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:19.822629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0b345092-d8dc-44dd-8009-12318daa7bc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046122 Jul 26 18:45:19.823197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1213/2454] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:19 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:20.842637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-80348ac0-a996-4d84-b6f1-cb2cab631a1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:20.844806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-80348ac0-a996-4d84-b6f1-cb2cab631a1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:20.851564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80348ac0-a996-4d84-b6f1-cb2cab631a1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:20.852000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80348ac0-a996-4d84-b6f1-cb2cab631a1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:20.852758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80348ac0-a996-4d84-b6f1-cb2cab631a1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:20.853179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80348ac0-a996-4d84-b6f1-cb2cab631a1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:20.882005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-80348ac0-a996-4d84-b6f1-cb2cab631a1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043234 Jul 26 18:45:20.882573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1242/2455] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:20 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:21.893891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1f54105f-cc2b-4ebd-9882-f42f7e49b157 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:21.896089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1f54105f-cc2b-4ebd-9882-f42f7e49b157 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:21.903218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f54105f-cc2b-4ebd-9882-f42f7e49b157 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:21.903676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f54105f-cc2b-4ebd-9882-f42f7e49b157 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:21.904446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f54105f-cc2b-4ebd-9882-f42f7e49b157 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:21.904881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f54105f-cc2b-4ebd-9882-f42f7e49b157 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:21.936153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1f54105f-cc2b-4ebd-9882-f42f7e49b157 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046174 Jul 26 18:45:21.936724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1214/2456] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:21 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:22.948570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4efa634b-c164-4e99-afd4-9950a394af4e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:22.950879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4efa634b-c164-4e99-afd4-9950a394af4e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:22.957562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4efa634b-c164-4e99-afd4-9950a394af4e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:22.958018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4efa634b-c164-4e99-afd4-9950a394af4e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:22.958782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4efa634b-c164-4e99-afd4-9950a394af4e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:22.959257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4efa634b-c164-4e99-afd4-9950a394af4e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:22.988945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4efa634b-c164-4e99-afd4-9950a394af4e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Jul 26 18:45:22.989529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1243/2457] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:22 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:24.005426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7ffb5604-ac1f-4909-b036-8ffa94934430 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:24.008997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7ffb5604-ac1f-4909-b036-8ffa94934430 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:24.016265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ffb5604-ac1f-4909-b036-8ffa94934430 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:24.016716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ffb5604-ac1f-4909-b036-8ffa94934430 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:24.017489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ffb5604-ac1f-4909-b036-8ffa94934430 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:24.019472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ffb5604-ac1f-4909-b036-8ffa94934430 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:24.048410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7ffb5604-ac1f-4909-b036-8ffa94934430 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049597 Jul 26 18:45:24.049149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1215/2458] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:23 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:25.061890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-07eec81b-fe68-4475-86d4-6b8cb49f0ef5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:25.064043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-07eec81b-fe68-4475-86d4-6b8cb49f0ef5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:25.071105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07eec81b-fe68-4475-86d4-6b8cb49f0ef5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:25.071575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07eec81b-fe68-4475-86d4-6b8cb49f0ef5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:25.072392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07eec81b-fe68-4475-86d4-6b8cb49f0ef5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:25.072766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07eec81b-fe68-4475-86d4-6b8cb49f0ef5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:25.102961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-07eec81b-fe68-4475-86d4-6b8cb49f0ef5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044892 Jul 26 18:45:25.103733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1244/2459] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:25 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:26.119927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d9307870-b655-4f22-a18c-8c010ba82210 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:26.122226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d9307870-b655-4f22-a18c-8c010ba82210 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:26.129141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9307870-b655-4f22-a18c-8c010ba82210 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:26.129593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9307870-b655-4f22-a18c-8c010ba82210 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:26.130360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9307870-b655-4f22-a18c-8c010ba82210 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:26.130843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9307870-b655-4f22-a18c-8c010ba82210 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:26.173357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d9307870-b655-4f22-a18c-8c010ba82210 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059880 Jul 26 18:45:26.174027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1216/2460] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:26 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:27.188148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b5434121-6107-468b-894e-f97372338861 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:27.191289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b5434121-6107-468b-894e-f97372338861 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:27.199622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5434121-6107-468b-894e-f97372338861 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:27.200071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5434121-6107-468b-894e-f97372338861 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:27.200843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5434121-6107-468b-894e-f97372338861 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:27.201312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5434121-6107-468b-894e-f97372338861 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:27.232528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b5434121-6107-468b-894e-f97372338861 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049753 Jul 26 18:45:27.234044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1245/2461] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:27 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:28.246994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-84935424-3940-4db5-b87b-2895b6b93d47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:28.249169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-84935424-3940-4db5-b87b-2895b6b93d47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:28.255547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84935424-3940-4db5-b87b-2895b6b93d47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:28.256002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84935424-3940-4db5-b87b-2895b6b93d47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:28.256759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84935424-3940-4db5-b87b-2895b6b93d47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:28.257194 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84935424-3940-4db5-b87b-2895b6b93d47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:28.288827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-84935424-3940-4db5-b87b-2895b6b93d47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047011 Jul 26 18:45:28.289427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1217/2462] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:28 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:29.306015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1a4af1c6-8cef-4c40-8625-ff67225062b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:29.309693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1a4af1c6-8cef-4c40-8625-ff67225062b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:29.320480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a4af1c6-8cef-4c40-8625-ff67225062b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:29.321509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a4af1c6-8cef-4c40-8625-ff67225062b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:29.322748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a4af1c6-8cef-4c40-8625-ff67225062b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:29.323212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a4af1c6-8cef-4c40-8625-ff67225062b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:29.352587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1a4af1c6-8cef-4c40-8625-ff67225062b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053885 Jul 26 18:45:29.353180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1246/2463] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:29 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:30.369440 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-25297854-9563-43ea-9d9f-def37b833fde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:30.371785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-25297854-9563-43ea-9d9f-def37b833fde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:30.379868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-25297854-9563-43ea-9d9f-def37b833fde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:30.380315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-25297854-9563-43ea-9d9f-def37b833fde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:30.381077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-25297854-9563-43ea-9d9f-def37b833fde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:30.381511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-25297854-9563-43ea-9d9f-def37b833fde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:30.412527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-25297854-9563-43ea-9d9f-def37b833fde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050540 Jul 26 18:45:30.413078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1218/2464] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:30 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:31.425257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e5df0ae6-3266-47a1-8cb0-35529d611680 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:31.427442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e5df0ae6-3266-47a1-8cb0-35529d611680 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:31.434290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5df0ae6-3266-47a1-8cb0-35529d611680 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:31.434734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5df0ae6-3266-47a1-8cb0-35529d611680 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:31.435510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5df0ae6-3266-47a1-8cb0-35529d611680 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:31.435939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5df0ae6-3266-47a1-8cb0-35529d611680 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:31.465233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e5df0ae6-3266-47a1-8cb0-35529d611680 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044120 Jul 26 18:45:31.465781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1247/2465] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:31 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:32.480478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c3b18cf0-f826-4908-8626-ea8246454ba9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:32.482630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c3b18cf0-f826-4908-8626-ea8246454ba9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:32.489679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3b18cf0-f826-4908-8626-ea8246454ba9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:32.490149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3b18cf0-f826-4908-8626-ea8246454ba9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:32.490910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3b18cf0-f826-4908-8626-ea8246454ba9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:32.491373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3b18cf0-f826-4908-8626-ea8246454ba9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:32.520599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c3b18cf0-f826-4908-8626-ea8246454ba9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045877 Jul 26 18:45:32.521140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1219/2466] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:33.533416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-69524d4a-34d1-4b77-9472-88ad6ca4ee11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:33.535715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-69524d4a-34d1-4b77-9472-88ad6ca4ee11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:33.542233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69524d4a-34d1-4b77-9472-88ad6ca4ee11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:33.542676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69524d4a-34d1-4b77-9472-88ad6ca4ee11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:33.543467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69524d4a-34d1-4b77-9472-88ad6ca4ee11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:33.543892 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69524d4a-34d1-4b77-9472-88ad6ca4ee11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:33.572577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-69524d4a-34d1-4b77-9472-88ad6ca4ee11 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043163 Jul 26 18:45:33.573109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1248/2467] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:33 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:34.585377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dd522ee2-4fb8-4280-a14b-7982d3463c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:34.587554 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dd522ee2-4fb8-4280-a14b-7982d3463c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:34.594300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd522ee2-4fb8-4280-a14b-7982d3463c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:34.594756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd522ee2-4fb8-4280-a14b-7982d3463c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:34.595527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd522ee2-4fb8-4280-a14b-7982d3463c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:34.595953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd522ee2-4fb8-4280-a14b-7982d3463c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:34.626771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dd522ee2-4fb8-4280-a14b-7982d3463c96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Jul 26 18:45:34.627352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1220/2468] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:34 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:35.639973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-576c6c2d-7638-43e4-84b4-44baafaf7e87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:35.642092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-576c6c2d-7638-43e4-84b4-44baafaf7e87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:35.648750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-576c6c2d-7638-43e4-84b4-44baafaf7e87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:35.649192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-576c6c2d-7638-43e4-84b4-44baafaf7e87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:35.649956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-576c6c2d-7638-43e4-84b4-44baafaf7e87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:35.650486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-576c6c2d-7638-43e4-84b4-44baafaf7e87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:35.679470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-576c6c2d-7638-43e4-84b4-44baafaf7e87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044104 Jul 26 18:45:35.680045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1249/2469] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:36.691958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7a7086a4-aa1a-4981-9dbe-64e4647d8d2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:36.694118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7a7086a4-aa1a-4981-9dbe-64e4647d8d2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:36.700868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a7086a4-aa1a-4981-9dbe-64e4647d8d2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:36.701312 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a7086a4-aa1a-4981-9dbe-64e4647d8d2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:36.702062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a7086a4-aa1a-4981-9dbe-64e4647d8d2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:36.702489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a7086a4-aa1a-4981-9dbe-64e4647d8d2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:36.733004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7a7086a4-aa1a-4981-9dbe-64e4647d8d2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044977 Jul 26 18:45:36.733559 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1221/2470] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:36 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:37.295195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:45:37.296165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 18:45:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:45:37.745561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d3ebad44-7c9b-43af-8a9c-6b1d9308b54b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:37.747957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d3ebad44-7c9b-43af-8a9c-6b1d9308b54b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:37.754673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3ebad44-7c9b-43af-8a9c-6b1d9308b54b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:37.755228 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3ebad44-7c9b-43af-8a9c-6b1d9308b54b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:37.756008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3ebad44-7c9b-43af-8a9c-6b1d9308b54b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:37.756443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3ebad44-7c9b-43af-8a9c-6b1d9308b54b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:37.758815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=90 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:45:37.787944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d3ebad44-7c9b-43af-8a9c-6b1d9308b54b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046342 Jul 26 18:45:37.788517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1250/2471] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:37 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:38.801000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ec407449-0315-490d-a39a-c1398b87455a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:38.803782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ec407449-0315-490d-a39a-c1398b87455a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:38.811430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec407449-0315-490d-a39a-c1398b87455a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:38.811870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec407449-0315-490d-a39a-c1398b87455a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:38.812619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec407449-0315-490d-a39a-c1398b87455a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:38.813049 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec407449-0315-490d-a39a-c1398b87455a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:38.844073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ec407449-0315-490d-a39a-c1398b87455a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047262 Jul 26 18:45:38.844724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1222/2472] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:38 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:39.859210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f6615c6a-8b73-4c5c-b695-d3801dfa2dc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:39.861430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f6615c6a-8b73-4c5c-b695-d3801dfa2dc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:39.863803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=30 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:45:39.869155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6615c6a-8b73-4c5c-b695-d3801dfa2dc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:39.869610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6615c6a-8b73-4c5c-b695-d3801dfa2dc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:39.870376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6615c6a-8b73-4c5c-b695-d3801dfa2dc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:39.870806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6615c6a-8b73-4c5c-b695-d3801dfa2dc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:39.903232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f6615c6a-8b73-4c5c-b695-d3801dfa2dc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048723 Jul 26 18:45:39.904208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1251/2473] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:39 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:40.919666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3af60ec3-aec6-4615-b74a-b944954383a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:40.923435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3af60ec3-aec6-4615-b74a-b944954383a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:40.926815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=30 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:45:40.935009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3af60ec3-aec6-4615-b74a-b944954383a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:40.935461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3af60ec3-aec6-4615-b74a-b944954383a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:40.936241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3af60ec3-aec6-4615-b74a-b944954383a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:40.936667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3af60ec3-aec6-4615-b74a-b944954383a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:40.966495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3af60ec3-aec6-4615-b74a-b944954383a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053285 Jul 26 18:45:40.967055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1223/2474] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:40 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:41.982745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-28fd7cae-87b3-450d-b8b0-97dc047331e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:41.985744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-28fd7cae-87b3-450d-b8b0-97dc047331e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:41.994833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28fd7cae-87b3-450d-b8b0-97dc047331e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:41.995490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28fd7cae-87b3-450d-b8b0-97dc047331e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:41.996553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28fd7cae-87b3-450d-b8b0-97dc047331e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:41.997131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28fd7cae-87b3-450d-b8b0-97dc047331e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:42.030564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-28fd7cae-87b3-450d-b8b0-97dc047331e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053952 Jul 26 18:45:42.031230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1252/2475] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:41 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:43.046096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3797bebf-71ad-4522-a9d8-8f9cd8c87c46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:43.049296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3797bebf-71ad-4522-a9d8-8f9cd8c87c46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:43.059616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3797bebf-71ad-4522-a9d8-8f9cd8c87c46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:43.060087 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3797bebf-71ad-4522-a9d8-8f9cd8c87c46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:43.060868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3797bebf-71ad-4522-a9d8-8f9cd8c87c46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:43.061300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3797bebf-71ad-4522-a9d8-8f9cd8c87c46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:43.091832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3797bebf-71ad-4522-a9d8-8f9cd8c87c46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051261 Jul 26 18:45:43.092198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1224/2476] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:44.108212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0e3944c8-5a44-4308-ba8b-f9ab02800145 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:44.110413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0e3944c8-5a44-4308-ba8b-f9ab02800145 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:44.117258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e3944c8-5a44-4308-ba8b-f9ab02800145 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:44.117696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e3944c8-5a44-4308-ba8b-f9ab02800145 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:44.118455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e3944c8-5a44-4308-ba8b-f9ab02800145 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:44.118891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e3944c8-5a44-4308-ba8b-f9ab02800145 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:44.148823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0e3944c8-5a44-4308-ba8b-f9ab02800145 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046417 Jul 26 18:45:44.149398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1253/2477] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:44 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:45.165241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-656f8fa3-210c-4c67-b181-66e2119ca70d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:45.168836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-656f8fa3-210c-4c67-b181-66e2119ca70d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:45.175653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-656f8fa3-210c-4c67-b181-66e2119ca70d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:45.176097 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-656f8fa3-210c-4c67-b181-66e2119ca70d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:45.176851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-656f8fa3-210c-4c67-b181-66e2119ca70d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:45.177278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-656f8fa3-210c-4c67-b181-66e2119ca70d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:45.180922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=90 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:45:45.207100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-656f8fa3-210c-4c67-b181-66e2119ca70d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048698 Jul 26 18:45:45.207674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1225/2478] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:45 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:46.224115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cd027b3f-f130-4496-be73-8b015c1abd67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:46.227738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cd027b3f-f130-4496-be73-8b015c1abd67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:46.238662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd027b3f-f130-4496-be73-8b015c1abd67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:46.239468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd027b3f-f130-4496-be73-8b015c1abd67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:46.240715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd027b3f-f130-4496-be73-8b015c1abd67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:46.241426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd027b3f-f130-4496-be73-8b015c1abd67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:46.272610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cd027b3f-f130-4496-be73-8b015c1abd67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055234 Jul 26 18:45:46.273458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1254/2479] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:46 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:47.289815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1a67e42d-575d-4597-bbd0-9e48900928d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:47.293319 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1a67e42d-575d-4597-bbd0-9e48900928d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:47.300710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a67e42d-575d-4597-bbd0-9e48900928d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:47.301136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a67e42d-575d-4597-bbd0-9e48900928d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:47.301903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a67e42d-575d-4597-bbd0-9e48900928d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:47.302363 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a67e42d-575d-4597-bbd0-9e48900928d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:47.331799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1a67e42d-575d-4597-bbd0-9e48900928d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048784 Jul 26 18:45:47.332336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1226/2480] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:47 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:48.344643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8731d575-1f8d-46c3-9e9c-3b3a918f39ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:48.346770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8731d575-1f8d-46c3-9e9c-3b3a918f39ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:48.354377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8731d575-1f8d-46c3-9e9c-3b3a918f39ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:48.354846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8731d575-1f8d-46c3-9e9c-3b3a918f39ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:48.355630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8731d575-1f8d-46c3-9e9c-3b3a918f39ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:48.356053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8731d575-1f8d-46c3-9e9c-3b3a918f39ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:48.388092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8731d575-1f8d-46c3-9e9c-3b3a918f39ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047397 Jul 26 18:45:48.388708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1255/2481] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:48 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:49.405654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3ab0137b-59e8-4a6d-b2ce-2d749cad5bf7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:49.409283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3ab0137b-59e8-4a6d-b2ce-2d749cad5bf7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:49.420418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ab0137b-59e8-4a6d-b2ce-2d749cad5bf7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:49.421021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ab0137b-59e8-4a6d-b2ce-2d749cad5bf7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:49.421742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ab0137b-59e8-4a6d-b2ce-2d749cad5bf7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:49.422177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ab0137b-59e8-4a6d-b2ce-2d749cad5bf7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:49.456390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3ab0137b-59e8-4a6d-b2ce-2d749cad5bf7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057290 Jul 26 18:45:49.456966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1227/2482] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:49 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:50.473981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-517b621e-5445-448b-8e07-8bceff5d3b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:50.477533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-517b621e-5445-448b-8e07-8bceff5d3b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:50.488702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-517b621e-5445-448b-8e07-8bceff5d3b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:50.489454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-517b621e-5445-448b-8e07-8bceff5d3b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:50.490717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-517b621e-5445-448b-8e07-8bceff5d3b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:50.491580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-517b621e-5445-448b-8e07-8bceff5d3b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:50.524016 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-517b621e-5445-448b-8e07-8bceff5d3b5a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056798 Jul 26 18:45:50.524576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1256/2483] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:50 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:51.541003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-38259e06-6032-489f-b1d6-156ef94f9815 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:51.544279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-38259e06-6032-489f-b1d6-156ef94f9815 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:51.551151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-38259e06-6032-489f-b1d6-156ef94f9815 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:51.551601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-38259e06-6032-489f-b1d6-156ef94f9815 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:51.552354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-38259e06-6032-489f-b1d6-156ef94f9815 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:51.552778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-38259e06-6032-489f-b1d6-156ef94f9815 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:51.581618 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-38259e06-6032-489f-b1d6-156ef94f9815 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047296 Jul 26 18:45:51.582437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1228/2484] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:52.598395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c6aa68c0-77a6-41a0-b4f5-d4f77d026ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:52.601944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c6aa68c0-77a6-41a0-b4f5-d4f77d026ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:52.610365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6aa68c0-77a6-41a0-b4f5-d4f77d026ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:52.610814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6aa68c0-77a6-41a0-b4f5-d4f77d026ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:52.611603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6aa68c0-77a6-41a0-b4f5-d4f77d026ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:52.612021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6aa68c0-77a6-41a0-b4f5-d4f77d026ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:52.641847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c6aa68c0-77a6-41a0-b4f5-d4f77d026ca9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050088 Jul 26 18:45:52.642408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1257/2485] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:52 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:53.659681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-065ca080-5bb7-45e6-9e74-1a356ab7e6e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:53.663285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-065ca080-5bb7-45e6-9e74-1a356ab7e6e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:53.674474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-065ca080-5bb7-45e6-9e74-1a356ab7e6e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:53.675245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-065ca080-5bb7-45e6-9e74-1a356ab7e6e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:53.676514 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-065ca080-5bb7-45e6-9e74-1a356ab7e6e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:53.677242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-065ca080-5bb7-45e6-9e74-1a356ab7e6e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:53.710092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-065ca080-5bb7-45e6-9e74-1a356ab7e6e3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057314 Jul 26 18:45:53.710673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1229/2486] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:53 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:54.570737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:45:54.571679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 18:45:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:45:54.726596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-66a5c574-a555-455b-be04-7dd120e637ea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:54.730101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-66a5c574-a555-455b-be04-7dd120e637ea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:54.738466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66a5c574-a555-455b-be04-7dd120e637ea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:54.738968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66a5c574-a555-455b-be04-7dd120e637ea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:54.739823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66a5c574-a555-455b-be04-7dd120e637ea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:54.740287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66a5c574-a555-455b-be04-7dd120e637ea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:54.770390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-66a5c574-a555-455b-be04-7dd120e637ea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050359 Jul 26 18:45:54.770923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1258/2487] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:54 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:55.784297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dd74318b-6c87-463c-b16b-cd390d5c7cd4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:55.786794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dd74318b-6c87-463c-b16b-cd390d5c7cd4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:55.794461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd74318b-6c87-463c-b16b-cd390d5c7cd4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:55.794955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd74318b-6c87-463c-b16b-cd390d5c7cd4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:55.795834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd74318b-6c87-463c-b16b-cd390d5c7cd4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:55.796313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd74318b-6c87-463c-b16b-cd390d5c7cd4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:55.828558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dd74318b-6c87-463c-b16b-cd390d5c7cd4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048877 Jul 26 18:45:55.829118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1230/2488] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:56.841285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c353fe8f-b12c-4a8b-883f-937d50c74be4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:56.843492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c353fe8f-b12c-4a8b-883f-937d50c74be4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:56.850387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c353fe8f-b12c-4a8b-883f-937d50c74be4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:56.850833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c353fe8f-b12c-4a8b-883f-937d50c74be4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:56.851627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c353fe8f-b12c-4a8b-883f-937d50c74be4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:56.852061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c353fe8f-b12c-4a8b-883f-937d50c74be4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:56.881443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c353fe8f-b12c-4a8b-883f-937d50c74be4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Jul 26 18:45:56.882014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1259/2489] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:56 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:57.894361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-554a53a4-88ef-4651-be00-674c09e9915c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:57.896562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-554a53a4-88ef-4651-be00-674c09e9915c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:57.903329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-554a53a4-88ef-4651-be00-674c09e9915c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:57.903776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-554a53a4-88ef-4651-be00-674c09e9915c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:57.904604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-554a53a4-88ef-4651-be00-674c09e9915c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:57.905040 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-554a53a4-88ef-4651-be00-674c09e9915c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:57.935919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-554a53a4-88ef-4651-be00-674c09e9915c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045761 Jul 26 18:45:57.940489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1231/2490] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:57 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:45:58.950165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1408e93e-1718-4e21-bfbe-500e27b680d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:45:58.952728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1408e93e-1718-4e21-bfbe-500e27b680d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:45:58.961193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1408e93e-1718-4e21-bfbe-500e27b680d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:58.961717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1408e93e-1718-4e21-bfbe-500e27b680d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:58.962691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1408e93e-1718-4e21-bfbe-500e27b680d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:45:58.963199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1408e93e-1718-4e21-bfbe-500e27b680d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:45:58.993510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1408e93e-1718-4e21-bfbe-500e27b680d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048429 Jul 26 18:45:58.994076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1260/2491] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:45:58 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:00.006842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ce146f11-610a-47df-aa06-04e024757c33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:00.009781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ce146f11-610a-47df-aa06-04e024757c33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:00.017206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce146f11-610a-47df-aa06-04e024757c33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:00.017657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce146f11-610a-47df-aa06-04e024757c33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:00.018433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce146f11-610a-47df-aa06-04e024757c33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:00.018871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ce146f11-610a-47df-aa06-04e024757c33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:00.058593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ce146f11-610a-47df-aa06-04e024757c33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055592 Jul 26 18:46:00.059647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1232/2492] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:00 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:01.070844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-10b1fcd4-f4f3-4fd0-9983-3cad3cbe2bc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:01.072985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-10b1fcd4-f4f3-4fd0-9983-3cad3cbe2bc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:01.080372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-10b1fcd4-f4f3-4fd0-9983-3cad3cbe2bc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:01.080824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-10b1fcd4-f4f3-4fd0-9983-3cad3cbe2bc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:01.081589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-10b1fcd4-f4f3-4fd0-9983-3cad3cbe2bc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:01.082029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-10b1fcd4-f4f3-4fd0-9983-3cad3cbe2bc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:01.112902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-10b1fcd4-f4f3-4fd0-9983-3cad3cbe2bc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046116 Jul 26 18:46:01.113484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1261/2493] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:01 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:02.125305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9dcb7b3a-8f6a-4967-90da-f04d4245feaa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:02.128293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9dcb7b3a-8f6a-4967-90da-f04d4245feaa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:02.135970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9dcb7b3a-8f6a-4967-90da-f04d4245feaa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:02.136417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9dcb7b3a-8f6a-4967-90da-f04d4245feaa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:02.137179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9dcb7b3a-8f6a-4967-90da-f04d4245feaa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:02.137609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9dcb7b3a-8f6a-4967-90da-f04d4245feaa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:02.171526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9dcb7b3a-8f6a-4967-90da-f04d4245feaa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050165 Jul 26 18:46:02.172132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1233/2494] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:02 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:03.185178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0a86fa4a-6acc-4f49-9880-1cb3ee8b4046 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:03.187374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0a86fa4a-6acc-4f49-9880-1cb3ee8b4046 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:03.193848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a86fa4a-6acc-4f49-9880-1cb3ee8b4046 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:03.194298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a86fa4a-6acc-4f49-9880-1cb3ee8b4046 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:03.195069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a86fa4a-6acc-4f49-9880-1cb3ee8b4046 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:03.195527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a86fa4a-6acc-4f49-9880-1cb3ee8b4046 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:03.225445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0a86fa4a-6acc-4f49-9880-1cb3ee8b4046 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044519 Jul 26 18:46:03.226032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1262/2495] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:03 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:04.241850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7bf17248-0585-4573-993a-2e0d606bbe16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:04.245391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7bf17248-0585-4573-993a-2e0d606bbe16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:04.256502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bf17248-0585-4573-993a-2e0d606bbe16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:04.257257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bf17248-0585-4573-993a-2e0d606bbe16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:04.258515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bf17248-0585-4573-993a-2e0d606bbe16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:04.259282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bf17248-0585-4573-993a-2e0d606bbe16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:04.291810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7bf17248-0585-4573-993a-2e0d606bbe16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056582 Jul 26 18:46:04.292375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1234/2496] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:04 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:05.310092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-04379934-889a-46aa-aaf6-0b9376d4d2b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:05.313633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-04379934-889a-46aa-aaf6-0b9376d4d2b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:05.324425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04379934-889a-46aa-aaf6-0b9376d4d2b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:05.325172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04379934-889a-46aa-aaf6-0b9376d4d2b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:05.326391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04379934-889a-46aa-aaf6-0b9376d4d2b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:05.327291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04379934-889a-46aa-aaf6-0b9376d4d2b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:05.358961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-04379934-889a-46aa-aaf6-0b9376d4d2b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056366 Jul 26 18:46:05.359580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1263/2497] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:05 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:06.374503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ae2c466e-82aa-474d-b26f-f0e04a654d95 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:06.376792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ae2c466e-82aa-474d-b26f-f0e04a654d95 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:06.384165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae2c466e-82aa-474d-b26f-f0e04a654d95 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:06.384616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae2c466e-82aa-474d-b26f-f0e04a654d95 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:06.385393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae2c466e-82aa-474d-b26f-f0e04a654d95 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:06.385820 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae2c466e-82aa-474d-b26f-f0e04a654d95 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:06.416164 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ae2c466e-82aa-474d-b26f-f0e04a654d95 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048141 Jul 26 18:46:06.416731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1235/2498] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:06 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:06.478890 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:46:06.479087 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:46:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:46:07.432258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-127f88ab-5dc8-4fdc-a5f5-473a3b401f3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:07.435704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-127f88ab-5dc8-4fdc-a5f5-473a3b401f3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:07.446764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-127f88ab-5dc8-4fdc-a5f5-473a3b401f3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:07.448540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-127f88ab-5dc8-4fdc-a5f5-473a3b401f3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:07.450138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-127f88ab-5dc8-4fdc-a5f5-473a3b401f3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:07.451105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-127f88ab-5dc8-4fdc-a5f5-473a3b401f3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:07.481371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-127f88ab-5dc8-4fdc-a5f5-473a3b401f3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055802 Jul 26 18:46:07.481852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1264/2499] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:07 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:08.497763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e66fa87c-407a-408f-bdb7-636c0d663a68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:08.500420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e66fa87c-407a-408f-bdb7-636c0d663a68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:08.507343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e66fa87c-407a-408f-bdb7-636c0d663a68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:08.507818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e66fa87c-407a-408f-bdb7-636c0d663a68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:08.508504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e66fa87c-407a-408f-bdb7-636c0d663a68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:08.508963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e66fa87c-407a-408f-bdb7-636c0d663a68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:08.539335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e66fa87c-407a-408f-bdb7-636c0d663a68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048338 Jul 26 18:46:08.539915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1236/2500] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:08 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:09.555236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e99f8d9c-a136-44a3-bbed-79d473974c42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:09.558526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e99f8d9c-a136-44a3-bbed-79d473974c42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:09.569551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e99f8d9c-a136-44a3-bbed-79d473974c42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:09.571382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e99f8d9c-a136-44a3-bbed-79d473974c42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:09.571585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e99f8d9c-a136-44a3-bbed-79d473974c42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:09.572292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e99f8d9c-a136-44a3-bbed-79d473974c42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:09.576241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=90 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:46:09.605013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e99f8d9c-a136-44a3-bbed-79d473974c42 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056610 Jul 26 18:46:09.605602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1265/2501] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:09 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:10.621017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3969be72-c362-4f2c-84b2-ead6c507ab16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:10.624262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3969be72-c362-4f2c-84b2-ead6c507ab16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:10.631077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3969be72-c362-4f2c-84b2-ead6c507ab16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:10.631565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3969be72-c362-4f2c-84b2-ead6c507ab16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:10.632314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3969be72-c362-4f2c-84b2-ead6c507ab16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:10.632735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3969be72-c362-4f2c-84b2-ead6c507ab16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:10.662917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3969be72-c362-4f2c-84b2-ead6c507ab16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048728 Jul 26 18:46:10.663515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1237/2502] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:10 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:11.679215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4c5cf2e2-9b7b-4e06-86f1-1f8cc933f515 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:11.682601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4c5cf2e2-9b7b-4e06-86f1-1f8cc933f515 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:11.686239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=30 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:46:11.692264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c5cf2e2-9b7b-4e06-86f1-1f8cc933f515 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:11.692669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c5cf2e2-9b7b-4e06-86f1-1f8cc933f515 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:11.693552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c5cf2e2-9b7b-4e06-86f1-1f8cc933f515 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:11.693854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c5cf2e2-9b7b-4e06-86f1-1f8cc933f515 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:11.723819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4c5cf2e2-9b7b-4e06-86f1-1f8cc933f515 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051456 Jul 26 18:46:11.724396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1266/2503] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:11 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:12.740418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fc57051d-5dc7-44ea-b99a-8fc6b2c5bb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:12.745453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fc57051d-5dc7-44ea-b99a-8fc6b2c5bb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:12.748337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=30 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:46:12.757537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc57051d-5dc7-44ea-b99a-8fc6b2c5bb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:12.758344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc57051d-5dc7-44ea-b99a-8fc6b2c5bb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:12.759852 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc57051d-5dc7-44ea-b99a-8fc6b2c5bb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:12.760339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc57051d-5dc7-44ea-b99a-8fc6b2c5bb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:12.793235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fc57051d-5dc7-44ea-b99a-8fc6b2c5bb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059648 Jul 26 18:46:12.793806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1238/2504] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:12 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:13.806113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c1d2c719-06e6-4f23-a263-75234825fce7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:13.808549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c1d2c719-06e6-4f23-a263-75234825fce7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:13.815934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c1d2c719-06e6-4f23-a263-75234825fce7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:13.816351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c1d2c719-06e6-4f23-a263-75234825fce7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:13.817108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c1d2c719-06e6-4f23-a263-75234825fce7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:13.817517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c1d2c719-06e6-4f23-a263-75234825fce7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:13.847484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c1d2c719-06e6-4f23-a263-75234825fce7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045723 Jul 26 18:46:13.848037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1267/2505] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:13 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:14.864838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-06d893b2-8c49-417a-945b-b05e8e472026 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:14.868358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-06d893b2-8c49-417a-945b-b05e8e472026 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:14.879836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06d893b2-8c49-417a-945b-b05e8e472026 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:14.880579 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06d893b2-8c49-417a-945b-b05e8e472026 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:14.882072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06d893b2-8c49-417a-945b-b05e8e472026 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:14.882553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-06d893b2-8c49-417a-945b-b05e8e472026 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:14.915557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-06d893b2-8c49-417a-945b-b05e8e472026 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057464 Jul 26 18:46:14.916107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1239/2506] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:14 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:15.929858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a616d9c0-1bdd-49a3-a8ce-98e610224483 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:15.932252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a616d9c0-1bdd-49a3-a8ce-98e610224483 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:15.938822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a616d9c0-1bdd-49a3-a8ce-98e610224483 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:15.939304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a616d9c0-1bdd-49a3-a8ce-98e610224483 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:15.940026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a616d9c0-1bdd-49a3-a8ce-98e610224483 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:15.940458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a616d9c0-1bdd-49a3-a8ce-98e610224483 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:15.974470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a616d9c0-1bdd-49a3-a8ce-98e610224483 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049856 Jul 26 18:46:15.975105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1268/2507] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:15 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:16.988267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9464d157-267d-41cf-9956-276ef8a63585 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:16.990431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9464d157-267d-41cf-9956-276ef8a63585 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:16.997271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9464d157-267d-41cf-9956-276ef8a63585 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:16.997710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9464d157-267d-41cf-9956-276ef8a63585 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:16.999722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9464d157-267d-41cf-9956-276ef8a63585 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:16.999722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9464d157-267d-41cf-9956-276ef8a63585 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:17.001278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=90 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:46:17.029685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9464d157-267d-41cf-9956-276ef8a63585 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 Jul 26 18:46:17.030227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1240/2508] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:16 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:18.046339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1071c184-1062-46a6-a85d-33851f14b86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:18.048466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1071c184-1062-46a6-a85d-33851f14b86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:18.057674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1071c184-1062-46a6-a85d-33851f14b86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:18.058110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1071c184-1062-46a6-a85d-33851f14b86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:18.058861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1071c184-1062-46a6-a85d-33851f14b86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:18.059311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1071c184-1062-46a6-a85d-33851f14b86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:18.089956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1071c184-1062-46a6-a85d-33851f14b86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050327 Jul 26 18:46:18.090543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1269/2509] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:18 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:19.106928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8e276564-eebf-43d7-8b47-0d4a5e8aaafc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:19.110376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8e276564-eebf-43d7-8b47-0d4a5e8aaafc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:19.121626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e276564-eebf-43d7-8b47-0d4a5e8aaafc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:19.122975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e276564-eebf-43d7-8b47-0d4a5e8aaafc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:19.124332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e276564-eebf-43d7-8b47-0d4a5e8aaafc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:19.125134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e276564-eebf-43d7-8b47-0d4a5e8aaafc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:19.156477 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8e276564-eebf-43d7-8b47-0d4a5e8aaafc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056441 Jul 26 18:46:19.157145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1241/2510] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:19 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:20.173398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-02dd6ce0-cfd8-48cc-9663-1ad9ec381372 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:20.176726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-02dd6ce0-cfd8-48cc-9663-1ad9ec381372 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:20.188151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-02dd6ce0-cfd8-48cc-9663-1ad9ec381372 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:20.188452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-02dd6ce0-cfd8-48cc-9663-1ad9ec381372 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:20.189642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-02dd6ce0-cfd8-48cc-9663-1ad9ec381372 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:20.190356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-02dd6ce0-cfd8-48cc-9663-1ad9ec381372 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:20.225367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-02dd6ce0-cfd8-48cc-9663-1ad9ec381372 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058715 Jul 26 18:46:20.225955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1270/2511] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:20 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:21.242250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6826a9bb-8fc7-419d-8ddb-368d853e0a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:21.245925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6826a9bb-8fc7-419d-8ddb-368d853e0a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:21.254573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6826a9bb-8fc7-419d-8ddb-368d853e0a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:21.255042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6826a9bb-8fc7-419d-8ddb-368d853e0a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:21.256464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6826a9bb-8fc7-419d-8ddb-368d853e0a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:21.256872 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6826a9bb-8fc7-419d-8ddb-368d853e0a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:21.289595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6826a9bb-8fc7-419d-8ddb-368d853e0a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054075 Jul 26 18:46:21.290152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1242/2512] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:21 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:22.302546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-97cd7bed-ac39-4b97-b21b-74d5ab8b3de5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:22.304715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-97cd7bed-ac39-4b97-b21b-74d5ab8b3de5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:22.312302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97cd7bed-ac39-4b97-b21b-74d5ab8b3de5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:22.312740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97cd7bed-ac39-4b97-b21b-74d5ab8b3de5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:22.313533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97cd7bed-ac39-4b97-b21b-74d5ab8b3de5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:22.313957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97cd7bed-ac39-4b97-b21b-74d5ab8b3de5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:22.343657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-97cd7bed-ac39-4b97-b21b-74d5ab8b3de5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Jul 26 18:46:22.344220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1271/2513] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:22 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:23.360601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0fb9751e-303d-495b-a90b-6c7f1d117004 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:23.364057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0fb9751e-303d-495b-a90b-6c7f1d117004 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:23.374994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fb9751e-303d-495b-a90b-6c7f1d117004 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:23.375469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fb9751e-303d-495b-a90b-6c7f1d117004 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:23.376235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fb9751e-303d-495b-a90b-6c7f1d117004 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:23.376670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fb9751e-303d-495b-a90b-6c7f1d117004 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:23.407223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0fb9751e-303d-495b-a90b-6c7f1d117004 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053452 Jul 26 18:46:23.407790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1243/2514] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:23 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:24.420070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6b8bfa2a-ff99-48a6-a6a0-468c1fe8a106 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:24.422313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6b8bfa2a-ff99-48a6-a6a0-468c1fe8a106 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:24.429297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b8bfa2a-ff99-48a6-a6a0-468c1fe8a106 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:24.429751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b8bfa2a-ff99-48a6-a6a0-468c1fe8a106 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:24.430552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b8bfa2a-ff99-48a6-a6a0-468c1fe8a106 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:24.430988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b8bfa2a-ff99-48a6-a6a0-468c1fe8a106 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:24.464542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6b8bfa2a-ff99-48a6-a6a0-468c1fe8a106 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048531 Jul 26 18:46:24.465124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1272/2515] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:24 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:25.479659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-33347972-841b-4a5e-9b08-b709bb9fa559 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:25.482732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-33347972-841b-4a5e-9b08-b709bb9fa559 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:25.489774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-33347972-841b-4a5e-9b08-b709bb9fa559 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:25.490157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-33347972-841b-4a5e-9b08-b709bb9fa559 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:25.490910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-33347972-841b-4a5e-9b08-b709bb9fa559 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:25.491365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-33347972-841b-4a5e-9b08-b709bb9fa559 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:25.520767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-33347972-841b-4a5e-9b08-b709bb9fa559 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046592 Jul 26 18:46:25.521357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1244/2516] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:25 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:26.534950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6066a38a-0911-4044-b6d8-44a9d2e4648e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:26.537401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6066a38a-0911-4044-b6d8-44a9d2e4648e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:26.545292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6066a38a-0911-4044-b6d8-44a9d2e4648e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:26.545817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6066a38a-0911-4044-b6d8-44a9d2e4648e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:26.546680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6066a38a-0911-4044-b6d8-44a9d2e4648e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:26.547246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6066a38a-0911-4044-b6d8-44a9d2e4648e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:26.580160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6066a38a-0911-4044-b6d8-44a9d2e4648e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049479 Jul 26 18:46:26.580797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1273/2517] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:26 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:27.596808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e884b65f-dfcc-4377-ae9e-6d298922e92f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:27.600229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e884b65f-dfcc-4377-ae9e-6d298922e92f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:27.610130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e884b65f-dfcc-4377-ae9e-6d298922e92f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:27.610568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e884b65f-dfcc-4377-ae9e-6d298922e92f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:27.611353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e884b65f-dfcc-4377-ae9e-6d298922e92f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:27.611778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e884b65f-dfcc-4377-ae9e-6d298922e92f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:27.642062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e884b65f-dfcc-4377-ae9e-6d298922e92f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051726 Jul 26 18:46:27.646489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1245/2518] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:27 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:28.658518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-494d3fca-c8a4-48d2-83d3-9e37821d3ce1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:28.661169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-494d3fca-c8a4-48d2-83d3-9e37821d3ce1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:28.669613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-494d3fca-c8a4-48d2-83d3-9e37821d3ce1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:28.670164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-494d3fca-c8a4-48d2-83d3-9e37821d3ce1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:28.671158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-494d3fca-c8a4-48d2-83d3-9e37821d3ce1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:28.671691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-494d3fca-c8a4-48d2-83d3-9e37821d3ce1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:28.704872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-494d3fca-c8a4-48d2-83d3-9e37821d3ce1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052584 Jul 26 18:46:28.705909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1274/2519] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:28 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:29.721510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7c5a7aef-9483-4672-84aa-5b69e2ed72a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:29.724962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7c5a7aef-9483-4672-84aa-5b69e2ed72a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:29.735968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c5a7aef-9483-4672-84aa-5b69e2ed72a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:29.736812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c5a7aef-9483-4672-84aa-5b69e2ed72a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:29.737567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c5a7aef-9483-4672-84aa-5b69e2ed72a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:29.738383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c5a7aef-9483-4672-84aa-5b69e2ed72a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:29.768581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7c5a7aef-9483-4672-84aa-5b69e2ed72a1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053581 Jul 26 18:46:29.769568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1246/2520] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:29 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:30.782205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6efd85f2-db62-47ac-90bf-5480618be1f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:30.785256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6efd85f2-db62-47ac-90bf-5480618be1f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:30.792241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6efd85f2-db62-47ac-90bf-5480618be1f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:30.792689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6efd85f2-db62-47ac-90bf-5480618be1f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:30.793490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6efd85f2-db62-47ac-90bf-5480618be1f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:30.793930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6efd85f2-db62-47ac-90bf-5480618be1f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:30.824681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6efd85f2-db62-47ac-90bf-5480618be1f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046850 Jul 26 18:46:30.825249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1275/2521] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:30 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:31.840467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6ea2a324-0886-4e09-934b-7c0e63e29fcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:31.843734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6ea2a324-0886-4e09-934b-7c0e63e29fcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:31.852042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ea2a324-0886-4e09-934b-7c0e63e29fcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:31.852531 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ea2a324-0886-4e09-934b-7c0e63e29fcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:31.853503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ea2a324-0886-4e09-934b-7c0e63e29fcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:31.853990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ea2a324-0886-4e09-934b-7c0e63e29fcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:31.885039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6ea2a324-0886-4e09-934b-7c0e63e29fcc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050666 Jul 26 18:46:31.885796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1247/2522] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:31 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:32.899013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3ca71565-fbaa-43a4-a35a-638c9522d68a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:32.901172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3ca71565-fbaa-43a4-a35a-638c9522d68a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:32.908346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3ca71565-fbaa-43a4-a35a-638c9522d68a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:32.908783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3ca71565-fbaa-43a4-a35a-638c9522d68a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:32.909534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3ca71565-fbaa-43a4-a35a-638c9522d68a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:32.909959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3ca71565-fbaa-43a4-a35a-638c9522d68a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:32.940278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3ca71565-fbaa-43a4-a35a-638c9522d68a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045635 Jul 26 18:46:32.940834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1276/2523] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:33.953466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8ad0f73c-cc5f-4049-8fdb-316c59c363f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:33.955799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8ad0f73c-cc5f-4049-8fdb-316c59c363f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:33.963593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ad0f73c-cc5f-4049-8fdb-316c59c363f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:33.964092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ad0f73c-cc5f-4049-8fdb-316c59c363f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:33.964919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ad0f73c-cc5f-4049-8fdb-316c59c363f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:33.965400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8ad0f73c-cc5f-4049-8fdb-316c59c363f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:33.996089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8ad0f73c-cc5f-4049-8fdb-316c59c363f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046944 Jul 26 18:46:33.996620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1248/2524] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:33 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:35.011111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e73439de-858b-4d02-a69b-f0b3409babea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:35.013739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e73439de-858b-4d02-a69b-f0b3409babea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:35.021434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e73439de-858b-4d02-a69b-f0b3409babea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:35.021873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e73439de-858b-4d02-a69b-f0b3409babea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:35.022622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e73439de-858b-4d02-a69b-f0b3409babea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:35.023377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e73439de-858b-4d02-a69b-f0b3409babea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:35.052670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e73439de-858b-4d02-a69b-f0b3409babea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046631 Jul 26 18:46:35.053223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1277/2525] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:36.067856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-468251d7-790d-495b-8a1f-66473cbd0912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:36.070539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-468251d7-790d-495b-8a1f-66473cbd0912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:36.079563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-468251d7-790d-495b-8a1f-66473cbd0912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:36.080162 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-468251d7-790d-495b-8a1f-66473cbd0912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:36.081153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-468251d7-790d-495b-8a1f-66473cbd0912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:36.081717 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-468251d7-790d-495b-8a1f-66473cbd0912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:36.115036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-468251d7-790d-495b-8a1f-66473cbd0912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053397 Jul 26 18:46:36.115608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1249/2526] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:36 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:37.131731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7e3fcd89-ec64-4646-9f92-1a8b473d6a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:37.135367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7e3fcd89-ec64-4646-9f92-1a8b473d6a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:37.145392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e3fcd89-ec64-4646-9f92-1a8b473d6a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:37.145841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e3fcd89-ec64-4646-9f92-1a8b473d6a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:37.146598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e3fcd89-ec64-4646-9f92-1a8b473d6a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:37.147057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e3fcd89-ec64-4646-9f92-1a8b473d6a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:37.176535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7e3fcd89-ec64-4646-9f92-1a8b473d6a53 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051542 Jul 26 18:46:37.177088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1278/2527] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:37 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:38.193052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-69ab0f90-f48e-4bdd-9337-3706e9eff25c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:38.196522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-69ab0f90-f48e-4bdd-9337-3706e9eff25c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:38.206896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69ab0f90-f48e-4bdd-9337-3706e9eff25c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:38.207784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69ab0f90-f48e-4bdd-9337-3706e9eff25c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:38.211193 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69ab0f90-f48e-4bdd-9337-3706e9eff25c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:38.211630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69ab0f90-f48e-4bdd-9337-3706e9eff25c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:38.241523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-69ab0f90-f48e-4bdd-9337-3706e9eff25c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055058 Jul 26 18:46:38.242071 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1250/2528] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:38 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:39.257214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9aa677d3-fd45-46f8-860b-7286a1037a6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:39.260017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9aa677d3-fd45-46f8-860b-7286a1037a6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:39.269043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9aa677d3-fd45-46f8-860b-7286a1037a6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:39.269627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9aa677d3-fd45-46f8-860b-7286a1037a6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:39.270627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9aa677d3-fd45-46f8-860b-7286a1037a6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:39.271238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9aa677d3-fd45-46f8-860b-7286a1037a6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:39.304278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9aa677d3-fd45-46f8-860b-7286a1037a6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052875 Jul 26 18:46:39.304816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1279/2529] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:39 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:40.320976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1da258ea-5a68-4a60-8dc6-d9b2adbf820d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:40.324567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1da258ea-5a68-4a60-8dc6-d9b2adbf820d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:40.334140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1da258ea-5a68-4a60-8dc6-d9b2adbf820d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:40.334590 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1da258ea-5a68-4a60-8dc6-d9b2adbf820d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:40.335378 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1da258ea-5a68-4a60-8dc6-d9b2adbf820d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:40.335804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1da258ea-5a68-4a60-8dc6-d9b2adbf820d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:40.366395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1da258ea-5a68-4a60-8dc6-d9b2adbf820d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052106 Jul 26 18:46:40.366966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1251/2530] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:40 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:41.382998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a663e218-70a8-4363-9d9c-0429e360a135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:41.386428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a663e218-70a8-4363-9d9c-0429e360a135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:41.397830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a663e218-70a8-4363-9d9c-0429e360a135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:41.398928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a663e218-70a8-4363-9d9c-0429e360a135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:41.400294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a663e218-70a8-4363-9d9c-0429e360a135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:41.401003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a663e218-70a8-4363-9d9c-0429e360a135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:41.405372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=90 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:46:41.436723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a663e218-70a8-4363-9d9c-0429e360a135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060535 Jul 26 18:46:41.438673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1280/2531] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:41 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:42.454027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cff5d231-98d0-475e-82b1-65617a922fc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:42.457150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cff5d231-98d0-475e-82b1-65617a922fc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:42.465084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cff5d231-98d0-475e-82b1-65617a922fc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:42.465084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cff5d231-98d0-475e-82b1-65617a922fc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:42.465803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cff5d231-98d0-475e-82b1-65617a922fc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:42.466261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cff5d231-98d0-475e-82b1-65617a922fc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:42.497364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cff5d231-98d0-475e-82b1-65617a922fc7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050055 Jul 26 18:46:42.497934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1252/2532] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:42 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:43.513605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c6f18baa-d883-4c91-b7d2-4847f373279a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:43.517114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c6f18baa-d883-4c91-b7d2-4847f373279a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:43.520691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=30 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:46:43.530008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6f18baa-d883-4c91-b7d2-4847f373279a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:43.530796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6f18baa-d883-4c91-b7d2-4847f373279a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:43.532235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6f18baa-d883-4c91-b7d2-4847f373279a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:43.532947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6f18baa-d883-4c91-b7d2-4847f373279a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:43.562060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c6f18baa-d883-4c91-b7d2-4847f373279a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055012 Jul 26 18:46:43.562574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1281/2533] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:44.576911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6f73e472-03fe-4473-944a-1ba5847169b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:44.579974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6f73e472-03fe-4473-944a-1ba5847169b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:44.583309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=30 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:46:44.589352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f73e472-03fe-4473-944a-1ba5847169b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:44.590166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f73e472-03fe-4473-944a-1ba5847169b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:44.590532 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f73e472-03fe-4473-944a-1ba5847169b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:44.590951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f73e472-03fe-4473-944a-1ba5847169b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:44.621666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6f73e472-03fe-4473-944a-1ba5847169b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051185 Jul 26 18:46:44.622279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1253/2534] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:44 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:45.634059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cc43f54a-0ce0-45a5-864a-c57a5cc061f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:45.636289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cc43f54a-0ce0-45a5-864a-c57a5cc061f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:45.642872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc43f54a-0ce0-45a5-864a-c57a5cc061f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:45.643399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc43f54a-0ce0-45a5-864a-c57a5cc061f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:45.644165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc43f54a-0ce0-45a5-864a-c57a5cc061f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:45.644596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc43f54a-0ce0-45a5-864a-c57a5cc061f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:45.675152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cc43f54a-0ce0-45a5-864a-c57a5cc061f0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045001 Jul 26 18:46:45.675724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1282/2535] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:45 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:46.688125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f8168499-7b32-436c-88d7-bfafb6ad2d41 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:46.690367 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f8168499-7b32-436c-88d7-bfafb6ad2d41 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:46.697151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8168499-7b32-436c-88d7-bfafb6ad2d41 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:46.697601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8168499-7b32-436c-88d7-bfafb6ad2d41 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:46.698353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8168499-7b32-436c-88d7-bfafb6ad2d41 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:46.698781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8168499-7b32-436c-88d7-bfafb6ad2d41 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:46.727918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f8168499-7b32-436c-88d7-bfafb6ad2d41 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043712 Jul 26 18:46:46.728467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1254/2536] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:46 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:47.740724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1c6442c7-a444-4a61-84aa-b9c998e2a139 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:47.742936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1c6442c7-a444-4a61-84aa-b9c998e2a139 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:47.750027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1c6442c7-a444-4a61-84aa-b9c998e2a139 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:47.750474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1c6442c7-a444-4a61-84aa-b9c998e2a139 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:47.751288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1c6442c7-a444-4a61-84aa-b9c998e2a139 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:47.751717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1c6442c7-a444-4a61-84aa-b9c998e2a139 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:47.786121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1c6442c7-a444-4a61-84aa-b9c998e2a139 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045790 Jul 26 18:46:47.786121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1283/2537] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:47 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:48.793989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0c113843-3b98-4947-b289-8f4b73cadf47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:48.796193 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0c113843-3b98-4947-b289-8f4b73cadf47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:48.803321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c113843-3b98-4947-b289-8f4b73cadf47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:48.803762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c113843-3b98-4947-b289-8f4b73cadf47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:48.804502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c113843-3b98-4947-b289-8f4b73cadf47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:48.804923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0c113843-3b98-4947-b289-8f4b73cadf47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:48.807230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=90 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:46:48.835144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0c113843-3b98-4947-b289-8f4b73cadf47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044969 Jul 26 18:46:48.835697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1255/2538] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:48 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:49.847893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ce8a3152-ba1f-4758-9ab0-7912630df487 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:49.850471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ce8a3152-ba1f-4758-9ab0-7912630df487 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:49.858505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce8a3152-ba1f-4758-9ab0-7912630df487 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:49.859478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce8a3152-ba1f-4758-9ab0-7912630df487 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:49.860293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce8a3152-ba1f-4758-9ab0-7912630df487 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:49.860956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce8a3152-ba1f-4758-9ab0-7912630df487 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:49.892942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ce8a3152-ba1f-4758-9ab0-7912630df487 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049103 Jul 26 18:46:49.893565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1284/2539] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:49 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:50.905276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c65782b0-c2f1-4e17-83fb-a2136a92498c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:50.907484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c65782b0-c2f1-4e17-83fb-a2136a92498c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:50.914211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c65782b0-c2f1-4e17-83fb-a2136a92498c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:50.914662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c65782b0-c2f1-4e17-83fb-a2136a92498c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:50.915509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c65782b0-c2f1-4e17-83fb-a2136a92498c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:50.915936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c65782b0-c2f1-4e17-83fb-a2136a92498c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:50.945729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c65782b0-c2f1-4e17-83fb-a2136a92498c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044272 Jul 26 18:46:50.946318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1256/2540] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:50 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:51.961978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9606e7b7-fefe-44ab-a599-a64490536551 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:51.965587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9606e7b7-fefe-44ab-a599-a64490536551 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:51.974509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9606e7b7-fefe-44ab-a599-a64490536551 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:51.974950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9606e7b7-fefe-44ab-a599-a64490536551 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:51.975761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9606e7b7-fefe-44ab-a599-a64490536551 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:51.976194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9606e7b7-fefe-44ab-a599-a64490536551 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:52.009322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9606e7b7-fefe-44ab-a599-a64490536551 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053886 Jul 26 18:46:52.009891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1285/2541] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:53.023349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0d1a30a6-8a74-4a63-b6bb-b936b1f0c83b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:53.025547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0d1a30a6-8a74-4a63-b6bb-b936b1f0c83b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:53.032268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d1a30a6-8a74-4a63-b6bb-b936b1f0c83b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:53.032711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d1a30a6-8a74-4a63-b6bb-b936b1f0c83b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:53.033458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d1a30a6-8a74-4a63-b6bb-b936b1f0c83b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:53.033889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d1a30a6-8a74-4a63-b6bb-b936b1f0c83b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:53.063478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0d1a30a6-8a74-4a63-b6bb-b936b1f0c83b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044338 Jul 26 18:46:53.068179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1257/2542] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:53 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:54.079388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-68887f6c-5624-4e60-a457-502ee9d54ac9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:54.082975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-68887f6c-5624-4e60-a457-502ee9d54ac9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:54.094213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68887f6c-5624-4e60-a457-502ee9d54ac9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:54.095101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68887f6c-5624-4e60-a457-502ee9d54ac9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:54.096322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68887f6c-5624-4e60-a457-502ee9d54ac9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:54.096819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68887f6c-5624-4e60-a457-502ee9d54ac9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:54.126712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-68887f6c-5624-4e60-a457-502ee9d54ac9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054136 Jul 26 18:46:54.131503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1286/2543] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:54 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:55.144815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cf811f05-ca6e-4de9-ad37-fe855b980929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:55.147166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cf811f05-ca6e-4de9-ad37-fe855b980929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:55.154027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf811f05-ca6e-4de9-ad37-fe855b980929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:55.154480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf811f05-ca6e-4de9-ad37-fe855b980929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:55.155294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf811f05-ca6e-4de9-ad37-fe855b980929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:55.155718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf811f05-ca6e-4de9-ad37-fe855b980929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:55.188176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cf811f05-ca6e-4de9-ad37-fe855b980929 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050481 Jul 26 18:46:55.188176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1258/2544] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:56.204421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f9e0db16-301b-4c87-be4b-ad3fa3aed599 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:56.207455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f9e0db16-301b-4c87-be4b-ad3fa3aed599 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:56.214596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9e0db16-301b-4c87-be4b-ad3fa3aed599 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:56.215137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9e0db16-301b-4c87-be4b-ad3fa3aed599 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:56.215956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9e0db16-301b-4c87-be4b-ad3fa3aed599 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:56.216401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9e0db16-301b-4c87-be4b-ad3fa3aed599 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:56.247705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f9e0db16-301b-4c87-be4b-ad3fa3aed599 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050285 Jul 26 18:46:56.248495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1287/2545] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:56 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:57.263190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2498f4eb-264f-45c7-adde-f566dd5e4ee8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:57.265783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2498f4eb-264f-45c7-adde-f566dd5e4ee8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:57.274106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2498f4eb-264f-45c7-adde-f566dd5e4ee8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:57.274627 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2498f4eb-264f-45c7-adde-f566dd5e4ee8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:57.275362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2498f4eb-264f-45c7-adde-f566dd5e4ee8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:57.275903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2498f4eb-264f-45c7-adde-f566dd5e4ee8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:57.307992 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2498f4eb-264f-45c7-adde-f566dd5e4ee8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050041 Jul 26 18:46:57.308549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1259/2546] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:57 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:58.324600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d5998986-6641-45ad-afdb-eb07a990d86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:58.328029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d5998986-6641-45ad-afdb-eb07a990d86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:58.336618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5998986-6641-45ad-afdb-eb07a990d86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:58.337071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5998986-6641-45ad-afdb-eb07a990d86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:58.338001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5998986-6641-45ad-afdb-eb07a990d86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:58.338265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5998986-6641-45ad-afdb-eb07a990d86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:58.368011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d5998986-6641-45ad-afdb-eb07a990d86f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050177 Jul 26 18:46:58.371689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1288/2547] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:58 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:46:59.382196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0bc0f014-6060-48e6-86e1-37dfeba1ca4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:46:59.384710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0bc0f014-6060-48e6-86e1-37dfeba1ca4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:46:59.394142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bc0f014-6060-48e6-86e1-37dfeba1ca4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:59.394142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bc0f014-6060-48e6-86e1-37dfeba1ca4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:59.394687 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bc0f014-6060-48e6-86e1-37dfeba1ca4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:46:59.395202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0bc0f014-6060-48e6-86e1-37dfeba1ca4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:46:59.428915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0bc0f014-6060-48e6-86e1-37dfeba1ca4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051415 Jul 26 18:46:59.429460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1260/2548] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:46:59 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:00.445550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fe92d375-105e-49a6-b870-f49042f78604 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:00.449087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fe92d375-105e-49a6-b870-f49042f78604 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:00.459508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe92d375-105e-49a6-b870-f49042f78604 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:00.459957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe92d375-105e-49a6-b870-f49042f78604 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:00.460715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe92d375-105e-49a6-b870-f49042f78604 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:00.461153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe92d375-105e-49a6-b870-f49042f78604 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:00.491548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fe92d375-105e-49a6-b870-f49042f78604 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052902 Jul 26 18:47:00.492145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1289/2549] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:47:00 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:01.507119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-df086bde-87e7-49af-938a-71fde4d64b77 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:01.509672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-df086bde-87e7-49af-938a-71fde4d64b77 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:01.516806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df086bde-87e7-49af-938a-71fde4d64b77 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:01.517275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df086bde-87e7-49af-938a-71fde4d64b77 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:01.518060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df086bde-87e7-49af-938a-71fde4d64b77 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:01.518514 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df086bde-87e7-49af-938a-71fde4d64b77 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:01.548577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-df086bde-87e7-49af-938a-71fde4d64b77 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046780 Jul 26 18:47:01.549139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1261/2550] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:47:01 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:02.565829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3dba06e9-f7da-46ca-93a9-5704b0995895 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:02.568641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3dba06e9-f7da-46ca-93a9-5704b0995895 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:02.576407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3dba06e9-f7da-46ca-93a9-5704b0995895 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:02.576905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3dba06e9-f7da-46ca-93a9-5704b0995895 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:02.577840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3dba06e9-f7da-46ca-93a9-5704b0995895 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:02.578335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3dba06e9-f7da-46ca-93a9-5704b0995895 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:02.608458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3dba06e9-f7da-46ca-93a9-5704b0995895 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049776 Jul 26 18:47:02.609077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1290/2551] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:47:02 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:03.625019 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-42a30c12-2a4c-4e13-b799-cc056b270875 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:03.628889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-42a30c12-2a4c-4e13-b799-cc056b270875 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:03.642506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42a30c12-2a4c-4e13-b799-cc056b270875 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:03.643436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42a30c12-2a4c-4e13-b799-cc056b270875 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:03.644673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42a30c12-2a4c-4e13-b799-cc056b270875 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:03.645395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-42a30c12-2a4c-4e13-b799-cc056b270875 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:03.675769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-42a30c12-2a4c-4e13-b799-cc056b270875 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057627 Jul 26 18:47:03.676403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1262/2552] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:47:03 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:04.692905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4cba91fb-1b36-459a-ae7e-581af204aca4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:04.696178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4cba91fb-1b36-459a-ae7e-581af204aca4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:04.702847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4cba91fb-1b36-459a-ae7e-581af204aca4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:04.703358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4cba91fb-1b36-459a-ae7e-581af204aca4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:04.704531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4cba91fb-1b36-459a-ae7e-581af204aca4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:04.704531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4cba91fb-1b36-459a-ae7e-581af204aca4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:04.733918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4cba91fb-1b36-459a-ae7e-581af204aca4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048167 Jul 26 18:47:04.734710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1291/2553] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:47:04 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:05.747286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cb1557e1-b06c-4f4c-9ca7-0faef9b2ff3a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:05.749534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cb1557e1-b06c-4f4c-9ca7-0faef9b2ff3a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:05.756378 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb1557e1-b06c-4f4c-9ca7-0faef9b2ff3a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:05.756806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb1557e1-b06c-4f4c-9ca7-0faef9b2ff3a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:05.757561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb1557e1-b06c-4f4c-9ca7-0faef9b2ff3a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:05.758018 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cb1557e1-b06c-4f4c-9ca7-0faef9b2ff3a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:05.787926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cb1557e1-b06c-4f4c-9ca7-0faef9b2ff3a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045868 Jul 26 18:47:05.792622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1263/2554] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:47:05 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:06.801714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-65bd46e3-af2b-48d7-b0da-d5b8cde2522b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:06.804326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-65bd46e3-af2b-48d7-b0da-d5b8cde2522b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:06.812361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65bd46e3-af2b-48d7-b0da-d5b8cde2522b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:06.812909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65bd46e3-af2b-48d7-b0da-d5b8cde2522b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:06.813808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65bd46e3-af2b-48d7-b0da-d5b8cde2522b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:06.814326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65bd46e3-af2b-48d7-b0da-d5b8cde2522b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:06.846217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-65bd46e3-af2b-48d7-b0da-d5b8cde2522b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049267 Jul 26 18:47:06.846758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1292/2555] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:47:06 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:07.862073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-008007d9-e3e7-4088-92d9-f99471cc437c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:07.865550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-008007d9-e3e7-4088-92d9-f99471cc437c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:07.875581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-008007d9-e3e7-4088-92d9-f99471cc437c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:07.876026 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-008007d9-e3e7-4088-92d9-f99471cc437c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:07.876785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-008007d9-e3e7-4088-92d9-f99471cc437c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:07.877214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-008007d9-e3e7-4088-92d9-f99471cc437c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:07.908137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-008007d9-e3e7-4088-92d9-f99471cc437c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052817 Jul 26 18:47:07.908712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1264/2556] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:47:07 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:08.922877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ba2e29f6-daee-4f62-b559-d5a292a34ce3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:08.924994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ba2e29f6-daee-4f62-b559-d5a292a34ce3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:08.932090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba2e29f6-daee-4f62-b559-d5a292a34ce3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:08.932535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba2e29f6-daee-4f62-b559-d5a292a34ce3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:08.933295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba2e29f6-daee-4f62-b559-d5a292a34ce3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:08.933738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba2e29f6-daee-4f62-b559-d5a292a34ce3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:08.964145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ba2e29f6-daee-4f62-b559-d5a292a34ce3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046854 Jul 26 18:47:08.964691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1293/2557] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:47:08 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:09.980863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-de366baa-7aeb-46bd-96df-867522e28b1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:09.984428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-de366baa-7aeb-46bd-96df-867522e28b1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:09.995460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de366baa-7aeb-46bd-96df-867522e28b1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:09.996158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de366baa-7aeb-46bd-96df-867522e28b1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:09.997410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de366baa-7aeb-46bd-96df-867522e28b1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:09.998129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de366baa-7aeb-46bd-96df-867522e28b1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:10.029506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-de366baa-7aeb-46bd-96df-867522e28b1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055366 Jul 26 18:47:10.030197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1265/2558] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:47:09 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:11.046197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ff60ae27-0c5e-4784-8bee-71e5c4c7b706 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:11.048609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ff60ae27-0c5e-4784-8bee-71e5c4c7b706 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:11.056511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff60ae27-0c5e-4784-8bee-71e5c4c7b706 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:11.057017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff60ae27-0c5e-4784-8bee-71e5c4c7b706 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:11.057888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff60ae27-0c5e-4784-8bee-71e5c4c7b706 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:11.058376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff60ae27-0c5e-4784-8bee-71e5c4c7b706 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:11.094804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ff60ae27-0c5e-4784-8bee-71e5c4c7b706 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055207 Jul 26 18:47:11.095382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1294/2559] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:47:11 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:12.112093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4053ab10-1422-4b18-9e39-0f2b3a333b39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:12.115521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4053ab10-1422-4b18-9e39-0f2b3a333b39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:12.126563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4053ab10-1422-4b18-9e39-0f2b3a333b39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:12.126706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4053ab10-1422-4b18-9e39-0f2b3a333b39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:12.127649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4053ab10-1422-4b18-9e39-0f2b3a333b39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:12.128098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4053ab10-1422-4b18-9e39-0f2b3a333b39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:12.162165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4053ab10-1422-4b18-9e39-0f2b3a333b39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056399 Jul 26 18:47:12.163029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1266/2560] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:47:12 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:13.178946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7e01776d-fb31-4ba1-90bb-b207d43b3f4d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:13.182117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7e01776d-fb31-4ba1-90bb-b207d43b3f4d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:13.191911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e01776d-fb31-4ba1-90bb-b207d43b3f4d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:13.192581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e01776d-fb31-4ba1-90bb-b207d43b3f4d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:13.193785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e01776d-fb31-4ba1-90bb-b207d43b3f4d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:13.194396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e01776d-fb31-4ba1-90bb-b207d43b3f4d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:13.196935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=90 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:47:13.225695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7e01776d-fb31-4ba1-90bb-b207d43b3f4d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053876 Jul 26 18:47:13.226257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1295/2561] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Jul 26 18:47:13 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:47:14.242405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-516f6c83-6671-4563-88dd-5e9994bb15cd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:47:14.245516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-516f6c83-6671-4563-88dd-5e9994bb15cd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:14.255297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-516f6c83-6671-4563-88dd-5e9994bb15cd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:14.255743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-516f6c83-6671-4563-88dd-5e9994bb15cd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:14.256593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-516f6c83-6671-4563-88dd-5e9994bb15cd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:14.257267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-516f6c83-6671-4563-88dd-5e9994bb15cd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:14.330947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:47:14.331152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:47:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/action (ip 10.222.0.27) !!! Jul 26 18:47:14.363538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-516f6c83-6671-4563-88dd-5e9994bb15cd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "POST /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/action" status: 200 len: 75702 microversion: 2.1 time: 0.127471 Jul 26 18:47:14.364255 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1267/2562] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Jul 26 18:47:14 2022] POST /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2/action => generated 75702 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:47:15.173650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2967e484-1dab-474c-8169-df9625592340 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:15.174178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2967e484-1dab-474c-8169-df9625592340 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:15.176464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=30 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:47:15.181574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2967e484-1dab-474c-8169-df9625592340 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:15.182026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2967e484-1dab-474c-8169-df9625592340 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:15.182786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2967e484-1dab-474c-8169-df9625592340 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:15.183247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2967e484-1dab-474c-8169-df9625592340 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:15.209332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2967e484-1dab-474c-8169-df9625592340 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Going to try to terminate instance {{(pid=117996) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 18:47:15.297504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2967e484-1dab-474c-8169-df9625592340 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 204 len: 0 microversion: 2.1 time: 0.127280 Jul 26 18:47:15.298212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1296/2563] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 18:47:15 2022] DELETE /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:47:15.307150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c09cdba7-d30f-4bd9-a6bb-1419222b2cda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:15.307833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c09cdba7-d30f-4bd9-a6bb-1419222b2cda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:15.310213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=30 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:47:15.316646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c09cdba7-d30f-4bd9-a6bb-1419222b2cda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:15.317331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c09cdba7-d30f-4bd9-a6bb-1419222b2cda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:15.317845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c09cdba7-d30f-4bd9-a6bb-1419222b2cda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:15.318279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c09cdba7-d30f-4bd9-a6bb-1419222b2cda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:15.508377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c09cdba7-d30f-4bd9-a6bb-1419222b2cda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:15.516509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c09cdba7-d30f-4bd9-a6bb-1419222b2cda tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.213685 Jul 26 18:47:15.517071 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1268/2564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:15 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:47:16.538934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-128ed7df-bacd-421e-a5bf-fb2da3ffd499 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:16.539661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-128ed7df-bacd-421e-a5bf-fb2da3ffd499 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:16.546311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-128ed7df-bacd-421e-a5bf-fb2da3ffd499 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:16.546793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-128ed7df-bacd-421e-a5bf-fb2da3ffd499 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:16.547592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-128ed7df-bacd-421e-a5bf-fb2da3ffd499 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:16.548025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-128ed7df-bacd-421e-a5bf-fb2da3ffd499 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:16.733345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-128ed7df-bacd-421e-a5bf-fb2da3ffd499 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:16.741904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-128ed7df-bacd-421e-a5bf-fb2da3ffd499 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.207493 Jul 26 18:47:16.742504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1297/2565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:16 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:17.767957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ba8fa35a-f263-439a-b581-e1865a888997 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:17.768587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ba8fa35a-f263-439a-b581-e1865a888997 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:17.776026 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba8fa35a-f263-439a-b581-e1865a888997 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:17.776479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba8fa35a-f263-439a-b581-e1865a888997 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:17.777224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba8fa35a-f263-439a-b581-e1865a888997 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:17.777628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba8fa35a-f263-439a-b581-e1865a888997 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:17.924583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ba8fa35a-f263-439a-b581-e1865a888997 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:17.932899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ba8fa35a-f263-439a-b581-e1865a888997 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.171031 Jul 26 18:47:17.933472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1269/2566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:17 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:18.954677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0d625b00-2556-4f54-8982-59c85c6aa865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:18.955278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0d625b00-2556-4f54-8982-59c85c6aa865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:18.962207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d625b00-2556-4f54-8982-59c85c6aa865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:18.962653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d625b00-2556-4f54-8982-59c85c6aa865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:18.963472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d625b00-2556-4f54-8982-59c85c6aa865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:18.963885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d625b00-2556-4f54-8982-59c85c6aa865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:19.097985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0d625b00-2556-4f54-8982-59c85c6aa865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:19.106475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0d625b00-2556-4f54-8982-59c85c6aa865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155857 Jul 26 18:47:19.107045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1298/2567] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:18 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:20.138024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9a8cf877-cc7c-4404-b756-008ab26f3879 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:20.139118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9a8cf877-cc7c-4404-b756-008ab26f3879 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:20.147166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a8cf877-cc7c-4404-b756-008ab26f3879 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:20.147614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a8cf877-cc7c-4404-b756-008ab26f3879 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:20.148733 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a8cf877-cc7c-4404-b756-008ab26f3879 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:20.149163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a8cf877-cc7c-4404-b756-008ab26f3879 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:20.151710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=88 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:47:20.290761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9a8cf877-cc7c-4404-b756-008ab26f3879 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:20.302836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9a8cf877-cc7c-4404-b756-008ab26f3879 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.171077 Jul 26 18:47:20.303722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1270/2568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:20 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:21.327586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2e55d879-8ebc-4308-b3a1-0206663b0225 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:21.328254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2e55d879-8ebc-4308-b3a1-0206663b0225 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:21.335310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e55d879-8ebc-4308-b3a1-0206663b0225 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:21.335748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e55d879-8ebc-4308-b3a1-0206663b0225 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:21.336475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e55d879-8ebc-4308-b3a1-0206663b0225 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:21.336954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e55d879-8ebc-4308-b3a1-0206663b0225 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:21.471377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2e55d879-8ebc-4308-b3a1-0206663b0225 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:21.479056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2e55d879-8ebc-4308-b3a1-0206663b0225 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155427 Jul 26 18:47:21.479777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1299/2569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:21 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:22.454530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:47:22.455514 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:47:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:47:22.501472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5ea29674-5926-45da-86a3-b48ea4aea5d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:22.502080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5ea29674-5926-45da-86a3-b48ea4aea5d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:22.508981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ea29674-5926-45da-86a3-b48ea4aea5d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:22.509428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ea29674-5926-45da-86a3-b48ea4aea5d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:22.510189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ea29674-5926-45da-86a3-b48ea4aea5d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:22.510624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ea29674-5926-45da-86a3-b48ea4aea5d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:22.644798 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5ea29674-5926-45da-86a3-b48ea4aea5d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:22.653238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5ea29674-5926-45da-86a3-b48ea4aea5d6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155965 Jul 26 18:47:22.653805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1271/2570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:22 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:23.675531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9a653555-af95-425f-ab64-c86d9e6033d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:23.676089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9a653555-af95-425f-ab64-c86d9e6033d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:23.682750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a653555-af95-425f-ab64-c86d9e6033d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:23.683317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a653555-af95-425f-ab64-c86d9e6033d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:23.684068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a653555-af95-425f-ab64-c86d9e6033d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:23.684503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a653555-af95-425f-ab64-c86d9e6033d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:23.817932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9a653555-af95-425f-ab64-c86d9e6033d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:23.826169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9a653555-af95-425f-ab64-c86d9e6033d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154748 Jul 26 18:47:23.826709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1300/2571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:23 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:24.851339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-34f41407-e460-49d1-ab76-90d347de561a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:24.852346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-34f41407-e460-49d1-ab76-90d347de561a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:24.860584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34f41407-e460-49d1-ab76-90d347de561a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:24.861079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34f41407-e460-49d1-ab76-90d347de561a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:24.861910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34f41407-e460-49d1-ab76-90d347de561a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:24.862388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34f41407-e460-49d1-ab76-90d347de561a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:25.001655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-34f41407-e460-49d1-ab76-90d347de561a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:25.010701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-34f41407-e460-49d1-ab76-90d347de561a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.165981 Jul 26 18:47:25.011320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1272/2572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:24 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:26.032239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-32cb7c59-ef9a-414a-88d1-b50252e5d022 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:26.032714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-32cb7c59-ef9a-414a-88d1-b50252e5d022 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:26.039369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32cb7c59-ef9a-414a-88d1-b50252e5d022 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:26.039856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32cb7c59-ef9a-414a-88d1-b50252e5d022 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:26.040550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32cb7c59-ef9a-414a-88d1-b50252e5d022 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:26.040981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32cb7c59-ef9a-414a-88d1-b50252e5d022 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:26.172268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-32cb7c59-ef9a-414a-88d1-b50252e5d022 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:26.181209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-32cb7c59-ef9a-414a-88d1-b50252e5d022 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153058 Jul 26 18:47:26.181767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1301/2573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:26 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:27.201576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-af5f7f16-85c4-4c87-9bee-63f7068af51b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:27.202140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-af5f7f16-85c4-4c87-9bee-63f7068af51b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:27.208895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af5f7f16-85c4-4c87-9bee-63f7068af51b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:27.209351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af5f7f16-85c4-4c87-9bee-63f7068af51b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:27.210099 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af5f7f16-85c4-4c87-9bee-63f7068af51b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:27.210535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af5f7f16-85c4-4c87-9bee-63f7068af51b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:27.511813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-af5f7f16-85c4-4c87-9bee-63f7068af51b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:27.520622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-af5f7f16-85c4-4c87-9bee-63f7068af51b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.322835 Jul 26 18:47:27.521165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1273/2574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:27 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:28.707896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6043bf41-c7e4-4c26-83f7-366c2926c3bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:28.708840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6043bf41-c7e4-4c26-83f7-366c2926c3bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:28.718608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6043bf41-c7e4-4c26-83f7-366c2926c3bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:28.719362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6043bf41-c7e4-4c26-83f7-366c2926c3bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:28.720569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6043bf41-c7e4-4c26-83f7-366c2926c3bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:28.721379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6043bf41-c7e4-4c26-83f7-366c2926c3bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:28.861366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6043bf41-c7e4-4c26-83f7-366c2926c3bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:28.870033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6043bf41-c7e4-4c26-83f7-366c2926c3bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.331392 Jul 26 18:47:28.870604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1302/2575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:28 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:29.891847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-108b2cc6-225d-4df9-99a3-814c40653ec0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:29.892455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-108b2cc6-225d-4df9-99a3-814c40653ec0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:29.899899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-108b2cc6-225d-4df9-99a3-814c40653ec0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:29.900344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-108b2cc6-225d-4df9-99a3-814c40653ec0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:29.901096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-108b2cc6-225d-4df9-99a3-814c40653ec0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:29.901528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-108b2cc6-225d-4df9-99a3-814c40653ec0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:30.034830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-108b2cc6-225d-4df9-99a3-814c40653ec0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:30.043237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-108b2cc6-225d-4df9-99a3-814c40653ec0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155462 Jul 26 18:47:30.043817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1274/2576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:29 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:31.076074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0e26827f-57fe-4229-a288-d77dbc6ca802 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:31.076680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0e26827f-57fe-4229-a288-d77dbc6ca802 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:31.083407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e26827f-57fe-4229-a288-d77dbc6ca802 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:31.083850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e26827f-57fe-4229-a288-d77dbc6ca802 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:31.084858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e26827f-57fe-4229-a288-d77dbc6ca802 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:31.085034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e26827f-57fe-4229-a288-d77dbc6ca802 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:31.214141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0e26827f-57fe-4229-a288-d77dbc6ca802 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:31.226657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0e26827f-57fe-4229-a288-d77dbc6ca802 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154280 Jul 26 18:47:31.227462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1303/2577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:31 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:32.255339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-96b2a6a5-625b-4776-930d-c9593caa134d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:32.256040 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-96b2a6a5-625b-4776-930d-c9593caa134d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:32.264505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96b2a6a5-625b-4776-930d-c9593caa134d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:32.265065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96b2a6a5-625b-4776-930d-c9593caa134d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:32.266002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96b2a6a5-625b-4776-930d-c9593caa134d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:32.266545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96b2a6a5-625b-4776-930d-c9593caa134d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:32.403778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-96b2a6a5-625b-4776-930d-c9593caa134d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:32.420832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-96b2a6a5-625b-4776-930d-c9593caa134d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.171403 Jul 26 18:47:32.421464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1275/2578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:32 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:33.445845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6ff9e005-c7e9-4ff4-8181-887b1bed9cc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:33.446804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6ff9e005-c7e9-4ff4-8181-887b1bed9cc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:33.456971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ff9e005-c7e9-4ff4-8181-887b1bed9cc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:33.457420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ff9e005-c7e9-4ff4-8181-887b1bed9cc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:33.458144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ff9e005-c7e9-4ff4-8181-887b1bed9cc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:33.458607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ff9e005-c7e9-4ff4-8181-887b1bed9cc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:33.594724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6ff9e005-c7e9-4ff4-8181-887b1bed9cc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:33.607076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6ff9e005-c7e9-4ff4-8181-887b1bed9cc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.167434 Jul 26 18:47:33.607888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1304/2579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:33 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:34.628107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c44ff8fc-7f58-493c-a5f7-8e753932fdcb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:34.628702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c44ff8fc-7f58-493c-a5f7-8e753932fdcb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:34.635809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c44ff8fc-7f58-493c-a5f7-8e753932fdcb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:34.636390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c44ff8fc-7f58-493c-a5f7-8e753932fdcb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:34.637124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c44ff8fc-7f58-493c-a5f7-8e753932fdcb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:34.637578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c44ff8fc-7f58-493c-a5f7-8e753932fdcb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:34.794281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c44ff8fc-7f58-493c-a5f7-8e753932fdcb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:34.806670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c44ff8fc-7f58-493c-a5f7-8e753932fdcb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.182270 Jul 26 18:47:34.807441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1276/2580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:34 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:35.829078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b48d0675-efbd-477a-bdf7-310c88da2ca3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:35.829642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b48d0675-efbd-477a-bdf7-310c88da2ca3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:35.836897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b48d0675-efbd-477a-bdf7-310c88da2ca3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:35.837347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b48d0675-efbd-477a-bdf7-310c88da2ca3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:35.838114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b48d0675-efbd-477a-bdf7-310c88da2ca3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:35.838546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b48d0675-efbd-477a-bdf7-310c88da2ca3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:35.985217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b48d0675-efbd-477a-bdf7-310c88da2ca3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:35.997863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b48d0675-efbd-477a-bdf7-310c88da2ca3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.173038 Jul 26 18:47:35.998644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1305/2581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:35 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:37.025527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ad0f25ab-d258-4ebd-80c4-af24b2afabe0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:37.026507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ad0f25ab-d258-4ebd-80c4-af24b2afabe0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:37.036591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad0f25ab-d258-4ebd-80c4-af24b2afabe0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:37.037044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad0f25ab-d258-4ebd-80c4-af24b2afabe0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:37.037804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad0f25ab-d258-4ebd-80c4-af24b2afabe0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:37.038239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad0f25ab-d258-4ebd-80c4-af24b2afabe0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:37.186202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ad0f25ab-d258-4ebd-80c4-af24b2afabe0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:37.199080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ad0f25ab-d258-4ebd-80c4-af24b2afabe0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.180237 Jul 26 18:47:37.199929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1277/2582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:37 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:38.224073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bae17022-8d57-4cd8-bfbc-d6619133ca02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:38.224663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bae17022-8d57-4cd8-bfbc-d6619133ca02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:38.231610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bae17022-8d57-4cd8-bfbc-d6619133ca02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:38.232087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bae17022-8d57-4cd8-bfbc-d6619133ca02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:38.232832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bae17022-8d57-4cd8-bfbc-d6619133ca02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:38.233282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bae17022-8d57-4cd8-bfbc-d6619133ca02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:38.362043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bae17022-8d57-4cd8-bfbc-d6619133ca02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:38.370366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bae17022-8d57-4cd8-bfbc-d6619133ca02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.150351 Jul 26 18:47:38.370906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1306/2583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:38 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:39.395130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ac53f13c-2dce-4ac6-aed7-94c079766bd3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:39.395821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ac53f13c-2dce-4ac6-aed7-94c079766bd3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:39.404279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac53f13c-2dce-4ac6-aed7-94c079766bd3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:39.404806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac53f13c-2dce-4ac6-aed7-94c079766bd3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:39.405691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac53f13c-2dce-4ac6-aed7-94c079766bd3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:39.406205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac53f13c-2dce-4ac6-aed7-94c079766bd3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:39.544268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ac53f13c-2dce-4ac6-aed7-94c079766bd3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:39.553961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ac53f13c-2dce-4ac6-aed7-94c079766bd3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.165496 Jul 26 18:47:39.554533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1278/2584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:39 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:40.579171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a817177c-b710-4f5f-9f7a-e6f8b4d0fa83 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:40.580253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a817177c-b710-4f5f-9f7a-e6f8b4d0fa83 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:40.591190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a817177c-b710-4f5f-9f7a-e6f8b4d0fa83 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:40.591932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a817177c-b710-4f5f-9f7a-e6f8b4d0fa83 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:40.593162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a817177c-b710-4f5f-9f7a-e6f8b4d0fa83 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:40.593866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a817177c-b710-4f5f-9f7a-e6f8b4d0fa83 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:40.725329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a817177c-b710-4f5f-9f7a-e6f8b4d0fa83 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:40.733271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a817177c-b710-4f5f-9f7a-e6f8b4d0fa83 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.160531 Jul 26 18:47:40.733795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1307/2585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:40 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:41.755466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5b8bd29b-096f-4175-af76-823b8e0802d7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:41.756126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5b8bd29b-096f-4175-af76-823b8e0802d7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:41.764194 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b8bd29b-096f-4175-af76-823b8e0802d7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:41.764769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b8bd29b-096f-4175-af76-823b8e0802d7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:41.765400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b8bd29b-096f-4175-af76-823b8e0802d7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:41.765830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b8bd29b-096f-4175-af76-823b8e0802d7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:41.910482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5b8bd29b-096f-4175-af76-823b8e0802d7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:41.918856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5b8bd29b-096f-4175-af76-823b8e0802d7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.168755 Jul 26 18:47:41.919475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1279/2586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:41 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:42.943837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a7f5ef86-f5d8-4dba-90e6-bbee09a0379e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:42.944415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a7f5ef86-f5d8-4dba-90e6-bbee09a0379e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:42.951659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7f5ef86-f5d8-4dba-90e6-bbee09a0379e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:42.952105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7f5ef86-f5d8-4dba-90e6-bbee09a0379e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:42.952861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7f5ef86-f5d8-4dba-90e6-bbee09a0379e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:42.953295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7f5ef86-f5d8-4dba-90e6-bbee09a0379e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:43.085642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a7f5ef86-f5d8-4dba-90e6-bbee09a0379e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:43.093568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a7f5ef86-f5d8-4dba-90e6-bbee09a0379e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155380 Jul 26 18:47:43.094131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1308/2587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:42 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:44.116302 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-00066382-3483-4e29-97e9-1ce5e2f6ed66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:44.116897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-00066382-3483-4e29-97e9-1ce5e2f6ed66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:44.123783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00066382-3483-4e29-97e9-1ce5e2f6ed66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:44.124195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00066382-3483-4e29-97e9-1ce5e2f6ed66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:44.125202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00066382-3483-4e29-97e9-1ce5e2f6ed66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:44.125600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00066382-3483-4e29-97e9-1ce5e2f6ed66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:44.270028 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-00066382-3483-4e29-97e9-1ce5e2f6ed66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:44.279203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-00066382-3483-4e29-97e9-1ce5e2f6ed66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.167790 Jul 26 18:47:44.279709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1280/2588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:44 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:45.300235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ec771f84-cf02-474d-94cd-a3310b06f035 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:45.300903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ec771f84-cf02-474d-94cd-a3310b06f035 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:45.303480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:47:45.309040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec771f84-cf02-474d-94cd-a3310b06f035 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:45.309485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec771f84-cf02-474d-94cd-a3310b06f035 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:45.310306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec771f84-cf02-474d-94cd-a3310b06f035 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:45.310738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec771f84-cf02-474d-94cd-a3310b06f035 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:45.315486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:47:45.446304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ec771f84-cf02-474d-94cd-a3310b06f035 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:45.455143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ec771f84-cf02-474d-94cd-a3310b06f035 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.158819 Jul 26 18:47:45.455724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1309/2589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:45 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:46.480732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cd8ad79c-f758-45a7-b7e9-6a5c3be7e60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:46.481489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cd8ad79c-f758-45a7-b7e9-6a5c3be7e60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:46.484294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=26 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:47:46.490886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd8ad79c-f758-45a7-b7e9-6a5c3be7e60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:46.491478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd8ad79c-f758-45a7-b7e9-6a5c3be7e60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:46.492414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd8ad79c-f758-45a7-b7e9-6a5c3be7e60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:46.492945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd8ad79c-f758-45a7-b7e9-6a5c3be7e60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:46.630112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cd8ad79c-f758-45a7-b7e9-6a5c3be7e60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:46.638676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cd8ad79c-f758-45a7-b7e9-6a5c3be7e60b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.162800 Jul 26 18:47:46.639278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1281/2590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:46 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:47.664777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2d00f414-32de-4b73-ba43-e05e95dab020 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:47.665646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2d00f414-32de-4b73-ba43-e05e95dab020 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:47.676522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d00f414-32de-4b73-ba43-e05e95dab020 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:47.677270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d00f414-32de-4b73-ba43-e05e95dab020 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:47.678524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d00f414-32de-4b73-ba43-e05e95dab020 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:47.679372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d00f414-32de-4b73-ba43-e05e95dab020 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:47.819354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2d00f414-32de-4b73-ba43-e05e95dab020 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:47.831959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2d00f414-32de-4b73-ba43-e05e95dab020 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.173533 Jul 26 18:47:47.832702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1310/2591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:47 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:48.859621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aa422e63-1094-4184-8fd4-5dd49a317363 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:48.860630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aa422e63-1094-4184-8fd4-5dd49a317363 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:48.871858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa422e63-1094-4184-8fd4-5dd49a317363 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:48.872609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa422e63-1094-4184-8fd4-5dd49a317363 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:48.873912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa422e63-1094-4184-8fd4-5dd49a317363 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:48.874631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aa422e63-1094-4184-8fd4-5dd49a317363 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:49.007548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-aa422e63-1094-4184-8fd4-5dd49a317363 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:49.019446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aa422e63-1094-4184-8fd4-5dd49a317363 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.166391 Jul 26 18:47:49.020221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1282/2592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:48 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:50.046500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fe17d073-6399-45d5-91a4-f0da48169341 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:50.047412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fe17d073-6399-45d5-91a4-f0da48169341 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:50.057143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe17d073-6399-45d5-91a4-f0da48169341 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:50.057599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe17d073-6399-45d5-91a4-f0da48169341 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:50.058416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe17d073-6399-45d5-91a4-f0da48169341 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:50.058870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe17d073-6399-45d5-91a4-f0da48169341 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:50.198777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fe17d073-6399-45d5-91a4-f0da48169341 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:50.211349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fe17d073-6399-45d5-91a4-f0da48169341 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.171161 Jul 26 18:47:50.212100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1311/2593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:50 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:51.241286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-682295e1-70dc-44c8-b3f0-a9197afd3093 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:51.242388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-682295e1-70dc-44c8-b3f0-a9197afd3093 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:51.249614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-682295e1-70dc-44c8-b3f0-a9197afd3093 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:51.250058 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-682295e1-70dc-44c8-b3f0-a9197afd3093 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:51.250931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-682295e1-70dc-44c8-b3f0-a9197afd3093 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:51.251399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-682295e1-70dc-44c8-b3f0-a9197afd3093 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:51.256149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=78 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:47:51.390653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-682295e1-70dc-44c8-b3f0-a9197afd3093 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:51.400620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-682295e1-70dc-44c8-b3f0-a9197afd3093 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.166405 Jul 26 18:47:51.401215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1283/2594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:51 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:52.422995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a5403ab1-2711-43c0-a672-159605345e66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:52.423637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a5403ab1-2711-43c0-a672-159605345e66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:52.430618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5403ab1-2711-43c0-a672-159605345e66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:52.431058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5403ab1-2711-43c0-a672-159605345e66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:52.431881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5403ab1-2711-43c0-a672-159605345e66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:52.432374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5403ab1-2711-43c0-a672-159605345e66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:52.565629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a5403ab1-2711-43c0-a672-159605345e66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:52.574191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a5403ab1-2711-43c0-a672-159605345e66 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155021 Jul 26 18:47:52.574765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1312/2595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:52 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:53.599883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6ca6c930-ba72-429b-ae6d-da9d55d43c6d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:53.600899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6ca6c930-ba72-429b-ae6d-da9d55d43c6d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:53.611212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ca6c930-ba72-429b-ae6d-da9d55d43c6d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:53.611957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ca6c930-ba72-429b-ae6d-da9d55d43c6d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:53.613231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ca6c930-ba72-429b-ae6d-da9d55d43c6d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:53.613921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ca6c930-ba72-429b-ae6d-da9d55d43c6d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:53.750007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6ca6c930-ba72-429b-ae6d-da9d55d43c6d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:53.758450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6ca6c930-ba72-429b-ae6d-da9d55d43c6d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.164990 Jul 26 18:47:53.759002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1284/2596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:53 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:54.593944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-96fe8678-dd26-4daa-9b03-c2a2ec03ded5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:54.594474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-96fe8678-dd26-4daa-9b03-c2a2ec03ded5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:54.600999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96fe8678-dd26-4daa-9b03-c2a2ec03ded5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:54.601439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96fe8678-dd26-4daa-9b03-c2a2ec03ded5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:54.602232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96fe8678-dd26-4daa-9b03-c2a2ec03ded5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:54.602663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96fe8678-dd26-4daa-9b03-c2a2ec03ded5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:54.627256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-96fe8678-dd26-4daa-9b03-c2a2ec03ded5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Going to try to terminate instance {{(pid=117996) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 18:47:54.710286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-96fe8678-dd26-4daa-9b03-c2a2ec03ded5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 204 len: 0 microversion: 2.20 time: 0.119883 Jul 26 18:47:54.710869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1313/2597] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Jul 26 18:47:54 2022] DELETE /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 18:47:54.720191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7d54f3f2-7d37-4039-8178-6572ca248919 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:54.720791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7d54f3f2-7d37-4039-8178-6572ca248919 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:54.728134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d54f3f2-7d37-4039-8178-6572ca248919 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:54.728578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d54f3f2-7d37-4039-8178-6572ca248919 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:54.729336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d54f3f2-7d37-4039-8178-6572ca248919 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:54.729769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d54f3f2-7d37-4039-8178-6572ca248919 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:54.782044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3391bc7d-e408-4b8b-b7ac-db397492401f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:54.786924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3391bc7d-e408-4b8b-b7ac-db397492401f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:54.796039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3391bc7d-e408-4b8b-b7ac-db397492401f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:54.796747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3391bc7d-e408-4b8b-b7ac-db397492401f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:54.797698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3391bc7d-e408-4b8b-b7ac-db397492401f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:54.798137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3391bc7d-e408-4b8b-b7ac-db397492401f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:54.879656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7d54f3f2-7d37-4039-8178-6572ca248919 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:54.892672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7d54f3f2-7d37-4039-8178-6572ca248919 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:54.894166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7d54f3f2-7d37-4039-8178-6572ca248919 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:54.895694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7d54f3f2-7d37-4039-8178-6572ca248919 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.179574 Jul 26 18:47:54.896242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1285/2598] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:47:54 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:47:54.945986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3391bc7d-e408-4b8b-b7ac-db397492401f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:54.954063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3391bc7d-e408-4b8b-b7ac-db397492401f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.177314 Jul 26 18:47:54.954630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1314/2599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:54 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:55.917851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6e8870a3-ccac-49cb-8c0d-0f2194b432c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:55.918463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6e8870a3-ccac-49cb-8c0d-0f2194b432c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:55.925139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e8870a3-ccac-49cb-8c0d-0f2194b432c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:55.925592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e8870a3-ccac-49cb-8c0d-0f2194b432c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:55.926350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e8870a3-ccac-49cb-8c0d-0f2194b432c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:55.926779 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e8870a3-ccac-49cb-8c0d-0f2194b432c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:55.974917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7dd11293-869f-49bd-976b-7743e0fdd048 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:55.975565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7dd11293-869f-49bd-976b-7743e0fdd048 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:55.982273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dd11293-869f-49bd-976b-7743e0fdd048 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:55.982719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dd11293-869f-49bd-976b-7743e0fdd048 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:55.983499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dd11293-869f-49bd-976b-7743e0fdd048 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:55.983947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dd11293-869f-49bd-976b-7743e0fdd048 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:56.061309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6e8870a3-ccac-49cb-8c0d-0f2194b432c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:56.070435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6e8870a3-ccac-49cb-8c0d-0f2194b432c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:56.072063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6e8870a3-ccac-49cb-8c0d-0f2194b432c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:56.073217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6e8870a3-ccac-49cb-8c0d-0f2194b432c0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159275 Jul 26 18:47:56.073751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1286/2600] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:47:55 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:47:56.115809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7dd11293-869f-49bd-976b-7743e0fdd048 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:56.127770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7dd11293-869f-49bd-976b-7743e0fdd048 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156368 Jul 26 18:47:56.128513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1315/2601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:55 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:57.098472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-912083dd-52b2-4ead-94d0-87e8866aabfa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:57.099225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-912083dd-52b2-4ead-94d0-87e8866aabfa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:57.106677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-912083dd-52b2-4ead-94d0-87e8866aabfa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:57.107150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-912083dd-52b2-4ead-94d0-87e8866aabfa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:57.107897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-912083dd-52b2-4ead-94d0-87e8866aabfa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:57.108319 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-912083dd-52b2-4ead-94d0-87e8866aabfa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:57.149798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c9a9d7a2-db6e-4e69-a8d4-9680e9d73a12 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:57.150392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c9a9d7a2-db6e-4e69-a8d4-9680e9d73a12 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:57.157087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9a9d7a2-db6e-4e69-a8d4-9680e9d73a12 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:57.157496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9a9d7a2-db6e-4e69-a8d4-9680e9d73a12 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:57.158267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9a9d7a2-db6e-4e69-a8d4-9680e9d73a12 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:57.158693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9a9d7a2-db6e-4e69-a8d4-9680e9d73a12 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:57.240504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-912083dd-52b2-4ead-94d0-87e8866aabfa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:57.249342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-912083dd-52b2-4ead-94d0-87e8866aabfa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:57.250883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-912083dd-52b2-4ead-94d0-87e8866aabfa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:57.252103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-912083dd-52b2-4ead-94d0-87e8866aabfa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159034 Jul 26 18:47:57.252661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1287/2602] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:47:57 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:47:57.291052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c9a9d7a2-db6e-4e69-a8d4-9680e9d73a12 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:57.299218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c9a9d7a2-db6e-4e69-a8d4-9680e9d73a12 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153680 Jul 26 18:47:57.299778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1316/2603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:57 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:58.037033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-50c81c83-cca9-4a5a-9a02-f28d18c735b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:58.037526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-50c81c83-cca9-4a5a-9a02-f28d18c735b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:58.043714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50c81c83-cca9-4a5a-9a02-f28d18c735b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:58.044199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50c81c83-cca9-4a5a-9a02-f28d18c735b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:58.044950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50c81c83-cca9-4a5a-9a02-f28d18c735b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:58.045388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50c81c83-cca9-4a5a-9a02-f28d18c735b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:58.069913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-50c81c83-cca9-4a5a-9a02-f28d18c735b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 18:47:58.164805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-50c81c83-cca9-4a5a-9a02-f28d18c735b2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 204 len: 0 microversion: 2.1 time: 0.131371 Jul 26 18:47:58.169943 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1288/2604] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 18:47:58 2022] DELETE /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:47:58.178958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-838eff23-a9e3-460a-a6c8-d23e3c818c0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:58.179724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-838eff23-a9e3-460a-a6c8-d23e3c818c0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:58.187566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-838eff23-a9e3-460a-a6c8-d23e3c818c0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:58.188015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-838eff23-a9e3-460a-a6c8-d23e3c818c0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:58.188779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-838eff23-a9e3-460a-a6c8-d23e3c818c0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:58.189224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-838eff23-a9e3-460a-a6c8-d23e3c818c0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:58.276416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-56c5ae26-9733-4b68-ad2c-97e76d648aa9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:58.277103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-56c5ae26-9733-4b68-ad2c-97e76d648aa9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:58.283357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56c5ae26-9733-4b68-ad2c-97e76d648aa9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:58.283801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56c5ae26-9733-4b68-ad2c-97e76d648aa9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:58.284548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56c5ae26-9733-4b68-ad2c-97e76d648aa9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:58.284981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56c5ae26-9733-4b68-ad2c-97e76d648aa9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:58.326280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-838eff23-a9e3-460a-a6c8-d23e3c818c0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:58.334859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-838eff23-a9e3-460a-a6c8-d23e3c818c0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.162295 Jul 26 18:47:58.335469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1317/2605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:58 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:58.340139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bee62f56-3f6d-4fbc-a7ac-5fb2219f5fad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:58.340740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bee62f56-3f6d-4fbc-a7ac-5fb2219f5fad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:58.349966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bee62f56-3f6d-4fbc-a7ac-5fb2219f5fad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:58.350420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bee62f56-3f6d-4fbc-a7ac-5fb2219f5fad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:58.351211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bee62f56-3f6d-4fbc-a7ac-5fb2219f5fad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:58.351661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bee62f56-3f6d-4fbc-a7ac-5fb2219f5fad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:58.420060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-56c5ae26-9733-4b68-ad2c-97e76d648aa9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:58.431520 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-56c5ae26-9733-4b68-ad2c-97e76d648aa9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:58.433526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-56c5ae26-9733-4b68-ad2c-97e76d648aa9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:58.435002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-56c5ae26-9733-4b68-ad2c-97e76d648aa9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.163280 Jul 26 18:47:58.436033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1289/2606] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:47:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:47:58.490892 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bee62f56-3f6d-4fbc-a7ac-5fb2219f5fad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:58.500822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bee62f56-3f6d-4fbc-a7ac-5fb2219f5fad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.164430 Jul 26 18:47:58.501558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1318/2607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:58 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:59.360901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9f95f372-de38-46fb-b2e3-fd09b343cda3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:59.361780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9f95f372-de38-46fb-b2e3-fd09b343cda3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:59.372969 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f95f372-de38-46fb-b2e3-fd09b343cda3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:59.373701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f95f372-de38-46fb-b2e3-fd09b343cda3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:59.374959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f95f372-de38-46fb-b2e3-fd09b343cda3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:59.375765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f95f372-de38-46fb-b2e3-fd09b343cda3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:59.463653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fb713149-bf43-4fa5-b10e-bf8f7d438c92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:59.464219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fb713149-bf43-4fa5-b10e-bf8f7d438c92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:59.470953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb713149-bf43-4fa5-b10e-bf8f7d438c92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:59.471733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb713149-bf43-4fa5-b10e-bf8f7d438c92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:59.472784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb713149-bf43-4fa5-b10e-bf8f7d438c92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:59.473455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb713149-bf43-4fa5-b10e-bf8f7d438c92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:59.541362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9f95f372-de38-46fb-b2e3-fd09b343cda3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:59.549776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9f95f372-de38-46fb-b2e3-fd09b343cda3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.195943 Jul 26 18:47:59.550317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1290/2608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:59 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:47:59.554917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c21fd0cf-afad-4da8-ab9c-b203c7b3813a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:47:59.555761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c21fd0cf-afad-4da8-ab9c-b203c7b3813a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:47:59.561889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c21fd0cf-afad-4da8-ab9c-b203c7b3813a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:59.562338 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c21fd0cf-afad-4da8-ab9c-b203c7b3813a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:59.563138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c21fd0cf-afad-4da8-ab9c-b203c7b3813a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:47:59.563575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c21fd0cf-afad-4da8-ab9c-b203c7b3813a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:47:59.618913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fb713149-bf43-4fa5-b10e-bf8f7d438c92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:59.627901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fb713149-bf43-4fa5-b10e-bf8f7d438c92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:59.629425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fb713149-bf43-4fa5-b10e-bf8f7d438c92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:59.630627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fb713149-bf43-4fa5-b10e-bf8f7d438c92 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.172538 Jul 26 18:47:59.631210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1319/2609] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:47:59 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:47:59.693090 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c21fd0cf-afad-4da8-ab9c-b203c7b3813a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:47:59.705307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c21fd0cf-afad-4da8-ab9c-b203c7b3813a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153535 Jul 26 18:47:59.706126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1291/2610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:47:59 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:00.575736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c599ac75-bcf8-49b4-9c7f-774cd25eae29 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:00.576701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c599ac75-bcf8-49b4-9c7f-774cd25eae29 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:00.587735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c599ac75-bcf8-49b4-9c7f-774cd25eae29 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:00.588468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c599ac75-bcf8-49b4-9c7f-774cd25eae29 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:00.589689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c599ac75-bcf8-49b4-9c7f-774cd25eae29 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:00.590398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c599ac75-bcf8-49b4-9c7f-774cd25eae29 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:00.653583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0f07c0c7-95a6-465a-a950-456e491d5f8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:00.654201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0f07c0c7-95a6-465a-a950-456e491d5f8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:00.661048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f07c0c7-95a6-465a-a950-456e491d5f8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:00.661600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f07c0c7-95a6-465a-a950-456e491d5f8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:00.662427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f07c0c7-95a6-465a-a950-456e491d5f8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:00.662854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f07c0c7-95a6-465a-a950-456e491d5f8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:00.725045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c599ac75-bcf8-49b4-9c7f-774cd25eae29 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:00.733499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c599ac75-bcf8-49b4-9c7f-774cd25eae29 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164493 Jul 26 18:48:00.734073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1320/2611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:00 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:00.738499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-175aebfc-5213-493f-b254-27611489a774 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:00.739117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-175aebfc-5213-493f-b254-27611489a774 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:00.747941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-175aebfc-5213-493f-b254-27611489a774 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:00.747941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-175aebfc-5213-493f-b254-27611489a774 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:00.748685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-175aebfc-5213-493f-b254-27611489a774 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:00.749118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-175aebfc-5213-493f-b254-27611489a774 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:00.799960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0f07c0c7-95a6-465a-a950-456e491d5f8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:00.808484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0f07c0c7-95a6-465a-a950-456e491d5f8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:00.809988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0f07c0c7-95a6-465a-a950-456e491d5f8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:00.811176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0f07c0c7-95a6-465a-a950-456e491d5f8f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161549 Jul 26 18:48:00.811742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1292/2612] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:00 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:00.880162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-175aebfc-5213-493f-b254-27611489a774 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:00.888419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-175aebfc-5213-493f-b254-27611489a774 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153370 Jul 26 18:48:00.888956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1321/2613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:00 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:01.755146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2eaf1c61-0905-4d07-affe-e6d8b4fc07d3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:01.755793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2eaf1c61-0905-4d07-affe-e6d8b4fc07d3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:01.762810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2eaf1c61-0905-4d07-affe-e6d8b4fc07d3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:01.763305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2eaf1c61-0905-4d07-affe-e6d8b4fc07d3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:01.764072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2eaf1c61-0905-4d07-affe-e6d8b4fc07d3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:01.764497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2eaf1c61-0905-4d07-affe-e6d8b4fc07d3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:01.834171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-80dd50d8-84c1-4a48-898a-e66cd078de1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:01.834846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-80dd50d8-84c1-4a48-898a-e66cd078de1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:01.843206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80dd50d8-84c1-4a48-898a-e66cd078de1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:01.843657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80dd50d8-84c1-4a48-898a-e66cd078de1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:01.844586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80dd50d8-84c1-4a48-898a-e66cd078de1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:01.844894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80dd50d8-84c1-4a48-898a-e66cd078de1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:01.908165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2eaf1c61-0905-4d07-affe-e6d8b4fc07d3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:01.916397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2eaf1c61-0905-4d07-affe-e6d8b4fc07d3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165201 Jul 26 18:48:01.917821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1293/2614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:01 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:01.922125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-57b8eeae-d7ff-4484-8214-842adffec922 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:01.922726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-57b8eeae-d7ff-4484-8214-842adffec922 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:01.928600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-57b8eeae-d7ff-4484-8214-842adffec922 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:01.929055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-57b8eeae-d7ff-4484-8214-842adffec922 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:01.929856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-57b8eeae-d7ff-4484-8214-842adffec922 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:01.930276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-57b8eeae-d7ff-4484-8214-842adffec922 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:02.060559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-80dd50d8-84c1-4a48-898a-e66cd078de1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:02.068556 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-57b8eeae-d7ff-4484-8214-842adffec922 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:02.069706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-80dd50d8-84c1-4a48-898a-e66cd078de1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:02.071321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-80dd50d8-84c1-4a48-898a-e66cd078de1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:02.072580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-80dd50d8-84c1-4a48-898a-e66cd078de1c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.242509 Jul 26 18:48:02.073214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1322/2615] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:01 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:02.076594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-57b8eeae-d7ff-4484-8214-842adffec922 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.158156 Jul 26 18:48:02.077334 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1294/2616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:01 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:02.941655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d30dae71-ccfb-48e5-9b72-7211e534726f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:02.942665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d30dae71-ccfb-48e5-9b72-7211e534726f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:02.951975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d30dae71-ccfb-48e5-9b72-7211e534726f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:02.952421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d30dae71-ccfb-48e5-9b72-7211e534726f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:02.953178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d30dae71-ccfb-48e5-9b72-7211e534726f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:02.953606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d30dae71-ccfb-48e5-9b72-7211e534726f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:03.093652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d30dae71-ccfb-48e5-9b72-7211e534726f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:03.096243 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-970cb6ee-342d-4f80-96e3-b609b259f4c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:03.096835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-970cb6ee-342d-4f80-96e3-b609b259f4c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:03.101968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d30dae71-ccfb-48e5-9b72-7211e534726f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.166720 Jul 26 18:48:03.102571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1323/2617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:02 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:03.103155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-970cb6ee-342d-4f80-96e3-b609b259f4c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:03.103661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-970cb6ee-342d-4f80-96e3-b609b259f4c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:03.104412 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-970cb6ee-342d-4f80-96e3-b609b259f4c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:03.104900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-970cb6ee-342d-4f80-96e3-b609b259f4c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:03.107177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-59f06d21-4998-4447-ad29-9a523460944a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:03.107916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-59f06d21-4998-4447-ad29-9a523460944a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:03.113643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59f06d21-4998-4447-ad29-9a523460944a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:03.114093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59f06d21-4998-4447-ad29-9a523460944a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:03.114848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59f06d21-4998-4447-ad29-9a523460944a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:03.115316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59f06d21-4998-4447-ad29-9a523460944a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:03.119316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:03.235359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-970cb6ee-342d-4f80-96e3-b609b259f4c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:03.244369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-970cb6ee-342d-4f80-96e3-b609b259f4c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:03.245942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-59f06d21-4998-4447-ad29-9a523460944a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:03.246093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-970cb6ee-342d-4f80-96e3-b609b259f4c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:03.247160 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-970cb6ee-342d-4f80-96e3-b609b259f4c2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155361 Jul 26 18:48:03.247726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1295/2618] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:03 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:48:03.253951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-59f06d21-4998-4447-ad29-9a523460944a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.150306 Jul 26 18:48:03.254671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1324/2619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:03 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:04.125148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-857baeab-306b-482a-9a68-c56177036367 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:04.125778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-857baeab-306b-482a-9a68-c56177036367 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:04.132821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-857baeab-306b-482a-9a68-c56177036367 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:04.133266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-857baeab-306b-482a-9a68-c56177036367 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:04.134019 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-857baeab-306b-482a-9a68-c56177036367 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:04.134447 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-857baeab-306b-482a-9a68-c56177036367 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:04.264176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-857baeab-306b-482a-9a68-c56177036367 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:04.270021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-875a8bb9-16c5-40e0-a153-e6405cec4703 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:04.270654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-875a8bb9-16c5-40e0-a153-e6405cec4703 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:04.273466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-857baeab-306b-482a-9a68-c56177036367 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.151788 Jul 26 18:48:04.286917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1296/2620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:04 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:04.287149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-875a8bb9-16c5-40e0-a153-e6405cec4703 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:04.287149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-875a8bb9-16c5-40e0-a153-e6405cec4703 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:04.287362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-74cb4440-9432-4695-ae16-d38cb5bedbb8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:04.287456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-875a8bb9-16c5-40e0-a153-e6405cec4703 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:04.287562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-74cb4440-9432-4695-ae16-d38cb5bedbb8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:04.287656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-875a8bb9-16c5-40e0-a153-e6405cec4703 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:04.287740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-74cb4440-9432-4695-ae16-d38cb5bedbb8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:04.287740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-74cb4440-9432-4695-ae16-d38cb5bedbb8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:04.287740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-74cb4440-9432-4695-ae16-d38cb5bedbb8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:04.287740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-74cb4440-9432-4695-ae16-d38cb5bedbb8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:04.414931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-875a8bb9-16c5-40e0-a153-e6405cec4703 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:04.419344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-74cb4440-9432-4695-ae16-d38cb5bedbb8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:04.424950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-875a8bb9-16c5-40e0-a153-e6405cec4703 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:04.426595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-875a8bb9-16c5-40e0-a153-e6405cec4703 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:04.427782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-875a8bb9-16c5-40e0-a153-e6405cec4703 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161937 Jul 26 18:48:04.428641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-74cb4440-9432-4695-ae16-d38cb5bedbb8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153661 Jul 26 18:48:04.430135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1297/2621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:04 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:04.454836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1325/2622] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:04 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:05.297004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a5458bac-87d6-4d5f-a7c7-7b195de7b368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:05.297750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a5458bac-87d6-4d5f-a7c7-7b195de7b368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:05.306955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5458bac-87d6-4d5f-a7c7-7b195de7b368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:05.307603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5458bac-87d6-4d5f-a7c7-7b195de7b368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:05.308615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5458bac-87d6-4d5f-a7c7-7b195de7b368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:05.309230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5458bac-87d6-4d5f-a7c7-7b195de7b368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:05.312748 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:05.448660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a5458bac-87d6-4d5f-a7c7-7b195de7b368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:05.452300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0df07b29-858d-437e-93b0-73569aa9518b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:05.452907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0df07b29-858d-437e-93b0-73569aa9518b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:05.459350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a5458bac-87d6-4d5f-a7c7-7b195de7b368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.167936 Jul 26 18:48:05.459534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0df07b29-858d-437e-93b0-73569aa9518b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:05.460102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1298/2623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:05 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:05.460239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0df07b29-858d-437e-93b0-73569aa9518b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:05.460712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0df07b29-858d-437e-93b0-73569aa9518b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:05.461128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0df07b29-858d-437e-93b0-73569aa9518b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:05.478570 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8629fded-56a1-4620-89b2-2c44abbef270 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:05.479217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8629fded-56a1-4620-89b2-2c44abbef270 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:05.487231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8629fded-56a1-4620-89b2-2c44abbef270 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:05.487898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8629fded-56a1-4620-89b2-2c44abbef270 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:05.488792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8629fded-56a1-4620-89b2-2c44abbef270 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:05.489227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8629fded-56a1-4620-89b2-2c44abbef270 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:05.603746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0df07b29-858d-437e-93b0-73569aa9518b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:05.614521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0df07b29-858d-437e-93b0-73569aa9518b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:05.616075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0df07b29-858d-437e-93b0-73569aa9518b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:05.617254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0df07b29-858d-437e-93b0-73569aa9518b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.168930 Jul 26 18:48:05.618030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1326/2624] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:48:05.633185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8629fded-56a1-4620-89b2-2c44abbef270 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:05.646922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8629fded-56a1-4620-89b2-2c44abbef270 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.174568 Jul 26 18:48:05.647711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1299/2625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:05 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:06.488957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f74fe88e-5063-46b1-9430-c4eea3b91504 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:06.489891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f74fe88e-5063-46b1-9430-c4eea3b91504 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:06.499332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f74fe88e-5063-46b1-9430-c4eea3b91504 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:06.499720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f74fe88e-5063-46b1-9430-c4eea3b91504 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:06.500485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f74fe88e-5063-46b1-9430-c4eea3b91504 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:06.500927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f74fe88e-5063-46b1-9430-c4eea3b91504 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:06.637502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f74fe88e-5063-46b1-9430-c4eea3b91504 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:06.640245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-39cdc957-4c99-4575-9244-a3a82345e364 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:06.640836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-39cdc957-4c99-4575-9244-a3a82345e364 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:06.645733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f74fe88e-5063-46b1-9430-c4eea3b91504 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163306 Jul 26 18:48:06.646324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1327/2626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:06 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:06.647315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39cdc957-4c99-4575-9244-a3a82345e364 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:06.648115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39cdc957-4c99-4575-9244-a3a82345e364 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:06.648884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39cdc957-4c99-4575-9244-a3a82345e364 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:06.649307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39cdc957-4c99-4575-9244-a3a82345e364 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:06.669075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-807351dd-f975-484f-83b0-b8af021e3542 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:06.669643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-807351dd-f975-484f-83b0-b8af021e3542 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:06.675719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-807351dd-f975-484f-83b0-b8af021e3542 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:06.676166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-807351dd-f975-484f-83b0-b8af021e3542 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:06.676915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-807351dd-f975-484f-83b0-b8af021e3542 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:06.677343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-807351dd-f975-484f-83b0-b8af021e3542 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:06.782057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-39cdc957-4c99-4575-9244-a3a82345e364 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:06.791460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-39cdc957-4c99-4575-9244-a3a82345e364 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:06.793145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-39cdc957-4c99-4575-9244-a3a82345e364 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:06.794289 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-39cdc957-4c99-4575-9244-a3a82345e364 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158057 Jul 26 18:48:06.794850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1300/2627] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:06 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:48:06.807090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-807351dd-f975-484f-83b0-b8af021e3542 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:06.815296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-807351dd-f975-484f-83b0-b8af021e3542 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.149971 Jul 26 18:48:06.815850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1328/2628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:06 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:07.666885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f84174ac-ae71-4678-a84a-9677569b032f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:07.667746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f84174ac-ae71-4678-a84a-9677569b032f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:07.674851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f84174ac-ae71-4678-a84a-9677569b032f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:07.675336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f84174ac-ae71-4678-a84a-9677569b032f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:07.676097 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f84174ac-ae71-4678-a84a-9677569b032f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:07.676505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f84174ac-ae71-4678-a84a-9677569b032f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:07.815862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f84174ac-ae71-4678-a84a-9677569b032f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:07.816265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ed2a17e8-df09-4557-a112-d4a0a31514ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:07.816863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ed2a17e8-df09-4557-a112-d4a0a31514ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:07.823630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed2a17e8-df09-4557-a112-d4a0a31514ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:07.826490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f84174ac-ae71-4678-a84a-9677569b032f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163561 Jul 26 18:48:07.828920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed2a17e8-df09-4557-a112-d4a0a31514ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:07.829549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed2a17e8-df09-4557-a112-d4a0a31514ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:07.829948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed2a17e8-df09-4557-a112-d4a0a31514ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:07.842301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1301/2629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:07 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:07.847781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e70b0f76-a0f3-4df5-8c50-c328d2956d22 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:07.848921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e70b0f76-a0f3-4df5-8c50-c328d2956d22 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:07.857271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e70b0f76-a0f3-4df5-8c50-c328d2956d22 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:07.857925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e70b0f76-a0f3-4df5-8c50-c328d2956d22 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:07.858898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e70b0f76-a0f3-4df5-8c50-c328d2956d22 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:07.859560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e70b0f76-a0f3-4df5-8c50-c328d2956d22 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:07.964915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ed2a17e8-df09-4557-a112-d4a0a31514ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:07.973778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ed2a17e8-df09-4557-a112-d4a0a31514ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:07.975312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ed2a17e8-df09-4557-a112-d4a0a31514ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:07.976448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ed2a17e8-df09-4557-a112-d4a0a31514ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.164070 Jul 26 18:48:07.977007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1329/2630] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:48:07.992893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e70b0f76-a0f3-4df5-8c50-c328d2956d22 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:08.001277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e70b0f76-a0f3-4df5-8c50-c328d2956d22 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157385 Jul 26 18:48:08.001845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1302/2631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:07 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:08.852820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-049600fe-5300-4af1-a68e-b060ebc092a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:08.853840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-049600fe-5300-4af1-a68e-b060ebc092a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:08.861272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-049600fe-5300-4af1-a68e-b060ebc092a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:08.861716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-049600fe-5300-4af1-a68e-b060ebc092a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:08.862477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-049600fe-5300-4af1-a68e-b060ebc092a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:08.862901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-049600fe-5300-4af1-a68e-b060ebc092a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:08.995916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-049600fe-5300-4af1-a68e-b060ebc092a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:08.999885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fcb3aa2a-6c78-4bb4-8098-a4c10bab56e8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:09.000567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fcb3aa2a-6c78-4bb4-8098-a4c10bab56e8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:09.004732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-049600fe-5300-4af1-a68e-b060ebc092a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158244 Jul 26 18:48:09.005514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1330/2632] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:08 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:09.006939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fcb3aa2a-6c78-4bb4-8098-a4c10bab56e8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:09.007444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fcb3aa2a-6c78-4bb4-8098-a4c10bab56e8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:09.008185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fcb3aa2a-6c78-4bb4-8098-a4c10bab56e8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:09.008612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fcb3aa2a-6c78-4bb4-8098-a4c10bab56e8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:09.023573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-85a3922e-f978-4623-ae1e-8c979033d1cb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:09.024177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-85a3922e-f978-4623-ae1e-8c979033d1cb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:09.031112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-85a3922e-f978-4623-ae1e-8c979033d1cb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:09.031562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-85a3922e-f978-4623-ae1e-8c979033d1cb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:09.032320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-85a3922e-f978-4623-ae1e-8c979033d1cb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:09.032753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-85a3922e-f978-4623-ae1e-8c979033d1cb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:09.138240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fcb3aa2a-6c78-4bb4-8098-a4c10bab56e8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:09.146918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fcb3aa2a-6c78-4bb4-8098-a4c10bab56e8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:09.148782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fcb3aa2a-6c78-4bb4-8098-a4c10bab56e8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:09.149939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fcb3aa2a-6c78-4bb4-8098-a4c10bab56e8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.153983 Jul 26 18:48:09.150480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1303/2633] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:08 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:48:09.163051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-85a3922e-f978-4623-ae1e-8c979033d1cb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:09.171249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-85a3922e-f978-4623-ae1e-8c979033d1cb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151926 Jul 26 18:48:09.171825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1331/2634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:09 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:10.030521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e63afe42-6bef-4c7c-ba2e-5f0a2ef49cc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:10.031245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e63afe42-6bef-4c7c-ba2e-5f0a2ef49cc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:10.040702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e63afe42-6bef-4c7c-ba2e-5f0a2ef49cc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:10.041309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e63afe42-6bef-4c7c-ba2e-5f0a2ef49cc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:10.042327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e63afe42-6bef-4c7c-ba2e-5f0a2ef49cc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:10.042909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e63afe42-6bef-4c7c-ba2e-5f0a2ef49cc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:10.173030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9160546f-9542-42b9-9040-b5c3321e74eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:10.173588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9160546f-9542-42b9-9040-b5c3321e74eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:10.180423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9160546f-9542-42b9-9040-b5c3321e74eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:10.180873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9160546f-9542-42b9-9040-b5c3321e74eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:10.181644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9160546f-9542-42b9-9040-b5c3321e74eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:10.182079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9160546f-9542-42b9-9040-b5c3321e74eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:10.190293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e63afe42-6bef-4c7c-ba2e-5f0a2ef49cc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:10.198416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e63afe42-6bef-4c7c-ba2e-5f0a2ef49cc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.173752 Jul 26 18:48:10.199006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1304/2635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:10.206813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7693f965-552f-411b-b87d-162debc22e5a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:10.207690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7693f965-552f-411b-b87d-162debc22e5a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:10.213550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7693f965-552f-411b-b87d-162debc22e5a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:10.214101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7693f965-552f-411b-b87d-162debc22e5a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:10.214859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7693f965-552f-411b-b87d-162debc22e5a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:10.215313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7693f965-552f-411b-b87d-162debc22e5a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:10.316602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9160546f-9542-42b9-9040-b5c3321e74eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:10.325423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9160546f-9542-42b9-9040-b5c3321e74eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:10.326945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9160546f-9542-42b9-9040-b5c3321e74eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:10.328134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9160546f-9542-42b9-9040-b5c3321e74eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159123 Jul 26 18:48:10.329022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1332/2636] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:10 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:10.343651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7693f965-552f-411b-b87d-162debc22e5a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:10.351889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7693f965-552f-411b-b87d-162debc22e5a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151966 Jul 26 18:48:10.352463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1305/2637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:10 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:11.224097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e8ade5a6-3666-4e18-9188-98d82427069e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:11.225158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e8ade5a6-3666-4e18-9188-98d82427069e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:11.233735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8ade5a6-3666-4e18-9188-98d82427069e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:11.234179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8ade5a6-3666-4e18-9188-98d82427069e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:11.234925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8ade5a6-3666-4e18-9188-98d82427069e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:11.235392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8ade5a6-3666-4e18-9188-98d82427069e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:11.351557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-55e8110e-4118-4f60-b3dc-eb4784ce0086 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:11.352146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-55e8110e-4118-4f60-b3dc-eb4784ce0086 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:11.359679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55e8110e-4118-4f60-b3dc-eb4784ce0086 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:11.360133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55e8110e-4118-4f60-b3dc-eb4784ce0086 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:11.360899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55e8110e-4118-4f60-b3dc-eb4784ce0086 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:11.361335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55e8110e-4118-4f60-b3dc-eb4784ce0086 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:11.364505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e8ade5a6-3666-4e18-9188-98d82427069e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:11.373164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e8ade5a6-3666-4e18-9188-98d82427069e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155584 Jul 26 18:48:11.373729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1333/2638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:11 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:11.378302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4b409ee5-98f9-4f00-82bc-dc5f82e635ee tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:11.379111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4b409ee5-98f9-4f00-82bc-dc5f82e635ee tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:11.385045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b409ee5-98f9-4f00-82bc-dc5f82e635ee tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:11.385725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b409ee5-98f9-4f00-82bc-dc5f82e635ee tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:11.386701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b409ee5-98f9-4f00-82bc-dc5f82e635ee tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:11.387316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b409ee5-98f9-4f00-82bc-dc5f82e635ee tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:11.497750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-55e8110e-4118-4f60-b3dc-eb4784ce0086 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:11.506775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-55e8110e-4118-4f60-b3dc-eb4784ce0086 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:11.508306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-55e8110e-4118-4f60-b3dc-eb4784ce0086 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:11.509482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-55e8110e-4118-4f60-b3dc-eb4784ce0086 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162151 Jul 26 18:48:11.510040 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1306/2639] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:11.522383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4b409ee5-98f9-4f00-82bc-dc5f82e635ee tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:11.531721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4b409ee5-98f9-4f00-82bc-dc5f82e635ee tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156819 Jul 26 18:48:11.532285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1334/2640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:11 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:12.393991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-00eb9967-1c51-4e1b-8927-c7b31ffe86aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:12.394722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-00eb9967-1c51-4e1b-8927-c7b31ffe86aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:12.402203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00eb9967-1c51-4e1b-8927-c7b31ffe86aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:12.402653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00eb9967-1c51-4e1b-8927-c7b31ffe86aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:12.403448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00eb9967-1c51-4e1b-8927-c7b31ffe86aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:12.403882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00eb9967-1c51-4e1b-8927-c7b31ffe86aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:12.532839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0c3b9a5f-26ae-4efa-bfbc-0955766160e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:12.533413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0c3b9a5f-26ae-4efa-bfbc-0955766160e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:12.540288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c3b9a5f-26ae-4efa-bfbc-0955766160e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:12.540736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c3b9a5f-26ae-4efa-bfbc-0955766160e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:12.541494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c3b9a5f-26ae-4efa-bfbc-0955766160e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:12.541922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c3b9a5f-26ae-4efa-bfbc-0955766160e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:12.544979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-00eb9967-1c51-4e1b-8927-c7b31ffe86aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:12.553426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-00eb9967-1c51-4e1b-8927-c7b31ffe86aa tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163302 Jul 26 18:48:12.554005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1307/2641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:12 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:12.558544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a26974dd-cd8d-437a-9d78-3506b8560c1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:12.559171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a26974dd-cd8d-437a-9d78-3506b8560c1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:12.565110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a26974dd-cd8d-437a-9d78-3506b8560c1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:12.565560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a26974dd-cd8d-437a-9d78-3506b8560c1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:12.566308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a26974dd-cd8d-437a-9d78-3506b8560c1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:12.566860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a26974dd-cd8d-437a-9d78-3506b8560c1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:12.679187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0c3b9a5f-26ae-4efa-bfbc-0955766160e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:12.688369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0c3b9a5f-26ae-4efa-bfbc-0955766160e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:12.690123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0c3b9a5f-26ae-4efa-bfbc-0955766160e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:12.691701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0c3b9a5f-26ae-4efa-bfbc-0955766160e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162750 Jul 26 18:48:12.700623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1335/2642] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:12 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:12.703527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a26974dd-cd8d-437a-9d78-3506b8560c1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:12.711657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a26974dd-cd8d-437a-9d78-3506b8560c1a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156753 Jul 26 18:48:12.712221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1308/2643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:12 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:13.577923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6d47efc6-1b38-4d8b-ae97-bcda36359c57 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:13.578667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6d47efc6-1b38-4d8b-ae97-bcda36359c57 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:13.587167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d47efc6-1b38-4d8b-ae97-bcda36359c57 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:13.587732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d47efc6-1b38-4d8b-ae97-bcda36359c57 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:13.588715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d47efc6-1b38-4d8b-ae97-bcda36359c57 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:13.589330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d47efc6-1b38-4d8b-ae97-bcda36359c57 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:13.714238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-be252d2a-f24f-4229-b18b-1e77f74030b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:13.714805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-be252d2a-f24f-4229-b18b-1e77f74030b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:13.721729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-be252d2a-f24f-4229-b18b-1e77f74030b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:13.722200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-be252d2a-f24f-4229-b18b-1e77f74030b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:13.722940 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-be252d2a-f24f-4229-b18b-1e77f74030b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:13.723401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-be252d2a-f24f-4229-b18b-1e77f74030b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:13.727065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6d47efc6-1b38-4d8b-ae97-bcda36359c57 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:13.734525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6d47efc6-1b38-4d8b-ae97-bcda36359c57 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161837 Jul 26 18:48:13.735327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1336/2644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:13.739671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-48f11a9e-af8c-4c4f-8808-df773a981cf4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:13.740283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-48f11a9e-af8c-4c4f-8808-df773a981cf4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:13.746810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48f11a9e-af8c-4c4f-8808-df773a981cf4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:13.747278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48f11a9e-af8c-4c4f-8808-df773a981cf4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:13.748035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48f11a9e-af8c-4c4f-8808-df773a981cf4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:13.749143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48f11a9e-af8c-4c4f-8808-df773a981cf4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:13.876919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-be252d2a-f24f-4229-b18b-1e77f74030b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:13.885435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-be252d2a-f24f-4229-b18b-1e77f74030b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:13.886952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-be252d2a-f24f-4229-b18b-1e77f74030b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:13.888190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-be252d2a-f24f-4229-b18b-1e77f74030b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.177983 Jul 26 18:48:13.888832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1309/2645] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:13.893326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1ff44946-b0bd-42b6-b4e7-4344fc1b0673 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:13.893811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1ff44946-b0bd-42b6-b4e7-4344fc1b0673 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:13.899788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-48f11a9e-af8c-4c4f-8808-df773a981cf4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:13.900177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ff44946-b0bd-42b6-b4e7-4344fc1b0673 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:13.900622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ff44946-b0bd-42b6-b4e7-4344fc1b0673 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:13.901423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ff44946-b0bd-42b6-b4e7-4344fc1b0673 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:13.901862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1ff44946-b0bd-42b6-b4e7-4344fc1b0673 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:13.910023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-48f11a9e-af8c-4c4f-8808-df773a981cf4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.173866 Jul 26 18:48:13.910676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1337/2646] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:13 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:13.926180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1ff44946-b0bd-42b6-b4e7-4344fc1b0673 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 18:48:14.010468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1ff44946-b0bd-42b6-b4e7-4344fc1b0673 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "DELETE /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 204 len: 0 microversion: 2.1 time: 0.120302 Jul 26 18:48:14.012150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1310/2647] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 18:48:13 2022] DELETE /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:48:14.020789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fea1463a-62ee-41b2-9aec-1119f0163f86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:14.021551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fea1463a-62ee-41b2-9aec-1119f0163f86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:14.028162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fea1463a-62ee-41b2-9aec-1119f0163f86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:14.028783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fea1463a-62ee-41b2-9aec-1119f0163f86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:14.029376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fea1463a-62ee-41b2-9aec-1119f0163f86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:14.030039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fea1463a-62ee-41b2-9aec-1119f0163f86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:14.166330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fea1463a-62ee-41b2-9aec-1119f0163f86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:14.174798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fea1463a-62ee-41b2-9aec-1119f0163f86 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158325 Jul 26 18:48:14.175411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1338/2648] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:14 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:14.763228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b328925f-2d00-42bd-9ed2-169c28a2dbd2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:14.763960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b328925f-2d00-42bd-9ed2-169c28a2dbd2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:14.771293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b328925f-2d00-42bd-9ed2-169c28a2dbd2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:14.771739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b328925f-2d00-42bd-9ed2-169c28a2dbd2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:14.773131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b328925f-2d00-42bd-9ed2-169c28a2dbd2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:14.773895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b328925f-2d00-42bd-9ed2-169c28a2dbd2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:14.908681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b328925f-2d00-42bd-9ed2-169c28a2dbd2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:14.911894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9a777d3e-d4d8-4414-8312-9f886436bab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:14.912503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9a777d3e-d4d8-4414-8312-9f886436bab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:14.917349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b328925f-2d00-42bd-9ed2-169c28a2dbd2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159927 Jul 26 18:48:14.917905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1311/2649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:14 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:14.920237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a777d3e-d4d8-4414-8312-9f886436bab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:14.920801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a777d3e-d4d8-4414-8312-9f886436bab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:14.921571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a777d3e-d4d8-4414-8312-9f886436bab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:14.922003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a777d3e-d4d8-4414-8312-9f886436bab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:14.931782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4da80970-2ac0-463b-8ade-74c020629a98 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:14.932471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4da80970-2ac0-463b-8ade-74c020629a98 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:14.938653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4da80970-2ac0-463b-8ade-74c020629a98 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:14.939125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4da80970-2ac0-463b-8ade-74c020629a98 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:14.939892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4da80970-2ac0-463b-8ade-74c020629a98 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:14.940307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4da80970-2ac0-463b-8ade-74c020629a98 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:15.061263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9a777d3e-d4d8-4414-8312-9f886436bab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:15.071893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9a777d3e-d4d8-4414-8312-9f886436bab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:15.073520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9a777d3e-d4d8-4414-8312-9f886436bab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:15.074751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9a777d3e-d4d8-4414-8312-9f886436bab3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.167011 Jul 26 18:48:15.075347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1339/2650] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:14 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:15.083658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4da80970-2ac0-463b-8ade-74c020629a98 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:15.092247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4da80970-2ac0-463b-8ade-74c020629a98 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.164271 Jul 26 18:48:15.092910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1312/2651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:14 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:15.196853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d3468813-36a1-420a-9bff-1939a061e48c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:15.197465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d3468813-36a1-420a-9bff-1939a061e48c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:15.204173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3468813-36a1-420a-9bff-1939a061e48c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:15.204622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3468813-36a1-420a-9bff-1939a061e48c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:15.205380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3468813-36a1-420a-9bff-1939a061e48c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:15.205813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3468813-36a1-420a-9bff-1939a061e48c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:15.338644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d3468813-36a1-420a-9bff-1939a061e48c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:15.340915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:15.351169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d3468813-36a1-420a-9bff-1939a061e48c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157881 Jul 26 18:48:15.352044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1340/2652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:15 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:15.939110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3cd67e78-a266-4b3e-b4d8-de9fe75cc9b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:15.939642 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3cd67e78-a266-4b3e-b4d8-de9fe75cc9b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:15.947763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cd67e78-a266-4b3e-b4d8-de9fe75cc9b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:15.948344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cd67e78-a266-4b3e-b4d8-de9fe75cc9b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:15.948988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cd67e78-a266-4b3e-b4d8-de9fe75cc9b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:15.949685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cd67e78-a266-4b3e-b4d8-de9fe75cc9b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:15.954934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:16.086048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3cd67e78-a266-4b3e-b4d8-de9fe75cc9b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:16.094343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3cd67e78-a266-4b3e-b4d8-de9fe75cc9b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159210 Jul 26 18:48:16.094898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1313/2653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:15 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:16.098781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d1693615-1e39-471d-8726-b7ffdf83bd35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:16.099414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d1693615-1e39-471d-8726-b7ffdf83bd35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:16.101694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:16.107200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1693615-1e39-471d-8726-b7ffdf83bd35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:16.107709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1693615-1e39-471d-8726-b7ffdf83bd35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:16.108522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1693615-1e39-471d-8726-b7ffdf83bd35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:16.109143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1693615-1e39-471d-8726-b7ffdf83bd35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:16.115046 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-62d4203e-48e1-4b2f-bd17-47163ad0ef15 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:16.115046 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-62d4203e-48e1-4b2f-bd17-47163ad0ef15 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:16.120619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62d4203e-48e1-4b2f-bd17-47163ad0ef15 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:16.121089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62d4203e-48e1-4b2f-bd17-47163ad0ef15 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:16.121823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62d4203e-48e1-4b2f-bd17-47163ad0ef15 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:16.122257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62d4203e-48e1-4b2f-bd17-47163ad0ef15 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:16.244270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d1693615-1e39-471d-8726-b7ffdf83bd35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:16.252773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d1693615-1e39-471d-8726-b7ffdf83bd35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:16.254271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d1693615-1e39-471d-8726-b7ffdf83bd35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:16.255452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d1693615-1e39-471d-8726-b7ffdf83bd35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160836 Jul 26 18:48:16.256037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1341/2654] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:16 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:16.265282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-62d4203e-48e1-4b2f-bd17-47163ad0ef15 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:16.273635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-62d4203e-48e1-4b2f-bd17-47163ad0ef15 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.163800 Jul 26 18:48:16.274191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1314/2655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:16 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:16.384641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5d3acd40-6726-4341-a448-018a0887d6b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:16.385779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5d3acd40-6726-4341-a448-018a0887d6b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:16.392638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d3acd40-6726-4341-a448-018a0887d6b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:16.393114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d3acd40-6726-4341-a448-018a0887d6b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:16.393902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d3acd40-6726-4341-a448-018a0887d6b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:16.394347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d3acd40-6726-4341-a448-018a0887d6b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:16.540879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5d3acd40-6726-4341-a448-018a0887d6b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:16.549638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5d3acd40-6726-4341-a448-018a0887d6b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.171937 Jul 26 18:48:16.550206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1342/2656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:16 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:17.119804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-56c4996f-3df3-4977-80c3-f78f5cbc4985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:17.120797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-56c4996f-3df3-4977-80c3-f78f5cbc4985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:17.124560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:17.133502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56c4996f-3df3-4977-80c3-f78f5cbc4985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:17.134231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56c4996f-3df3-4977-80c3-f78f5cbc4985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:17.135539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56c4996f-3df3-4977-80c3-f78f5cbc4985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:17.136160 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56c4996f-3df3-4977-80c3-f78f5cbc4985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:17.278247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7c6ca2ad-9399-48f7-9dc0-cd93366cef67 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:17.278881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7c6ca2ad-9399-48f7-9dc0-cd93366cef67 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:17.283740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-56c4996f-3df3-4977-80c3-f78f5cbc4985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:17.285743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c6ca2ad-9399-48f7-9dc0-cd93366cef67 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:17.286268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c6ca2ad-9399-48f7-9dc0-cd93366cef67 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:17.287135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c6ca2ad-9399-48f7-9dc0-cd93366cef67 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:17.287693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c6ca2ad-9399-48f7-9dc0-cd93366cef67 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:17.291848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-56c4996f-3df3-4977-80c3-f78f5cbc4985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.178466 Jul 26 18:48:17.292517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1315/2657] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:17 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:17.296948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0e072986-86e0-4da8-b8d9-9918b59823c7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:17.297680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0e072986-86e0-4da8-b8d9-9918b59823c7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:17.303396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e072986-86e0-4da8-b8d9-9918b59823c7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:17.304071 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e072986-86e0-4da8-b8d9-9918b59823c7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:17.305068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e072986-86e0-4da8-b8d9-9918b59823c7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:17.306415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e072986-86e0-4da8-b8d9-9918b59823c7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:17.419713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7c6ca2ad-9399-48f7-9dc0-cd93366cef67 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:17.428289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7c6ca2ad-9399-48f7-9dc0-cd93366cef67 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:17.429794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7c6ca2ad-9399-48f7-9dc0-cd93366cef67 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:17.431059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7c6ca2ad-9399-48f7-9dc0-cd93366cef67 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156780 Jul 26 18:48:17.431624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1343/2658] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:17.433553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0e072986-86e0-4da8-b8d9-9918b59823c7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:17.441606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0e072986-86e0-4da8-b8d9-9918b59823c7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.148066 Jul 26 18:48:17.442120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1316/2659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:17 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:17.575562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-47697476-5f19-4a89-8a7f-6db4f276161b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:17.576567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-47697476-5f19-4a89-8a7f-6db4f276161b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:17.586658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47697476-5f19-4a89-8a7f-6db4f276161b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:17.587460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47697476-5f19-4a89-8a7f-6db4f276161b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:17.588706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47697476-5f19-4a89-8a7f-6db4f276161b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:17.589359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47697476-5f19-4a89-8a7f-6db4f276161b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:17.730653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-47697476-5f19-4a89-8a7f-6db4f276161b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:17.738827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-47697476-5f19-4a89-8a7f-6db4f276161b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.169773 Jul 26 18:48:17.739408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1344/2660] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:17 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:18.313131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1388a73d-9d9d-48a8-956a-37b85588452d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:18.314254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1388a73d-9d9d-48a8-956a-37b85588452d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:18.321356 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1388a73d-9d9d-48a8-956a-37b85588452d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:18.321799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1388a73d-9d9d-48a8-956a-37b85588452d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:18.322549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1388a73d-9d9d-48a8-956a-37b85588452d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:18.322974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1388a73d-9d9d-48a8-956a-37b85588452d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:18.454174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-60a19d21-02e6-4f46-8845-0e5d95ce15e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:18.454778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-60a19d21-02e6-4f46-8845-0e5d95ce15e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:18.454929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1388a73d-9d9d-48a8-956a-37b85588452d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:18.461570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60a19d21-02e6-4f46-8845-0e5d95ce15e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:18.462012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60a19d21-02e6-4f46-8845-0e5d95ce15e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:18.462763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60a19d21-02e6-4f46-8845-0e5d95ce15e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:18.463228 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60a19d21-02e6-4f46-8845-0e5d95ce15e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:18.463402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1388a73d-9d9d-48a8-956a-37b85588452d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154005 Jul 26 18:48:18.464068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1317/2661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:18 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:18.468473 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-543d21f0-8526-4934-8a2e-b534c06f7cd4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:18.469092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-543d21f0-8526-4934-8a2e-b534c06f7cd4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:18.474871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-543d21f0-8526-4934-8a2e-b534c06f7cd4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:18.475353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-543d21f0-8526-4934-8a2e-b534c06f7cd4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:18.476101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-543d21f0-8526-4934-8a2e-b534c06f7cd4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:18.476529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-543d21f0-8526-4934-8a2e-b534c06f7cd4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:18.593883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-60a19d21-02e6-4f46-8845-0e5d95ce15e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:18.602500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-60a19d21-02e6-4f46-8845-0e5d95ce15e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:18.604036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-60a19d21-02e6-4f46-8845-0e5d95ce15e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:18.604222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-543d21f0-8526-4934-8a2e-b534c06f7cd4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:18.605262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-60a19d21-02e6-4f46-8845-0e5d95ce15e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155069 Jul 26 18:48:18.605823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1345/2662] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:18 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:18.612323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-543d21f0-8526-4934-8a2e-b534c06f7cd4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.147332 Jul 26 18:48:18.612908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1318/2663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:18 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:18.763363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a78e3531-5ce9-4630-9ef6-dbf689e4923c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:18.763978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a78e3531-5ce9-4630-9ef6-dbf689e4923c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:18.770452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a78e3531-5ce9-4630-9ef6-dbf689e4923c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:18.770921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a78e3531-5ce9-4630-9ef6-dbf689e4923c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:18.771687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a78e3531-5ce9-4630-9ef6-dbf689e4923c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:18.772122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a78e3531-5ce9-4630-9ef6-dbf689e4923c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:18.911052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a78e3531-5ce9-4630-9ef6-dbf689e4923c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:18.919678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a78e3531-5ce9-4630-9ef6-dbf689e4923c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161381 Jul 26 18:48:18.920234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1346/2664] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:18 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:19.485949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-56143660-31e5-4b29-9c03-04ab2938047d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:19.487838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-56143660-31e5-4b29-9c03-04ab2938047d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:19.497265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56143660-31e5-4b29-9c03-04ab2938047d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:19.497884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56143660-31e5-4b29-9c03-04ab2938047d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:19.498872 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56143660-31e5-4b29-9c03-04ab2938047d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:19.499658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56143660-31e5-4b29-9c03-04ab2938047d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:19.629948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4f69dd41-7525-4aa8-8830-37241406a9c7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:19.630519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4f69dd41-7525-4aa8-8830-37241406a9c7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:19.637567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f69dd41-7525-4aa8-8830-37241406a9c7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:19.638130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f69dd41-7525-4aa8-8830-37241406a9c7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:19.638936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f69dd41-7525-4aa8-8830-37241406a9c7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:19.639407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f69dd41-7525-4aa8-8830-37241406a9c7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:19.664701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-56143660-31e5-4b29-9c03-04ab2938047d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:19.673885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-56143660-31e5-4b29-9c03-04ab2938047d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.193150 Jul 26 18:48:19.674533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1319/2665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:19 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:19.679440 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-68ebab8d-a851-4240-8ec0-c002132adc39 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:19.680038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-68ebab8d-a851-4240-8ec0-c002132adc39 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:19.688426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68ebab8d-a851-4240-8ec0-c002132adc39 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:19.688871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68ebab8d-a851-4240-8ec0-c002132adc39 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:19.689707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68ebab8d-a851-4240-8ec0-c002132adc39 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:19.690139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68ebab8d-a851-4240-8ec0-c002132adc39 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:19.780266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4f69dd41-7525-4aa8-8830-37241406a9c7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:19.789318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4f69dd41-7525-4aa8-8830-37241406a9c7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:19.790871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4f69dd41-7525-4aa8-8830-37241406a9c7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:19.792128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4f69dd41-7525-4aa8-8830-37241406a9c7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.166127 Jul 26 18:48:19.792705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1347/2666] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:19 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:19.827595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-68ebab8d-a851-4240-8ec0-c002132adc39 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:19.836610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-68ebab8d-a851-4240-8ec0-c002132adc39 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161066 Jul 26 18:48:19.837190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1320/2667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:19 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:19.945699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5ba8bc30-56d0-4ede-8366-80a1b504879c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:19.946687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5ba8bc30-56d0-4ede-8366-80a1b504879c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:19.956813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc30-56d0-4ede-8366-80a1b504879c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:19.957548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc30-56d0-4ede-8366-80a1b504879c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:19.958805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc30-56d0-4ede-8366-80a1b504879c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:19.959558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc30-56d0-4ede-8366-80a1b504879c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:20.098299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5ba8bc30-56d0-4ede-8366-80a1b504879c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:20.106981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5ba8bc30-56d0-4ede-8366-80a1b504879c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.167706 Jul 26 18:48:20.107596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1348/2668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:19 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:20.700001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-47513157-ccf4-4944-9ee7-9a848031c75d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:20.700873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-47513157-ccf4-4944-9ee7-9a848031c75d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:20.712006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47513157-ccf4-4944-9ee7-9a848031c75d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:20.712756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47513157-ccf4-4944-9ee7-9a848031c75d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:20.714084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47513157-ccf4-4944-9ee7-9a848031c75d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:20.714522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47513157-ccf4-4944-9ee7-9a848031c75d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:20.816818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d4a23ede-5df2-4425-b53a-8202f6af2bca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:20.817535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d4a23ede-5df2-4425-b53a-8202f6af2bca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:20.824943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4a23ede-5df2-4425-b53a-8202f6af2bca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:20.825395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4a23ede-5df2-4425-b53a-8202f6af2bca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:20.826175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4a23ede-5df2-4425-b53a-8202f6af2bca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:20.826619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4a23ede-5df2-4425-b53a-8202f6af2bca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:20.848837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-47513157-ccf4-4944-9ee7-9a848031c75d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:20.858584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-47513157-ccf4-4944-9ee7-9a848031c75d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165241 Jul 26 18:48:20.859202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1321/2669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:20.864071 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-192ba532-eb2a-4c9a-aeb1-991212c38597 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:20.864752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-192ba532-eb2a-4c9a-aeb1-991212c38597 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:20.871429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-192ba532-eb2a-4c9a-aeb1-991212c38597 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:20.871877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-192ba532-eb2a-4c9a-aeb1-991212c38597 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:20.872649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-192ba532-eb2a-4c9a-aeb1-991212c38597 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:20.873221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-192ba532-eb2a-4c9a-aeb1-991212c38597 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:20.969404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d4a23ede-5df2-4425-b53a-8202f6af2bca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:20.978141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d4a23ede-5df2-4425-b53a-8202f6af2bca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:20.979781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d4a23ede-5df2-4425-b53a-8202f6af2bca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:20.980940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d4a23ede-5df2-4425-b53a-8202f6af2bca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.168782 Jul 26 18:48:20.981480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1349/2670] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:21.011997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-192ba532-eb2a-4c9a-aeb1-991212c38597 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:21.020090 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-192ba532-eb2a-4c9a-aeb1-991212c38597 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.159976 Jul 26 18:48:21.020684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1322/2671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:20 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:21.130570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e11d73e4-8979-43ac-813a-623dd9d394e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:21.131337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e11d73e4-8979-43ac-813a-623dd9d394e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:21.138974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e11d73e4-8979-43ac-813a-623dd9d394e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:21.139545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e11d73e4-8979-43ac-813a-623dd9d394e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:21.140430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e11d73e4-8979-43ac-813a-623dd9d394e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:21.140936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e11d73e4-8979-43ac-813a-623dd9d394e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:21.280541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e11d73e4-8979-43ac-813a-623dd9d394e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:21.289407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e11d73e4-8979-43ac-813a-623dd9d394e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.163530 Jul 26 18:48:21.289993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1350/2672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:21 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:21.886145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b90ef45f-7cc0-4cfd-a366-a07a7d1d111a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:21.887102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b90ef45f-7cc0-4cfd-a366-a07a7d1d111a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:21.898320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b90ef45f-7cc0-4cfd-a366-a07a7d1d111a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:21.899119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b90ef45f-7cc0-4cfd-a366-a07a7d1d111a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:21.900573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b90ef45f-7cc0-4cfd-a366-a07a7d1d111a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:21.901396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b90ef45f-7cc0-4cfd-a366-a07a7d1d111a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:22.003424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-15a442a7-bf56-4b09-b9f2-d2eae65f61e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:22.003946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-15a442a7-bf56-4b09-b9f2-d2eae65f61e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:22.010903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15a442a7-bf56-4b09-b9f2-d2eae65f61e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:22.011375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15a442a7-bf56-4b09-b9f2-d2eae65f61e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:22.012143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15a442a7-bf56-4b09-b9f2-d2eae65f61e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:22.012569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15a442a7-bf56-4b09-b9f2-d2eae65f61e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:22.042852 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b90ef45f-7cc0-4cfd-a366-a07a7d1d111a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:22.051473 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b90ef45f-7cc0-4cfd-a366-a07a7d1d111a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.172168 Jul 26 18:48:22.052064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1323/2673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:21 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:22.056823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-aff9d93e-88a0-495d-b38c-1b7002ec7fd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:22.057425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-aff9d93e-88a0-495d-b38c-1b7002ec7fd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:22.063496 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aff9d93e-88a0-495d-b38c-1b7002ec7fd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:22.063930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aff9d93e-88a0-495d-b38c-1b7002ec7fd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:22.064699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aff9d93e-88a0-495d-b38c-1b7002ec7fd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:22.065143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-aff9d93e-88a0-495d-b38c-1b7002ec7fd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:22.148837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15a442a7-bf56-4b09-b9f2-d2eae65f61e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:22.158311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15a442a7-bf56-4b09-b9f2-d2eae65f61e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:22.159867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15a442a7-bf56-4b09-b9f2-d2eae65f61e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:22.161042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-15a442a7-bf56-4b09-b9f2-d2eae65f61e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161747 Jul 26 18:48:22.161574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1351/2674] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:21 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:22.196917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-aff9d93e-88a0-495d-b38c-1b7002ec7fd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:22.204984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-aff9d93e-88a0-495d-b38c-1b7002ec7fd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151943 Jul 26 18:48:22.205519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1324/2675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:22 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:22.315782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f92060cd-807c-4311-815d-b27bd91a3166 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:22.316702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f92060cd-807c-4311-815d-b27bd91a3166 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:22.326193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f92060cd-807c-4311-815d-b27bd91a3166 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:22.326649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f92060cd-807c-4311-815d-b27bd91a3166 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:22.327447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f92060cd-807c-4311-815d-b27bd91a3166 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:22.327876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f92060cd-807c-4311-815d-b27bd91a3166 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:22.474514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f92060cd-807c-4311-815d-b27bd91a3166 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:22.482797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f92060cd-807c-4311-815d-b27bd91a3166 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.173903 Jul 26 18:48:22.483411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1352/2676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:22 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:23.073617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-26f4f78f-83cc-4c72-80a8-8ea566536894 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:23.074252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-26f4f78f-83cc-4c72-80a8-8ea566536894 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:23.081098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26f4f78f-83cc-4c72-80a8-8ea566536894 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:23.081540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26f4f78f-83cc-4c72-80a8-8ea566536894 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:23.082280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26f4f78f-83cc-4c72-80a8-8ea566536894 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:23.082705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26f4f78f-83cc-4c72-80a8-8ea566536894 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:23.183614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b50917d4-8560-4afd-9124-a94f8f95a5b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:23.184942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b50917d4-8560-4afd-9124-a94f8f95a5b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:23.194085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b50917d4-8560-4afd-9124-a94f8f95a5b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:23.194784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b50917d4-8560-4afd-9124-a94f8f95a5b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:23.195569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b50917d4-8560-4afd-9124-a94f8f95a5b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:23.196165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b50917d4-8560-4afd-9124-a94f8f95a5b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:23.216091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-26f4f78f-83cc-4c72-80a8-8ea566536894 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:23.224978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-26f4f78f-83cc-4c72-80a8-8ea566536894 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155309 Jul 26 18:48:23.225549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1325/2677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:23 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:23.230371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-500ae44a-71d5-477d-b968-1b066d8080f5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:23.231262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-500ae44a-71d5-477d-b968-1b066d8080f5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:23.237538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-500ae44a-71d5-477d-b968-1b066d8080f5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:23.238268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-500ae44a-71d5-477d-b968-1b066d8080f5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:23.239324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-500ae44a-71d5-477d-b968-1b066d8080f5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:23.239955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-500ae44a-71d5-477d-b968-1b066d8080f5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:23.331947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b50917d4-8560-4afd-9124-a94f8f95a5b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:23.341630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b50917d4-8560-4afd-9124-a94f8f95a5b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:23.343423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b50917d4-8560-4afd-9124-a94f8f95a5b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:23.345464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b50917d4-8560-4afd-9124-a94f8f95a5b1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.165782 Jul 26 18:48:23.347130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1353/2678] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:23 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:23.380421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-500ae44a-71d5-477d-b968-1b066d8080f5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:23.388545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-500ae44a-71d5-477d-b968-1b066d8080f5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161743 Jul 26 18:48:23.389339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1326/2679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:23 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:23.508492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-375abc5a-d636-4d8a-8c28-4e4ad0918778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:23.509508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-375abc5a-d636-4d8a-8c28-4e4ad0918778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:23.519679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-375abc5a-d636-4d8a-8c28-4e4ad0918778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:23.520426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-375abc5a-d636-4d8a-8c28-4e4ad0918778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:23.521684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-375abc5a-d636-4d8a-8c28-4e4ad0918778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:23.522400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-375abc5a-d636-4d8a-8c28-4e4ad0918778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:23.661202 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-375abc5a-d636-4d8a-8c28-4e4ad0918778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:23.669436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-375abc5a-d636-4d8a-8c28-4e4ad0918778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.167459 Jul 26 18:48:23.670877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1354/2680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:23 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:24.249408 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-31c57069-87a8-4aaa-a9c4-dd3368622bc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:24.250041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-31c57069-87a8-4aaa-a9c4-dd3368622bc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:24.257021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31c57069-87a8-4aaa-a9c4-dd3368622bc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:24.257469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31c57069-87a8-4aaa-a9c4-dd3368622bc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:24.258221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31c57069-87a8-4aaa-a9c4-dd3368622bc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:24.258646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-31c57069-87a8-4aaa-a9c4-dd3368622bc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:24.369835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a2ef429c-35d6-4609-99f3-71f063ddeaef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:24.370502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a2ef429c-35d6-4609-99f3-71f063ddeaef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:24.377527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2ef429c-35d6-4609-99f3-71f063ddeaef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:24.377980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2ef429c-35d6-4609-99f3-71f063ddeaef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:24.378736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2ef429c-35d6-4609-99f3-71f063ddeaef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:24.379204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2ef429c-35d6-4609-99f3-71f063ddeaef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:24.395665 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-31c57069-87a8-4aaa-a9c4-dd3368622bc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:24.404357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-31c57069-87a8-4aaa-a9c4-dd3368622bc8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160075 Jul 26 18:48:24.405064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1327/2681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:24 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:24.409634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-55a521e5-d7b0-44de-b2e9-e614b1e4d1ac tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:24.414157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-55a521e5-d7b0-44de-b2e9-e614b1e4d1ac tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:24.421473 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55a521e5-d7b0-44de-b2e9-e614b1e4d1ac tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:24.421925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55a521e5-d7b0-44de-b2e9-e614b1e4d1ac tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:24.422702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55a521e5-d7b0-44de-b2e9-e614b1e4d1ac tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:24.423190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55a521e5-d7b0-44de-b2e9-e614b1e4d1ac tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:24.514516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a2ef429c-35d6-4609-99f3-71f063ddeaef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:24.523391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a2ef429c-35d6-4609-99f3-71f063ddeaef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:24.524887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a2ef429c-35d6-4609-99f3-71f063ddeaef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:24.526039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a2ef429c-35d6-4609-99f3-71f063ddeaef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160236 Jul 26 18:48:24.526651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1355/2682] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:24.560679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-55a521e5-d7b0-44de-b2e9-e614b1e4d1ac tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:24.573828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-55a521e5-d7b0-44de-b2e9-e614b1e4d1ac tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.167493 Jul 26 18:48:24.574430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1328/2683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:24 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:24.690778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-09b6d655-c62d-4167-ab96-cd7cfe48963d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:24.691422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-09b6d655-c62d-4167-ab96-cd7cfe48963d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:24.697902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09b6d655-c62d-4167-ab96-cd7cfe48963d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:24.698419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09b6d655-c62d-4167-ab96-cd7cfe48963d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:24.699306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09b6d655-c62d-4167-ab96-cd7cfe48963d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:24.699735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09b6d655-c62d-4167-ab96-cd7cfe48963d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:24.834656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-09b6d655-c62d-4167-ab96-cd7cfe48963d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:24.847840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-09b6d655-c62d-4167-ab96-cd7cfe48963d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.160996 Jul 26 18:48:24.848682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1356/2684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:24 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:25.427650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-67fd6df8-b8a6-42ac-9b38-ce162de16314 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:25.428426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-67fd6df8-b8a6-42ac-9b38-ce162de16314 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:25.436868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-67fd6df8-b8a6-42ac-9b38-ce162de16314 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:25.437426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-67fd6df8-b8a6-42ac-9b38-ce162de16314 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:25.438358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-67fd6df8-b8a6-42ac-9b38-ce162de16314 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:25.438882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-67fd6df8-b8a6-42ac-9b38-ce162de16314 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:25.548955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8c8c4edf-2f75-4b75-9143-92d9a8339099 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:25.549533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8c8c4edf-2f75-4b75-9143-92d9a8339099 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:25.556451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c8c4edf-2f75-4b75-9143-92d9a8339099 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:25.556902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c8c4edf-2f75-4b75-9143-92d9a8339099 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:25.557687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c8c4edf-2f75-4b75-9143-92d9a8339099 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:25.558123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c8c4edf-2f75-4b75-9143-92d9a8339099 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:25.573448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:25.575240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-67fd6df8-b8a6-42ac-9b38-ce162de16314 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:25.577539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:25.584547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-67fd6df8-b8a6-42ac-9b38-ce162de16314 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161729 Jul 26 18:48:25.585124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1329/2685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:25 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:25.594450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bb86f8f4-bdb4-452b-b800-a5c829692e7a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:25.595136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bb86f8f4-bdb4-452b-b800-a5c829692e7a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:25.601803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb86f8f4-bdb4-452b-b800-a5c829692e7a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:25.602269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb86f8f4-bdb4-452b-b800-a5c829692e7a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:25.603077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb86f8f4-bdb4-452b-b800-a5c829692e7a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:25.603552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb86f8f4-bdb4-452b-b800-a5c829692e7a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:25.695730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8c8c4edf-2f75-4b75-9143-92d9a8339099 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:25.704481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8c8c4edf-2f75-4b75-9143-92d9a8339099 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:25.706230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8c8c4edf-2f75-4b75-9143-92d9a8339099 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:25.707451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8c8c4edf-2f75-4b75-9143-92d9a8339099 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162453 Jul 26 18:48:25.708279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1357/2686] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:25.736657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bb86f8f4-bdb4-452b-b800-a5c829692e7a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:25.744881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bb86f8f4-bdb4-452b-b800-a5c829692e7a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154155 Jul 26 18:48:25.745701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1330/2687] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:25 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:48:25.874496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-af9f40f3-e396-43d1-81ca-fe8b706553b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:25.875285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-af9f40f3-e396-43d1-81ca-fe8b706553b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:25.883229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af9f40f3-e396-43d1-81ca-fe8b706553b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:25.883787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af9f40f3-e396-43d1-81ca-fe8b706553b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:25.884728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af9f40f3-e396-43d1-81ca-fe8b706553b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:25.885270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af9f40f3-e396-43d1-81ca-fe8b706553b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:26.020050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-af9f40f3-e396-43d1-81ca-fe8b706553b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:26.028845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-af9f40f3-e396-43d1-81ca-fe8b706553b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.159824 Jul 26 18:48:26.029432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1358/2688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:25 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:26.610241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3db5f227-b22c-47f3-8917-e4df456d3db1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:26.611241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3db5f227-b22c-47f3-8917-e4df456d3db1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:26.621622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3db5f227-b22c-47f3-8917-e4df456d3db1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:26.622063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3db5f227-b22c-47f3-8917-e4df456d3db1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:26.622809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3db5f227-b22c-47f3-8917-e4df456d3db1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:26.623274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3db5f227-b22c-47f3-8917-e4df456d3db1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:26.730155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-50f49ac2-4208-41df-8166-ee026a9b4e98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:26.730834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-50f49ac2-4208-41df-8166-ee026a9b4e98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:26.737906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50f49ac2-4208-41df-8166-ee026a9b4e98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:26.738350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50f49ac2-4208-41df-8166-ee026a9b4e98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:26.739103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50f49ac2-4208-41df-8166-ee026a9b4e98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:26.739556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50f49ac2-4208-41df-8166-ee026a9b4e98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:26.761267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3db5f227-b22c-47f3-8917-e4df456d3db1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:26.768258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3db5f227-b22c-47f3-8917-e4df456d3db1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164381 Jul 26 18:48:26.769035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1331/2689] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:26 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:26.775061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0e8f1eaf-d2c1-4667-8d1e-26759721179d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:26.775667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0e8f1eaf-d2c1-4667-8d1e-26759721179d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:26.781723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e8f1eaf-d2c1-4667-8d1e-26759721179d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:26.782181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e8f1eaf-d2c1-4667-8d1e-26759721179d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:26.787413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e8f1eaf-d2c1-4667-8d1e-26759721179d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:26.787879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e8f1eaf-d2c1-4667-8d1e-26759721179d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:26.890287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-50f49ac2-4208-41df-8166-ee026a9b4e98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:26.899570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-50f49ac2-4208-41df-8166-ee026a9b4e98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:26.901069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-50f49ac2-4208-41df-8166-ee026a9b4e98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:26.902559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-50f49ac2-4208-41df-8166-ee026a9b4e98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.176275 Jul 26 18:48:26.903451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1359/2690] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:26.926449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0e8f1eaf-d2c1-4667-8d1e-26759721179d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:26.934596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0e8f1eaf-d2c1-4667-8d1e-26759721179d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.164862 Jul 26 18:48:26.935234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1332/2691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:26 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:27.054628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-df3a44ea-50a8-45fc-80f8-cd29438cfc44 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:27.055654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-df3a44ea-50a8-45fc-80f8-cd29438cfc44 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:27.066031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df3a44ea-50a8-45fc-80f8-cd29438cfc44 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:27.066770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df3a44ea-50a8-45fc-80f8-cd29438cfc44 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:27.068058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df3a44ea-50a8-45fc-80f8-cd29438cfc44 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:27.068759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df3a44ea-50a8-45fc-80f8-cd29438cfc44 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:27.210292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-df3a44ea-50a8-45fc-80f8-cd29438cfc44 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:27.218783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-df3a44ea-50a8-45fc-80f8-cd29438cfc44 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.170557 Jul 26 18:48:27.219457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1360/2692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:27 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:27.792623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b5f41efd-f3d7-49e6-8ae9-d9ff61f461ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:27.793278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b5f41efd-f3d7-49e6-8ae9-d9ff61f461ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:27.799884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5f41efd-f3d7-49e6-8ae9-d9ff61f461ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:27.800318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5f41efd-f3d7-49e6-8ae9-d9ff61f461ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:27.801064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5f41efd-f3d7-49e6-8ae9-d9ff61f461ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:27.801486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5f41efd-f3d7-49e6-8ae9-d9ff61f461ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:27.925616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4dd86995-c612-4ab6-8bb7-7c17a8db267c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:27.926445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4dd86995-c612-4ab6-8bb7-7c17a8db267c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:27.931390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b5f41efd-f3d7-49e6-8ae9-d9ff61f461ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:27.933548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4dd86995-c612-4ab6-8bb7-7c17a8db267c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:27.934060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4dd86995-c612-4ab6-8bb7-7c17a8db267c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:27.934888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4dd86995-c612-4ab6-8bb7-7c17a8db267c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:27.935412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4dd86995-c612-4ab6-8bb7-7c17a8db267c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:27.939635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b5f41efd-f3d7-49e6-8ae9-d9ff61f461ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.152395 Jul 26 18:48:27.940208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1333/2693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:27.956691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-af42914e-9358-4879-b19b-30781ab4080b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:27.957298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-af42914e-9358-4879-b19b-30781ab4080b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:27.963348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af42914e-9358-4879-b19b-30781ab4080b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:27.963841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af42914e-9358-4879-b19b-30781ab4080b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:27.964789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af42914e-9358-4879-b19b-30781ab4080b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:27.965228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af42914e-9358-4879-b19b-30781ab4080b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:28.085167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4dd86995-c612-4ab6-8bb7-7c17a8db267c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:28.094187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4dd86995-c612-4ab6-8bb7-7c17a8db267c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:28.095727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4dd86995-c612-4ab6-8bb7-7c17a8db267c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:28.097016 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4dd86995-c612-4ab6-8bb7-7c17a8db267c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.175479 Jul 26 18:48:28.097590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1361/2694] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:27 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:28.103698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-af42914e-9358-4879-b19b-30781ab4080b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:28.111892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-af42914e-9358-4879-b19b-30781ab4080b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.158887 Jul 26 18:48:28.112518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1334/2695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:27 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:48:28.244948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0e472f6d-37b5-4f77-a847-79280685194f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:28.245950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0e472f6d-37b5-4f77-a847-79280685194f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:28.256179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e472f6d-37b5-4f77-a847-79280685194f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:28.256936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e472f6d-37b5-4f77-a847-79280685194f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:28.258184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e472f6d-37b5-4f77-a847-79280685194f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:28.258904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e472f6d-37b5-4f77-a847-79280685194f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:28.391274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0e472f6d-37b5-4f77-a847-79280685194f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:28.402877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0e472f6d-37b5-4f77-a847-79280685194f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.164224 Jul 26 18:48:28.403723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1362/2696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:28 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:28.960691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2a7087c4-5325-4bed-8e80-e2d30436ab1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:28.961305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2a7087c4-5325-4bed-8e80-e2d30436ab1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:28.968274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a7087c4-5325-4bed-8e80-e2d30436ab1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:28.968727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a7087c4-5325-4bed-8e80-e2d30436ab1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:28.969486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a7087c4-5325-4bed-8e80-e2d30436ab1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:28.969944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a7087c4-5325-4bed-8e80-e2d30436ab1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:29.105125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2a7087c4-5325-4bed-8e80-e2d30436ab1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:29.113477 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2a7087c4-5325-4bed-8e80-e2d30436ab1d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156651 Jul 26 18:48:29.114056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1335/2697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:28 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:29.120107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b5cf3097-94ff-4273-981c-60f7dd99950c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:29.120836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b5cf3097-94ff-4273-981c-60f7dd99950c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:29.127715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5cf3097-94ff-4273-981c-60f7dd99950c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:29.128161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5cf3097-94ff-4273-981c-60f7dd99950c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:29.128918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5cf3097-94ff-4273-981c-60f7dd99950c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:29.129353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5cf3097-94ff-4273-981c-60f7dd99950c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:29.133675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6b8ec5db-e900-4cfc-96ba-2116063ff2ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:29.134540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6b8ec5db-e900-4cfc-96ba-2116063ff2ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:29.140784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b8ec5db-e900-4cfc-96ba-2116063ff2ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:29.141241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b8ec5db-e900-4cfc-96ba-2116063ff2ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:29.141987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b8ec5db-e900-4cfc-96ba-2116063ff2ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:29.142529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b8ec5db-e900-4cfc-96ba-2116063ff2ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:29.267176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b5cf3097-94ff-4273-981c-60f7dd99950c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:29.274260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6b8ec5db-e900-4cfc-96ba-2116063ff2ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:29.276167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b5cf3097-94ff-4273-981c-60f7dd99950c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:29.277706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b5cf3097-94ff-4273-981c-60f7dd99950c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:29.278909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b5cf3097-94ff-4273-981c-60f7dd99950c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162741 Jul 26 18:48:29.279492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1363/2698] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:29.282454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6b8ec5db-e900-4cfc-96ba-2116063ff2ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152637 Jul 26 18:48:29.283037 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1336/2699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:29 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:48:29.434625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-18f9653a-7927-45cc-8bee-2b116840fde3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:29.435186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-18f9653a-7927-45cc-8bee-2b116840fde3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:29.442613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18f9653a-7927-45cc-8bee-2b116840fde3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:29.443041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18f9653a-7927-45cc-8bee-2b116840fde3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:29.443902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18f9653a-7927-45cc-8bee-2b116840fde3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:29.444333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18f9653a-7927-45cc-8bee-2b116840fde3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:29.577226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-18f9653a-7927-45cc-8bee-2b116840fde3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:29.585565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-18f9653a-7927-45cc-8bee-2b116840fde3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158242 Jul 26 18:48:29.586144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1364/2700] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:29 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:30.135738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1e517aad-1afb-4c1d-95fc-7e746306a373 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:30.136373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1e517aad-1afb-4c1d-95fc-7e746306a373 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:30.143584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e517aad-1afb-4c1d-95fc-7e746306a373 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:30.144044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e517aad-1afb-4c1d-95fc-7e746306a373 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:30.144828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e517aad-1afb-4c1d-95fc-7e746306a373 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:30.145286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1e517aad-1afb-4c1d-95fc-7e746306a373 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:30.278451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1e517aad-1afb-4c1d-95fc-7e746306a373 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:30.286581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1e517aad-1afb-4c1d-95fc-7e746306a373 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154952 Jul 26 18:48:30.287167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1337/2701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:30 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:30.301946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ca786741-56ff-4cbe-8c24-eccb711aa88d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:30.302519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ca786741-56ff-4cbe-8c24-eccb711aa88d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:30.304346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ac1280f7-78b4-4a3e-842c-d21adffd06e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:30.304949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ac1280f7-78b4-4a3e-842c-d21adffd06e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:30.309306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca786741-56ff-4cbe-8c24-eccb711aa88d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:30.309754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca786741-56ff-4cbe-8c24-eccb711aa88d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:30.310494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca786741-56ff-4cbe-8c24-eccb711aa88d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:30.310923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca786741-56ff-4cbe-8c24-eccb711aa88d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:30.311252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac1280f7-78b4-4a3e-842c-d21adffd06e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:30.311698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac1280f7-78b4-4a3e-842c-d21adffd06e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:30.312443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac1280f7-78b4-4a3e-842c-d21adffd06e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:30.312867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ac1280f7-78b4-4a3e-842c-d21adffd06e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:30.443873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ca786741-56ff-4cbe-8c24-eccb711aa88d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:30.445765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ac1280f7-78b4-4a3e-842c-d21adffd06e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:30.456355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ca786741-56ff-4cbe-8c24-eccb711aa88d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:30.457227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ac1280f7-78b4-4a3e-842c-d21adffd06e1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156392 Jul 26 18:48:30.458072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1338/2702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:30 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:30.458400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ca786741-56ff-4cbe-8c24-eccb711aa88d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:30.459609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ca786741-56ff-4cbe-8c24-eccb711aa88d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161624 Jul 26 18:48:30.460347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1365/2703] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:30.610958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-050c8cce-4651-4524-9bd7-57c052d90899 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:30.611900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-050c8cce-4651-4524-9bd7-57c052d90899 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:30.622199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-050c8cce-4651-4524-9bd7-57c052d90899 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:30.622971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-050c8cce-4651-4524-9bd7-57c052d90899 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:30.624258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-050c8cce-4651-4524-9bd7-57c052d90899 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:30.624976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-050c8cce-4651-4524-9bd7-57c052d90899 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:30.769014 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-050c8cce-4651-4524-9bd7-57c052d90899 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:30.782252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-050c8cce-4651-4524-9bd7-57c052d90899 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.177548 Jul 26 18:48:30.782894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1339/2704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:30 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:31.312338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b031610f-6626-4f08-98e3-ab8eae398e4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:31.313180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b031610f-6626-4f08-98e3-ab8eae398e4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:31.324173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b031610f-6626-4f08-98e3-ab8eae398e4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:31.324622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b031610f-6626-4f08-98e3-ab8eae398e4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:31.325380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b031610f-6626-4f08-98e3-ab8eae398e4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:31.325813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b031610f-6626-4f08-98e3-ab8eae398e4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:31.463923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b031610f-6626-4f08-98e3-ab8eae398e4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:31.472109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b031610f-6626-4f08-98e3-ab8eae398e4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.166419 Jul 26 18:48:31.473017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1366/2705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:31 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:31.477869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7342e8cb-33e1-48bf-aa79-6a8ef769c90b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:31.478577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7342e8cb-33e1-48bf-aa79-6a8ef769c90b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:31.481817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-688288dc-466a-48aa-a489-de3dbcf6caf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:31.482541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-688288dc-466a-48aa-a489-de3dbcf6caf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:31.485724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7342e8cb-33e1-48bf-aa79-6a8ef769c90b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:31.486167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7342e8cb-33e1-48bf-aa79-6a8ef769c90b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:31.486920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7342e8cb-33e1-48bf-aa79-6a8ef769c90b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:31.487499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7342e8cb-33e1-48bf-aa79-6a8ef769c90b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:31.488874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-688288dc-466a-48aa-a489-de3dbcf6caf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:31.489314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-688288dc-466a-48aa-a489-de3dbcf6caf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:31.490064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-688288dc-466a-48aa-a489-de3dbcf6caf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:31.490493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-688288dc-466a-48aa-a489-de3dbcf6caf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:31.616972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-688288dc-466a-48aa-a489-de3dbcf6caf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:31.617149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7342e8cb-33e1-48bf-aa79-6a8ef769c90b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:31.625298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7342e8cb-33e1-48bf-aa79-6a8ef769c90b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151392 Jul 26 18:48:31.625871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1340/2706] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:31 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:31.626027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-688288dc-466a-48aa-a489-de3dbcf6caf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:31.627421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-688288dc-466a-48aa-a489-de3dbcf6caf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:31.628582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-688288dc-466a-48aa-a489-de3dbcf6caf3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.150694 Jul 26 18:48:31.629129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1367/2707] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:31.809014 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3c1f232d-7a91-4fc0-9110-82768ee79435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:31.809628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3c1f232d-7a91-4fc0-9110-82768ee79435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:31.816202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c1f232d-7a91-4fc0-9110-82768ee79435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:31.816591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c1f232d-7a91-4fc0-9110-82768ee79435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:31.817348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c1f232d-7a91-4fc0-9110-82768ee79435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:31.817783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c1f232d-7a91-4fc0-9110-82768ee79435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:31.951948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3c1f232d-7a91-4fc0-9110-82768ee79435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:31.960121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3c1f232d-7a91-4fc0-9110-82768ee79435 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157302 Jul 26 18:48:31.960698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1341/2708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:31 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:32.497251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-23e0668e-839c-4861-803b-9fed5bd25982 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:32.498050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-23e0668e-839c-4861-803b-9fed5bd25982 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:32.507258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23e0668e-839c-4861-803b-9fed5bd25982 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:32.507851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23e0668e-839c-4861-803b-9fed5bd25982 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:32.508852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23e0668e-839c-4861-803b-9fed5bd25982 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:32.509428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23e0668e-839c-4861-803b-9fed5bd25982 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:32.645977 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c17ec7c8-7096-4dc2-888f-66621fd06b05 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:32.646706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c17ec7c8-7096-4dc2-888f-66621fd06b05 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:32.650307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-23e0668e-839c-4861-803b-9fed5bd25982 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:32.654291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c17ec7c8-7096-4dc2-888f-66621fd06b05 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:32.654737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c17ec7c8-7096-4dc2-888f-66621fd06b05 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:32.655518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c17ec7c8-7096-4dc2-888f-66621fd06b05 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:32.655947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c17ec7c8-7096-4dc2-888f-66621fd06b05 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:32.658950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-23e0668e-839c-4861-803b-9fed5bd25982 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.168021 Jul 26 18:48:32.660333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1368/2709] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:32 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:32.664277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c09c617a-c344-4880-9e12-f56be4de2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:32.664870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c09c617a-c344-4880-9e12-f56be4de2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:32.671110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c09c617a-c344-4880-9e12-f56be4de2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:32.671290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c09c617a-c344-4880-9e12-f56be4de2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:32.672034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c09c617a-c344-4880-9e12-f56be4de2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:32.672462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c09c617a-c344-4880-9e12-f56be4de2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:32.784648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c17ec7c8-7096-4dc2-888f-66621fd06b05 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:32.793416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c17ec7c8-7096-4dc2-888f-66621fd06b05 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151360 Jul 26 18:48:32.794019 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1342/2710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:32 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:32.801369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c09c617a-c344-4880-9e12-f56be4de2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:32.810021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c09c617a-c344-4880-9e12-f56be4de2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:32.811595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c09c617a-c344-4880-9e12-f56be4de2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:32.812749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c09c617a-c344-4880-9e12-f56be4de2de4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.152228 Jul 26 18:48:32.813311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1369/2711] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:32 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:32.985771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0113ddcb-3a70-4840-b863-ccf74a26dc52 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:32.986748 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0113ddcb-3a70-4840-b863-ccf74a26dc52 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:32.996915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0113ddcb-3a70-4840-b863-ccf74a26dc52 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:32.997651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0113ddcb-3a70-4840-b863-ccf74a26dc52 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:32.998987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0113ddcb-3a70-4840-b863-ccf74a26dc52 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:32.999647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0113ddcb-3a70-4840-b863-ccf74a26dc52 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:33.139487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0113ddcb-3a70-4840-b863-ccf74a26dc52 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:33.148402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0113ddcb-3a70-4840-b863-ccf74a26dc52 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.169045 Jul 26 18:48:33.148995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1343/2712] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:32 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:33.684826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f6b5c435-ce90-480b-b12d-a5ccb9e1e3f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:33.685693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f6b5c435-ce90-480b-b12d-a5ccb9e1e3f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:33.696178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6b5c435-ce90-480b-b12d-a5ccb9e1e3f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:33.696921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6b5c435-ce90-480b-b12d-a5ccb9e1e3f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:33.698161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6b5c435-ce90-480b-b12d-a5ccb9e1e3f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:33.698937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6b5c435-ce90-480b-b12d-a5ccb9e1e3f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:33.813919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7d76b59c-2b06-425d-ab8e-7863666b47a3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:33.814506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7d76b59c-2b06-425d-ab8e-7863666b47a3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:33.821390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d76b59c-2b06-425d-ab8e-7863666b47a3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:33.821836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d76b59c-2b06-425d-ab8e-7863666b47a3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:33.822601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d76b59c-2b06-425d-ab8e-7863666b47a3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:33.823051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7d76b59c-2b06-425d-ab8e-7863666b47a3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:33.841495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f6b5c435-ce90-480b-b12d-a5ccb9e1e3f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:33.849806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f6b5c435-ce90-480b-b12d-a5ccb9e1e3f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.171838 Jul 26 18:48:33.850375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1370/2713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:33 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:33.854765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a2e72a40-1575-4016-b3aa-639d5c53d53e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:33.855364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a2e72a40-1575-4016-b3aa-639d5c53d53e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:33.861510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2e72a40-1575-4016-b3aa-639d5c53d53e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:33.861955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2e72a40-1575-4016-b3aa-639d5c53d53e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:33.862708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2e72a40-1575-4016-b3aa-639d5c53d53e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:33.863136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2e72a40-1575-4016-b3aa-639d5c53d53e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:33.956124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7d76b59c-2b06-425d-ab8e-7863666b47a3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:33.964459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7d76b59c-2b06-425d-ab8e-7863666b47a3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154368 Jul 26 18:48:33.965205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1344/2714] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:33 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:33.998153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a2e72a40-1575-4016-b3aa-639d5c53d53e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:34.006820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a2e72a40-1575-4016-b3aa-639d5c53d53e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:34.008352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a2e72a40-1575-4016-b3aa-639d5c53d53e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:34.009537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a2e72a40-1575-4016-b3aa-639d5c53d53e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158262 Jul 26 18:48:34.010133 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1371/2715] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:34.173820 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-849b6ffc-bcee-43e6-8375-dab02f4fdc46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:34.175005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-849b6ffc-bcee-43e6-8375-dab02f4fdc46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:34.184952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-849b6ffc-bcee-43e6-8375-dab02f4fdc46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:34.185422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-849b6ffc-bcee-43e6-8375-dab02f4fdc46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:34.186218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-849b6ffc-bcee-43e6-8375-dab02f4fdc46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:34.186657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-849b6ffc-bcee-43e6-8375-dab02f4fdc46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:34.317508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-849b6ffc-bcee-43e6-8375-dab02f4fdc46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:34.325869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-849b6ffc-bcee-43e6-8375-dab02f4fdc46 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158630 Jul 26 18:48:34.326493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1345/2716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:34 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:34.874567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bd362dfa-4d8c-456a-b189-61198feb518f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:34.875387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bd362dfa-4d8c-456a-b189-61198feb518f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:34.884347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd362dfa-4d8c-456a-b189-61198feb518f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:34.884941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd362dfa-4d8c-456a-b189-61198feb518f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:34.885938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd362dfa-4d8c-456a-b189-61198feb518f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:34.886561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd362dfa-4d8c-456a-b189-61198feb518f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:34.985759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f19eb57a-1e49-43b4-bd1f-e35489d4d2c3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:34.986398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f19eb57a-1e49-43b4-bd1f-e35489d4d2c3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:34.993113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f19eb57a-1e49-43b4-bd1f-e35489d4d2c3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:34.993563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f19eb57a-1e49-43b4-bd1f-e35489d4d2c3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:34.994322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f19eb57a-1e49-43b4-bd1f-e35489d4d2c3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:34.994755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f19eb57a-1e49-43b4-bd1f-e35489d4d2c3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:35.009897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:35.022268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bd362dfa-4d8c-456a-b189-61198feb518f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:35.031116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bd362dfa-4d8c-456a-b189-61198feb518f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.162298 Jul 26 18:48:35.031736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1372/2717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:34 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:35.036244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3427500e-3c55-496f-97f7-e935ccccc768 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:35.036887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3427500e-3c55-496f-97f7-e935ccccc768 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:35.043178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3427500e-3c55-496f-97f7-e935ccccc768 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:35.043625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3427500e-3c55-496f-97f7-e935ccccc768 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:35.044406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3427500e-3c55-496f-97f7-e935ccccc768 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:35.044835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3427500e-3c55-496f-97f7-e935ccccc768 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:35.130351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f19eb57a-1e49-43b4-bd1f-e35489d4d2c3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:35.140592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f19eb57a-1e49-43b4-bd1f-e35489d4d2c3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.158668 Jul 26 18:48:35.141240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1346/2718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:34 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:35.180217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3427500e-3c55-496f-97f7-e935ccccc768 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:35.188842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3427500e-3c55-496f-97f7-e935ccccc768 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:35.190403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3427500e-3c55-496f-97f7-e935ccccc768 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:35.191590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3427500e-3c55-496f-97f7-e935ccccc768 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158929 Jul 26 18:48:35.192152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1373/2719] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:35 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:35.347207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-882385d0-ad5c-4c5d-88dc-7d4bbe0e94a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:35.347898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-882385d0-ad5c-4c5d-88dc-7d4bbe0e94a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:35.354132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-882385d0-ad5c-4c5d-88dc-7d4bbe0e94a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:35.354577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-882385d0-ad5c-4c5d-88dc-7d4bbe0e94a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:35.355361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-882385d0-ad5c-4c5d-88dc-7d4bbe0e94a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:35.355789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-882385d0-ad5c-4c5d-88dc-7d4bbe0e94a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:35.487400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-882385d0-ad5c-4c5d-88dc-7d4bbe0e94a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:35.495574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-882385d0-ad5c-4c5d-88dc-7d4bbe0e94a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152311 Jul 26 18:48:35.496145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1347/2720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:35 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:36.056989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d546e324-4992-4564-b1d1-ff022fb20997 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:36.057861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d546e324-4992-4564-b1d1-ff022fb20997 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:36.068916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d546e324-4992-4564-b1d1-ff022fb20997 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:36.069654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d546e324-4992-4564-b1d1-ff022fb20997 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:36.070902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d546e324-4992-4564-b1d1-ff022fb20997 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:36.071707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d546e324-4992-4564-b1d1-ff022fb20997 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:36.075078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:36.164795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-085aaff8-d0bc-4fa4-81af-64ba405ad6c5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:36.165399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-085aaff8-d0bc-4fa4-81af-64ba405ad6c5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:36.172435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-085aaff8-d0bc-4fa4-81af-64ba405ad6c5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:36.172877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-085aaff8-d0bc-4fa4-81af-64ba405ad6c5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:36.173629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-085aaff8-d0bc-4fa4-81af-64ba405ad6c5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:36.174055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-085aaff8-d0bc-4fa4-81af-64ba405ad6c5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:36.210156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d546e324-4992-4564-b1d1-ff022fb20997 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:36.218442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d546e324-4992-4564-b1d1-ff022fb20997 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.168059 Jul 26 18:48:36.218985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1374/2721] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:36 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:36.224110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d68dea3b-e23b-4a11-be7e-47a6b0850ba2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:36.224696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d68dea3b-e23b-4a11-be7e-47a6b0850ba2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:36.230621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d68dea3b-e23b-4a11-be7e-47a6b0850ba2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:36.231095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d68dea3b-e23b-4a11-be7e-47a6b0850ba2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:36.231846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d68dea3b-e23b-4a11-be7e-47a6b0850ba2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:36.232275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d68dea3b-e23b-4a11-be7e-47a6b0850ba2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:36.307225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-085aaff8-d0bc-4fa4-81af-64ba405ad6c5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:36.315626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-085aaff8-d0bc-4fa4-81af-64ba405ad6c5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156355 Jul 26 18:48:36.316174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1348/2722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:36 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:36.362519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d68dea3b-e23b-4a11-be7e-47a6b0850ba2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:36.371187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d68dea3b-e23b-4a11-be7e-47a6b0850ba2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:36.372689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d68dea3b-e23b-4a11-be7e-47a6b0850ba2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:36.373855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d68dea3b-e23b-4a11-be7e-47a6b0850ba2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.153904 Jul 26 18:48:36.374412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1375/2723] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:36 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:36.520287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bdef9f41-e837-47c4-9db5-9dff532427b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:36.521079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bdef9f41-e837-47c4-9db5-9dff532427b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:36.530620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bdef9f41-e837-47c4-9db5-9dff532427b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:36.531285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bdef9f41-e837-47c4-9db5-9dff532427b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:36.532306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bdef9f41-e837-47c4-9db5-9dff532427b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:36.532888 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bdef9f41-e837-47c4-9db5-9dff532427b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:36.669648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bdef9f41-e837-47c4-9db5-9dff532427b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:36.677908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bdef9f41-e837-47c4-9db5-9dff532427b9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.163192 Jul 26 18:48:36.678471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1349/2724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:36 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:37.243686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1039467f-5c4f-42bb-815f-8e10d842e701 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:37.244572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1039467f-5c4f-42bb-815f-8e10d842e701 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:37.255174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1039467f-5c4f-42bb-815f-8e10d842e701 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:37.255863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1039467f-5c4f-42bb-815f-8e10d842e701 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:37.257019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1039467f-5c4f-42bb-815f-8e10d842e701 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:37.257685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1039467f-5c4f-42bb-815f-8e10d842e701 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:37.336576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-08a1eed1-5380-49eb-9bbb-c214370bda1b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:37.337247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-08a1eed1-5380-49eb-9bbb-c214370bda1b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:37.344441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08a1eed1-5380-49eb-9bbb-c214370bda1b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:37.344879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08a1eed1-5380-49eb-9bbb-c214370bda1b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:37.345633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08a1eed1-5380-49eb-9bbb-c214370bda1b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:37.346061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08a1eed1-5380-49eb-9bbb-c214370bda1b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:37.387845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1039467f-5c4f-42bb-815f-8e10d842e701 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:37.396403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1039467f-5c4f-42bb-815f-8e10d842e701 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158808 Jul 26 18:48:37.396986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1376/2725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:37 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:37.401862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-536775c1-2cac-4e5d-9cad-4559075c6d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:37.402502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-536775c1-2cac-4e5d-9cad-4559075c6d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:37.409338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-536775c1-2cac-4e5d-9cad-4559075c6d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:37.409777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-536775c1-2cac-4e5d-9cad-4559075c6d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:37.410593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-536775c1-2cac-4e5d-9cad-4559075c6d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:37.411037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-536775c1-2cac-4e5d-9cad-4559075c6d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:37.489216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-08a1eed1-5380-49eb-9bbb-c214370bda1b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:37.498310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-08a1eed1-5380-49eb-9bbb-c214370bda1b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.165738 Jul 26 18:48:37.499067 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1350/2726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:37 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:37.566447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-536775c1-2cac-4e5d-9cad-4559075c6d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:37.575324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-536775c1-2cac-4e5d-9cad-4559075c6d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:37.576815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-536775c1-2cac-4e5d-9cad-4559075c6d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:37.577961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-536775c1-2cac-4e5d-9cad-4559075c6d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.180086 Jul 26 18:48:37.578539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1377/2727] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:37.702946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b7c75e38-2d90-4477-a014-d12a266b9f61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:37.704034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b7c75e38-2d90-4477-a014-d12a266b9f61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:37.714331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7c75e38-2d90-4477-a014-d12a266b9f61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:37.714780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7c75e38-2d90-4477-a014-d12a266b9f61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:37.715579 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7c75e38-2d90-4477-a014-d12a266b9f61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:37.715993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7c75e38-2d90-4477-a014-d12a266b9f61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:37.847318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b7c75e38-2d90-4477-a014-d12a266b9f61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:37.855524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b7c75e38-2d90-4477-a014-d12a266b9f61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.159280 Jul 26 18:48:37.856094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1351/2728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:37 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:38.421790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ced97860-5f54-48be-97c6-8d2c286c2ea7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:38.422707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ced97860-5f54-48be-97c6-8d2c286c2ea7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:38.433527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ced97860-5f54-48be-97c6-8d2c286c2ea7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:38.433973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ced97860-5f54-48be-97c6-8d2c286c2ea7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:38.434718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ced97860-5f54-48be-97c6-8d2c286c2ea7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:38.435190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ced97860-5f54-48be-97c6-8d2c286c2ea7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:38.520618 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-abf645ff-0491-4bca-b4de-da95e460a711 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:38.521084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-abf645ff-0491-4bca-b4de-da95e460a711 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:38.542525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abf645ff-0491-4bca-b4de-da95e460a711 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:38.542978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abf645ff-0491-4bca-b4de-da95e460a711 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:38.543875 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abf645ff-0491-4bca-b4de-da95e460a711 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:38.544317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-abf645ff-0491-4bca-b4de-da95e460a711 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:38.573027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ced97860-5f54-48be-97c6-8d2c286c2ea7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:38.581663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ced97860-5f54-48be-97c6-8d2c286c2ea7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165744 Jul 26 18:48:38.583282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1378/2729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:38 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:38.601274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-00b81dfe-4227-4de6-8fcf-f5fe3d7b613b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:38.601884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-00b81dfe-4227-4de6-8fcf-f5fe3d7b613b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:38.608168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00b81dfe-4227-4de6-8fcf-f5fe3d7b613b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:38.608818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00b81dfe-4227-4de6-8fcf-f5fe3d7b613b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:38.610050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00b81dfe-4227-4de6-8fcf-f5fe3d7b613b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:38.610576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00b81dfe-4227-4de6-8fcf-f5fe3d7b613b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:38.683867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-abf645ff-0491-4bca-b4de-da95e460a711 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:38.691999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-abf645ff-0491-4bca-b4de-da95e460a711 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.175813 Jul 26 18:48:38.692573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1352/2730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:38 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:48:38.742560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-00b81dfe-4227-4de6-8fcf-f5fe3d7b613b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:38.754515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-00b81dfe-4227-4de6-8fcf-f5fe3d7b613b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:38.756927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-00b81dfe-4227-4de6-8fcf-f5fe3d7b613b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:38.758686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-00b81dfe-4227-4de6-8fcf-f5fe3d7b613b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161006 Jul 26 18:48:38.759519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1379/2731] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:48:38.881029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d715c5a0-9d98-4491-9b1d-c2d3d6c5de09 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:38.882029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d715c5a0-9d98-4491-9b1d-c2d3d6c5de09 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:38.889974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d715c5a0-9d98-4491-9b1d-c2d3d6c5de09 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:38.890421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d715c5a0-9d98-4491-9b1d-c2d3d6c5de09 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:38.891221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d715c5a0-9d98-4491-9b1d-c2d3d6c5de09 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:38.891654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d715c5a0-9d98-4491-9b1d-c2d3d6c5de09 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:39.030500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d715c5a0-9d98-4491-9b1d-c2d3d6c5de09 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:39.039144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d715c5a0-9d98-4491-9b1d-c2d3d6c5de09 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.164527 Jul 26 18:48:39.039740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1353/2732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:38 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:39.602604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-28c346e2-9575-4d0a-993e-cf9da798e024 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:39.603250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-28c346e2-9575-4d0a-993e-cf9da798e024 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:39.610501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28c346e2-9575-4d0a-993e-cf9da798e024 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:39.610959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28c346e2-9575-4d0a-993e-cf9da798e024 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:39.611791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28c346e2-9575-4d0a-993e-cf9da798e024 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:39.612208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28c346e2-9575-4d0a-993e-cf9da798e024 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:39.713272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c24eb99c-e614-491f-8259-781eecf04706 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:39.713864 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c24eb99c-e614-491f-8259-781eecf04706 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:39.720869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c24eb99c-e614-491f-8259-781eecf04706 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:39.721323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c24eb99c-e614-491f-8259-781eecf04706 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:39.722084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c24eb99c-e614-491f-8259-781eecf04706 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:39.722513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c24eb99c-e614-491f-8259-781eecf04706 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:39.746811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-28c346e2-9575-4d0a-993e-cf9da798e024 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:39.755275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-28c346e2-9575-4d0a-993e-cf9da798e024 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156513 Jul 26 18:48:39.755870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1380/2733] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:39 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:39.782185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ab5837be-734e-4104-80a1-d0d62a3af844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:39.782952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ab5837be-734e-4104-80a1-d0d62a3af844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:39.790488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab5837be-734e-4104-80a1-d0d62a3af844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:39.790935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab5837be-734e-4104-80a1-d0d62a3af844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:39.791840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab5837be-734e-4104-80a1-d0d62a3af844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:39.792164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab5837be-734e-4104-80a1-d0d62a3af844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:39.859078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c24eb99c-e614-491f-8259-781eecf04706 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:39.870539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c24eb99c-e614-491f-8259-781eecf04706 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161175 Jul 26 18:48:39.871574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1354/2734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:39 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:39.937683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ab5837be-734e-4104-80a1-d0d62a3af844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:39.950591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ab5837be-734e-4104-80a1-d0d62a3af844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:39.952995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ab5837be-734e-4104-80a1-d0d62a3af844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:39.954809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ab5837be-734e-4104-80a1-d0d62a3af844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.176482 Jul 26 18:48:39.955547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1381/2735] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:40.065449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-59651f25-3cff-4ba7-857f-ed3690e0ac14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:40.066211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-59651f25-3cff-4ba7-857f-ed3690e0ac14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:40.076010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59651f25-3cff-4ba7-857f-ed3690e0ac14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:40.076684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59651f25-3cff-4ba7-857f-ed3690e0ac14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:40.077826 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59651f25-3cff-4ba7-857f-ed3690e0ac14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:40.078485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59651f25-3cff-4ba7-857f-ed3690e0ac14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:40.223541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-59651f25-3cff-4ba7-857f-ed3690e0ac14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:40.234381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-59651f25-3cff-4ba7-857f-ed3690e0ac14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.175174 Jul 26 18:48:40.234967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1355/2736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:40 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:40.780054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e1827ee0-7c52-482a-a3d9-f1ce4ab1dccd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:40.780613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e1827ee0-7c52-482a-a3d9-f1ce4ab1dccd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:40.787607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1827ee0-7c52-482a-a3d9-f1ce4ab1dccd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:40.788052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1827ee0-7c52-482a-a3d9-f1ce4ab1dccd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:40.788803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1827ee0-7c52-482a-a3d9-f1ce4ab1dccd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:40.789228 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1827ee0-7c52-482a-a3d9-f1ce4ab1dccd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:40.892544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cfb8ee0d-a6ad-42f3-8ce5-5e428d8d5412 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:40.893123 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cfb8ee0d-a6ad-42f3-8ce5-5e428d8d5412 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:40.900005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfb8ee0d-a6ad-42f3-8ce5-5e428d8d5412 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:40.900448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfb8ee0d-a6ad-42f3-8ce5-5e428d8d5412 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:40.901195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfb8ee0d-a6ad-42f3-8ce5-5e428d8d5412 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:40.901616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfb8ee0d-a6ad-42f3-8ce5-5e428d8d5412 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:40.926674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e1827ee0-7c52-482a-a3d9-f1ce4ab1dccd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:40.935068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e1827ee0-7c52-482a-a3d9-f1ce4ab1dccd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158946 Jul 26 18:48:40.935687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1382/2737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:40 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:40.982373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0cd4c693-1365-4e79-86bb-f2a91e6849cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:40.983002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0cd4c693-1365-4e79-86bb-f2a91e6849cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:40.989701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0cd4c693-1365-4e79-86bb-f2a91e6849cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:40.990143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0cd4c693-1365-4e79-86bb-f2a91e6849cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:40.991135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0cd4c693-1365-4e79-86bb-f2a91e6849cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:40.991581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0cd4c693-1365-4e79-86bb-f2a91e6849cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:41.031580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cfb8ee0d-a6ad-42f3-8ce5-5e428d8d5412 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:41.039871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cfb8ee0d-a6ad-42f3-8ce5-5e428d8d5412 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151103 Jul 26 18:48:41.040451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1356/2738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:40 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:41.129308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0cd4c693-1365-4e79-86bb-f2a91e6849cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:41.138099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0cd4c693-1365-4e79-86bb-f2a91e6849cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:41.139652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0cd4c693-1365-4e79-86bb-f2a91e6849cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:41.140811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0cd4c693-1365-4e79-86bb-f2a91e6849cd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162704 Jul 26 18:48:41.141376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1383/2739] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:40 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:41.260225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dcf61ef1-52f2-441c-b91f-1e86d04b8e59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:41.261228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dcf61ef1-52f2-441c-b91f-1e86d04b8e59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:41.268305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcf61ef1-52f2-441c-b91f-1e86d04b8e59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:41.268759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcf61ef1-52f2-441c-b91f-1e86d04b8e59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:41.269513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcf61ef1-52f2-441c-b91f-1e86d04b8e59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:41.269945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dcf61ef1-52f2-441c-b91f-1e86d04b8e59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:41.402699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dcf61ef1-52f2-441c-b91f-1e86d04b8e59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:41.411601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dcf61ef1-52f2-441c-b91f-1e86d04b8e59 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157809 Jul 26 18:48:41.412176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1357/2740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:41 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:41.956328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-60954de2-c853-4767-9422-e9266878f9b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:41.956894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-60954de2-c853-4767-9422-e9266878f9b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:41.963890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60954de2-c853-4767-9422-e9266878f9b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:41.964338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60954de2-c853-4767-9422-e9266878f9b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:41.965093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60954de2-c853-4767-9422-e9266878f9b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:41.965524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60954de2-c853-4767-9422-e9266878f9b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:42.061599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-762389d7-65f0-4178-9b94-6360ac1f617b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:42.062861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-762389d7-65f0-4178-9b94-6360ac1f617b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:42.069980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-762389d7-65f0-4178-9b94-6360ac1f617b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:42.070428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-762389d7-65f0-4178-9b94-6360ac1f617b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:42.071368 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-762389d7-65f0-4178-9b94-6360ac1f617b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:42.071799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-762389d7-65f0-4178-9b94-6360ac1f617b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:42.094145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-60954de2-c853-4767-9422-e9266878f9b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:42.102456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-60954de2-c853-4767-9422-e9266878f9b7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.150153 Jul 26 18:48:42.103052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1384/2741] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:41 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:42.164438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-80965b43-e3b9-418c-8c6b-0268579d6a6c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:42.165073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-80965b43-e3b9-418c-8c6b-0268579d6a6c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:42.171502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80965b43-e3b9-418c-8c6b-0268579d6a6c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:42.171957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80965b43-e3b9-418c-8c6b-0268579d6a6c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:42.172711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80965b43-e3b9-418c-8c6b-0268579d6a6c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:42.173208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80965b43-e3b9-418c-8c6b-0268579d6a6c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:42.208892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-762389d7-65f0-4178-9b94-6360ac1f617b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:42.217414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-762389d7-65f0-4178-9b94-6360ac1f617b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.159736 Jul 26 18:48:42.217959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1358/2742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:42 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:42.306346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-80965b43-e3b9-418c-8c6b-0268579d6a6c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:42.315256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-80965b43-e3b9-418c-8c6b-0268579d6a6c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:42.316757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-80965b43-e3b9-418c-8c6b-0268579d6a6c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:42.317912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-80965b43-e3b9-418c-8c6b-0268579d6a6c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157421 Jul 26 18:48:42.318498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1385/2743] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:42.436623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-732dbaec-c130-4d2c-ae4d-71fcf4b1a946 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:42.437615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-732dbaec-c130-4d2c-ae4d-71fcf4b1a946 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:42.447846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-732dbaec-c130-4d2c-ae4d-71fcf4b1a946 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:42.448593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-732dbaec-c130-4d2c-ae4d-71fcf4b1a946 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:42.449840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-732dbaec-c130-4d2c-ae4d-71fcf4b1a946 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:42.450539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-732dbaec-c130-4d2c-ae4d-71fcf4b1a946 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:42.590235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-732dbaec-c130-4d2c-ae4d-71fcf4b1a946 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:42.598844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-732dbaec-c130-4d2c-ae4d-71fcf4b1a946 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.168789 Jul 26 18:48:42.599449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1359/2744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:42 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:43.128515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e8ad41cb-5a3c-4320-ae78-61887568d852 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:43.129372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e8ad41cb-5a3c-4320-ae78-61887568d852 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:43.141024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8ad41cb-5a3c-4320-ae78-61887568d852 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:43.141765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8ad41cb-5a3c-4320-ae78-61887568d852 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:43.142998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8ad41cb-5a3c-4320-ae78-61887568d852 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:43.143746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8ad41cb-5a3c-4320-ae78-61887568d852 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:43.238157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-733f97f6-afa3-4c22-bcca-0ec7bb69e34e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:43.238741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-733f97f6-afa3-4c22-bcca-0ec7bb69e34e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:43.246003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-733f97f6-afa3-4c22-bcca-0ec7bb69e34e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:43.246452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-733f97f6-afa3-4c22-bcca-0ec7bb69e34e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:43.247244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-733f97f6-afa3-4c22-bcca-0ec7bb69e34e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:43.247700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-733f97f6-afa3-4c22-bcca-0ec7bb69e34e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:43.300954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e8ad41cb-5a3c-4320-ae78-61887568d852 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:43.308966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e8ad41cb-5a3c-4320-ae78-61887568d852 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.187227 Jul 26 18:48:43.320699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1386/2745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:43 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:43.340771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-15522373-b1d8-484b-84c5-480eb64675e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:43.341373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-15522373-b1d8-484b-84c5-480eb64675e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:43.347341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15522373-b1d8-484b-84c5-480eb64675e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:43.347787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15522373-b1d8-484b-84c5-480eb64675e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:43.348531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15522373-b1d8-484b-84c5-480eb64675e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:43.348962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15522373-b1d8-484b-84c5-480eb64675e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:43.381739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-733f97f6-afa3-4c22-bcca-0ec7bb69e34e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:43.390152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-733f97f6-afa3-4c22-bcca-0ec7bb69e34e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155854 Jul 26 18:48:43.390825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1360/2746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:43 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:48:43.480963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15522373-b1d8-484b-84c5-480eb64675e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:43.490177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15522373-b1d8-484b-84c5-480eb64675e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:43.491707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15522373-b1d8-484b-84c5-480eb64675e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:43.492863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-15522373-b1d8-484b-84c5-480eb64675e4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155906 Jul 26 18:48:43.493417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1387/2747] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:48:43.620760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-10d072b6-c2cf-4de9-a484-c541aae600a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:43.621469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-10d072b6-c2cf-4de9-a484-c541aae600a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:43.628189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10d072b6-c2cf-4de9-a484-c541aae600a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:43.628637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10d072b6-c2cf-4de9-a484-c541aae600a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:43.629453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10d072b6-c2cf-4de9-a484-c541aae600a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:43.629819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10d072b6-c2cf-4de9-a484-c541aae600a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:43.761664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-10d072b6-c2cf-4de9-a484-c541aae600a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:43.769682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-10d072b6-c2cf-4de9-a484-c541aae600a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152880 Jul 26 18:48:43.770406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1361/2748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:43 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:44.330398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-764dc828-a62b-4445-986e-a4feab198521 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:44.331009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-764dc828-a62b-4445-986e-a4feab198521 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:44.337771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-764dc828-a62b-4445-986e-a4feab198521 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:44.338219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-764dc828-a62b-4445-986e-a4feab198521 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:44.338976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-764dc828-a62b-4445-986e-a4feab198521 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:44.339442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-764dc828-a62b-4445-986e-a4feab198521 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:44.412202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7b6c81dc-c183-47b9-94f9-3495b19a534c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:44.412941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7b6c81dc-c183-47b9-94f9-3495b19a534c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:44.421001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b6c81dc-c183-47b9-94f9-3495b19a534c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:44.421793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b6c81dc-c183-47b9-94f9-3495b19a534c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:44.423073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b6c81dc-c183-47b9-94f9-3495b19a534c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:44.423793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b6c81dc-c183-47b9-94f9-3495b19a534c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:44.474134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-764dc828-a62b-4445-986e-a4feab198521 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:44.482547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-764dc828-a62b-4445-986e-a4feab198521 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156099 Jul 26 18:48:44.483343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1388/2749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:44 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:44.519527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-493aa266-91ab-4c06-86ad-9f3b66b4579f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:44.520140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-493aa266-91ab-4c06-86ad-9f3b66b4579f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:44.526527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-493aa266-91ab-4c06-86ad-9f3b66b4579f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:44.526996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-493aa266-91ab-4c06-86ad-9f3b66b4579f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:44.527780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-493aa266-91ab-4c06-86ad-9f3b66b4579f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:44.528333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-493aa266-91ab-4c06-86ad-9f3b66b4579f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:44.556738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7b6c81dc-c183-47b9-94f9-3495b19a534c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:44.565017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7b6c81dc-c183-47b9-94f9-3495b19a534c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156673 Jul 26 18:48:44.565592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1362/2750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:44 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:44.659535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-493aa266-91ab-4c06-86ad-9f3b66b4579f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:44.671448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-493aa266-91ab-4c06-86ad-9f3b66b4579f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:44.672949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-493aa266-91ab-4c06-86ad-9f3b66b4579f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:44.674110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-493aa266-91ab-4c06-86ad-9f3b66b4579f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158716 Jul 26 18:48:44.674674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1389/2751] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:44 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:44.792206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f7484366-396f-4c3f-809e-03cdabb53aeb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:44.792869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f7484366-396f-4c3f-809e-03cdabb53aeb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:44.799619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7484366-396f-4c3f-809e-03cdabb53aeb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:44.800056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7484366-396f-4c3f-809e-03cdabb53aeb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:44.800800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7484366-396f-4c3f-809e-03cdabb53aeb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:44.801251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7484366-396f-4c3f-809e-03cdabb53aeb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:44.803762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:44.940589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f7484366-396f-4c3f-809e-03cdabb53aeb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:44.948796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f7484366-396f-4c3f-809e-03cdabb53aeb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161104 Jul 26 18:48:44.949372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1363/2752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:44 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:45.503838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4d3499f3-a73b-4c1f-8f51-e8d856c9e0ab tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:45.504443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4d3499f3-a73b-4c1f-8f51-e8d856c9e0ab tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:45.511261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d3499f3-a73b-4c1f-8f51-e8d856c9e0ab tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:45.511710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d3499f3-a73b-4c1f-8f51-e8d856c9e0ab tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:45.512457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d3499f3-a73b-4c1f-8f51-e8d856c9e0ab tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:45.512931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d3499f3-a73b-4c1f-8f51-e8d856c9e0ab tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:45.586435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1837e340-0930-440d-b219-61d889234141 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:45.587049 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1837e340-0930-440d-b219-61d889234141 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:45.594545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1837e340-0930-440d-b219-61d889234141 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:45.594923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1837e340-0930-440d-b219-61d889234141 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:45.595785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1837e340-0930-440d-b219-61d889234141 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:45.596212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1837e340-0930-440d-b219-61d889234141 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:45.654788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4d3499f3-a73b-4c1f-8f51-e8d856c9e0ab tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:45.657081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:45.665714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4d3499f3-a73b-4c1f-8f51-e8d856c9e0ab tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165741 Jul 26 18:48:45.666621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1390/2753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:45 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:45.697311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9c30e7d5-3317-49c7-9fbf-1a50aebc4bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:45.697918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9c30e7d5-3317-49c7-9fbf-1a50aebc4bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:45.699953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:45.705450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c30e7d5-3317-49c7-9fbf-1a50aebc4bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:45.705994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c30e7d5-3317-49c7-9fbf-1a50aebc4bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:45.706770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c30e7d5-3317-49c7-9fbf-1a50aebc4bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:45.707226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c30e7d5-3317-49c7-9fbf-1a50aebc4bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:45.728875 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1837e340-0930-440d-b219-61d889234141 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:45.737119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1837e340-0930-440d-b219-61d889234141 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155146 Jul 26 18:48:45.737657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1364/2754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:45 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:45.839363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9c30e7d5-3317-49c7-9fbf-1a50aebc4bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:45.848710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9c30e7d5-3317-49c7-9fbf-1a50aebc4bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:45.850255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9c30e7d5-3317-49c7-9fbf-1a50aebc4bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:45.851609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9c30e7d5-3317-49c7-9fbf-1a50aebc4bcb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158113 Jul 26 18:48:45.851997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1391/2755] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:45.974431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7a40e9b2-b92d-4090-b5b2-41230fb9429c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:45.975171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7a40e9b2-b92d-4090-b5b2-41230fb9429c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:45.978025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:45.996563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a40e9b2-b92d-4090-b5b2-41230fb9429c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:45.997076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a40e9b2-b92d-4090-b5b2-41230fb9429c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:45.997917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a40e9b2-b92d-4090-b5b2-41230fb9429c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:45.998263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a40e9b2-b92d-4090-b5b2-41230fb9429c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:46.133263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a40e9b2-b92d-4090-b5b2-41230fb9429c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:46.145861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7a40e9b2-b92d-4090-b5b2-41230fb9429c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.175694 Jul 26 18:48:46.146679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1365/2756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:45 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:46.692197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-91440012-3794-4ae9-93a6-f4e912f08d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:46.693251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-91440012-3794-4ae9-93a6-f4e912f08d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:46.704355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91440012-3794-4ae9-93a6-f4e912f08d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:46.705153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91440012-3794-4ae9-93a6-f4e912f08d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:46.706475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91440012-3794-4ae9-93a6-f4e912f08d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:46.707290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91440012-3794-4ae9-93a6-f4e912f08d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:46.757885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5b61de3b-e51f-4169-969a-84adb8e12bf5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:46.758468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5b61de3b-e51f-4169-969a-84adb8e12bf5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:46.765448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b61de3b-e51f-4169-969a-84adb8e12bf5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:46.765892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b61de3b-e51f-4169-969a-84adb8e12bf5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:46.766637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b61de3b-e51f-4169-969a-84adb8e12bf5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:46.767093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b61de3b-e51f-4169-969a-84adb8e12bf5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:46.843826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-91440012-3794-4ae9-93a6-f4e912f08d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:46.852945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-91440012-3794-4ae9-93a6-f4e912f08d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.167414 Jul 26 18:48:46.853568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1392/2757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:46 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:46.881712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6667073e-15cd-4c3a-9c89-53b282b319b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:46.882365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6667073e-15cd-4c3a-9c89-53b282b319b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:46.888733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6667073e-15cd-4c3a-9c89-53b282b319b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:46.889168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6667073e-15cd-4c3a-9c89-53b282b319b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:46.889954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6667073e-15cd-4c3a-9c89-53b282b319b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:46.890472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6667073e-15cd-4c3a-9c89-53b282b319b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:46.896706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5b61de3b-e51f-4169-969a-84adb8e12bf5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:46.905202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5b61de3b-e51f-4169-969a-84adb8e12bf5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151283 Jul 26 18:48:46.905841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1366/2758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:46 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:47.024972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6667073e-15cd-4c3a-9c89-53b282b319b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:47.034026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6667073e-15cd-4c3a-9c89-53b282b319b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:47.035557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6667073e-15cd-4c3a-9c89-53b282b319b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:47.036877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6667073e-15cd-4c3a-9c89-53b282b319b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159225 Jul 26 18:48:47.037463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1393/2759] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:47.174203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fdbb3816-5e60-458c-b9fd-330bcd17e97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:47.175362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fdbb3816-5e60-458c-b9fd-330bcd17e97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:47.186018 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdbb3816-5e60-458c-b9fd-330bcd17e97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:47.186767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdbb3816-5e60-458c-b9fd-330bcd17e97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:47.188070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdbb3816-5e60-458c-b9fd-330bcd17e97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:47.188818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdbb3816-5e60-458c-b9fd-330bcd17e97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:47.341796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fdbb3816-5e60-458c-b9fd-330bcd17e97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:47.350162 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fdbb3816-5e60-458c-b9fd-330bcd17e97d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.182945 Jul 26 18:48:47.350740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1367/2760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:47 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:47.873931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-64866bd2-afcc-4494-9558-e839bc00cb84 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:47.874543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-64866bd2-afcc-4494-9558-e839bc00cb84 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:47.881621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-64866bd2-afcc-4494-9558-e839bc00cb84 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:47.882075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-64866bd2-afcc-4494-9558-e839bc00cb84 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:47.882834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-64866bd2-afcc-4494-9558-e839bc00cb84 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:47.883349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-64866bd2-afcc-4494-9558-e839bc00cb84 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:47.927459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cfa8457e-4f4a-4ea0-a3d4-66d0daef67e6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:47.928039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cfa8457e-4f4a-4ea0-a3d4-66d0daef67e6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:47.934773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfa8457e-4f4a-4ea0-a3d4-66d0daef67e6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:47.935336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfa8457e-4f4a-4ea0-a3d4-66d0daef67e6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:47.936110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfa8457e-4f4a-4ea0-a3d4-66d0daef67e6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:47.936542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfa8457e-4f4a-4ea0-a3d4-66d0daef67e6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:48.016468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-64866bd2-afcc-4494-9558-e839bc00cb84 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:48.025477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-64866bd2-afcc-4494-9558-e839bc00cb84 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155399 Jul 26 18:48:48.026312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1394/2761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:47 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:48.060178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ac90f010-2b94-4a98-b0dd-f9aa9919c038 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:48.060828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ac90f010-2b94-4a98-b0dd-f9aa9919c038 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:48.066945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac90f010-2b94-4a98-b0dd-f9aa9919c038 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:48.067419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac90f010-2b94-4a98-b0dd-f9aa9919c038 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:48.068305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac90f010-2b94-4a98-b0dd-f9aa9919c038 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:48.068602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac90f010-2b94-4a98-b0dd-f9aa9919c038 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:48.071403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cfa8457e-4f4a-4ea0-a3d4-66d0daef67e6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:48.080397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cfa8457e-4f4a-4ea0-a3d4-66d0daef67e6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156787 Jul 26 18:48:48.081214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1368/2762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:47 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:48.199157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ac90f010-2b94-4a98-b0dd-f9aa9919c038 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:48.208165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ac90f010-2b94-4a98-b0dd-f9aa9919c038 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:48.209682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ac90f010-2b94-4a98-b0dd-f9aa9919c038 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:48.210848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ac90f010-2b94-4a98-b0dd-f9aa9919c038 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.154590 Jul 26 18:48:48.211420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1395/2763] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:48:48.375875 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-98d91e21-4557-4ae8-b4c3-962c76e75383 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:48.376826 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-98d91e21-4557-4ae8-b4c3-962c76e75383 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:48.386863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98d91e21-4557-4ae8-b4c3-962c76e75383 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:48.387656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98d91e21-4557-4ae8-b4c3-962c76e75383 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:48.388884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98d91e21-4557-4ae8-b4c3-962c76e75383 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:48.389597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-98d91e21-4557-4ae8-b4c3-962c76e75383 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:48.531987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-98d91e21-4557-4ae8-b4c3-962c76e75383 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:48.540172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-98d91e21-4557-4ae8-b4c3-962c76e75383 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.171180 Jul 26 18:48:48.540751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1369/2764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:48 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:49.046058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-806944c7-b7a5-4d79-a35d-d84ad0f003ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:49.046634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-806944c7-b7a5-4d79-a35d-d84ad0f003ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:49.053629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-806944c7-b7a5-4d79-a35d-d84ad0f003ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:49.054041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-806944c7-b7a5-4d79-a35d-d84ad0f003ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:49.054818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-806944c7-b7a5-4d79-a35d-d84ad0f003ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:49.055281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-806944c7-b7a5-4d79-a35d-d84ad0f003ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:49.101183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3e390a50-c60a-4538-b496-dccc0ebc469e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:49.101796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3e390a50-c60a-4538-b496-dccc0ebc469e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:49.108634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3e390a50-c60a-4538-b496-dccc0ebc469e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:49.109079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3e390a50-c60a-4538-b496-dccc0ebc469e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:49.109832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3e390a50-c60a-4538-b496-dccc0ebc469e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:49.110263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3e390a50-c60a-4538-b496-dccc0ebc469e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:49.189279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-806944c7-b7a5-4d79-a35d-d84ad0f003ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:49.199838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-806944c7-b7a5-4d79-a35d-d84ad0f003ee tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.157704 Jul 26 18:48:49.200484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1396/2765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:49 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:49.233961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-669d1247-252e-4ae3-a335-463d69e7efb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:49.234568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-669d1247-252e-4ae3-a335-463d69e7efb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:49.240628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-669d1247-252e-4ae3-a335-463d69e7efb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:49.241075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-669d1247-252e-4ae3-a335-463d69e7efb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:49.241830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-669d1247-252e-4ae3-a335-463d69e7efb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:49.242258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-669d1247-252e-4ae3-a335-463d69e7efb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:49.244929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3e390a50-c60a-4538-b496-dccc0ebc469e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:49.254906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3e390a50-c60a-4538-b496-dccc0ebc469e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157598 Jul 26 18:48:49.255768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1370/2766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:49 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:49.384143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-669d1247-252e-4ae3-a335-463d69e7efb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:49.392814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-669d1247-252e-4ae3-a335-463d69e7efb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:49.394322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-669d1247-252e-4ae3-a335-463d69e7efb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:49.395509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-669d1247-252e-4ae3-a335-463d69e7efb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.165629 Jul 26 18:48:49.396066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1397/2767] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:49 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:48:49.562031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-51801eff-da1f-4674-a77d-7f97d0c34d22 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:49.562641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-51801eff-da1f-4674-a77d-7f97d0c34d22 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:49.569129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-51801eff-da1f-4674-a77d-7f97d0c34d22 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:49.569580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-51801eff-da1f-4674-a77d-7f97d0c34d22 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:49.570337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-51801eff-da1f-4674-a77d-7f97d0c34d22 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:49.570760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-51801eff-da1f-4674-a77d-7f97d0c34d22 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:49.719743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-51801eff-da1f-4674-a77d-7f97d0c34d22 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:49.728478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-51801eff-da1f-4674-a77d-7f97d0c34d22 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.170509 Jul 26 18:48:49.729021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1371/2768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:49 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:50.221199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d1b3ef34-7148-4242-a522-33135f7a1160 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:50.221975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d1b3ef34-7148-4242-a522-33135f7a1160 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:50.228445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1b3ef34-7148-4242-a522-33135f7a1160 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:50.228884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1b3ef34-7148-4242-a522-33135f7a1160 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:50.229634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1b3ef34-7148-4242-a522-33135f7a1160 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:50.230061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1b3ef34-7148-4242-a522-33135f7a1160 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:50.276718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b1bfa785-c006-4ec0-9ccf-8c9cdbbd1882 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:50.277369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b1bfa785-c006-4ec0-9ccf-8c9cdbbd1882 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:50.284524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b1bfa785-c006-4ec0-9ccf-8c9cdbbd1882 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:50.284968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b1bfa785-c006-4ec0-9ccf-8c9cdbbd1882 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:50.285735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b1bfa785-c006-4ec0-9ccf-8c9cdbbd1882 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:50.286144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b1bfa785-c006-4ec0-9ccf-8c9cdbbd1882 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:50.363463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d1b3ef34-7148-4242-a522-33135f7a1160 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:50.371721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d1b3ef34-7148-4242-a522-33135f7a1160 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154365 Jul 26 18:48:50.372340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1398/2769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:50 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:50.417706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cac04c81-8efc-497c-9e7f-388f018ee965 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:50.418299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cac04c81-8efc-497c-9e7f-388f018ee965 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:50.419538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b1bfa785-c006-4ec0-9ccf-8c9cdbbd1882 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:50.424551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cac04c81-8efc-497c-9e7f-388f018ee965 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:50.425003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cac04c81-8efc-497c-9e7f-388f018ee965 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:50.425750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cac04c81-8efc-497c-9e7f-388f018ee965 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:50.426175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cac04c81-8efc-497c-9e7f-388f018ee965 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:50.427958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b1bfa785-c006-4ec0-9ccf-8c9cdbbd1882 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155616 Jul 26 18:48:50.428566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1372/2770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:50 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:50.560639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cac04c81-8efc-497c-9e7f-388f018ee965 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:50.569269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cac04c81-8efc-497c-9e7f-388f018ee965 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:50.570745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cac04c81-8efc-497c-9e7f-388f018ee965 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:50.571950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cac04c81-8efc-497c-9e7f-388f018ee965 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158169 Jul 26 18:48:50.572503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1399/2771] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:50 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:48:50.753900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fdfa48ce-c29b-4af3-ac96-bd54b8a24e96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:50.754834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fdfa48ce-c29b-4af3-ac96-bd54b8a24e96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:50.764188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdfa48ce-c29b-4af3-ac96-bd54b8a24e96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:50.764638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdfa48ce-c29b-4af3-ac96-bd54b8a24e96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:50.765389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdfa48ce-c29b-4af3-ac96-bd54b8a24e96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:50.765829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fdfa48ce-c29b-4af3-ac96-bd54b8a24e96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:50.897426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fdfa48ce-c29b-4af3-ac96-bd54b8a24e96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:50.909926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fdfa48ce-c29b-4af3-ac96-bd54b8a24e96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.162323 Jul 26 18:48:50.910646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1373/2772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:50 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:51.393466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bf8af18e-6ef2-47ed-883e-7c049286e86e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:51.394061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bf8af18e-6ef2-47ed-883e-7c049286e86e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:51.402137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf8af18e-6ef2-47ed-883e-7c049286e86e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:51.402395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf8af18e-6ef2-47ed-883e-7c049286e86e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:51.403458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf8af18e-6ef2-47ed-883e-7c049286e86e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:51.404065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf8af18e-6ef2-47ed-883e-7c049286e86e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:51.449704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4bcdeb43-b623-4569-be53-5e0e0ecb9cae tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:51.450416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4bcdeb43-b623-4569-be53-5e0e0ecb9cae tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:51.457149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bcdeb43-b623-4569-be53-5e0e0ecb9cae tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:51.457634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bcdeb43-b623-4569-be53-5e0e0ecb9cae tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:51.458378 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bcdeb43-b623-4569-be53-5e0e0ecb9cae tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:51.458796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bcdeb43-b623-4569-be53-5e0e0ecb9cae tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:51.534584 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bf8af18e-6ef2-47ed-883e-7c049286e86e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:51.542786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bf8af18e-6ef2-47ed-883e-7c049286e86e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.153217 Jul 26 18:48:51.543423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1400/2773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:51 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:51.588379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4bcdeb43-b623-4569-be53-5e0e0ecb9cae tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:51.596804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4bcdeb43-b623-4569-be53-5e0e0ecb9cae tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151027 Jul 26 18:48:51.597353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1374/2774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:51 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:51.601715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3bb31327-c79e-428c-8f23-7f41ab250e91 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:51.602325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3bb31327-c79e-428c-8f23-7f41ab250e91 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:51.608691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3bb31327-c79e-428c-8f23-7f41ab250e91 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:51.609140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3bb31327-c79e-428c-8f23-7f41ab250e91 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:51.609879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3bb31327-c79e-428c-8f23-7f41ab250e91 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:51.610328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3bb31327-c79e-428c-8f23-7f41ab250e91 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:51.742281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3bb31327-c79e-428c-8f23-7f41ab250e91 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:51.751314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3bb31327-c79e-428c-8f23-7f41ab250e91 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:51.752854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3bb31327-c79e-428c-8f23-7f41ab250e91 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:51.754022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3bb31327-c79e-428c-8f23-7f41ab250e91 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156224 Jul 26 18:48:51.754589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1401/2775] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:48:51.934220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a326d4d7-7b33-4706-a9e0-f0fb48533ae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:51.934956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a326d4d7-7b33-4706-a9e0-f0fb48533ae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:51.941420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a326d4d7-7b33-4706-a9e0-f0fb48533ae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:51.941871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a326d4d7-7b33-4706-a9e0-f0fb48533ae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:51.942626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a326d4d7-7b33-4706-a9e0-f0fb48533ae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:51.943071 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a326d4d7-7b33-4706-a9e0-f0fb48533ae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:52.075546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a326d4d7-7b33-4706-a9e0-f0fb48533ae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:52.084245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a326d4d7-7b33-4706-a9e0-f0fb48533ae7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156145 Jul 26 18:48:52.084821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1375/2776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:51 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:52.568022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a66d5fb6-8d0e-432c-8a7b-351a9695c13a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:52.568726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a66d5fb6-8d0e-432c-8a7b-351a9695c13a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:52.575965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a66d5fb6-8d0e-432c-8a7b-351a9695c13a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:52.576351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a66d5fb6-8d0e-432c-8a7b-351a9695c13a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:52.577380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a66d5fb6-8d0e-432c-8a7b-351a9695c13a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:52.578002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a66d5fb6-8d0e-432c-8a7b-351a9695c13a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:52.618657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1a40d2be-dd72-4762-92ec-bdb6d27331f9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:52.619281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1a40d2be-dd72-4762-92ec-bdb6d27331f9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:52.626340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a40d2be-dd72-4762-92ec-bdb6d27331f9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:52.626805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a40d2be-dd72-4762-92ec-bdb6d27331f9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:52.627588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a40d2be-dd72-4762-92ec-bdb6d27331f9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:52.628025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1a40d2be-dd72-4762-92ec-bdb6d27331f9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:52.719681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a66d5fb6-8d0e-432c-8a7b-351a9695c13a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:52.728119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a66d5fb6-8d0e-432c-8a7b-351a9695c13a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.166162 Jul 26 18:48:52.728717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1402/2777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:52 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:52.765248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1a40d2be-dd72-4762-92ec-bdb6d27331f9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:52.773731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1a40d2be-dd72-4762-92ec-bdb6d27331f9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.158944 Jul 26 18:48:52.774264 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1376/2778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:52 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:52.777485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aef155bd-b552-46d7-99a8-e635b9612a35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:52.778239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aef155bd-b552-46d7-99a8-e635b9612a35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:52.784784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aef155bd-b552-46d7-99a8-e635b9612a35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:52.785253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aef155bd-b552-46d7-99a8-e635b9612a35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:52.786167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aef155bd-b552-46d7-99a8-e635b9612a35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:52.786855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aef155bd-b552-46d7-99a8-e635b9612a35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:52.939187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-aef155bd-b552-46d7-99a8-e635b9612a35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:52.948391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-aef155bd-b552-46d7-99a8-e635b9612a35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:52.949941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-aef155bd-b552-46d7-99a8-e635b9612a35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:52.951118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aef155bd-b552-46d7-99a8-e635b9612a35 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.177544 Jul 26 18:48:52.951681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1403/2779] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:53.106150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-84a0b7b7-b8af-4236-886f-9db24af8136d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:53.106789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-84a0b7b7-b8af-4236-886f-9db24af8136d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:53.113522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84a0b7b7-b8af-4236-886f-9db24af8136d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:53.113968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84a0b7b7-b8af-4236-886f-9db24af8136d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:53.114724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84a0b7b7-b8af-4236-886f-9db24af8136d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:53.115196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84a0b7b7-b8af-4236-886f-9db24af8136d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:53.259673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-84a0b7b7-b8af-4236-886f-9db24af8136d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:53.268641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-84a0b7b7-b8af-4236-886f-9db24af8136d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.166468 Jul 26 18:48:53.269195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1377/2780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:53 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:53.754077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-faf88008-6c24-4560-b5a2-712118d2f571 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:53.754817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-faf88008-6c24-4560-b5a2-712118d2f571 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:53.764435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-faf88008-6c24-4560-b5a2-712118d2f571 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:53.764877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-faf88008-6c24-4560-b5a2-712118d2f571 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:53.765622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-faf88008-6c24-4560-b5a2-712118d2f571 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:53.766049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-faf88008-6c24-4560-b5a2-712118d2f571 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:53.795015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0ea41eae-1b39-4294-8766-42ad6dc553f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:53.795634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0ea41eae-1b39-4294-8766-42ad6dc553f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:53.802538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ea41eae-1b39-4294-8766-42ad6dc553f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:53.802958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ea41eae-1b39-4294-8766-42ad6dc553f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:53.803782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ea41eae-1b39-4294-8766-42ad6dc553f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:53.804213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ea41eae-1b39-4294-8766-42ad6dc553f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:53.905156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-faf88008-6c24-4560-b5a2-712118d2f571 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:53.913172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-faf88008-6c24-4560-b5a2-712118d2f571 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.166089 Jul 26 18:48:53.913750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1404/2781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:53 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:53.934468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0ea41eae-1b39-4294-8766-42ad6dc553f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:53.942518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0ea41eae-1b39-4294-8766-42ad6dc553f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151453 Jul 26 18:48:53.943113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1378/2782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:53 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:53.976731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4cddf3b4-8d16-4072-bc77-e20c0ffe8af9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:53.977380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4cddf3b4-8d16-4072-bc77-e20c0ffe8af9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:53.983588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4cddf3b4-8d16-4072-bc77-e20c0ffe8af9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:53.984032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4cddf3b4-8d16-4072-bc77-e20c0ffe8af9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:53.984785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4cddf3b4-8d16-4072-bc77-e20c0ffe8af9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:53.985220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4cddf3b4-8d16-4072-bc77-e20c0ffe8af9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:54.136693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4cddf3b4-8d16-4072-bc77-e20c0ffe8af9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:54.150896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4cddf3b4-8d16-4072-bc77-e20c0ffe8af9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:54.153356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4cddf3b4-8d16-4072-bc77-e20c0ffe8af9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:54.154493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4cddf3b4-8d16-4072-bc77-e20c0ffe8af9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.181639 Jul 26 18:48:54.155261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1405/2783] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:54.295059 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d8940444-a8ab-4e93-adcd-c3933e005dd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:54.296050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d8940444-a8ab-4e93-adcd-c3933e005dd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:54.306109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8940444-a8ab-4e93-adcd-c3933e005dd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:54.306843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8940444-a8ab-4e93-adcd-c3933e005dd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:54.308133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8940444-a8ab-4e93-adcd-c3933e005dd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:54.308841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8940444-a8ab-4e93-adcd-c3933e005dd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:54.454919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d8940444-a8ab-4e93-adcd-c3933e005dd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:54.457201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:54.464302 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d8940444-a8ab-4e93-adcd-c3933e005dd3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.175781 Jul 26 18:48:54.464861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1379/2784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:54 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:54.938111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-73d1c970-f064-408e-ad3a-8f16e0a990f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:54.939109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-73d1c970-f064-408e-ad3a-8f16e0a990f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:54.950142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73d1c970-f064-408e-ad3a-8f16e0a990f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:54.950880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73d1c970-f064-408e-ad3a-8f16e0a990f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:54.952192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73d1c970-f064-408e-ad3a-8f16e0a990f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:54.952882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73d1c970-f064-408e-ad3a-8f16e0a990f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:54.966944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9acded42-14f9-4655-a6df-b272aad1d71a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:54.967592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9acded42-14f9-4655-a6df-b272aad1d71a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:54.974989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9acded42-14f9-4655-a6df-b272aad1d71a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:54.975465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9acded42-14f9-4655-a6df-b272aad1d71a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:54.976229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9acded42-14f9-4655-a6df-b272aad1d71a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:54.976682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9acded42-14f9-4655-a6df-b272aad1d71a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:55.087625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-73d1c970-f064-408e-ad3a-8f16e0a990f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:55.095650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-73d1c970-f064-408e-ad3a-8f16e0a990f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164211 Jul 26 18:48:55.096260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1406/2785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:55.106733 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9acded42-14f9-4655-a6df-b272aad1d71a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:55.114878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9acded42-14f9-4655-a6df-b272aad1d71a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153929 Jul 26 18:48:55.115482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1380/2786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:54 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:55.180748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7a8f19ac-86ef-45d0-82ce-608a17f05318 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:55.181740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7a8f19ac-86ef-45d0-82ce-608a17f05318 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:55.191937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a8f19ac-86ef-45d0-82ce-608a17f05318 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:55.192677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a8f19ac-86ef-45d0-82ce-608a17f05318 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:55.193935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a8f19ac-86ef-45d0-82ce-608a17f05318 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:55.194647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a8f19ac-86ef-45d0-82ce-608a17f05318 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:55.211461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:48:55.334508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7a8f19ac-86ef-45d0-82ce-608a17f05318 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:55.351558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7a8f19ac-86ef-45d0-82ce-608a17f05318 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:55.353989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7a8f19ac-86ef-45d0-82ce-608a17f05318 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:55.355796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7a8f19ac-86ef-45d0-82ce-608a17f05318 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.181316 Jul 26 18:48:55.357093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1407/2787] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:55 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:55.487472 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8d42c66d-2d57-4986-8088-c81542906d61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:55.488197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8d42c66d-2d57-4986-8088-c81542906d61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:55.494997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d42c66d-2d57-4986-8088-c81542906d61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:55.495469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d42c66d-2d57-4986-8088-c81542906d61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:55.496216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d42c66d-2d57-4986-8088-c81542906d61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:55.496643 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d42c66d-2d57-4986-8088-c81542906d61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:55.625504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8d42c66d-2d57-4986-8088-c81542906d61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:55.633563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8d42c66d-2d57-4986-8088-c81542906d61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150328 Jul 26 18:48:55.634129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1381/2788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:55 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:56.121624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a87e648e-8f2e-4b83-927e-3431cfc9eceb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:56.122436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a87e648e-8f2e-4b83-927e-3431cfc9eceb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:56.133448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a87e648e-8f2e-4b83-927e-3431cfc9eceb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:56.134188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a87e648e-8f2e-4b83-927e-3431cfc9eceb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:56.135500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a87e648e-8f2e-4b83-927e-3431cfc9eceb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:56.136221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a87e648e-8f2e-4b83-927e-3431cfc9eceb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:56.139053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-84e83e28-c49c-4370-835e-86773f6dd7ba tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:56.139610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-84e83e28-c49c-4370-835e-86773f6dd7ba tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:56.146363 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84e83e28-c49c-4370-835e-86773f6dd7ba tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:56.146776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84e83e28-c49c-4370-835e-86773f6dd7ba tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:56.147878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84e83e28-c49c-4370-835e-86773f6dd7ba tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:56.148446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84e83e28-c49c-4370-835e-86773f6dd7ba tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:56.264997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a87e648e-8f2e-4b83-927e-3431cfc9eceb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:56.273549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a87e648e-8f2e-4b83-927e-3431cfc9eceb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158569 Jul 26 18:48:56.274122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1408/2789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:56 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:56.279303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-84e83e28-c49c-4370-835e-86773f6dd7ba tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:56.287780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-84e83e28-c49c-4370-835e-86773f6dd7ba tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154379 Jul 26 18:48:56.288380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1382/2790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:56 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:56.384396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-092a28b6-e1f0-4102-bf33-a35521aae70f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:56.385273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-092a28b6-e1f0-4102-bf33-a35521aae70f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:56.395622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-092a28b6-e1f0-4102-bf33-a35521aae70f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:56.396356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-092a28b6-e1f0-4102-bf33-a35521aae70f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:56.397871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-092a28b6-e1f0-4102-bf33-a35521aae70f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:56.398627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-092a28b6-e1f0-4102-bf33-a35521aae70f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:56.539064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-092a28b6-e1f0-4102-bf33-a35521aae70f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:56.552087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-092a28b6-e1f0-4102-bf33-a35521aae70f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:56.554356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-092a28b6-e1f0-4102-bf33-a35521aae70f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:56.556053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-092a28b6-e1f0-4102-bf33-a35521aae70f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.177971 Jul 26 18:48:56.556828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1409/2791] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:56 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:56.655628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0a5aa81b-432b-4350-af00-caa5c98673f5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:56.656319 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0a5aa81b-432b-4350-af00-caa5c98673f5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:56.662395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a5aa81b-432b-4350-af00-caa5c98673f5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:56.662842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a5aa81b-432b-4350-af00-caa5c98673f5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:56.663652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a5aa81b-432b-4350-af00-caa5c98673f5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:56.664085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a5aa81b-432b-4350-af00-caa5c98673f5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:56.792353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0a5aa81b-432b-4350-af00-caa5c98673f5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:56.800897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0a5aa81b-432b-4350-af00-caa5c98673f5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.149615 Jul 26 18:48:56.801460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1383/2792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:56 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:57.298419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f7b58568-2bac-48bd-ad6a-7101d28eb1f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:57.299633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f7b58568-2bac-48bd-ad6a-7101d28eb1f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:57.308780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:48:57.309249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 18:48:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 (ip 10.222.0.27) !!! Jul 26 18:48:57.311462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7b58568-2bac-48bd-ad6a-7101d28eb1f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:57.312242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-43dca09d-807f-4634-b79f-d6e44588c601 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:57.314394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7b58568-2bac-48bd-ad6a-7101d28eb1f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:57.314500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-43dca09d-807f-4634-b79f-d6e44588c601 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:57.314601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7b58568-2bac-48bd-ad6a-7101d28eb1f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:57.314601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7b58568-2bac-48bd-ad6a-7101d28eb1f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:57.318680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43dca09d-807f-4634-b79f-d6e44588c601 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:57.319157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43dca09d-807f-4634-b79f-d6e44588c601 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:57.319907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43dca09d-807f-4634-b79f-d6e44588c601 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:57.320334 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43dca09d-807f-4634-b79f-d6e44588c601 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:57.456574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f7b58568-2bac-48bd-ad6a-7101d28eb1f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:57.465365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f7b58568-2bac-48bd-ad6a-7101d28eb1f2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.173353 Jul 26 18:48:57.466006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1410/2793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:57 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:57.580429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-728fe02b-0b93-4095-8e18-78e6ebc906c1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:57.581122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-728fe02b-0b93-4095-8e18-78e6ebc906c1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:57.587849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-728fe02b-0b93-4095-8e18-78e6ebc906c1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:57.588291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-728fe02b-0b93-4095-8e18-78e6ebc906c1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:57.589054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-728fe02b-0b93-4095-8e18-78e6ebc906c1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:57.589476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-728fe02b-0b93-4095-8e18-78e6ebc906c1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:57.688320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-43dca09d-807f-4634-b79f-d6e44588c601 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:57.697401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-43dca09d-807f-4634-b79f-d6e44588c601 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.391213 Jul 26 18:48:57.697970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1384/2794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:57 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:57.727640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-728fe02b-0b93-4095-8e18-78e6ebc906c1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:57.736079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-728fe02b-0b93-4095-8e18-78e6ebc906c1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:57.737667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-728fe02b-0b93-4095-8e18-78e6ebc906c1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:57.738811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-728fe02b-0b93-4095-8e18-78e6ebc906c1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162475 Jul 26 18:48:57.739413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1411/2795] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:57 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:57.826471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-24989396-f8e7-4407-a4c8-ffdfbe34e4fb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:57.827505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-24989396-f8e7-4407-a4c8-ffdfbe34e4fb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:57.837708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24989396-f8e7-4407-a4c8-ffdfbe34e4fb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:57.838335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24989396-f8e7-4407-a4c8-ffdfbe34e4fb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:57.839629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24989396-f8e7-4407-a4c8-ffdfbe34e4fb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:57.840492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24989396-f8e7-4407-a4c8-ffdfbe34e4fb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:57.968703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-24989396-f8e7-4407-a4c8-ffdfbe34e4fb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:57.977310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-24989396-f8e7-4407-a4c8-ffdfbe34e4fb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157387 Jul 26 18:48:57.977885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1385/2796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:57 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:58.491465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-798270d3-ea30-4d9f-a140-10c527ebed94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:58.492438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-798270d3-ea30-4d9f-a140-10c527ebed94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:58.504101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-798270d3-ea30-4d9f-a140-10c527ebed94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:58.504850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-798270d3-ea30-4d9f-a140-10c527ebed94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:58.506100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-798270d3-ea30-4d9f-a140-10c527ebed94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:58.506822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-798270d3-ea30-4d9f-a140-10c527ebed94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:58.654076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-798270d3-ea30-4d9f-a140-10c527ebed94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:58.665337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-798270d3-ea30-4d9f-a140-10c527ebed94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.180164 Jul 26 18:48:58.666075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1412/2797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:58 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:58.719063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eca41ad9-9e50-4016-b23b-52dabe012a3b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:58.719782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eca41ad9-9e50-4016-b23b-52dabe012a3b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:58.729320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eca41ad9-9e50-4016-b23b-52dabe012a3b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:58.729762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eca41ad9-9e50-4016-b23b-52dabe012a3b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:58.730519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eca41ad9-9e50-4016-b23b-52dabe012a3b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:58.731224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eca41ad9-9e50-4016-b23b-52dabe012a3b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:58.771867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-99669472-1402-4dc5-ab71-8ab7491a1014 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:58.773224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-99669472-1402-4dc5-ab71-8ab7491a1014 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:58.779795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-99669472-1402-4dc5-ab71-8ab7491a1014 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:58.780384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-99669472-1402-4dc5-ab71-8ab7491a1014 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:58.781323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-99669472-1402-4dc5-ab71-8ab7491a1014 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:58.781862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-99669472-1402-4dc5-ab71-8ab7491a1014 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:58.878783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eca41ad9-9e50-4016-b23b-52dabe012a3b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:58.886911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eca41ad9-9e50-4016-b23b-52dabe012a3b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.171762 Jul 26 18:48:58.887519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1386/2798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:58 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:58.916404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-99669472-1402-4dc5-ab71-8ab7491a1014 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:58.924901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-99669472-1402-4dc5-ab71-8ab7491a1014 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:58.926465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-99669472-1402-4dc5-ab71-8ab7491a1014 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:58.927640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-99669472-1402-4dc5-ab71-8ab7491a1014 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159821 Jul 26 18:48:58.928173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1413/2799] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:48:59.002841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-50b0c63f-3778-4ba5-81c8-70a796b6a523 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:59.003880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-50b0c63f-3778-4ba5-81c8-70a796b6a523 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:59.013388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50b0c63f-3778-4ba5-81c8-70a796b6a523 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:59.013921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50b0c63f-3778-4ba5-81c8-70a796b6a523 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:59.014673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50b0c63f-3778-4ba5-81c8-70a796b6a523 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:59.015158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50b0c63f-3778-4ba5-81c8-70a796b6a523 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:59.171246 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-50b0c63f-3778-4ba5-81c8-70a796b6a523 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:59.181564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-50b0c63f-3778-4ba5-81c8-70a796b6a523 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.184984 Jul 26 18:48:59.182362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1387/2800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:58 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:59.697817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d0b98f75-3cec-4c3c-955a-33836e21a7f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:59.698805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d0b98f75-3cec-4c3c-955a-33836e21a7f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:59.706138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0b98f75-3cec-4c3c-955a-33836e21a7f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:59.706576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0b98f75-3cec-4c3c-955a-33836e21a7f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:59.707360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0b98f75-3cec-4c3c-955a-33836e21a7f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:59.707787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0b98f75-3cec-4c3c-955a-33836e21a7f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:59.844234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d0b98f75-3cec-4c3c-955a-33836e21a7f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:48:59.852567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d0b98f75-3cec-4c3c-955a-33836e21a7f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161331 Jul 26 18:48:59.853417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1414/2801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:59 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:48:59.907961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-988d4acc-298e-4356-bb14-3eebae2a80c1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:59.908519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-988d4acc-298e-4356-bb14-3eebae2a80c1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:59.915326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-988d4acc-298e-4356-bb14-3eebae2a80c1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:59.915774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-988d4acc-298e-4356-bb14-3eebae2a80c1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:59.916545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-988d4acc-298e-4356-bb14-3eebae2a80c1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:59.916976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-988d4acc-298e-4356-bb14-3eebae2a80c1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:59.956392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6778dd8b-fed5-4956-a634-56b4e1a6dfa6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:48:59.956926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6778dd8b-fed5-4956-a634-56b4e1a6dfa6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:48:59.963349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6778dd8b-fed5-4956-a634-56b4e1a6dfa6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:59.963923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6778dd8b-fed5-4956-a634-56b4e1a6dfa6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:48:59.964697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6778dd8b-fed5-4956-a634-56b4e1a6dfa6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:48:59.965128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6778dd8b-fed5-4956-a634-56b4e1a6dfa6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:00.050612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-988d4acc-298e-4356-bb14-3eebae2a80c1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:00.058823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-988d4acc-298e-4356-bb14-3eebae2a80c1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154729 Jul 26 18:49:00.059478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1388/2802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:48:59 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:00.095589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6778dd8b-fed5-4956-a634-56b4e1a6dfa6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:00.104368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6778dd8b-fed5-4956-a634-56b4e1a6dfa6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:00.106161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6778dd8b-fed5-4956-a634-56b4e1a6dfa6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:00.107361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6778dd8b-fed5-4956-a634-56b4e1a6dfa6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.154930 Jul 26 18:49:00.107911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1415/2803] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:48:59 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:00.210485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-63c51fec-3337-408a-be67-18950babaa57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:00.211078 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-63c51fec-3337-408a-be67-18950babaa57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:00.218033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63c51fec-3337-408a-be67-18950babaa57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:00.218483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63c51fec-3337-408a-be67-18950babaa57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:00.219277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63c51fec-3337-408a-be67-18950babaa57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:00.219709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-63c51fec-3337-408a-be67-18950babaa57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:00.357253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-63c51fec-3337-408a-be67-18950babaa57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:00.369755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-63c51fec-3337-408a-be67-18950babaa57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.163130 Jul 26 18:49:00.370528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1389/2804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:00 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:00.874008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aada5127-13f1-41d1-bffa-b07bcaa386c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:00.874607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aada5127-13f1-41d1-bffa-b07bcaa386c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:00.882264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aada5127-13f1-41d1-bffa-b07bcaa386c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:00.883001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aada5127-13f1-41d1-bffa-b07bcaa386c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:00.883790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aada5127-13f1-41d1-bffa-b07bcaa386c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:00.884223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aada5127-13f1-41d1-bffa-b07bcaa386c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:01.018029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-aada5127-13f1-41d1-bffa-b07bcaa386c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:01.026688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aada5127-13f1-41d1-bffa-b07bcaa386c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156713 Jul 26 18:49:01.027303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1416/2805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:00 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:01.082754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-41965f6e-301e-4331-905e-04aa94311b77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:01.083636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-41965f6e-301e-4331-905e-04aa94311b77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:01.092579 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41965f6e-301e-4331-905e-04aa94311b77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:01.093027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41965f6e-301e-4331-905e-04aa94311b77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:01.093776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41965f6e-301e-4331-905e-04aa94311b77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:01.094200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41965f6e-301e-4331-905e-04aa94311b77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:01.129896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fefed12c-e9e7-43b8-8fab-4184bbc20a10 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:01.130594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fefed12c-e9e7-43b8-8fab-4184bbc20a10 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:01.136967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fefed12c-e9e7-43b8-8fab-4184bbc20a10 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:01.137499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fefed12c-e9e7-43b8-8fab-4184bbc20a10 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:01.138371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fefed12c-e9e7-43b8-8fab-4184bbc20a10 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:01.138813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fefed12c-e9e7-43b8-8fab-4184bbc20a10 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:01.239424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-41965f6e-301e-4331-905e-04aa94311b77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:01.247972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-41965f6e-301e-4331-905e-04aa94311b77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.170982 Jul 26 18:49:01.248551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1390/2806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:01 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:01.274162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fefed12c-e9e7-43b8-8fab-4184bbc20a10 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:01.282703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fefed12c-e9e7-43b8-8fab-4184bbc20a10 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:01.284241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fefed12c-e9e7-43b8-8fab-4184bbc20a10 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:01.285391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fefed12c-e9e7-43b8-8fab-4184bbc20a10 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159549 Jul 26 18:49:01.285943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1417/2807] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:01 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:01.394335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fbf27b95-a077-4d08-88ef-3be90bf7a838 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:01.395057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fbf27b95-a077-4d08-88ef-3be90bf7a838 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:01.402995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf27b95-a077-4d08-88ef-3be90bf7a838 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:01.403584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf27b95-a077-4d08-88ef-3be90bf7a838 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:01.404470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf27b95-a077-4d08-88ef-3be90bf7a838 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:01.405490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fbf27b95-a077-4d08-88ef-3be90bf7a838 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:01.551069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fbf27b95-a077-4d08-88ef-3be90bf7a838 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:01.561515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fbf27b95-a077-4d08-88ef-3be90bf7a838 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.171788 Jul 26 18:49:01.562053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1391/2808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:01 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:02.049801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d86077a6-8ab1-4215-ae61-ec034bcd2368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:02.050618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d86077a6-8ab1-4215-ae61-ec034bcd2368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:02.059495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d86077a6-8ab1-4215-ae61-ec034bcd2368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:02.060068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d86077a6-8ab1-4215-ae61-ec034bcd2368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:02.061103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d86077a6-8ab1-4215-ae61-ec034bcd2368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:02.061712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d86077a6-8ab1-4215-ae61-ec034bcd2368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:02.192724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d86077a6-8ab1-4215-ae61-ec034bcd2368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:02.201367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d86077a6-8ab1-4215-ae61-ec034bcd2368 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156791 Jul 26 18:49:02.201945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1418/2809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:02 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:02.272436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0a5becef-6bdb-4a76-a488-678f91b3b31a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:02.273703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0a5becef-6bdb-4a76-a488-678f91b3b31a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:02.284672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a5becef-6bdb-4a76-a488-678f91b3b31a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:02.285405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a5becef-6bdb-4a76-a488-678f91b3b31a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:02.286639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a5becef-6bdb-4a76-a488-678f91b3b31a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:02.287414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a5becef-6bdb-4a76-a488-678f91b3b31a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:02.425637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0a5becef-6bdb-4a76-a488-678f91b3b31a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:02.433864 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0a5becef-6bdb-4a76-a488-678f91b3b31a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.167818 Jul 26 18:49:02.434461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1392/2810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:02 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:02.450157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e81a1cda-fd03-464e-b64e-0d9954e08c20 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:02.451356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e81a1cda-fd03-464e-b64e-0d9954e08c20 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:02.459785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e81a1cda-fd03-464e-b64e-0d9954e08c20 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:02.460234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e81a1cda-fd03-464e-b64e-0d9954e08c20 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:02.460996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e81a1cda-fd03-464e-b64e-0d9954e08c20 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:02.461438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e81a1cda-fd03-464e-b64e-0d9954e08c20 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:02.583515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-69b44114-92c7-4d67-82c9-4a04f662d53e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:02.584125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-69b44114-92c7-4d67-82c9-4a04f662d53e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:02.590738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69b44114-92c7-4d67-82c9-4a04f662d53e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:02.591219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69b44114-92c7-4d67-82c9-4a04f662d53e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:02.591971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69b44114-92c7-4d67-82c9-4a04f662d53e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:02.592372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69b44114-92c7-4d67-82c9-4a04f662d53e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:02.602691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e81a1cda-fd03-464e-b64e-0d9954e08c20 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:02.611842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e81a1cda-fd03-464e-b64e-0d9954e08c20 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:02.613302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e81a1cda-fd03-464e-b64e-0d9954e08c20 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:02.614479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e81a1cda-fd03-464e-b64e-0d9954e08c20 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.309272 Jul 26 18:49:02.615064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1419/2811] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:02 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:02.734424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-69b44114-92c7-4d67-82c9-4a04f662d53e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:02.744679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-69b44114-92c7-4d67-82c9-4a04f662d53e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.165429 Jul 26 18:49:02.745213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1393/2812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:02 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:03.226637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-be4165a1-b210-4be4-9787-9087356a4085 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:03.227691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-be4165a1-b210-4be4-9787-9087356a4085 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:03.237764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be4165a1-b210-4be4-9787-9087356a4085 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:03.238507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be4165a1-b210-4be4-9787-9087356a4085 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:03.239824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be4165a1-b210-4be4-9787-9087356a4085 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:03.240541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be4165a1-b210-4be4-9787-9087356a4085 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:03.375097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-be4165a1-b210-4be4-9787-9087356a4085 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:03.383436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-be4165a1-b210-4be4-9787-9087356a4085 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163483 Jul 26 18:49:03.384038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1420/2813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:03 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:03.458720 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cfc19b79-d6b2-40c5-95c8-5be44697d30d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:03.459701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cfc19b79-d6b2-40c5-95c8-5be44697d30d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:03.470841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfc19b79-d6b2-40c5-95c8-5be44697d30d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:03.471653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfc19b79-d6b2-40c5-95c8-5be44697d30d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:03.472892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfc19b79-d6b2-40c5-95c8-5be44697d30d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:03.473603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfc19b79-d6b2-40c5-95c8-5be44697d30d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:03.618802 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cfc19b79-d6b2-40c5-95c8-5be44697d30d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:03.631307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cfc19b79-d6b2-40c5-95c8-5be44697d30d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.178673 Jul 26 18:49:03.631878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1394/2814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:03 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:03.637996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9d2b0edb-b668-4592-ba98-2a1da96da644 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:03.638623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9d2b0edb-b668-4592-ba98-2a1da96da644 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:03.644779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d2b0edb-b668-4592-ba98-2a1da96da644 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:03.645280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d2b0edb-b668-4592-ba98-2a1da96da644 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:03.646023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d2b0edb-b668-4592-ba98-2a1da96da644 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:03.646471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d2b0edb-b668-4592-ba98-2a1da96da644 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:03.772095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1f372636-d91a-4b6f-8949-8ce9bc991872 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:03.773019 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1f372636-d91a-4b6f-8949-8ce9bc991872 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:03.779156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f372636-d91a-4b6f-8949-8ce9bc991872 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:03.779580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f372636-d91a-4b6f-8949-8ce9bc991872 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:03.780324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f372636-d91a-4b6f-8949-8ce9bc991872 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:03.780749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1f372636-d91a-4b6f-8949-8ce9bc991872 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:03.784206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9d2b0edb-b668-4592-ba98-2a1da96da644 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:03.793164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9d2b0edb-b668-4592-ba98-2a1da96da644 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:03.794835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9d2b0edb-b668-4592-ba98-2a1da96da644 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:03.796020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9d2b0edb-b668-4592-ba98-2a1da96da644 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162000 Jul 26 18:49:03.796603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1421/2815] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:03 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:03.916915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1f372636-d91a-4b6f-8949-8ce9bc991872 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:03.929912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1f372636-d91a-4b6f-8949-8ce9bc991872 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161465 Jul 26 18:49:03.930707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1395/2816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:03 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:04.409209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-27654e41-5166-4410-912a-c03e4d574df8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:04.410128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-27654e41-5166-4410-912a-c03e4d574df8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:04.420103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27654e41-5166-4410-912a-c03e4d574df8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:04.420545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27654e41-5166-4410-912a-c03e4d574df8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:04.421294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27654e41-5166-4410-912a-c03e4d574df8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:04.421715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27654e41-5166-4410-912a-c03e4d574df8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:04.564725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-27654e41-5166-4410-912a-c03e4d574df8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:04.573351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-27654e41-5166-4410-912a-c03e4d574df8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.170745 Jul 26 18:49:04.573924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1422/2817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:04 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:04.653317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-67d19efd-0c4b-4d8b-a4f5-df058515bd23 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:04.653874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-67d19efd-0c4b-4d8b-a4f5-df058515bd23 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:04.660878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-67d19efd-0c4b-4d8b-a4f5-df058515bd23 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:04.661266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-67d19efd-0c4b-4d8b-a4f5-df058515bd23 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:04.662035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-67d19efd-0c4b-4d8b-a4f5-df058515bd23 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:04.662464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-67d19efd-0c4b-4d8b-a4f5-df058515bd23 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:04.679866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:04.802353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-67d19efd-0c4b-4d8b-a4f5-df058515bd23 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:04.810693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-67d19efd-0c4b-4d8b-a4f5-df058515bd23 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161410 Jul 26 18:49:04.811304 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1396/2818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:04 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:04.819274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5038e874-f876-4e1d-84e2-85608ea26571 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:04.819877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5038e874-f876-4e1d-84e2-85608ea26571 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:04.826066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5038e874-f876-4e1d-84e2-85608ea26571 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:04.826505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5038e874-f876-4e1d-84e2-85608ea26571 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:04.827273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5038e874-f876-4e1d-84e2-85608ea26571 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:04.827699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5038e874-f876-4e1d-84e2-85608ea26571 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:04.954030 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-033e3ce0-4c1a-465a-9a7d-08c8ed88617f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:04.954630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-033e3ce0-4c1a-465a-9a7d-08c8ed88617f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:04.961027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-033e3ce0-4c1a-465a-9a7d-08c8ed88617f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:04.961719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-033e3ce0-4c1a-465a-9a7d-08c8ed88617f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:04.962475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-033e3ce0-4c1a-465a-9a7d-08c8ed88617f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:04.962899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-033e3ce0-4c1a-465a-9a7d-08c8ed88617f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:04.968613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5038e874-f876-4e1d-84e2-85608ea26571 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:04.977458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5038e874-f876-4e1d-84e2-85608ea26571 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:04.979108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5038e874-f876-4e1d-84e2-85608ea26571 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:04.980353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5038e874-f876-4e1d-84e2-85608ea26571 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.165052 Jul 26 18:49:04.981035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1423/2819] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:04 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:05.090694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-033e3ce0-4c1a-465a-9a7d-08c8ed88617f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:05.098925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-033e3ce0-4c1a-465a-9a7d-08c8ed88617f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.148839 Jul 26 18:49:05.099496 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1397/2820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:04 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:05.605042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5de59c2f-7867-4a6e-a5c9-454cde25df86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:05.606093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5de59c2f-7867-4a6e-a5c9-454cde25df86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:05.617208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5de59c2f-7867-4a6e-a5c9-454cde25df86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:05.617957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5de59c2f-7867-4a6e-a5c9-454cde25df86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:05.619259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5de59c2f-7867-4a6e-a5c9-454cde25df86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:05.620004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5de59c2f-7867-4a6e-a5c9-454cde25df86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:05.623246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:05.752577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5de59c2f-7867-4a6e-a5c9-454cde25df86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:05.760727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5de59c2f-7867-4a6e-a5c9-454cde25df86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.162167 Jul 26 18:49:05.761311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1424/2821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:05 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:05.835907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dbbe44dd-e66b-4841-ac2d-a3e26a9185e4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:05.836899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dbbe44dd-e66b-4841-ac2d-a3e26a9185e4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:05.848141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dbbe44dd-e66b-4841-ac2d-a3e26a9185e4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:05.848888 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dbbe44dd-e66b-4841-ac2d-a3e26a9185e4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:05.850145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dbbe44dd-e66b-4841-ac2d-a3e26a9185e4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:05.850876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dbbe44dd-e66b-4841-ac2d-a3e26a9185e4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:05.988592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dbbe44dd-e66b-4841-ac2d-a3e26a9185e4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:06.000922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dbbe44dd-e66b-4841-ac2d-a3e26a9185e4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.171185 Jul 26 18:49:06.001596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1398/2822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:05 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:06.005558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2adcec35-2058-40a7-a8ab-bb8d2eee7a2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:06.006418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2adcec35-2058-40a7-a8ab-bb8d2eee7a2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:06.014557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2adcec35-2058-40a7-a8ab-bb8d2eee7a2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:06.015003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2adcec35-2058-40a7-a8ab-bb8d2eee7a2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:06.015797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2adcec35-2058-40a7-a8ab-bb8d2eee7a2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:06.016230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2adcec35-2058-40a7-a8ab-bb8d2eee7a2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:06.120725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6faf20e3-5022-47cf-ab67-d8506a6e663d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:06.121350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6faf20e3-5022-47cf-ab67-d8506a6e663d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:06.127942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6faf20e3-5022-47cf-ab67-d8506a6e663d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:06.128385 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6faf20e3-5022-47cf-ab67-d8506a6e663d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:06.129140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6faf20e3-5022-47cf-ab67-d8506a6e663d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:06.129568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6faf20e3-5022-47cf-ab67-d8506a6e663d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:06.147891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2adcec35-2058-40a7-a8ab-bb8d2eee7a2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:06.157248 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2adcec35-2058-40a7-a8ab-bb8d2eee7a2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:06.158835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2adcec35-2058-40a7-a8ab-bb8d2eee7a2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:06.160179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2adcec35-2058-40a7-a8ab-bb8d2eee7a2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159745 Jul 26 18:49:06.165241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1425/2823] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:06.264035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6faf20e3-5022-47cf-ab67-d8506a6e663d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:06.272311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6faf20e3-5022-47cf-ab67-d8506a6e663d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155543 Jul 26 18:49:06.273170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1399/2824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:06 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:06.782829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b48c690c-9e69-40ce-abf5-19dc8ee4fbea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:06.783445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b48c690c-9e69-40ce-abf5-19dc8ee4fbea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:06.790641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b48c690c-9e69-40ce-abf5-19dc8ee4fbea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:06.791168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b48c690c-9e69-40ce-abf5-19dc8ee4fbea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:06.792036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b48c690c-9e69-40ce-abf5-19dc8ee4fbea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:06.792529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b48c690c-9e69-40ce-abf5-19dc8ee4fbea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:07.025638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0f09b2b9-1fbd-4289-a3ad-835ba23e1e72 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:07.026206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0f09b2b9-1fbd-4289-a3ad-835ba23e1e72 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:07.033523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f09b2b9-1fbd-4289-a3ad-835ba23e1e72 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:07.033967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f09b2b9-1fbd-4289-a3ad-835ba23e1e72 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:07.034732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f09b2b9-1fbd-4289-a3ad-835ba23e1e72 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:07.035192 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f09b2b9-1fbd-4289-a3ad-835ba23e1e72 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:07.166516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b48c690c-9e69-40ce-abf5-19dc8ee4fbea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:07.170662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0f09b2b9-1fbd-4289-a3ad-835ba23e1e72 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:07.175067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b48c690c-9e69-40ce-abf5-19dc8ee4fbea tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.396571 Jul 26 18:49:07.175818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1426/2825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:06 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:07.179116 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0f09b2b9-1fbd-4289-a3ad-835ba23e1e72 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157773 Jul 26 18:49:07.179698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1400/2826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:07 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:07.183842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7c09d832-4c04-4474-a1aa-6d1ce1883261 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:07.184436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7c09d832-4c04-4474-a1aa-6d1ce1883261 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:07.190368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c09d832-4c04-4474-a1aa-6d1ce1883261 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:07.190804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c09d832-4c04-4474-a1aa-6d1ce1883261 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:07.191590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c09d832-4c04-4474-a1aa-6d1ce1883261 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:07.192012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c09d832-4c04-4474-a1aa-6d1ce1883261 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:07.294240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5380debf-8695-493c-8bf4-7c03facb6b1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:07.295045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5380debf-8695-493c-8bf4-7c03facb6b1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:07.301054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5380debf-8695-493c-8bf4-7c03facb6b1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:07.301577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5380debf-8695-493c-8bf4-7c03facb6b1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:07.302375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5380debf-8695-493c-8bf4-7c03facb6b1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:07.302860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5380debf-8695-493c-8bf4-7c03facb6b1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:07.324291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7c09d832-4c04-4474-a1aa-6d1ce1883261 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:07.333058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7c09d832-4c04-4474-a1aa-6d1ce1883261 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:07.334839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7c09d832-4c04-4474-a1aa-6d1ce1883261 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:07.336034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7c09d832-4c04-4474-a1aa-6d1ce1883261 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156775 Jul 26 18:49:07.336611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1427/2827] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:07.435527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5380debf-8695-493c-8bf4-7c03facb6b1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:07.443850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5380debf-8695-493c-8bf4-7c03facb6b1e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153758 Jul 26 18:49:07.444419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1401/2828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:07 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:08.200544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b06c6027-4497-4325-9e73-f1303ded6566 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:08.201093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b06c6027-4497-4325-9e73-f1303ded6566 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:08.204680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3a869a86-f089-4c36-83ab-8aae22b9626e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:08.205623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3a869a86-f089-4c36-83ab-8aae22b9626e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:08.207944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b06c6027-4497-4325-9e73-f1303ded6566 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:08.208395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b06c6027-4497-4325-9e73-f1303ded6566 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:08.209155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b06c6027-4497-4325-9e73-f1303ded6566 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:08.209591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b06c6027-4497-4325-9e73-f1303ded6566 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:08.220706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a869a86-f089-4c36-83ab-8aae22b9626e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:08.221310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a869a86-f089-4c36-83ab-8aae22b9626e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:08.222297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a869a86-f089-4c36-83ab-8aae22b9626e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:08.222727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a869a86-f089-4c36-83ab-8aae22b9626e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:08.357678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b06c6027-4497-4325-9e73-f1303ded6566 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:08.366368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b06c6027-4497-4325-9e73-f1303ded6566 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.171806 Jul 26 18:49:08.366707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1428/2829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:08 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:08.374269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3a869a86-f089-4c36-83ab-8aae22b9626e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:08.380710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8de15185-99bb-4645-b897-b148479e3883 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:08.381451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8de15185-99bb-4645-b897-b148479e3883 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:08.386785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3a869a86-f089-4c36-83ab-8aae22b9626e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.189221 Jul 26 18:49:08.389733 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1402/2830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:08 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:08.389905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8de15185-99bb-4645-b897-b148479e3883 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:08.389905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8de15185-99bb-4645-b897-b148479e3883 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:08.389905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8de15185-99bb-4645-b897-b148479e3883 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:08.390208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8de15185-99bb-4645-b897-b148479e3883 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:08.465639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a640e1d5-86b9-4ade-a5c3-cc97187832b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:08.466352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a640e1d5-86b9-4ade-a5c3-cc97187832b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:08.472764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a640e1d5-86b9-4ade-a5c3-cc97187832b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:08.473288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a640e1d5-86b9-4ade-a5c3-cc97187832b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:08.474117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a640e1d5-86b9-4ade-a5c3-cc97187832b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:08.474643 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a640e1d5-86b9-4ade-a5c3-cc97187832b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:08.519523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8de15185-99bb-4645-b897-b148479e3883 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:08.528557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8de15185-99bb-4645-b897-b148479e3883 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:08.530155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8de15185-99bb-4645-b897-b148479e3883 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:08.531337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8de15185-99bb-4645-b897-b148479e3883 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.163665 Jul 26 18:49:08.531941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1429/2831] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:08 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:08.612179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a640e1d5-86b9-4ade-a5c3-cc97187832b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:08.622505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a640e1d5-86b9-4ade-a5c3-cc97187832b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.160873 Jul 26 18:49:08.623149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1403/2832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:08 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:09.387540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-97df8f18-a938-442c-b980-b781aa5fb1bf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:09.388180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-97df8f18-a938-442c-b980-b781aa5fb1bf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:09.394995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97df8f18-a938-442c-b980-b781aa5fb1bf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:09.395488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97df8f18-a938-442c-b980-b781aa5fb1bf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:09.396249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97df8f18-a938-442c-b980-b781aa5fb1bf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:09.396680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97df8f18-a938-442c-b980-b781aa5fb1bf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:09.408706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a0b51a48-1388-4de5-adb9-a85284128245 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:09.409463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a0b51a48-1388-4de5-adb9-a85284128245 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:09.416201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0b51a48-1388-4de5-adb9-a85284128245 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:09.416708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0b51a48-1388-4de5-adb9-a85284128245 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:09.417517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0b51a48-1388-4de5-adb9-a85284128245 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:09.418143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0b51a48-1388-4de5-adb9-a85284128245 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:09.537236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-97df8f18-a938-442c-b980-b781aa5fb1bf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:09.545227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-97df8f18-a938-442c-b980-b781aa5fb1bf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161569 Jul 26 18:49:09.546344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1430/2833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:09 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:09.548244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a0b51a48-1388-4de5-adb9-a85284128245 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:09.554116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-91930519-d94e-4b6e-bca9-f4812aa8fc40 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:09.554712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-91930519-d94e-4b6e-bca9-f4812aa8fc40 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:09.556914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a0b51a48-1388-4de5-adb9-a85284128245 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152172 Jul 26 18:49:09.557830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1404/2834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:09 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:09.564812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91930519-d94e-4b6e-bca9-f4812aa8fc40 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:09.565228 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91930519-d94e-4b6e-bca9-f4812aa8fc40 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:09.565991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91930519-d94e-4b6e-bca9-f4812aa8fc40 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:09.566423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91930519-d94e-4b6e-bca9-f4812aa8fc40 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:09.644627 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5ee85e42-b18d-4286-903d-2d3a257e7eca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:09.645203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5ee85e42-b18d-4286-903d-2d3a257e7eca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:09.652165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ee85e42-b18d-4286-903d-2d3a257e7eca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:09.652620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ee85e42-b18d-4286-903d-2d3a257e7eca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:09.653407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ee85e42-b18d-4286-903d-2d3a257e7eca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:09.653865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ee85e42-b18d-4286-903d-2d3a257e7eca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:09.700962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-91930519-d94e-4b6e-bca9-f4812aa8fc40 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:09.709553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-91930519-d94e-4b6e-bca9-f4812aa8fc40 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:09.711155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-91930519-d94e-4b6e-bca9-f4812aa8fc40 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:09.712376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-91930519-d94e-4b6e-bca9-f4812aa8fc40 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162714 Jul 26 18:49:09.713026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1431/2835] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:09 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:09.799626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5ee85e42-b18d-4286-903d-2d3a257e7eca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:09.807961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5ee85e42-b18d-4286-903d-2d3a257e7eca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.167536 Jul 26 18:49:09.808557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1405/2836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:09 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:10.572074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-34a074c7-963c-4ece-a41c-c1938c3a9b59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:10.573098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-34a074c7-963c-4ece-a41c-c1938c3a9b59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:10.584295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cd0c3476-29a8-40aa-9966-55a0bd008794 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:10.585184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34a074c7-963c-4ece-a41c-c1938c3a9b59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:10.585365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cd0c3476-29a8-40aa-9966-55a0bd008794 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:10.585528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34a074c7-963c-4ece-a41c-c1938c3a9b59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:10.586726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34a074c7-963c-4ece-a41c-c1938c3a9b59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:10.587529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34a074c7-963c-4ece-a41c-c1938c3a9b59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:10.594013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd0c3476-29a8-40aa-9966-55a0bd008794 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:10.594456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd0c3476-29a8-40aa-9966-55a0bd008794 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:10.595254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd0c3476-29a8-40aa-9966-55a0bd008794 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:10.595678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cd0c3476-29a8-40aa-9966-55a0bd008794 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:10.721554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-34a074c7-963c-4ece-a41c-c1938c3a9b59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:10.726278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cd0c3476-29a8-40aa-9966-55a0bd008794 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:10.729840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-34a074c7-963c-4ece-a41c-c1938c3a9b59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164505 Jul 26 18:49:10.730580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1432/2837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:10.735257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-841a207e-3853-43b4-a3be-6e79890d3dd1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:10.735850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-841a207e-3853-43b4-a3be-6e79890d3dd1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:10.736913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cd0c3476-29a8-40aa-9966-55a0bd008794 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.159515 Jul 26 18:49:10.737494 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1406/2838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:10 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:10.742573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-841a207e-3853-43b4-a3be-6e79890d3dd1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:10.743273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-841a207e-3853-43b4-a3be-6e79890d3dd1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:10.744214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-841a207e-3853-43b4-a3be-6e79890d3dd1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:10.744789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-841a207e-3853-43b4-a3be-6e79890d3dd1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:10.829861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bed95a24-85c7-40a2-9c0f-627a1c753c64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:10.830534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bed95a24-85c7-40a2-9c0f-627a1c753c64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:10.836991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bed95a24-85c7-40a2-9c0f-627a1c753c64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:10.837429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bed95a24-85c7-40a2-9c0f-627a1c753c64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:10.838183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bed95a24-85c7-40a2-9c0f-627a1c753c64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:10.838848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bed95a24-85c7-40a2-9c0f-627a1c753c64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:10.877950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-841a207e-3853-43b4-a3be-6e79890d3dd1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:10.887058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-841a207e-3853-43b4-a3be-6e79890d3dd1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:10.888622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-841a207e-3853-43b4-a3be-6e79890d3dd1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:10.889796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-841a207e-3853-43b4-a3be-6e79890d3dd1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158277 Jul 26 18:49:10.890359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1433/2839] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:10 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:10.975277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bed95a24-85c7-40a2-9c0f-627a1c753c64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:10.983894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bed95a24-85c7-40a2-9c0f-627a1c753c64 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157936 Jul 26 18:49:10.984468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1407/2840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:10 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:11.755286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3107c212-88aa-4282-9478-edaa61de23e3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:11.756297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3107c212-88aa-4282-9478-edaa61de23e3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:11.761522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ae039155-af05-4d06-98f4-2987d474d560 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:11.762417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ae039155-af05-4d06-98f4-2987d474d560 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:11.765698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3107c212-88aa-4282-9478-edaa61de23e3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:11.766142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3107c212-88aa-4282-9478-edaa61de23e3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:11.767064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3107c212-88aa-4282-9478-edaa61de23e3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:11.767485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3107c212-88aa-4282-9478-edaa61de23e3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:11.769210 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae039155-af05-4d06-98f4-2987d474d560 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:11.769654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae039155-af05-4d06-98f4-2987d474d560 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:11.770397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae039155-af05-4d06-98f4-2987d474d560 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:11.770836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae039155-af05-4d06-98f4-2987d474d560 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:11.898301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3107c212-88aa-4282-9478-edaa61de23e3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:11.905741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ae039155-af05-4d06-98f4-2987d474d560 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:11.912486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3107c212-88aa-4282-9478-edaa61de23e3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.162415 Jul 26 18:49:11.913073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1434/2841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:11 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:11.914235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ae039155-af05-4d06-98f4-2987d474d560 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.159091 Jul 26 18:49:11.914796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1408/2842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:11 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:11.917696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-859852fc-0cac-4df3-933b-358029272501 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:11.918361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-859852fc-0cac-4df3-933b-358029272501 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:11.924488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-859852fc-0cac-4df3-933b-358029272501 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:11.924943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-859852fc-0cac-4df3-933b-358029272501 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:11.925684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-859852fc-0cac-4df3-933b-358029272501 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:11.926114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-859852fc-0cac-4df3-933b-358029272501 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:12.007654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e302cf0a-3fc8-49b1-a9fa-158f3a9e6507 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:12.008354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e302cf0a-3fc8-49b1-a9fa-158f3a9e6507 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:12.014644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e302cf0a-3fc8-49b1-a9fa-158f3a9e6507 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:12.015123 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e302cf0a-3fc8-49b1-a9fa-158f3a9e6507 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:12.015884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e302cf0a-3fc8-49b1-a9fa-158f3a9e6507 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:12.016311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e302cf0a-3fc8-49b1-a9fa-158f3a9e6507 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:12.063281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-859852fc-0cac-4df3-933b-358029272501 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:12.071745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-859852fc-0cac-4df3-933b-358029272501 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:12.073232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-859852fc-0cac-4df3-933b-358029272501 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:12.074376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-859852fc-0cac-4df3-933b-358029272501 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160224 Jul 26 18:49:12.075082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1435/2843] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:12.145777 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e302cf0a-3fc8-49b1-a9fa-158f3a9e6507 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:12.156435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e302cf0a-3fc8-49b1-a9fa-158f3a9e6507 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154944 Jul 26 18:49:12.156990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1409/2844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:11 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:12.936906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ad83a437-faf1-4857-82cd-98c1a81316a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:12.937502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ad83a437-faf1-4857-82cd-98c1a81316a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:12.937902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d74b1c8e-8fb3-4cfe-82f1-d28a8d75c08c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:12.938584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d74b1c8e-8fb3-4cfe-82f1-d28a8d75c08c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:12.944737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad83a437-faf1-4857-82cd-98c1a81316a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:12.946100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad83a437-faf1-4857-82cd-98c1a81316a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:12.946235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d74b1c8e-8fb3-4cfe-82f1-d28a8d75c08c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:12.946365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad83a437-faf1-4857-82cd-98c1a81316a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:12.946489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d74b1c8e-8fb3-4cfe-82f1-d28a8d75c08c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:12.946628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad83a437-faf1-4857-82cd-98c1a81316a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:12.947365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d74b1c8e-8fb3-4cfe-82f1-d28a8d75c08c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:12.947871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d74b1c8e-8fb3-4cfe-82f1-d28a8d75c08c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:13.078111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ad83a437-faf1-4857-82cd-98c1a81316a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:13.081740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d74b1c8e-8fb3-4cfe-82f1-d28a8d75c08c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:13.086350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ad83a437-faf1-4857-82cd-98c1a81316a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154630 Jul 26 18:49:13.086931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1436/2845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:12 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:13.090054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d74b1c8e-8fb3-4cfe-82f1-d28a8d75c08c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156492 Jul 26 18:49:13.090694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1410/2846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:12 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:13.097556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c4e7bfe6-853b-4ef0-ba20-837ba72e834f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:13.098157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c4e7bfe6-853b-4ef0-ba20-837ba72e834f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:13.104493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4e7bfe6-853b-4ef0-ba20-837ba72e834f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:13.104940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4e7bfe6-853b-4ef0-ba20-837ba72e834f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:13.105691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4e7bfe6-853b-4ef0-ba20-837ba72e834f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:13.106123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4e7bfe6-853b-4ef0-ba20-837ba72e834f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:13.178757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4161facd-3e4c-4391-a1ef-f763e13dd9a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:13.179386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4161facd-3e4c-4391-a1ef-f763e13dd9a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:13.185908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4161facd-3e4c-4391-a1ef-f763e13dd9a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:13.186354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4161facd-3e4c-4391-a1ef-f763e13dd9a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:13.187563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4161facd-3e4c-4391-a1ef-f763e13dd9a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:13.188060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4161facd-3e4c-4391-a1ef-f763e13dd9a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:13.240849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c4e7bfe6-853b-4ef0-ba20-837ba72e834f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:13.249436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c4e7bfe6-853b-4ef0-ba20-837ba72e834f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:13.250947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c4e7bfe6-853b-4ef0-ba20-837ba72e834f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:13.252133 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c4e7bfe6-853b-4ef0-ba20-837ba72e834f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158322 Jul 26 18:49:13.252693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1437/2847] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:13.320839 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4161facd-3e4c-4391-a1ef-f763e13dd9a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:13.329021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4161facd-3e4c-4391-a1ef-f763e13dd9a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154271 Jul 26 18:49:13.329586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1411/2848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:13 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:14.109793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0d158d2a-0eb8-4f56-b734-6971a728571a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:14.110753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0d158d2a-0eb8-4f56-b734-6971a728571a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:14.112340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-17febb18-cbd3-4542-a3b0-39eb2288029b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:14.113111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-17febb18-cbd3-4542-a3b0-39eb2288029b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:14.120051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d158d2a-0eb8-4f56-b734-6971a728571a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:14.120563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d158d2a-0eb8-4f56-b734-6971a728571a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:14.121633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d158d2a-0eb8-4f56-b734-6971a728571a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:14.122199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d158d2a-0eb8-4f56-b734-6971a728571a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:14.122400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17febb18-cbd3-4542-a3b0-39eb2288029b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:14.122956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17febb18-cbd3-4542-a3b0-39eb2288029b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:14.124057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17febb18-cbd3-4542-a3b0-39eb2288029b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:14.124604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17febb18-cbd3-4542-a3b0-39eb2288029b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:14.260967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0d158d2a-0eb8-4f56-b734-6971a728571a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:14.264693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-17febb18-cbd3-4542-a3b0-39eb2288029b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:14.269251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0d158d2a-0eb8-4f56-b734-6971a728571a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.164808 Jul 26 18:49:14.270042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1438/2849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:14 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:14.273546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-17febb18-cbd3-4542-a3b0-39eb2288029b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.166458 Jul 26 18:49:14.274101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1412/2850] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:14 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:14.280217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0e7dfa75-2d26-4403-8750-ddb93695177d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:14.280890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0e7dfa75-2d26-4403-8750-ddb93695177d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:14.286984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e7dfa75-2d26-4403-8750-ddb93695177d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:14.287530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e7dfa75-2d26-4403-8750-ddb93695177d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:14.288279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e7dfa75-2d26-4403-8750-ddb93695177d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:14.288713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e7dfa75-2d26-4403-8750-ddb93695177d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:14.349942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d214b0e4-f64c-43ac-bbb1-2c1862d876e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:14.353848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d214b0e4-f64c-43ac-bbb1-2c1862d876e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:14.356914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d214b0e4-f64c-43ac-bbb1-2c1862d876e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:14.357364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d214b0e4-f64c-43ac-bbb1-2c1862d876e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:14.358091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d214b0e4-f64c-43ac-bbb1-2c1862d876e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:14.358526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d214b0e4-f64c-43ac-bbb1-2c1862d876e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:14.362523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:14.429167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0e7dfa75-2d26-4403-8750-ddb93695177d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:14.437904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0e7dfa75-2d26-4403-8750-ddb93695177d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:14.439428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0e7dfa75-2d26-4403-8750-ddb93695177d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:14.440589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0e7dfa75-2d26-4403-8750-ddb93695177d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.169615 Jul 26 18:49:14.451371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1439/2851] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:14 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:14.490994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d214b0e4-f64c-43ac-bbb1-2c1862d876e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:14.499522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d214b0e4-f64c-43ac-bbb1-2c1862d876e4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153534 Jul 26 18:49:14.500090 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1413/2852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:14 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:14.582937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:49:14.583219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 18:49:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:49:15.294004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-106c0626-83c6-45e0-b201-9a5e61a5fac0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:15.295336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-106c0626-83c6-45e0-b201-9a5e61a5fac0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:15.298833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d4fc94a5-71fd-4322-ae89-23562be977b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:15.299860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d4fc94a5-71fd-4322-ae89-23562be977b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:15.306237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-106c0626-83c6-45e0-b201-9a5e61a5fac0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:15.306978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-106c0626-83c6-45e0-b201-9a5e61a5fac0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:15.308267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-106c0626-83c6-45e0-b201-9a5e61a5fac0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:15.309009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-106c0626-83c6-45e0-b201-9a5e61a5fac0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:15.310260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d4fc94a5-71fd-4322-ae89-23562be977b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:15.310701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d4fc94a5-71fd-4322-ae89-23562be977b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:15.311480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d4fc94a5-71fd-4322-ae89-23562be977b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:15.311910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d4fc94a5-71fd-4322-ae89-23562be977b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:15.442838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-106c0626-83c6-45e0-b201-9a5e61a5fac0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:15.443134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d4fc94a5-71fd-4322-ae89-23562be977b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:15.445113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:15.451755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d4fc94a5-71fd-4322-ae89-23562be977b8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159267 Jul 26 18:49:15.452335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1414/2853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:15 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:15.452606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-106c0626-83c6-45e0-b201-9a5e61a5fac0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.164958 Jul 26 18:49:15.453172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1440/2854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:15 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:15.463239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a5fdc7e3-ae4d-420d-9cda-d2d84a4fd784 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:15.463836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a5fdc7e3-ae4d-420d-9cda-d2d84a4fd784 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:15.465685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:15.471417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5fdc7e3-ae4d-420d-9cda-d2d84a4fd784 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:15.471859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5fdc7e3-ae4d-420d-9cda-d2d84a4fd784 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:15.472722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5fdc7e3-ae4d-420d-9cda-d2d84a4fd784 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:15.473145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5fdc7e3-ae4d-420d-9cda-d2d84a4fd784 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:15.522120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-21ccc567-86fa-4e15-b8eb-010bf96958d3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:15.523049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-21ccc567-86fa-4e15-b8eb-010bf96958d3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:15.525149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:15.531066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21ccc567-86fa-4e15-b8eb-010bf96958d3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:15.531543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21ccc567-86fa-4e15-b8eb-010bf96958d3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:15.532358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21ccc567-86fa-4e15-b8eb-010bf96958d3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:15.532817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21ccc567-86fa-4e15-b8eb-010bf96958d3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:15.606172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a5fdc7e3-ae4d-420d-9cda-d2d84a4fd784 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:15.614769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a5fdc7e3-ae4d-420d-9cda-d2d84a4fd784 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:15.616308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a5fdc7e3-ae4d-420d-9cda-d2d84a4fd784 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:15.617462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a5fdc7e3-ae4d-420d-9cda-d2d84a4fd784 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158057 Jul 26 18:49:15.618276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1415/2855] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:15 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:15.662840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-21ccc567-86fa-4e15-b8eb-010bf96958d3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:15.670872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-21ccc567-86fa-4e15-b8eb-010bf96958d3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152905 Jul 26 18:49:15.671469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1441/2856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:15 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:16.473758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3dac956a-0a09-4da3-abd9-e24518fe4af3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:16.474388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c356ab83-efdb-490b-bf28-bda054218b3e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:16.474388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c356ab83-efdb-490b-bf28-bda054218b3e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:16.474867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3dac956a-0a09-4da3-abd9-e24518fe4af3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:16.481396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c356ab83-efdb-490b-bf28-bda054218b3e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:16.481590 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dac956a-0a09-4da3-abd9-e24518fe4af3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:16.481822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dac956a-0a09-4da3-abd9-e24518fe4af3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:16.481943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c356ab83-efdb-490b-bf28-bda054218b3e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:16.482603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dac956a-0a09-4da3-abd9-e24518fe4af3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:16.482774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c356ab83-efdb-490b-bf28-bda054218b3e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:16.483003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c356ab83-efdb-490b-bf28-bda054218b3e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:16.483149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dac956a-0a09-4da3-abd9-e24518fe4af3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:16.614956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3dac956a-0a09-4da3-abd9-e24518fe4af3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:16.615142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c356ab83-efdb-490b-bf28-bda054218b3e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:16.623130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c356ab83-efdb-490b-bf28-bda054218b3e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.153265 Jul 26 18:49:16.623608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3dac956a-0a09-4da3-abd9-e24518fe4af3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153704 Jul 26 18:49:16.624055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1442/2857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:16 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:16.624335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1416/2858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:16 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:16.640192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ea5bac75-2ca9-4683-806e-4d60f68f81ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:16.640790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ea5bac75-2ca9-4683-806e-4d60f68f81ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:16.646884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea5bac75-2ca9-4683-806e-4d60f68f81ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:16.647365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea5bac75-2ca9-4683-806e-4d60f68f81ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:16.648432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea5bac75-2ca9-4683-806e-4d60f68f81ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:16.648864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea5bac75-2ca9-4683-806e-4d60f68f81ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:16.693229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f3da4a63-fef3-41c7-a96f-5a073cd35718 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:16.693849 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f3da4a63-fef3-41c7-a96f-5a073cd35718 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:16.700528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3da4a63-fef3-41c7-a96f-5a073cd35718 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:16.700980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3da4a63-fef3-41c7-a96f-5a073cd35718 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:16.701745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3da4a63-fef3-41c7-a96f-5a073cd35718 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:16.702184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3da4a63-fef3-41c7-a96f-5a073cd35718 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:16.779906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ea5bac75-2ca9-4683-806e-4d60f68f81ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:16.789004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ea5bac75-2ca9-4683-806e-4d60f68f81ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:16.790526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ea5bac75-2ca9-4683-806e-4d60f68f81ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:16.791739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ea5bac75-2ca9-4683-806e-4d60f68f81ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155352 Jul 26 18:49:16.792451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1443/2859] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:16 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:16.841512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f3da4a63-fef3-41c7-a96f-5a073cd35718 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:16.849862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f3da4a63-fef3-41c7-a96f-5a073cd35718 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.160723 Jul 26 18:49:16.857783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1417/2860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:16 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:17.648389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0b7ca252-1eac-4ae4-84d0-aedd48b18859 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:17.649440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3682c2ce-c334-4298-9a1a-3cc7a959d50e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:17.650115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0b7ca252-1eac-4ae4-84d0-aedd48b18859 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:17.650302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3682c2ce-c334-4298-9a1a-3cc7a959d50e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:17.657499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b7ca252-1eac-4ae4-84d0-aedd48b18859 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:17.657668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3682c2ce-c334-4298-9a1a-3cc7a959d50e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:17.657943 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b7ca252-1eac-4ae4-84d0-aedd48b18859 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:17.658198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3682c2ce-c334-4298-9a1a-3cc7a959d50e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:17.658691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b7ca252-1eac-4ae4-84d0-aedd48b18859 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:17.658846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3682c2ce-c334-4298-9a1a-3cc7a959d50e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:17.659143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b7ca252-1eac-4ae4-84d0-aedd48b18859 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:17.659298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3682c2ce-c334-4298-9a1a-3cc7a959d50e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:17.789703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3682c2ce-c334-4298-9a1a-3cc7a959d50e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:17.793563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0b7ca252-1eac-4ae4-84d0-aedd48b18859 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:17.798198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3682c2ce-c334-4298-9a1a-3cc7a959d50e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156571 Jul 26 18:49:17.798776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1444/2861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:17 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:17.801760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0b7ca252-1eac-4ae4-84d0-aedd48b18859 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160150 Jul 26 18:49:17.802322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1418/2862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:17 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:17.813715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3e4255cf-71ee-4274-bdbf-f5279e0ab7a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:17.814323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3e4255cf-71ee-4274-bdbf-f5279e0ab7a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:17.820500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e4255cf-71ee-4274-bdbf-f5279e0ab7a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:17.820938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e4255cf-71ee-4274-bdbf-f5279e0ab7a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:17.821681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e4255cf-71ee-4274-bdbf-f5279e0ab7a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:17.822106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e4255cf-71ee-4274-bdbf-f5279e0ab7a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:17.871625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-49b587b1-bbc3-4d75-8e03-0680a40837ca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:17.872358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-49b587b1-bbc3-4d75-8e03-0680a40837ca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:17.878711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49b587b1-bbc3-4d75-8e03-0680a40837ca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:17.879269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49b587b1-bbc3-4d75-8e03-0680a40837ca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:17.880107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49b587b1-bbc3-4d75-8e03-0680a40837ca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:17.880587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49b587b1-bbc3-4d75-8e03-0680a40837ca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:17.961430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3e4255cf-71ee-4274-bdbf-f5279e0ab7a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:17.970460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3e4255cf-71ee-4274-bdbf-f5279e0ab7a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:17.972014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3e4255cf-71ee-4274-bdbf-f5279e0ab7a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:17.973163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3e4255cf-71ee-4274-bdbf-f5279e0ab7a7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.163278 Jul 26 18:49:17.973718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1445/2863] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:18.016108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-49b587b1-bbc3-4d75-8e03-0680a40837ca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:18.024391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-49b587b1-bbc3-4d75-8e03-0680a40837ca tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156800 Jul 26 18:49:18.024993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1419/2864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:17 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:18.823045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ce538567-fb0e-41c3-b741-e894df878cef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:18.824079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ce538567-fb0e-41c3-b741-e894df878cef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:18.826718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e1ed85e7-4ee6-4c67-a746-399f69a2164e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:18.828035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e1ed85e7-4ee6-4c67-a746-399f69a2164e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:18.834990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce538567-fb0e-41c3-b741-e894df878cef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:18.835777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce538567-fb0e-41c3-b741-e894df878cef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:18.837010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce538567-fb0e-41c3-b741-e894df878cef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:18.837720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce538567-fb0e-41c3-b741-e894df878cef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:18.838039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1ed85e7-4ee6-4c67-a746-399f69a2164e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:18.838819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1ed85e7-4ee6-4c67-a746-399f69a2164e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:18.840109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1ed85e7-4ee6-4c67-a746-399f69a2164e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:18.840753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1ed85e7-4ee6-4c67-a746-399f69a2164e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:18.972099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ce538567-fb0e-41c3-b741-e894df878cef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:18.977526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e1ed85e7-4ee6-4c67-a746-399f69a2164e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:18.987011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ce538567-fb0e-41c3-b741-e894df878cef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.170233 Jul 26 18:49:18.987617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1446/2865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:18 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:18.992706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e1ed85e7-4ee6-4c67-a746-399f69a2164e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.167357 Jul 26 18:49:18.992706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1420/2866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:18 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:19.002064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-078dd8a7-487a-4572-812c-9ba3a4b4cd58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:19.002854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-078dd8a7-487a-4572-812c-9ba3a4b4cd58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:19.009076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-078dd8a7-487a-4572-812c-9ba3a4b4cd58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:19.009605 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-078dd8a7-487a-4572-812c-9ba3a4b4cd58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:19.010414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-078dd8a7-487a-4572-812c-9ba3a4b4cd58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:19.010910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-078dd8a7-487a-4572-812c-9ba3a4b4cd58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:19.045680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d1ca158b-6ff2-4dca-874a-82331eff22d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:19.046288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d1ca158b-6ff2-4dca-874a-82331eff22d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:19.052358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1ca158b-6ff2-4dca-874a-82331eff22d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:19.052834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1ca158b-6ff2-4dca-874a-82331eff22d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:19.053596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1ca158b-6ff2-4dca-874a-82331eff22d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:19.054046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1ca158b-6ff2-4dca-874a-82331eff22d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:19.140466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-078dd8a7-487a-4572-812c-9ba3a4b4cd58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:19.149559 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-078dd8a7-487a-4572-812c-9ba3a4b4cd58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:19.151111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-078dd8a7-487a-4572-812c-9ba3a4b4cd58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:19.152268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-078dd8a7-487a-4572-812c-9ba3a4b4cd58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.154315 Jul 26 18:49:19.153001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1421/2867] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:18 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:19.184299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d1ca158b-6ff2-4dca-874a-82331eff22d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:19.192405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d1ca158b-6ff2-4dca-874a-82331eff22d5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150549 Jul 26 18:49:19.192937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1447/2868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:19 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:20.012857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-27f9ad7d-6f23-40cd-888e-f53b57deae78 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:20.013405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-08a30c78-e29d-4ca2-90e0-5dd3202b1b40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:20.013787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-27f9ad7d-6f23-40cd-888e-f53b57deae78 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:20.013900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-08a30c78-e29d-4ca2-90e0-5dd3202b1b40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:20.021321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27f9ad7d-6f23-40cd-888e-f53b57deae78 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:20.021842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27f9ad7d-6f23-40cd-888e-f53b57deae78 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:20.022056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-08a30c78-e29d-4ca2-90e0-5dd3202b1b40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:20.022812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-08a30c78-e29d-4ca2-90e0-5dd3202b1b40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:20.023120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27f9ad7d-6f23-40cd-888e-f53b57deae78 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:20.023635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-08a30c78-e29d-4ca2-90e0-5dd3202b1b40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:20.023818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27f9ad7d-6f23-40cd-888e-f53b57deae78 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:20.024075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-08a30c78-e29d-4ca2-90e0-5dd3202b1b40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:20.159882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-08a30c78-e29d-4ca2-90e0-5dd3202b1b40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:20.167935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-08a30c78-e29d-4ca2-90e0-5dd3202b1b40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160744 Jul 26 18:49:20.168629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1448/2869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:20.176598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-27f9ad7d-6f23-40cd-888e-f53b57deae78 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:20.178993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c27add3d-5352-4f21-91ed-140f452761f6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:20.179740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c27add3d-5352-4f21-91ed-140f452761f6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:20.185213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-27f9ad7d-6f23-40cd-888e-f53b57deae78 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.179460 Jul 26 18:49:20.185786 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1422/2870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:20 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:20.186095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c27add3d-5352-4f21-91ed-140f452761f6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:20.186606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c27add3d-5352-4f21-91ed-140f452761f6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:20.187460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c27add3d-5352-4f21-91ed-140f452761f6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:20.187960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c27add3d-5352-4f21-91ed-140f452761f6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:20.213634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1d6ab2ec-39ab-4237-b499-63f5f99bf1a9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:20.214244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1d6ab2ec-39ab-4237-b499-63f5f99bf1a9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:20.220478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d6ab2ec-39ab-4237-b499-63f5f99bf1a9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:20.220925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d6ab2ec-39ab-4237-b499-63f5f99bf1a9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:20.221716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d6ab2ec-39ab-4237-b499-63f5f99bf1a9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:20.222146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d6ab2ec-39ab-4237-b499-63f5f99bf1a9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:20.320159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c27add3d-5352-4f21-91ed-140f452761f6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:20.329131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c27add3d-5352-4f21-91ed-140f452761f6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:20.330653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c27add3d-5352-4f21-91ed-140f452761f6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:20.331832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c27add3d-5352-4f21-91ed-140f452761f6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156687 Jul 26 18:49:20.332394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1449/2871] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:20.354094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d6ab2ec-39ab-4237-b499-63f5f99bf1a9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:20.362207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1d6ab2ec-39ab-4237-b499-63f5f99bf1a9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152493 Jul 26 18:49:20.362773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1423/2872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:20 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:21.189392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e5b94389-f387-4b9f-8251-1f88453af062 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:21.189927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e5b94389-f387-4b9f-8251-1f88453af062 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:21.196596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5b94389-f387-4b9f-8251-1f88453af062 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:21.197047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5b94389-f387-4b9f-8251-1f88453af062 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:21.197790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5b94389-f387-4b9f-8251-1f88453af062 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:21.198247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5b94389-f387-4b9f-8251-1f88453af062 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:21.206439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a37fbc81-4c59-470b-954d-f33ba1fab59a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:21.207050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a37fbc81-4c59-470b-954d-f33ba1fab59a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:21.213756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a37fbc81-4c59-470b-954d-f33ba1fab59a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:21.214196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a37fbc81-4c59-470b-954d-f33ba1fab59a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:21.214931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a37fbc81-4c59-470b-954d-f33ba1fab59a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:21.215408 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a37fbc81-4c59-470b-954d-f33ba1fab59a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:21.336151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e5b94389-f387-4b9f-8251-1f88453af062 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:21.345047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e5b94389-f387-4b9f-8251-1f88453af062 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159557 Jul 26 18:49:21.345799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1450/2873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:21 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:21.354026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1b092bb3-e567-43e3-99c0-d37edd9df263 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:21.354637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1b092bb3-e567-43e3-99c0-d37edd9df263 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:21.360642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b092bb3-e567-43e3-99c0-d37edd9df263 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:21.361094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b092bb3-e567-43e3-99c0-d37edd9df263 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:21.361701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a37fbc81-4c59-470b-954d-f33ba1fab59a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:21.361868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b092bb3-e567-43e3-99c0-d37edd9df263 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:21.362265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b092bb3-e567-43e3-99c0-d37edd9df263 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:21.370477 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a37fbc81-4c59-470b-954d-f33ba1fab59a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.167836 Jul 26 18:49:21.371201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1424/2874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:21 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:21.383558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7ba173df-62a3-4cb2-921c-ba02518c2b57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:21.384151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7ba173df-62a3-4cb2-921c-ba02518c2b57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:21.390294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ba173df-62a3-4cb2-921c-ba02518c2b57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:21.390507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ba173df-62a3-4cb2-921c-ba02518c2b57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:21.391284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ba173df-62a3-4cb2-921c-ba02518c2b57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:21.391710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7ba173df-62a3-4cb2-921c-ba02518c2b57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:21.505620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1b092bb3-e567-43e3-99c0-d37edd9df263 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:21.514281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1b092bb3-e567-43e3-99c0-d37edd9df263 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:21.515862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1b092bb3-e567-43e3-99c0-d37edd9df263 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:21.517021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1b092bb3-e567-43e3-99c0-d37edd9df263 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.166877 Jul 26 18:49:21.517584 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1451/2875] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:21 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:21.532252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7ba173df-62a3-4cb2-921c-ba02518c2b57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:21.540686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7ba173df-62a3-4cb2-921c-ba02518c2b57 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.160737 Jul 26 18:49:21.541262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1425/2876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:21 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:22.370475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-051820eb-14fa-4d21-8f7e-b4f1ff34a30e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:22.371453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-051820eb-14fa-4d21-8f7e-b4f1ff34a30e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:22.382591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-051820eb-14fa-4d21-8f7e-b4f1ff34a30e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:22.383376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-051820eb-14fa-4d21-8f7e-b4f1ff34a30e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:22.384611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-051820eb-14fa-4d21-8f7e-b4f1ff34a30e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:22.385640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-051820eb-14fa-4d21-8f7e-b4f1ff34a30e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:22.392990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-11a0543b-f04b-4184-93f3-50cb378aa55f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:22.393629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-11a0543b-f04b-4184-93f3-50cb378aa55f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:22.400856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11a0543b-f04b-4184-93f3-50cb378aa55f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:22.401304 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11a0543b-f04b-4184-93f3-50cb378aa55f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:22.402064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11a0543b-f04b-4184-93f3-50cb378aa55f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:22.402495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11a0543b-f04b-4184-93f3-50cb378aa55f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:22.520113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-051820eb-14fa-4d21-8f7e-b4f1ff34a30e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:22.529141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-051820eb-14fa-4d21-8f7e-b4f1ff34a30e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164931 Jul 26 18:49:22.529717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1452/2877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:22 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:22.533851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-11a0543b-f04b-4184-93f3-50cb378aa55f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:22.540605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-66f29e34-31eb-4541-9ee2-2da152364394 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:22.541205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-66f29e34-31eb-4541-9ee2-2da152364394 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:22.541998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-11a0543b-f04b-4184-93f3-50cb378aa55f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152917 Jul 26 18:49:22.542760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1426/2878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:22 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:22.547297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66f29e34-31eb-4541-9ee2-2da152364394 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:22.547745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66f29e34-31eb-4541-9ee2-2da152364394 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:22.548502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66f29e34-31eb-4541-9ee2-2da152364394 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:22.548931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-66f29e34-31eb-4541-9ee2-2da152364394 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:22.561503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d72831ab-f790-485b-8eb6-324f580f421a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:22.562106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d72831ab-f790-485b-8eb6-324f580f421a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:22.568142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d72831ab-f790-485b-8eb6-324f580f421a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:22.568592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d72831ab-f790-485b-8eb6-324f580f421a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:22.569343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d72831ab-f790-485b-8eb6-324f580f421a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:22.569773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d72831ab-f790-485b-8eb6-324f580f421a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:22.680184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-66f29e34-31eb-4541-9ee2-2da152364394 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:22.689207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-66f29e34-31eb-4541-9ee2-2da152364394 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:22.690702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-66f29e34-31eb-4541-9ee2-2da152364394 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:22.691887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-66f29e34-31eb-4541-9ee2-2da152364394 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155044 Jul 26 18:49:22.692447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1453/2879] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:22 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:22.704464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d72831ab-f790-485b-8eb6-324f580f421a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:22.712644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d72831ab-f790-485b-8eb6-324f580f421a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154917 Jul 26 18:49:22.713219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1427/2880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:22 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:23.400356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-109c322d-4d49-4a8d-9471-26796e025840 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:23.400968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-109c322d-4d49-4a8d-9471-26796e025840 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:23.408024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-109c322d-4d49-4a8d-9471-26796e025840 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:23.408501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-109c322d-4d49-4a8d-9471-26796e025840 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:23.409257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-109c322d-4d49-4a8d-9471-26796e025840 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:23.409686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-109c322d-4d49-4a8d-9471-26796e025840 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:23.436429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-109c322d-4d49-4a8d-9471-26796e025840 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Going to try to terminate instance {{(pid=117996) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 18:49:23.517923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-109c322d-4d49-4a8d-9471-26796e025840 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 204 len: 0 microversion: 2.1 time: 0.121488 Jul 26 18:49:23.518613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1454/2881] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 18:49:23 2022] DELETE /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:49:23.529088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e978bd12-58fa-42ac-941c-a7feca93bb32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:23.529788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e978bd12-58fa-42ac-941c-a7feca93bb32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:23.536539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e978bd12-58fa-42ac-941c-a7feca93bb32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:23.536988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e978bd12-58fa-42ac-941c-a7feca93bb32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:23.537746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e978bd12-58fa-42ac-941c-a7feca93bb32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:23.538180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e978bd12-58fa-42ac-941c-a7feca93bb32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:23.550680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-82c3cf39-373f-431b-89e0-4aa003f2e7f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:23.551549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-82c3cf39-373f-431b-89e0-4aa003f2e7f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:23.559141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82c3cf39-373f-431b-89e0-4aa003f2e7f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:23.559585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82c3cf39-373f-431b-89e0-4aa003f2e7f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:23.560420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82c3cf39-373f-431b-89e0-4aa003f2e7f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:23.561434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82c3cf39-373f-431b-89e0-4aa003f2e7f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:23.682516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e978bd12-58fa-42ac-941c-a7feca93bb32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:23.691791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e978bd12-58fa-42ac-941c-a7feca93bb32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167553 Jul 26 18:49:23.692569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1428/2882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:23 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:23.700319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-82c3cf39-373f-431b-89e0-4aa003f2e7f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:23.702682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:23.706108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7c611e0b-a1a5-403a-b8ce-117a728fd965 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:23.706715 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7c611e0b-a1a5-403a-b8ce-117a728fd965 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:23.709856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-82c3cf39-373f-431b-89e0-4aa003f2e7f9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163391 Jul 26 18:49:23.710440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1455/2883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:23 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:23.712950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c611e0b-a1a5-403a-b8ce-117a728fd965 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:23.713397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c611e0b-a1a5-403a-b8ce-117a728fd965 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:23.714152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c611e0b-a1a5-403a-b8ce-117a728fd965 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:23.714579 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c611e0b-a1a5-403a-b8ce-117a728fd965 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:23.728880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9ec849ba-085c-4d69-a0be-b56ecd8bd4ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:23.729486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9ec849ba-085c-4d69-a0be-b56ecd8bd4ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:23.736568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ec849ba-085c-4d69-a0be-b56ecd8bd4ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:23.737016 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ec849ba-085c-4d69-a0be-b56ecd8bd4ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:23.737786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ec849ba-085c-4d69-a0be-b56ecd8bd4ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:23.738225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ec849ba-085c-4d69-a0be-b56ecd8bd4ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:23.848779 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7c611e0b-a1a5-403a-b8ce-117a728fd965 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:23.851035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:23.858232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7c611e0b-a1a5-403a-b8ce-117a728fd965 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.164897 Jul 26 18:49:23.858994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1429/2884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:23 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:23.863568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-648e14b4-b55e-42c6-afbb-b41d62dee6f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:23.864157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-648e14b4-b55e-42c6-afbb-b41d62dee6f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:23.870455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-648e14b4-b55e-42c6-afbb-b41d62dee6f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:23.871055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-648e14b4-b55e-42c6-afbb-b41d62dee6f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:23.871833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-648e14b4-b55e-42c6-afbb-b41d62dee6f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:23.872263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-648e14b4-b55e-42c6-afbb-b41d62dee6f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:23.874207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9ec849ba-085c-4d69-a0be-b56ecd8bd4ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:23.883188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9ec849ba-085c-4d69-a0be-b56ecd8bd4ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:23.884686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9ec849ba-085c-4d69-a0be-b56ecd8bd4ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:23.885858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9ec849ba-085c-4d69-a0be-b56ecd8bd4ff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161659 Jul 26 18:49:23.886391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1456/2885] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:23 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:24.013347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-648e14b4-b55e-42c6-afbb-b41d62dee6f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:24.021767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-648e14b4-b55e-42c6-afbb-b41d62dee6f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161891 Jul 26 18:49:24.022338 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1430/2886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:23 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:24.716877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-23f9d5c1-3445-4d13-8d18-00a9119b19b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:24.717775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-23f9d5c1-3445-4d13-8d18-00a9119b19b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:24.728120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23f9d5c1-3445-4d13-8d18-00a9119b19b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:24.728643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23f9d5c1-3445-4d13-8d18-00a9119b19b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:24.729515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23f9d5c1-3445-4d13-8d18-00a9119b19b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:24.730018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23f9d5c1-3445-4d13-8d18-00a9119b19b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:24.732517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a7ac3a89-fafe-4df3-8420-c5209aa60532 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:24.733156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a7ac3a89-fafe-4df3-8420-c5209aa60532 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:24.740024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7ac3a89-fafe-4df3-8420-c5209aa60532 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:24.740476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7ac3a89-fafe-4df3-8420-c5209aa60532 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:24.745644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7ac3a89-fafe-4df3-8420-c5209aa60532 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:24.745644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7ac3a89-fafe-4df3-8420-c5209aa60532 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:24.862273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-23f9d5c1-3445-4d13-8d18-00a9119b19b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:24.870777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-23f9d5c1-3445-4d13-8d18-00a9119b19b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160147 Jul 26 18:49:24.871057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a7ac3a89-fafe-4df3-8420-c5209aa60532 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:24.871811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1457/2887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:24 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:24.879284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a7ac3a89-fafe-4df3-8420-c5209aa60532 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.151245 Jul 26 18:49:24.879799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1431/2888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:24 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:24.884776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e2d7af11-701b-4d6f-94d4-c82f8f317fd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:24.885374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e2d7af11-701b-4d6f-94d4-c82f8f317fd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:24.891517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2d7af11-701b-4d6f-94d4-c82f8f317fd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:24.891957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2d7af11-701b-4d6f-94d4-c82f8f317fd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:24.892697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2d7af11-701b-4d6f-94d4-c82f8f317fd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:24.893123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2d7af11-701b-4d6f-94d4-c82f8f317fd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:24.909279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-663b92d1-565b-43b8-b076-aa7bf9e7657b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:24.909883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-663b92d1-565b-43b8-b076-aa7bf9e7657b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:24.916041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-663b92d1-565b-43b8-b076-aa7bf9e7657b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:24.916487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-663b92d1-565b-43b8-b076-aa7bf9e7657b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:24.917238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-663b92d1-565b-43b8-b076-aa7bf9e7657b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:24.917665 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-663b92d1-565b-43b8-b076-aa7bf9e7657b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:25.025671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e2d7af11-701b-4d6f-94d4-c82f8f317fd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:25.034105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e2d7af11-701b-4d6f-94d4-c82f8f317fd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.158382 Jul 26 18:49:25.034682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1458/2889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:24 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:25.043713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c68561e9-72ee-4496-b8e7-47fdcac5ca0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:25.044508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c68561e9-72ee-4496-b8e7-47fdcac5ca0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:25.051042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c68561e9-72ee-4496-b8e7-47fdcac5ca0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:25.051488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-663b92d1-565b-43b8-b076-aa7bf9e7657b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:25.051631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c68561e9-72ee-4496-b8e7-47fdcac5ca0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:25.052238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c68561e9-72ee-4496-b8e7-47fdcac5ca0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:25.052661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c68561e9-72ee-4496-b8e7-47fdcac5ca0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:25.060011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-663b92d1-565b-43b8-b076-aa7bf9e7657b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:25.061516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-663b92d1-565b-43b8-b076-aa7bf9e7657b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:25.062669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-663b92d1-565b-43b8-b076-aa7bf9e7657b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157231 Jul 26 18:49:25.063255 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1432/2890] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:25.183097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c68561e9-72ee-4496-b8e7-47fdcac5ca0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:25.195529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c68561e9-72ee-4496-b8e7-47fdcac5ca0e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155344 Jul 26 18:49:25.196349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1459/2891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:25 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:25.894066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2f1d485f-32ca-4c33-9b1c-d8ff4096ae7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:25.894673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2f1d485f-32ca-4c33-9b1c-d8ff4096ae7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:25.900206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-54676b74-7f71-462f-a312-9483be43534f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:25.900890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-54676b74-7f71-462f-a312-9483be43534f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:25.901936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f1d485f-32ca-4c33-9b1c-d8ff4096ae7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:25.902391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f1d485f-32ca-4c33-9b1c-d8ff4096ae7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:25.903184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f1d485f-32ca-4c33-9b1c-d8ff4096ae7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:25.903615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2f1d485f-32ca-4c33-9b1c-d8ff4096ae7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:25.907847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54676b74-7f71-462f-a312-9483be43534f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:25.908441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54676b74-7f71-462f-a312-9483be43534f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:25.909216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54676b74-7f71-462f-a312-9483be43534f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:25.909772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54676b74-7f71-462f-a312-9483be43534f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:26.035874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2f1d485f-32ca-4c33-9b1c-d8ff4096ae7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:26.044159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2f1d485f-32ca-4c33-9b1c-d8ff4096ae7b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154002 Jul 26 18:49:26.044792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1433/2892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:25 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:26.045821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-54676b74-7f71-462f-a312-9483be43534f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:26.054075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dc4dfc7f-d565-4539-9d77-906cef8d6487 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:26.054267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-54676b74-7f71-462f-a312-9483be43534f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158210 Jul 26 18:49:26.054679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dc4dfc7f-d565-4539-9d77-906cef8d6487 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:26.067053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1460/2893] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:25 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:26.067219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc4dfc7f-d565-4539-9d77-906cef8d6487 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:26.067219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc4dfc7f-d565-4539-9d77-906cef8d6487 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:26.067219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc4dfc7f-d565-4539-9d77-906cef8d6487 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:26.067219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc4dfc7f-d565-4539-9d77-906cef8d6487 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:26.084790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7fd73d55-d458-466a-9356-3f9b46ac5fb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:26.085390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7fd73d55-d458-466a-9356-3f9b46ac5fb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:26.091384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7fd73d55-d458-466a-9356-3f9b46ac5fb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:26.091830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7fd73d55-d458-466a-9356-3f9b46ac5fb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:26.092580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7fd73d55-d458-466a-9356-3f9b46ac5fb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:26.093014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7fd73d55-d458-466a-9356-3f9b46ac5fb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:26.194678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dc4dfc7f-d565-4539-9d77-906cef8d6487 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:26.202926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dc4dfc7f-d565-4539-9d77-906cef8d6487 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152489 Jul 26 18:49:26.203664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1434/2894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:26 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:26.219598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7e069efd-1869-4d2e-8ac1-44923595dee8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:26.220208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7e069efd-1869-4d2e-8ac1-44923595dee8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:26.224562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7fd73d55-d458-466a-9356-3f9b46ac5fb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:26.226439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e069efd-1869-4d2e-8ac1-44923595dee8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:26.226891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e069efd-1869-4d2e-8ac1-44923595dee8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:26.227680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e069efd-1869-4d2e-8ac1-44923595dee8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:26.228120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e069efd-1869-4d2e-8ac1-44923595dee8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:26.233682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7fd73d55-d458-466a-9356-3f9b46ac5fb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:26.235341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7fd73d55-d458-466a-9356-3f9b46ac5fb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:26.236570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7fd73d55-d458-466a-9356-3f9b46ac5fb8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155602 Jul 26 18:49:26.237208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1461/2895] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:26.358104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7e069efd-1869-4d2e-8ac1-44923595dee8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:26.369451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7e069efd-1869-4d2e-8ac1-44923595dee8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153304 Jul 26 18:49:26.370204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1435/2896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:26 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:27.070469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-40e0becf-074c-4f19-8437-0d10dfc18c8e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:27.071383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-40e0becf-074c-4f19-8437-0d10dfc18c8e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:27.079607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-07026c7c-2326-4c11-a02f-5cd3cf904645 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:27.080601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-07026c7c-2326-4c11-a02f-5cd3cf904645 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:27.082440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40e0becf-074c-4f19-8437-0d10dfc18c8e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:27.083256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40e0becf-074c-4f19-8437-0d10dfc18c8e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:27.084522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40e0becf-074c-4f19-8437-0d10dfc18c8e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:27.085447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40e0becf-074c-4f19-8437-0d10dfc18c8e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:27.090178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07026c7c-2326-4c11-a02f-5cd3cf904645 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:27.090911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07026c7c-2326-4c11-a02f-5cd3cf904645 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:27.091896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07026c7c-2326-4c11-a02f-5cd3cf904645 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:27.092325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-07026c7c-2326-4c11-a02f-5cd3cf904645 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:27.218777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-40e0becf-074c-4f19-8437-0d10dfc18c8e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:27.223322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-07026c7c-2326-4c11-a02f-5cd3cf904645 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:27.228486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-40e0becf-074c-4f19-8437-0d10dfc18c8e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.164470 Jul 26 18:49:27.229242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1462/2897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:27 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:27.231228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-07026c7c-2326-4c11-a02f-5cd3cf904645 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158170 Jul 26 18:49:27.231919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1436/2898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:27.233745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0b41b040-71f2-4722-bd8d-2c4085a91991 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:27.234343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0b41b040-71f2-4722-bd8d-2c4085a91991 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:27.240372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b41b040-71f2-4722-bd8d-2c4085a91991 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:27.240833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b41b040-71f2-4722-bd8d-2c4085a91991 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:27.241636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b41b040-71f2-4722-bd8d-2c4085a91991 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:27.242043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b41b040-71f2-4722-bd8d-2c4085a91991 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:27.258943 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7a9a7a50-b584-45f0-bc52-365fea7bc249 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:27.259573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7a9a7a50-b584-45f0-bc52-365fea7bc249 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:27.265540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a50-b584-45f0-bc52-365fea7bc249 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:27.265985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a50-b584-45f0-bc52-365fea7bc249 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:27.266737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a50-b584-45f0-bc52-365fea7bc249 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:27.267165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a9a7a50-b584-45f0-bc52-365fea7bc249 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:27.377020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0b41b040-71f2-4722-bd8d-2c4085a91991 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:27.385038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0b41b040-71f2-4722-bd8d-2c4085a91991 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154898 Jul 26 18:49:27.385795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1463/2899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:27 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:27.394889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0ac13f39-fd21-42c4-bdff-143ccb3621db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:27.395532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0ac13f39-fd21-42c4-bdff-143ccb3621db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:27.399271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a9a7a50-b584-45f0-bc52-365fea7bc249 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:27.401955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ac13f39-fd21-42c4-bdff-143ccb3621db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:27.402410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ac13f39-fd21-42c4-bdff-143ccb3621db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:27.403213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ac13f39-fd21-42c4-bdff-143ccb3621db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:27.403672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ac13f39-fd21-42c4-bdff-143ccb3621db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:27.407889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a9a7a50-b584-45f0-bc52-365fea7bc249 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:27.409401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a9a7a50-b584-45f0-bc52-365fea7bc249 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:27.410551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7a9a7a50-b584-45f0-bc52-365fea7bc249 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155478 Jul 26 18:49:27.411129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1437/2900] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:27 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:27.533524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0ac13f39-fd21-42c4-bdff-143ccb3621db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:27.541845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0ac13f39-fd21-42c4-bdff-143ccb3621db tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153741 Jul 26 18:49:27.542418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1464/2901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:27 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:28.253959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eff0fdcb-0c01-452f-83cd-cd2039389ed4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:28.254877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eff0fdcb-0c01-452f-83cd-cd2039389ed4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:28.256274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-54cf7ad9-48e3-4b15-9ac0-a9584ce5178d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:28.257371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-54cf7ad9-48e3-4b15-9ac0-a9584ce5178d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:28.264819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eff0fdcb-0c01-452f-83cd-cd2039389ed4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:28.265265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eff0fdcb-0c01-452f-83cd-cd2039389ed4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:28.266017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eff0fdcb-0c01-452f-83cd-cd2039389ed4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:28.266172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54cf7ad9-48e3-4b15-9ac0-a9584ce5178d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:28.266443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eff0fdcb-0c01-452f-83cd-cd2039389ed4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:28.266610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54cf7ad9-48e3-4b15-9ac0-a9584ce5178d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:28.267357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54cf7ad9-48e3-4b15-9ac0-a9584ce5178d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:28.267787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54cf7ad9-48e3-4b15-9ac0-a9584ce5178d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:28.399570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-54cf7ad9-48e3-4b15-9ac0-a9584ce5178d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:28.401179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eff0fdcb-0c01-452f-83cd-cd2039389ed4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:28.408700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-54cf7ad9-48e3-4b15-9ac0-a9584ce5178d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158984 Jul 26 18:49:28.409308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1465/2902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:28 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:28.409788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eff0fdcb-0c01-452f-83cd-cd2039389ed4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162300 Jul 26 18:49:28.410387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1438/2903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:28 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:28.418652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-84ff71bd-3478-44c8-b765-28995e6dc677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:28.419507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-84ff71bd-3478-44c8-b765-28995e6dc677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:28.425925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-84ff71bd-3478-44c8-b765-28995e6dc677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:28.426410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-84ff71bd-3478-44c8-b765-28995e6dc677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:28.427253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-84ff71bd-3478-44c8-b765-28995e6dc677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:28.427696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-84ff71bd-3478-44c8-b765-28995e6dc677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:28.432667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b0bbf01e-b6b1-4813-a03d-d26262393ca7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:28.433267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b0bbf01e-b6b1-4813-a03d-d26262393ca7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:28.439299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0bbf01e-b6b1-4813-a03d-d26262393ca7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:28.439745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0bbf01e-b6b1-4813-a03d-d26262393ca7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:28.440498 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0bbf01e-b6b1-4813-a03d-d26262393ca7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:28.440930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0bbf01e-b6b1-4813-a03d-d26262393ca7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:28.557774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-84ff71bd-3478-44c8-b765-28995e6dc677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:28.565963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-84ff71bd-3478-44c8-b765-28995e6dc677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155701 Jul 26 18:49:28.566522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1466/2904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:28 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:28.570922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-73cf9c98-4803-4ef6-bfac-094ca0605a17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:28.571541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-73cf9c98-4803-4ef6-bfac-094ca0605a17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:28.574340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b0bbf01e-b6b1-4813-a03d-d26262393ca7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:28.577548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73cf9c98-4803-4ef6-bfac-094ca0605a17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:28.578001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73cf9c98-4803-4ef6-bfac-094ca0605a17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:28.578777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73cf9c98-4803-4ef6-bfac-094ca0605a17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:28.579226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73cf9c98-4803-4ef6-bfac-094ca0605a17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:28.584099 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b0bbf01e-b6b1-4813-a03d-d26262393ca7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:28.585861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b0bbf01e-b6b1-4813-a03d-d26262393ca7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:28.587752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b0bbf01e-b6b1-4813-a03d-d26262393ca7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158145 Jul 26 18:49:28.587752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1439/2905] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:28.712894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-73cf9c98-4803-4ef6-bfac-094ca0605a17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:28.721083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-73cf9c98-4803-4ef6-bfac-094ca0605a17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153646 Jul 26 18:49:28.721661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1467/2906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:28 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:29.434024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ef0e445d-5896-4823-89db-de0b7ebfde4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:29.435160 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ef0e445d-5896-4823-89db-de0b7ebfde4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:29.435367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d1c8c3fa-6fd9-4878-ac3a-e05d2ab4263d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:29.435783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d1c8c3fa-6fd9-4878-ac3a-e05d2ab4263d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:29.442321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef0e445d-5896-4823-89db-de0b7ebfde4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:29.442679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1c8c3fa-6fd9-4878-ac3a-e05d2ab4263d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:29.442865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef0e445d-5896-4823-89db-de0b7ebfde4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:29.443148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1c8c3fa-6fd9-4878-ac3a-e05d2ab4263d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:29.443587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef0e445d-5896-4823-89db-de0b7ebfde4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:29.443919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1c8c3fa-6fd9-4878-ac3a-e05d2ab4263d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:29.444213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef0e445d-5896-4823-89db-de0b7ebfde4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:29.444348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1c8c3fa-6fd9-4878-ac3a-e05d2ab4263d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:29.577099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d1c8c3fa-6fd9-4878-ac3a-e05d2ab4263d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:29.577623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ef0e445d-5896-4823-89db-de0b7ebfde4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:29.585391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d1c8c3fa-6fd9-4878-ac3a-e05d2ab4263d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156827 Jul 26 18:49:29.586123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1468/2907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:29 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:29.586324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ef0e445d-5896-4823-89db-de0b7ebfde4c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158782 Jul 26 18:49:29.587184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1440/2908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:29 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:29.590324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a5a909e0-df7c-4461-846d-cfad4ae83a4e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:29.591171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a5a909e0-df7c-4461-846d-cfad4ae83a4e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:29.596898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5a909e0-df7c-4461-846d-cfad4ae83a4e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:29.597335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5a909e0-df7c-4461-846d-cfad4ae83a4e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:29.598073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5a909e0-df7c-4461-846d-cfad4ae83a4e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:29.598496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a5a909e0-df7c-4461-846d-cfad4ae83a4e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:29.609660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c3d843bd-3b1e-465d-b72e-8b873f995df8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:29.610409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c3d843bd-3b1e-465d-b72e-8b873f995df8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:29.616615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3d843bd-3b1e-465d-b72e-8b873f995df8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:29.617128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3d843bd-3b1e-465d-b72e-8b873f995df8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:29.617951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3d843bd-3b1e-465d-b72e-8b873f995df8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:29.618457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3d843bd-3b1e-465d-b72e-8b873f995df8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:29.731322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a5a909e0-df7c-4461-846d-cfad4ae83a4e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:29.739934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a5a909e0-df7c-4461-846d-cfad4ae83a4e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152755 Jul 26 18:49:29.740483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1469/2909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:29 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:29.745371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1a9b77b3-83bd-4b41-912a-5211fd80ba28 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:29.745537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1a9b77b3-83bd-4b41-912a-5211fd80ba28 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:29.751461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a9b77b3-83bd-4b41-912a-5211fd80ba28 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:29.751907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a9b77b3-83bd-4b41-912a-5211fd80ba28 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:29.752659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a9b77b3-83bd-4b41-912a-5211fd80ba28 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:29.753084 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a9b77b3-83bd-4b41-912a-5211fd80ba28 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:29.757464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c3d843bd-3b1e-465d-b72e-8b873f995df8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:29.766216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c3d843bd-3b1e-465d-b72e-8b873f995df8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:29.767743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c3d843bd-3b1e-465d-b72e-8b873f995df8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:29.768891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c3d843bd-3b1e-465d-b72e-8b873f995df8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.163176 Jul 26 18:49:29.769454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1441/2910] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:29.885316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1a9b77b3-83bd-4b41-912a-5211fd80ba28 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:29.893651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1a9b77b3-83bd-4b41-912a-5211fd80ba28 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152194 Jul 26 18:49:29.894206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1470/2911] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:29 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:30.609879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a0a1edfd-fcc0-4614-8c0c-67d4415ebcde tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:30.610581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a6efd46b-45b3-464b-9a58-d9fd981013e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:30.610581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a6efd46b-45b3-464b-9a58-d9fd981013e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:30.611114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a0a1edfd-fcc0-4614-8c0c-67d4415ebcde tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:30.618233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0a1edfd-fcc0-4614-8c0c-67d4415ebcde tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:30.618447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a6efd46b-45b3-464b-9a58-d9fd981013e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:30.618735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0a1edfd-fcc0-4614-8c0c-67d4415ebcde tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:30.618937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a6efd46b-45b3-464b-9a58-d9fd981013e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:30.619592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0a1edfd-fcc0-4614-8c0c-67d4415ebcde tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:30.619842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a6efd46b-45b3-464b-9a58-d9fd981013e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:30.620108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a0a1edfd-fcc0-4614-8c0c-67d4415ebcde tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:30.620471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a6efd46b-45b3-464b-9a58-d9fd981013e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:30.755556 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a0a1edfd-fcc0-4614-8c0c-67d4415ebcde tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:30.758960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a6efd46b-45b3-464b-9a58-d9fd981013e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:30.763807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a0a1edfd-fcc0-4614-8c0c-67d4415ebcde tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.159083 Jul 26 18:49:30.764865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1442/2912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:30 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:30.767328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a6efd46b-45b3-464b-9a58-d9fd981013e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.162336 Jul 26 18:49:30.770789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1471/2913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:30 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:30.771637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1455d37f-6c93-4ed1-9a0b-21c5c85b05cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:30.772913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1455d37f-6c93-4ed1-9a0b-21c5c85b05cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:30.778971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1455d37f-6c93-4ed1-9a0b-21c5c85b05cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:30.779446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1455d37f-6c93-4ed1-9a0b-21c5c85b05cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:30.780191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1455d37f-6c93-4ed1-9a0b-21c5c85b05cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:30.780617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1455d37f-6c93-4ed1-9a0b-21c5c85b05cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:30.791996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d797a5af-fc30-4460-b436-4dcdb381520a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:30.792763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d797a5af-fc30-4460-b436-4dcdb381520a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:30.799127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d797a5af-fc30-4460-b436-4dcdb381520a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:30.799578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d797a5af-fc30-4460-b436-4dcdb381520a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:30.800335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d797a5af-fc30-4460-b436-4dcdb381520a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:30.800764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d797a5af-fc30-4460-b436-4dcdb381520a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:30.815882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:30.914862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1455d37f-6c93-4ed1-9a0b-21c5c85b05cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:30.922998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1455d37f-6c93-4ed1-9a0b-21c5c85b05cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157057 Jul 26 18:49:30.923908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1443/2914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:30 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:30.928603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a3573c53-0133-4c7f-b15a-574021382a02 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:30.929234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a3573c53-0133-4c7f-b15a-574021382a02 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:30.935270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a3573c53-0133-4c7f-b15a-574021382a02 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:30.935721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a3573c53-0133-4c7f-b15a-574021382a02 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:30.936507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a3573c53-0133-4c7f-b15a-574021382a02 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:30.936940 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a3573c53-0133-4c7f-b15a-574021382a02 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:30.944600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d797a5af-fc30-4460-b436-4dcdb381520a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:30.953165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d797a5af-fc30-4460-b436-4dcdb381520a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:30.954714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d797a5af-fc30-4460-b436-4dcdb381520a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:30.955875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d797a5af-fc30-4460-b436-4dcdb381520a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.167816 Jul 26 18:49:30.956435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1472/2915] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:31.073236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a3573c53-0133-4c7f-b15a-574021382a02 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:31.081737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a3573c53-0133-4c7f-b15a-574021382a02 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156863 Jul 26 18:49:31.082345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1444/2916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:30 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:31.785750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-03222556-2a51-4436-bcf7-26a884e2d531 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:31.786961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-03222556-2a51-4436-bcf7-26a884e2d531 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:31.789705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-22e679f6-ae75-4d6b-9309-36b6ff96dc19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:31.790423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-22e679f6-ae75-4d6b-9309-36b6ff96dc19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:31.794826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-03222556-2a51-4436-bcf7-26a884e2d531 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:31.795282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-03222556-2a51-4436-bcf7-26a884e2d531 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:31.796022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-03222556-2a51-4436-bcf7-26a884e2d531 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:31.796508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-03222556-2a51-4436-bcf7-26a884e2d531 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:31.798325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22e679f6-ae75-4d6b-9309-36b6ff96dc19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:31.798895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22e679f6-ae75-4d6b-9309-36b6ff96dc19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:31.799771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22e679f6-ae75-4d6b-9309-36b6ff96dc19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:31.801835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22e679f6-ae75-4d6b-9309-36b6ff96dc19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:31.930560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-03222556-2a51-4436-bcf7-26a884e2d531 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:31.931337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-22e679f6-ae75-4d6b-9309-36b6ff96dc19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:31.938838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-03222556-2a51-4436-bcf7-26a884e2d531 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157165 Jul 26 18:49:31.939688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1473/2917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:31 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:31.939954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-22e679f6-ae75-4d6b-9309-36b6ff96dc19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154178 Jul 26 18:49:31.940562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1445/2918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:31 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:31.948371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-373696f9-38b1-44e9-b0ff-5717d2ab695e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:31.948977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-373696f9-38b1-44e9-b0ff-5717d2ab695e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:31.955145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-373696f9-38b1-44e9-b0ff-5717d2ab695e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:31.955593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-373696f9-38b1-44e9-b0ff-5717d2ab695e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:31.956356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-373696f9-38b1-44e9-b0ff-5717d2ab695e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:31.956783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-373696f9-38b1-44e9-b0ff-5717d2ab695e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:31.979305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6a3df27c-689d-44c6-b9f0-7ab10861e81c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:31.979917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6a3df27c-689d-44c6-b9f0-7ab10861e81c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:31.986062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a3df27c-689d-44c6-b9f0-7ab10861e81c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:31.986514 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a3df27c-689d-44c6-b9f0-7ab10861e81c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:31.987308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a3df27c-689d-44c6-b9f0-7ab10861e81c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:31.987739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a3df27c-689d-44c6-b9f0-7ab10861e81c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:32.003051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:32.088029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-373696f9-38b1-44e9-b0ff-5717d2ab695e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:32.096431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-373696f9-38b1-44e9-b0ff-5717d2ab695e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151665 Jul 26 18:49:32.098719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1474/2919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:31 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:32.103348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f4934088-6677-408b-b0a0-a68ea30d0a58 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:32.103975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f4934088-6677-408b-b0a0-a68ea30d0a58 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:32.110963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4934088-6677-408b-b0a0-a68ea30d0a58 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:32.111452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4934088-6677-408b-b0a0-a68ea30d0a58 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:32.112221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4934088-6677-408b-b0a0-a68ea30d0a58 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:32.112639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4934088-6677-408b-b0a0-a68ea30d0a58 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:32.121881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6a3df27c-689d-44c6-b9f0-7ab10861e81c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:32.130467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6a3df27c-689d-44c6-b9f0-7ab10861e81c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:32.132006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6a3df27c-689d-44c6-b9f0-7ab10861e81c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:32.133165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6a3df27c-689d-44c6-b9f0-7ab10861e81c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157739 Jul 26 18:49:32.133952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1446/2920] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:32.243519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f4934088-6677-408b-b0a0-a68ea30d0a58 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:32.256037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f4934088-6677-408b-b0a0-a68ea30d0a58 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155894 Jul 26 18:49:32.256777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1475/2921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:32 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:32.964848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6e89a143-c414-499b-a7c5-f5f0495a26d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:32.965826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e051205a-26c7-43eb-bb8c-40c98115152c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:32.965826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e051205a-26c7-43eb-bb8c-40c98115152c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:32.966592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6e89a143-c414-499b-a7c5-f5f0495a26d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:32.976269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e051205a-26c7-43eb-bb8c-40c98115152c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:32.976559 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e89a143-c414-499b-a7c5-f5f0495a26d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:32.977212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e89a143-c414-499b-a7c5-f5f0495a26d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:32.977495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e051205a-26c7-43eb-bb8c-40c98115152c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:32.978424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e89a143-c414-499b-a7c5-f5f0495a26d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:32.978678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e051205a-26c7-43eb-bb8c-40c98115152c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:32.979190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e051205a-26c7-43eb-bb8c-40c98115152c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:32.979427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6e89a143-c414-499b-a7c5-f5f0495a26d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:33.110825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e051205a-26c7-43eb-bb8c-40c98115152c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:33.111253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6e89a143-c414-499b-a7c5-f5f0495a26d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:33.119374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e051205a-26c7-43eb-bb8c-40c98115152c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160910 Jul 26 18:49:33.119576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6e89a143-c414-499b-a7c5-f5f0495a26d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160932 Jul 26 18:49:33.120113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1447/2923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:32 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:33.120243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1476/2923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:32 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:33.124616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-62f18117-23f9-42c4-a80e-0d19dce18502 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:33.125223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-62f18117-23f9-42c4-a80e-0d19dce18502 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:33.131260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62f18117-23f9-42c4-a80e-0d19dce18502 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:33.131707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62f18117-23f9-42c4-a80e-0d19dce18502 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:33.132459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62f18117-23f9-42c4-a80e-0d19dce18502 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:33.132884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62f18117-23f9-42c4-a80e-0d19dce18502 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:33.157288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c6c406ec-cb23-44a7-914f-db298f924c01 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:33.157922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c6c406ec-cb23-44a7-914f-db298f924c01 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:33.164102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6c406ec-cb23-44a7-914f-db298f924c01 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:33.164549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6c406ec-cb23-44a7-914f-db298f924c01 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:33.165308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6c406ec-cb23-44a7-914f-db298f924c01 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:33.165737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6c406ec-cb23-44a7-914f-db298f924c01 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:33.265155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-62f18117-23f9-42c4-a80e-0d19dce18502 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:33.273757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-62f18117-23f9-42c4-a80e-0d19dce18502 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152771 Jul 26 18:49:33.285190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1448/2924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:33 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:33.290023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dee47e59-0dde-4dd4-8fce-f5a683052efb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:33.290621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dee47e59-0dde-4dd4-8fce-f5a683052efb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:33.296890 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dee47e59-0dde-4dd4-8fce-f5a683052efb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:33.297352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dee47e59-0dde-4dd4-8fce-f5a683052efb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:33.298111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dee47e59-0dde-4dd4-8fce-f5a683052efb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:33.298541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dee47e59-0dde-4dd4-8fce-f5a683052efb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:33.300845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c6c406ec-cb23-44a7-914f-db298f924c01 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:33.309784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c6c406ec-cb23-44a7-914f-db298f924c01 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:33.311407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c6c406ec-cb23-44a7-914f-db298f924c01 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:33.312644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c6c406ec-cb23-44a7-914f-db298f924c01 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159561 Jul 26 18:49:33.313312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1477/2925] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:33.428317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dee47e59-0dde-4dd4-8fce-f5a683052efb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:33.440376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dee47e59-0dde-4dd4-8fce-f5a683052efb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153768 Jul 26 18:49:33.441238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1449/2926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:33 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:34.143512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8448fa82-1f3a-4784-8479-21de5f0e7204 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:34.144161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8448fa82-1f3a-4784-8479-21de5f0e7204 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:34.144857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f7fab09f-f4ee-410f-9a3a-b2cd0349236b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:34.145610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f7fab09f-f4ee-410f-9a3a-b2cd0349236b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:34.152521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8448fa82-1f3a-4784-8479-21de5f0e7204 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:34.153047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8448fa82-1f3a-4784-8479-21de5f0e7204 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:34.153997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8448fa82-1f3a-4784-8479-21de5f0e7204 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:34.154306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7fab09f-f4ee-410f-9a3a-b2cd0349236b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:34.154519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8448fa82-1f3a-4784-8479-21de5f0e7204 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:34.154874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7fab09f-f4ee-410f-9a3a-b2cd0349236b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:34.155882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7fab09f-f4ee-410f-9a3a-b2cd0349236b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:34.156430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7fab09f-f4ee-410f-9a3a-b2cd0349236b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:34.286033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f7fab09f-f4ee-410f-9a3a-b2cd0349236b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:34.287196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8448fa82-1f3a-4784-8479-21de5f0e7204 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:34.294793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f7fab09f-f4ee-410f-9a3a-b2cd0349236b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154552 Jul 26 18:49:34.295441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1450/2927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:34 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:34.295916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8448fa82-1f3a-4784-8479-21de5f0e7204 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157332 Jul 26 18:49:34.296575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1478/2928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:34 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:34.300089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-27b354ef-bc93-470e-8c51-3e648c745694 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:34.300688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-27b354ef-bc93-470e-8c51-3e648c745694 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:34.306681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27b354ef-bc93-470e-8c51-3e648c745694 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:34.307170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27b354ef-bc93-470e-8c51-3e648c745694 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:34.307923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27b354ef-bc93-470e-8c51-3e648c745694 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:34.308354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27b354ef-bc93-470e-8c51-3e648c745694 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:34.335619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9c395b7f-ecb4-4178-9df9-d351a3d26899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:34.336348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9c395b7f-ecb4-4178-9df9-d351a3d26899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:34.342355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c395b7f-ecb4-4178-9df9-d351a3d26899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:34.342799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c395b7f-ecb4-4178-9df9-d351a3d26899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:34.343581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c395b7f-ecb4-4178-9df9-d351a3d26899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:34.344011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9c395b7f-ecb4-4178-9df9-d351a3d26899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:34.441256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-27b354ef-bc93-470e-8c51-3e648c745694 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:34.450146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-27b354ef-bc93-470e-8c51-3e648c745694 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153739 Jul 26 18:49:34.451400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1451/2929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:34 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:34.465429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7252852f-c504-4055-9d40-9e9cfcc486a1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:34.466042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7252852f-c504-4055-9d40-9e9cfcc486a1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:34.472232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7252852f-c504-4055-9d40-9e9cfcc486a1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:34.472682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7252852f-c504-4055-9d40-9e9cfcc486a1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:34.473657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7252852f-c504-4055-9d40-9e9cfcc486a1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:34.473803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7252852f-c504-4055-9d40-9e9cfcc486a1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:34.481108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9c395b7f-ecb4-4178-9df9-d351a3d26899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:34.489727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9c395b7f-ecb4-4178-9df9-d351a3d26899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:34.491267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9c395b7f-ecb4-4178-9df9-d351a3d26899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:34.492431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9c395b7f-ecb4-4178-9df9-d351a3d26899 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160711 Jul 26 18:49:34.495768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1479/2930] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:34 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:34.602350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7252852f-c504-4055-9d40-9e9cfcc486a1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:34.611202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7252852f-c504-4055-9d40-9e9cfcc486a1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.149456 Jul 26 18:49:34.611788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1452/2931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:34 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:35.320513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ed51573d-eb0d-4a46-9122-77c404df6b0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:35.321414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-70da0a37-76dd-443d-8341-7d65a263dd2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:35.322044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ed51573d-eb0d-4a46-9122-77c404df6b0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:35.322239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-70da0a37-76dd-443d-8341-7d65a263dd2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:35.332820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed51573d-eb0d-4a46-9122-77c404df6b0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:35.333112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70da0a37-76dd-443d-8341-7d65a263dd2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:35.333559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed51573d-eb0d-4a46-9122-77c404df6b0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:35.333814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70da0a37-76dd-443d-8341-7d65a263dd2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:35.334794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed51573d-eb0d-4a46-9122-77c404df6b0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:35.335131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70da0a37-76dd-443d-8341-7d65a263dd2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:35.335554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed51573d-eb0d-4a46-9122-77c404df6b0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:35.335808 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70da0a37-76dd-443d-8341-7d65a263dd2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:35.471869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ed51573d-eb0d-4a46-9122-77c404df6b0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:35.472077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-70da0a37-76dd-443d-8341-7d65a263dd2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:35.480529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ed51573d-eb0d-4a46-9122-77c404df6b0a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.166634 Jul 26 18:49:35.481390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1480/2932] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:35 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:35.481852 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-70da0a37-76dd-443d-8341-7d65a263dd2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167090 Jul 26 18:49:35.495046 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1453/2933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:35 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:35.495259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2c50f963-6152-4e67-be11-227d58916ac1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:35.495259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2c50f963-6152-4e67-be11-227d58916ac1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:35.497251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2c50f963-6152-4e67-be11-227d58916ac1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:35.497719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2c50f963-6152-4e67-be11-227d58916ac1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:35.498471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2c50f963-6152-4e67-be11-227d58916ac1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:35.498900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2c50f963-6152-4e67-be11-227d58916ac1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:35.515194 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-80f96a3b-4803-42d1-bcc5-af18f07c730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:35.515876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-80f96a3b-4803-42d1-bcc5-af18f07c730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:35.521840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80f96a3b-4803-42d1-bcc5-af18f07c730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:35.522659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80f96a3b-4803-42d1-bcc5-af18f07c730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:35.523543 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80f96a3b-4803-42d1-bcc5-af18f07c730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:35.524034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80f96a3b-4803-42d1-bcc5-af18f07c730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:35.628214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2c50f963-6152-4e67-be11-227d58916ac1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:35.637014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2c50f963-6152-4e67-be11-227d58916ac1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154302 Jul 26 18:49:35.637714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1481/2934] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:35 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:35.642330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a71bd725-1ed1-4055-91af-d389e34147d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:35.642950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a71bd725-1ed1-4055-91af-d389e34147d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:35.650054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a71bd725-1ed1-4055-91af-d389e34147d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:35.650496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a71bd725-1ed1-4055-91af-d389e34147d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:35.651294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a71bd725-1ed1-4055-91af-d389e34147d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:35.651728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a71bd725-1ed1-4055-91af-d389e34147d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:35.654845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80f96a3b-4803-42d1-bcc5-af18f07c730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:35.664021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80f96a3b-4803-42d1-bcc5-af18f07c730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:35.665619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80f96a3b-4803-42d1-bcc5-af18f07c730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:35.666865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-80f96a3b-4803-42d1-bcc5-af18f07c730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155602 Jul 26 18:49:35.667427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1454/2935] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:35 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:35.789348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a71bd725-1ed1-4055-91af-d389e34147d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:35.797796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a71bd725-1ed1-4055-91af-d389e34147d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158995 Jul 26 18:49:35.798365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1482/2936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:35 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:36.506796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4e8bc890-48fc-4fc8-aeba-8e5efcad1b1e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:36.507862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4d91f31a-9e8d-4330-92a2-4bc4cedfab06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:36.508486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4e8bc890-48fc-4fc8-aeba-8e5efcad1b1e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:36.508676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4d91f31a-9e8d-4330-92a2-4bc4cedfab06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:36.516623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d91f31a-9e8d-4330-92a2-4bc4cedfab06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:36.516809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e8bc890-48fc-4fc8-aeba-8e5efcad1b1e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:36.517078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d91f31a-9e8d-4330-92a2-4bc4cedfab06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:36.517230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e8bc890-48fc-4fc8-aeba-8e5efcad1b1e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:36.517822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d91f31a-9e8d-4330-92a2-4bc4cedfab06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:36.517975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e8bc890-48fc-4fc8-aeba-8e5efcad1b1e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:36.518250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e8bc890-48fc-4fc8-aeba-8e5efcad1b1e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:36.518417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d91f31a-9e8d-4330-92a2-4bc4cedfab06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:36.650619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4e8bc890-48fc-4fc8-aeba-8e5efcad1b1e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:36.653552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4d91f31a-9e8d-4330-92a2-4bc4cedfab06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:36.658873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4e8bc890-48fc-4fc8-aeba-8e5efcad1b1e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158409 Jul 26 18:49:36.659483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1455/2937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:36 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:36.662085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4d91f31a-9e8d-4330-92a2-4bc4cedfab06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161616 Jul 26 18:49:36.662823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1483/2938] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:36 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:36.663889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-731a5c6e-21df-42ca-9d44-c29850a361b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:36.664508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-731a5c6e-21df-42ca-9d44-c29850a361b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:36.670700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-731a5c6e-21df-42ca-9d44-c29850a361b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:36.671230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-731a5c6e-21df-42ca-9d44-c29850a361b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:36.672072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-731a5c6e-21df-42ca-9d44-c29850a361b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:36.672503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-731a5c6e-21df-42ca-9d44-c29850a361b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:36.689800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d3241e7f-ea76-43b3-ab54-2e073b5ee8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:36.690391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d3241e7f-ea76-43b3-ab54-2e073b5ee8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:36.696356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3241e7f-ea76-43b3-ab54-2e073b5ee8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:36.696792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3241e7f-ea76-43b3-ab54-2e073b5ee8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:36.697536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3241e7f-ea76-43b3-ab54-2e073b5ee8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:36.697961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3241e7f-ea76-43b3-ab54-2e073b5ee8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:36.806114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-731a5c6e-21df-42ca-9d44-c29850a361b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:36.814409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-731a5c6e-21df-42ca-9d44-c29850a361b2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153962 Jul 26 18:49:36.815110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1456/2939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:36 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:36.819610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f8621a35-a473-4299-bf9b-200219968316 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:36.820213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f8621a35-a473-4299-bf9b-200219968316 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:36.826250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8621a35-a473-4299-bf9b-200219968316 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:36.826697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8621a35-a473-4299-bf9b-200219968316 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:36.827563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8621a35-a473-4299-bf9b-200219968316 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:36.828217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8621a35-a473-4299-bf9b-200219968316 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:36.832269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d3241e7f-ea76-43b3-ab54-2e073b5ee8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:36.841018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d3241e7f-ea76-43b3-ab54-2e073b5ee8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:36.842601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d3241e7f-ea76-43b3-ab54-2e073b5ee8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:36.843873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d3241e7f-ea76-43b3-ab54-2e073b5ee8b8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158127 Jul 26 18:49:36.844432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1484/2940] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:36 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:36.972281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f8621a35-a473-4299-bf9b-200219968316 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:36.980515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f8621a35-a473-4299-bf9b-200219968316 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.164435 Jul 26 18:49:36.981095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1457/2941] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:36 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:37.684418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-107f1033-bb11-48f4-af89-1d3b26dfad52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:37.685229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-107f1033-bb11-48f4-af89-1d3b26dfad52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:37.686433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f0ad5475-7eb0-466e-97e2-d437077d6522 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:37.687065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f0ad5475-7eb0-466e-97e2-d437077d6522 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:37.692216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-107f1033-bb11-48f4-af89-1d3b26dfad52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:37.692669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-107f1033-bb11-48f4-af89-1d3b26dfad52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:37.693418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-107f1033-bb11-48f4-af89-1d3b26dfad52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:37.693843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-107f1033-bb11-48f4-af89-1d3b26dfad52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:37.694104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0ad5475-7eb0-466e-97e2-d437077d6522 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:37.694561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0ad5475-7eb0-466e-97e2-d437077d6522 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:37.695390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0ad5475-7eb0-466e-97e2-d437077d6522 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:37.695823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0ad5475-7eb0-466e-97e2-d437077d6522 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:37.825625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f0ad5475-7eb0-466e-97e2-d437077d6522 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:37.827119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-107f1033-bb11-48f4-af89-1d3b26dfad52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:37.834034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f0ad5475-7eb0-466e-97e2-d437077d6522 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.152878 Jul 26 18:49:37.834607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1458/2942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:37 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:37.835048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-107f1033-bb11-48f4-af89-1d3b26dfad52 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157327 Jul 26 18:49:37.845951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1485/2943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:37 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:37.846121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0fe10c6c-3c67-4554-aeb5-df544c15379f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:37.846121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0fe10c6c-3c67-4554-aeb5-df544c15379f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:37.846121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fe10c6c-3c67-4554-aeb5-df544c15379f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:37.846121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fe10c6c-3c67-4554-aeb5-df544c15379f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:37.846695 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fe10c6c-3c67-4554-aeb5-df544c15379f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:37.847207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fe10c6c-3c67-4554-aeb5-df544c15379f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:37.866820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4936d0a5-3983-4d67-b667-7c2cf353fb58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:37.867481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4936d0a5-3983-4d67-b667-7c2cf353fb58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:37.873828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4936d0a5-3983-4d67-b667-7c2cf353fb58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:37.874241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4936d0a5-3983-4d67-b667-7c2cf353fb58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:37.875007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4936d0a5-3983-4d67-b667-7c2cf353fb58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:37.875472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4936d0a5-3983-4d67-b667-7c2cf353fb58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:37.976954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0fe10c6c-3c67-4554-aeb5-df544c15379f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:37.985464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0fe10c6c-3c67-4554-aeb5-df544c15379f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.149861 Jul 26 18:49:37.986039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1459/2944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:37 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:38.003561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4936d0a5-3983-4d67-b667-7c2cf353fb58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:38.008917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2808d85b-1da5-4bd8-afa6-b42c51434021 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:38.009646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2808d85b-1da5-4bd8-afa6-b42c51434021 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:38.012127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4936d0a5-3983-4d67-b667-7c2cf353fb58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:38.013692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4936d0a5-3983-4d67-b667-7c2cf353fb58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:38.014842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4936d0a5-3983-4d67-b667-7c2cf353fb58 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.151973 Jul 26 18:49:38.015416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1486/2945] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:38.015979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2808d85b-1da5-4bd8-afa6-b42c51434021 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:38.016502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2808d85b-1da5-4bd8-afa6-b42c51434021 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:38.017253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2808d85b-1da5-4bd8-afa6-b42c51434021 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:38.017680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2808d85b-1da5-4bd8-afa6-b42c51434021 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:38.148308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2808d85b-1da5-4bd8-afa6-b42c51434021 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:38.160225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2808d85b-1da5-4bd8-afa6-b42c51434021 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155007 Jul 26 18:49:38.160578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1460/2946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:38 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:38.859041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bc4a3a9c-b75d-4b7e-83a4-41e3e0f7b89f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:38.859632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b31d2a9d-c33a-4908-a835-2cc78c083e27 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:38.859999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bc4a3a9c-b75d-4b7e-83a4-41e3e0f7b89f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:38.860102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b31d2a9d-c33a-4908-a835-2cc78c083e27 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:38.866595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc4a3a9c-b75d-4b7e-83a4-41e3e0f7b89f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:38.866988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b31d2a9d-c33a-4908-a835-2cc78c083e27 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:38.867200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc4a3a9c-b75d-4b7e-83a4-41e3e0f7b89f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:38.867467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b31d2a9d-c33a-4908-a835-2cc78c083e27 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:38.867881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc4a3a9c-b75d-4b7e-83a4-41e3e0f7b89f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:38.868228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b31d2a9d-c33a-4908-a835-2cc78c083e27 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:38.868378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc4a3a9c-b75d-4b7e-83a4-41e3e0f7b89f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:38.868645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b31d2a9d-c33a-4908-a835-2cc78c083e27 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:38.999837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b31d2a9d-c33a-4908-a835-2cc78c083e27 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:39.002480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bc4a3a9c-b75d-4b7e-83a4-41e3e0f7b89f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:39.008741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b31d2a9d-c33a-4908-a835-2cc78c083e27 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154469 Jul 26 18:49:39.009322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1461/2947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:38 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:39.011153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bc4a3a9c-b75d-4b7e-83a4-41e3e0f7b89f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157234 Jul 26 18:49:39.012194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1487/2948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:38 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:39.016141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-108c63b3-334c-4bc6-83cd-1cdf6db84ea6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:39.016746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-108c63b3-334c-4bc6-83cd-1cdf6db84ea6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:39.023462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-108c63b3-334c-4bc6-83cd-1cdf6db84ea6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:39.023896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-108c63b3-334c-4bc6-83cd-1cdf6db84ea6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:39.024630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-108c63b3-334c-4bc6-83cd-1cdf6db84ea6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:39.025053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-108c63b3-334c-4bc6-83cd-1cdf6db84ea6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:39.038087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-12435d59-59bc-4d4e-93b3-aac2f9aee182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:39.038699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-12435d59-59bc-4d4e-93b3-aac2f9aee182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:39.040718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:39.046636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-12435d59-59bc-4d4e-93b3-aac2f9aee182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:39.047066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-12435d59-59bc-4d4e-93b3-aac2f9aee182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:39.047852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-12435d59-59bc-4d4e-93b3-aac2f9aee182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:39.048272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-12435d59-59bc-4d4e-93b3-aac2f9aee182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:39.153985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-108c63b3-334c-4bc6-83cd-1cdf6db84ea6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:39.162133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-108c63b3-334c-4bc6-83cd-1cdf6db84ea6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151873 Jul 26 18:49:39.162696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1462/2949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:39 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:39.178658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-12435d59-59bc-4d4e-93b3-aac2f9aee182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:39.181217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-054423f2-bbbc-4472-bb0d-8239afe75f41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:39.181895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-054423f2-bbbc-4472-bb0d-8239afe75f41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:39.187214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-12435d59-59bc-4d4e-93b3-aac2f9aee182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:39.188019 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-054423f2-bbbc-4472-bb0d-8239afe75f41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:39.188522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-054423f2-bbbc-4472-bb0d-8239afe75f41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:39.188721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-12435d59-59bc-4d4e-93b3-aac2f9aee182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:39.189296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-054423f2-bbbc-4472-bb0d-8239afe75f41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:39.189720 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-054423f2-bbbc-4472-bb0d-8239afe75f41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:39.189885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-12435d59-59bc-4d4e-93b3-aac2f9aee182 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156063 Jul 26 18:49:39.191170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1488/2950] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:39.193887 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:39.320311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-054423f2-bbbc-4472-bb0d-8239afe75f41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:39.329068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-054423f2-bbbc-4472-bb0d-8239afe75f41 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151660 Jul 26 18:49:39.329663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1463/2951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:39 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:40.033179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b9e59774-2401-4def-9efa-1a051dd1276e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:40.033866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b9e59774-2401-4def-9efa-1a051dd1276e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:40.035932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e63214c3-7023-49a7-bcd8-b2720ac67265 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:40.036671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e63214c3-7023-49a7-bcd8-b2720ac67265 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:40.042604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9e59774-2401-4def-9efa-1a051dd1276e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:40.043200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9e59774-2401-4def-9efa-1a051dd1276e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:40.044134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9e59774-2401-4def-9efa-1a051dd1276e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:40.044675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9e59774-2401-4def-9efa-1a051dd1276e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:40.045884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e63214c3-7023-49a7-bcd8-b2720ac67265 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:40.046448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e63214c3-7023-49a7-bcd8-b2720ac67265 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:40.047419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e63214c3-7023-49a7-bcd8-b2720ac67265 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:40.047834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:40.047983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e63214c3-7023-49a7-bcd8-b2720ac67265 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:40.179181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e63214c3-7023-49a7-bcd8-b2720ac67265 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:40.180672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b9e59774-2401-4def-9efa-1a051dd1276e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:40.187422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e63214c3-7023-49a7-bcd8-b2720ac67265 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156616 Jul 26 18:49:40.188210 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1464/2952] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:40 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:40.188886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b9e59774-2401-4def-9efa-1a051dd1276e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161571 Jul 26 18:49:40.189601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1489/2953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:40 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:40.193286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7bf07336-3cb1-4e31-802f-b3504b956288 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:40.193883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7bf07336-3cb1-4e31-802f-b3504b956288 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:40.196580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:40.201053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bf07336-3cb1-4e31-802f-b3504b956288 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:40.201503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bf07336-3cb1-4e31-802f-b3504b956288 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:40.202259 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bf07336-3cb1-4e31-802f-b3504b956288 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:40.202689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bf07336-3cb1-4e31-802f-b3504b956288 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:40.212241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bef65203-694f-43b4-869c-fda7658d033e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:40.212842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bef65203-694f-43b4-869c-fda7658d033e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:40.218997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bef65203-694f-43b4-869c-fda7658d033e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:40.219491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bef65203-694f-43b4-869c-fda7658d033e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:40.220242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bef65203-694f-43b4-869c-fda7658d033e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:40.221276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bef65203-694f-43b4-869c-fda7658d033e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:40.339559 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7bf07336-3cb1-4e31-802f-b3504b956288 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:40.347455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7bf07336-3cb1-4e31-802f-b3504b956288 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.158497 Jul 26 18:49:40.348266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1465/2954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:40 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:40.358642 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f91b3882-752b-4cf3-ab17-909a8445e13b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:40.359305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f91b3882-752b-4cf3-ab17-909a8445e13b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:40.365552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f91b3882-752b-4cf3-ab17-909a8445e13b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:40.365994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f91b3882-752b-4cf3-ab17-909a8445e13b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:40.366749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f91b3882-752b-4cf3-ab17-909a8445e13b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:40.367212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f91b3882-752b-4cf3-ab17-909a8445e13b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:40.374111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bef65203-694f-43b4-869c-fda7658d033e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:40.382646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bef65203-694f-43b4-869c-fda7658d033e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:40.384236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bef65203-694f-43b4-869c-fda7658d033e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:40.385387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bef65203-694f-43b4-869c-fda7658d033e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.176992 Jul 26 18:49:40.385950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1490/2955] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:40 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:40.496959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f91b3882-752b-4cf3-ab17-909a8445e13b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:40.509668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f91b3882-752b-4cf3-ab17-909a8445e13b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154488 Jul 26 18:49:40.510547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1466/2956] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:40 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:41.213646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c186bf10-853c-4065-aef3-6d9268436181 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:41.214493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-95e8465d-53de-43df-9949-8815ee10ade7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:41.215145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c186bf10-853c-4065-aef3-6d9268436181 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:41.215364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-95e8465d-53de-43df-9949-8815ee10ade7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:41.225376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c186bf10-853c-4065-aef3-6d9268436181 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:41.226126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c186bf10-853c-4065-aef3-6d9268436181 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:41.226379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95e8465d-53de-43df-9949-8815ee10ade7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:41.227461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95e8465d-53de-43df-9949-8815ee10ade7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:41.227749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c186bf10-853c-4065-aef3-6d9268436181 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:41.228176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c186bf10-853c-4065-aef3-6d9268436181 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:41.228709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95e8465d-53de-43df-9949-8815ee10ade7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:41.229427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95e8465d-53de-43df-9949-8815ee10ade7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:41.361649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-95e8465d-53de-43df-9949-8815ee10ade7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:41.363922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c186bf10-853c-4065-aef3-6d9268436181 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:41.370354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-95e8465d-53de-43df-9949-8815ee10ade7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.162495 Jul 26 18:49:41.370937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1467/2957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:41 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:41.372538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c186bf10-853c-4065-aef3-6d9268436181 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.165440 Jul 26 18:49:41.373401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1491/2958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:41 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:41.375949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2fb36ce3-5a9b-4a88-b446-d147789c2bf9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:41.376542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2fb36ce3-5a9b-4a88-b446-d147789c2bf9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:41.382542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2fb36ce3-5a9b-4a88-b446-d147789c2bf9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:41.383135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2fb36ce3-5a9b-4a88-b446-d147789c2bf9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:41.383899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2fb36ce3-5a9b-4a88-b446-d147789c2bf9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:41.384327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2fb36ce3-5a9b-4a88-b446-d147789c2bf9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:41.408700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e33dd870-0949-4289-8f8d-91a6b718ac7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:41.409460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e33dd870-0949-4289-8f8d-91a6b718ac7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:41.417035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e33dd870-0949-4289-8f8d-91a6b718ac7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:41.417902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e33dd870-0949-4289-8f8d-91a6b718ac7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:41.419788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e33dd870-0949-4289-8f8d-91a6b718ac7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:41.420317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e33dd870-0949-4289-8f8d-91a6b718ac7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:41.520786 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2fb36ce3-5a9b-4a88-b446-d147789c2bf9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:41.529536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2fb36ce3-5a9b-4a88-b446-d147789c2bf9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157341 Jul 26 18:49:41.543068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1468/2959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:41 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:41.543068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-14dc994b-d1ae-4d1e-8905-14dbb47ec948 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:41.543068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-14dc994b-d1ae-4d1e-8905-14dbb47ec948 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:41.543068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14dc994b-d1ae-4d1e-8905-14dbb47ec948 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:41.543551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14dc994b-d1ae-4d1e-8905-14dbb47ec948 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:41.543551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14dc994b-d1ae-4d1e-8905-14dbb47ec948 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:41.543551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-14dc994b-d1ae-4d1e-8905-14dbb47ec948 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:41.547977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e33dd870-0949-4289-8f8d-91a6b718ac7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:41.556282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e33dd870-0949-4289-8f8d-91a6b718ac7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:41.557783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e33dd870-0949-4289-8f8d-91a6b718ac7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:41.558934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e33dd870-0949-4289-8f8d-91a6b718ac7b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.154258 Jul 26 18:49:41.559588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1492/2960] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:41 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:41.674323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-14dc994b-d1ae-4d1e-8905-14dbb47ec948 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:41.682573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-14dc994b-d1ae-4d1e-8905-14dbb47ec948 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151516 Jul 26 18:49:41.683137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1469/2961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:41 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:42.398993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8d7ad033-daa9-4cbb-9a19-1d9dd643b1ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:42.400007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8d7ad033-daa9-4cbb-9a19-1d9dd643b1ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:42.402457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-02eab87b-c539-4715-9fe0-e7236cde4e1b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:42.403497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-02eab87b-c539-4715-9fe0-e7236cde4e1b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:42.410900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d7ad033-daa9-4cbb-9a19-1d9dd643b1ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:42.411740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d7ad033-daa9-4cbb-9a19-1d9dd643b1ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:42.415464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d7ad033-daa9-4cbb-9a19-1d9dd643b1ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:42.415464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d7ad033-daa9-4cbb-9a19-1d9dd643b1ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:42.415814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02eab87b-c539-4715-9fe0-e7236cde4e1b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:42.415814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02eab87b-c539-4715-9fe0-e7236cde4e1b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:42.416861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02eab87b-c539-4715-9fe0-e7236cde4e1b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:42.417658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02eab87b-c539-4715-9fe0-e7236cde4e1b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:42.547673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8d7ad033-daa9-4cbb-9a19-1d9dd643b1ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:42.554889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-02eab87b-c539-4715-9fe0-e7236cde4e1b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:42.555604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8d7ad033-daa9-4cbb-9a19-1d9dd643b1ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163748 Jul 26 18:49:42.556394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1493/2962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:42 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:42.561042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6fd26d9f-26f2-40b8-beb6-77d5b4b448a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:42.561860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6fd26d9f-26f2-40b8-beb6-77d5b4b448a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:42.563136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-02eab87b-c539-4715-9fe0-e7236cde4e1b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.168001 Jul 26 18:49:42.563847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1470/2963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:42 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:42.567770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6fd26d9f-26f2-40b8-beb6-77d5b4b448a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:42.568220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6fd26d9f-26f2-40b8-beb6-77d5b4b448a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:42.568974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6fd26d9f-26f2-40b8-beb6-77d5b4b448a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:42.569403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6fd26d9f-26f2-40b8-beb6-77d5b4b448a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:42.581486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-99e0c883-bced-4835-b0ce-65d5052f1484 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:42.582088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-99e0c883-bced-4835-b0ce-65d5052f1484 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:42.588124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99e0c883-bced-4835-b0ce-65d5052f1484 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:42.588573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99e0c883-bced-4835-b0ce-65d5052f1484 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:42.589322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99e0c883-bced-4835-b0ce-65d5052f1484 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:42.589755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99e0c883-bced-4835-b0ce-65d5052f1484 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:42.705081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6fd26d9f-26f2-40b8-beb6-77d5b4b448a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:42.713536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6fd26d9f-26f2-40b8-beb6-77d5b4b448a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156008 Jul 26 18:49:42.714111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1494/2964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:42 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:42.717705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-99e0c883-bced-4835-b0ce-65d5052f1484 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:42.718982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7718381d-1042-44c7-b5e2-d5acb67e294f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:42.719625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7718381d-1042-44c7-b5e2-d5acb67e294f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:42.725776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7718381d-1042-44c7-b5e2-d5acb67e294f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:42.726230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7718381d-1042-44c7-b5e2-d5acb67e294f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:42.726772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-99e0c883-bced-4835-b0ce-65d5052f1484 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:42.726985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7718381d-1042-44c7-b5e2-d5acb67e294f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:42.727455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7718381d-1042-44c7-b5e2-d5acb67e294f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:42.728555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-99e0c883-bced-4835-b0ce-65d5052f1484 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:42.729823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-99e0c883-bced-4835-b0ce-65d5052f1484 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.152082 Jul 26 18:49:42.730410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1471/2965] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:42.856115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7718381d-1042-44c7-b5e2-d5acb67e294f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:42.864213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7718381d-1042-44c7-b5e2-d5acb67e294f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.148744 Jul 26 18:49:42.864788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1495/2966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:42 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:43.579861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f86c3662-b293-424f-8e57-6cb54cce150e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:43.580438 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f86c3662-b293-424f-8e57-6cb54cce150e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:43.584266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-07d049b8-f473-4cd0-ab2e-b0cfd71474d2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:43.584974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-07d049b8-f473-4cd0-ab2e-b0cfd71474d2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:43.587621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f86c3662-b293-424f-8e57-6cb54cce150e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:43.588064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f86c3662-b293-424f-8e57-6cb54cce150e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:43.588814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f86c3662-b293-424f-8e57-6cb54cce150e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:43.589234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f86c3662-b293-424f-8e57-6cb54cce150e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:43.591876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07d049b8-f473-4cd0-ab2e-b0cfd71474d2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:43.592326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07d049b8-f473-4cd0-ab2e-b0cfd71474d2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:43.593215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07d049b8-f473-4cd0-ab2e-b0cfd71474d2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:43.593764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07d049b8-f473-4cd0-ab2e-b0cfd71474d2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:43.727013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-07d049b8-f473-4cd0-ab2e-b0cfd71474d2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:43.728475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f86c3662-b293-424f-8e57-6cb54cce150e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:43.736284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-07d049b8-f473-4cd0-ab2e-b0cfd71474d2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155801 Jul 26 18:49:43.736830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1496/2967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:43 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:43.737513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f86c3662-b293-424f-8e57-6cb54cce150e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162374 Jul 26 18:49:43.738376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1472/2968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:43 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:43.741387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-307ef924-012a-4247-a4ca-0a90b17a8b59 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:43.746000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-307ef924-012a-4247-a4ca-0a90b17a8b59 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:43.748132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-307ef924-012a-4247-a4ca-0a90b17a8b59 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:43.749409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-307ef924-012a-4247-a4ca-0a90b17a8b59 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:43.750420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-307ef924-012a-4247-a4ca-0a90b17a8b59 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:43.751009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-307ef924-012a-4247-a4ca-0a90b17a8b59 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:43.754229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b7a70ada-2c97-4e37-b64b-18b79a8557f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:43.754905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b7a70ada-2c97-4e37-b64b-18b79a8557f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:43.760900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7a70ada-2c97-4e37-b64b-18b79a8557f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:43.761343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7a70ada-2c97-4e37-b64b-18b79a8557f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:43.762094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7a70ada-2c97-4e37-b64b-18b79a8557f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:43.762535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7a70ada-2c97-4e37-b64b-18b79a8557f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:43.882672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-307ef924-012a-4247-a4ca-0a90b17a8b59 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:43.889326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b7a70ada-2c97-4e37-b64b-18b79a8557f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:43.892290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-307ef924-012a-4247-a4ca-0a90b17a8b59 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154450 Jul 26 18:49:43.892913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1497/2969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:43 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:43.897702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1ec82d72-782f-4404-9455-9c14372f3f33 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:43.898305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1ec82d72-782f-4404-9455-9c14372f3f33 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:43.898518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b7a70ada-2c97-4e37-b64b-18b79a8557f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:43.900048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b7a70ada-2c97-4e37-b64b-18b79a8557f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:43.901206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b7a70ada-2c97-4e37-b64b-18b79a8557f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.150942 Jul 26 18:49:43.901966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1473/2970] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:43.904533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ec82d72-782f-4404-9455-9c14372f3f33 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:43.904986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ec82d72-782f-4404-9455-9c14372f3f33 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:43.905746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ec82d72-782f-4404-9455-9c14372f3f33 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:43.906235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ec82d72-782f-4404-9455-9c14372f3f33 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:44.036377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1ec82d72-782f-4404-9455-9c14372f3f33 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:44.044830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1ec82d72-782f-4404-9455-9c14372f3f33 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150979 Jul 26 18:49:44.045405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1498/2971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:43 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:44.763409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ca7de4c4-0d74-4950-992c-1a4e6a230b48 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:44.763996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ca7de4c4-0d74-4950-992c-1a4e6a230b48 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:44.765343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-91ddbba0-e5d0-4121-8a1f-2f4e0123c03c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:44.766157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-91ddbba0-e5d0-4121-8a1f-2f4e0123c03c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:44.771948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca7de4c4-0d74-4950-992c-1a4e6a230b48 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:44.772712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca7de4c4-0d74-4950-992c-1a4e6a230b48 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:44.773471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca7de4c4-0d74-4950-992c-1a4e6a230b48 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:44.773894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca7de4c4-0d74-4950-992c-1a4e6a230b48 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:44.774216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91ddbba0-e5d0-4121-8a1f-2f4e0123c03c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:44.774822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91ddbba0-e5d0-4121-8a1f-2f4e0123c03c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:44.776185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91ddbba0-e5d0-4121-8a1f-2f4e0123c03c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:44.776978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91ddbba0-e5d0-4121-8a1f-2f4e0123c03c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:44.910135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ca7de4c4-0d74-4950-992c-1a4e6a230b48 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:44.910489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-91ddbba0-e5d0-4121-8a1f-2f4e0123c03c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:44.918489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ca7de4c4-0d74-4950-992c-1a4e6a230b48 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.161203 Jul 26 18:49:44.919060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-91ddbba0-e5d0-4121-8a1f-2f4e0123c03c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161963 Jul 26 18:49:44.919386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1499/2972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:44 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:44.931106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1474/2973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:44 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:44.931106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-779b8d13-05f4-47a7-bb7c-3ffe4a9e3b98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:44.931106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-779b8d13-05f4-47a7-bb7c-3ffe4a9e3b98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:44.931484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7c7dc234-0cf8-4c17-a0be-cdd00440c6af tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:44.931484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7c7dc234-0cf8-4c17-a0be-cdd00440c6af tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:44.931670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-779b8d13-05f4-47a7-bb7c-3ffe4a9e3b98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:44.931670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-779b8d13-05f4-47a7-bb7c-3ffe4a9e3b98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:44.932326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-779b8d13-05f4-47a7-bb7c-3ffe4a9e3b98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:44.932643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c7dc234-0cf8-4c17-a0be-cdd00440c6af tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:44.933091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c7dc234-0cf8-4c17-a0be-cdd00440c6af tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:44.933269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-779b8d13-05f4-47a7-bb7c-3ffe4a9e3b98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:44.933839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c7dc234-0cf8-4c17-a0be-cdd00440c6af tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:44.934268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c7dc234-0cf8-4c17-a0be-cdd00440c6af tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:45.062936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7c7dc234-0cf8-4c17-a0be-cdd00440c6af tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:45.065172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-779b8d13-05f4-47a7-bb7c-3ffe4a9e3b98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:45.071380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7c7dc234-0cf8-4c17-a0be-cdd00440c6af tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151011 Jul 26 18:49:45.072151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1500/2974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:44 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:45.073646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-779b8d13-05f4-47a7-bb7c-3ffe4a9e3b98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:45.075223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-779b8d13-05f4-47a7-bb7c-3ffe4a9e3b98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:45.076381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-779b8d13-05f4-47a7-bb7c-3ffe4a9e3b98 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155417 Jul 26 18:49:45.076579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9809bed5-df29-4a23-b8d4-994cbad03657 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:45.077118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1475/2975] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:44 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:45.077260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9809bed5-df29-4a23-b8d4-994cbad03657 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:45.083113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9809bed5-df29-4a23-b8d4-994cbad03657 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:45.083555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9809bed5-df29-4a23-b8d4-994cbad03657 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:45.084580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9809bed5-df29-4a23-b8d4-994cbad03657 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:45.085008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9809bed5-df29-4a23-b8d4-994cbad03657 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:45.223429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9809bed5-df29-4a23-b8d4-994cbad03657 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:45.231902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9809bed5-df29-4a23-b8d4-994cbad03657 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.159022 Jul 26 18:49:45.232469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1501/2976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:45 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:45.945860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-99135de2-1419-4228-9f23-701ccb4cd17b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:45.946831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-99135de2-1419-4228-9f23-701ccb4cd17b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:45.949016 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-08ffebd7-0ab7-4f3e-a19b-74412cb0dd7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:45.949967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-08ffebd7-0ab7-4f3e-a19b-74412cb0dd7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:45.957660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-99135de2-1419-4228-9f23-701ccb4cd17b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:45.958405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-99135de2-1419-4228-9f23-701ccb4cd17b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:45.959927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-99135de2-1419-4228-9f23-701ccb4cd17b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:45.960477 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08ffebd7-0ab7-4f3e-a19b-74412cb0dd7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:45.960853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-99135de2-1419-4228-9f23-701ccb4cd17b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:45.961225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08ffebd7-0ab7-4f3e-a19b-74412cb0dd7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:45.966194 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08ffebd7-0ab7-4f3e-a19b-74412cb0dd7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:45.967053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08ffebd7-0ab7-4f3e-a19b-74412cb0dd7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:46.098228 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-99135de2-1419-4228-9f23-701ccb4cd17b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:46.101232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-08ffebd7-0ab7-4f3e-a19b-74412cb0dd7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:46.106590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-99135de2-1419-4228-9f23-701ccb4cd17b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167343 Jul 26 18:49:46.107192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1502/2977] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:45 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:46.109371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-08ffebd7-0ab7-4f3e-a19b-74412cb0dd7a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.166520 Jul 26 18:49:46.111349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1476/2978] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:45 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:46.111612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-052ebc66-f81b-4119-ade5-5efd87a25a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:46.112345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-052ebc66-f81b-4119-ade5-5efd87a25a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:46.116876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7c0885db-ce2b-4182-aee0-36ebf10de42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:46.118113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7c0885db-ce2b-4182-aee0-36ebf10de42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:46.118241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-052ebc66-f81b-4119-ade5-5efd87a25a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:46.118611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-052ebc66-f81b-4119-ade5-5efd87a25a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:46.119395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-052ebc66-f81b-4119-ade5-5efd87a25a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:46.120003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-052ebc66-f81b-4119-ade5-5efd87a25a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:46.126491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c0885db-ce2b-4182-aee0-36ebf10de42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:46.127047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c0885db-ce2b-4182-aee0-36ebf10de42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:46.127944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c0885db-ce2b-4182-aee0-36ebf10de42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:46.128576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c0885db-ce2b-4182-aee0-36ebf10de42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:46.252242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-052ebc66-f81b-4119-ade5-5efd87a25a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:46.257600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7c0885db-ce2b-4182-aee0-36ebf10de42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:46.260707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-052ebc66-f81b-4119-ade5-5efd87a25a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152536 Jul 26 18:49:46.261289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1503/2979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:46 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:46.265820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-18f06d23-e2e8-4713-bc32-9d2d14dcd910 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:46.266416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-18f06d23-e2e8-4713-bc32-9d2d14dcd910 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:46.266620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7c0885db-ce2b-4182-aee0-36ebf10de42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:46.268152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7c0885db-ce2b-4182-aee0-36ebf10de42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:46.269396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7c0885db-ce2b-4182-aee0-36ebf10de42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156650 Jul 26 18:49:46.272693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18f06d23-e2e8-4713-bc32-9d2d14dcd910 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:46.273142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18f06d23-e2e8-4713-bc32-9d2d14dcd910 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:46.273899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18f06d23-e2e8-4713-bc32-9d2d14dcd910 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:46.274324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18f06d23-e2e8-4713-bc32-9d2d14dcd910 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:46.277608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1477/2980] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:46.415603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-18f06d23-e2e8-4713-bc32-9d2d14dcd910 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:46.424508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-18f06d23-e2e8-4713-bc32-9d2d14dcd910 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.162241 Jul 26 18:49:46.425083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1504/2981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:46 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:47.132567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1764b251-952b-438d-afb3-31bf1630ae6e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:47.133632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1764b251-952b-438d-afb3-31bf1630ae6e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:47.135150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ea30e160-74f6-4bb2-8798-20fc668f1a0d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:47.136215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ea30e160-74f6-4bb2-8798-20fc668f1a0d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:47.141947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1764b251-952b-438d-afb3-31bf1630ae6e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:47.142402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1764b251-952b-438d-afb3-31bf1630ae6e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:47.143183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1764b251-952b-438d-afb3-31bf1630ae6e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:47.143619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1764b251-952b-438d-afb3-31bf1630ae6e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:47.144525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea30e160-74f6-4bb2-8798-20fc668f1a0d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:47.144969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea30e160-74f6-4bb2-8798-20fc668f1a0d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:47.145731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea30e160-74f6-4bb2-8798-20fc668f1a0d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:47.146156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea30e160-74f6-4bb2-8798-20fc668f1a0d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:47.277783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1764b251-952b-438d-afb3-31bf1630ae6e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:47.281974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ea30e160-74f6-4bb2-8798-20fc668f1a0d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:47.284189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:47.286322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1764b251-952b-438d-afb3-31bf1630ae6e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160630 Jul 26 18:49:47.286908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1478/2982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:47 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:47.299192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ea30e160-74f6-4bb2-8798-20fc668f1a0d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163216 Jul 26 18:49:47.299192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1505/2983] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:47 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:47.299424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3b3d07e9-4751-408e-b44e-284b3ff067c6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:47.299424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3b3d07e9-4751-408e-b44e-284b3ff067c6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:47.299589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-57a83d3c-275b-4c88-85ac-984e8202091f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:47.299589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-57a83d3c-275b-4c88-85ac-984e8202091f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:47.302465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b3d07e9-4751-408e-b44e-284b3ff067c6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:47.302938 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b3d07e9-4751-408e-b44e-284b3ff067c6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:47.303765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b3d07e9-4751-408e-b44e-284b3ff067c6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:47.304117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57a83d3c-275b-4c88-85ac-984e8202091f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:47.304263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b3d07e9-4751-408e-b44e-284b3ff067c6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:47.304565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57a83d3c-275b-4c88-85ac-984e8202091f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:47.305321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57a83d3c-275b-4c88-85ac-984e8202091f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:47.305755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-57a83d3c-275b-4c88-85ac-984e8202091f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:47.436696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3b3d07e9-4751-408e-b44e-284b3ff067c6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:47.438947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:47.443195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-57a83d3c-275b-4c88-85ac-984e8202091f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:47.446514 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3b3d07e9-4751-408e-b44e-284b3ff067c6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154367 Jul 26 18:49:47.447096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1479/2984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:47 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:47.451620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-53842831-b765-4cd1-9c9f-a0533350c6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:47.451964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-57a83d3c-275b-4c88-85ac-984e8202091f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:47.452198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-53842831-b765-4cd1-9c9f-a0533350c6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:47.453653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-57a83d3c-275b-4c88-85ac-984e8202091f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:47.454858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-57a83d3c-275b-4c88-85ac-984e8202091f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161433 Jul 26 18:49:47.455663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1506/2985] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:47 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:47.458349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53842831-b765-4cd1-9c9f-a0533350c6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:47.458794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53842831-b765-4cd1-9c9f-a0533350c6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:47.459598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53842831-b765-4cd1-9c9f-a0533350c6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:47.460018 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53842831-b765-4cd1-9c9f-a0533350c6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:47.597517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-53842831-b765-4cd1-9c9f-a0533350c6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:47.610246 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-53842831-b765-4cd1-9c9f-a0533350c6a0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161899 Jul 26 18:49:47.611098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1480/2986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:47 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:48.311574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a9ab4a2e-1425-47ee-a15a-f0b5c88b366d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:48.312291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a9ab4a2e-1425-47ee-a15a-f0b5c88b366d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:48.315013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-95765403-1985-4963-82f3-23c13b65904e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:48.315881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-95765403-1985-4963-82f3-23c13b65904e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:48.320539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9ab4a2e-1425-47ee-a15a-f0b5c88b366d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:48.321038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9ab4a2e-1425-47ee-a15a-f0b5c88b366d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:48.321968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9ab4a2e-1425-47ee-a15a-f0b5c88b366d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:48.322484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9ab4a2e-1425-47ee-a15a-f0b5c88b366d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:48.324388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95765403-1985-4963-82f3-23c13b65904e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:48.324916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95765403-1985-4963-82f3-23c13b65904e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:48.325805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95765403-1985-4963-82f3-23c13b65904e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:48.326343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-95765403-1985-4963-82f3-23c13b65904e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:48.458967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-95765403-1985-4963-82f3-23c13b65904e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:48.459210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a9ab4a2e-1425-47ee-a15a-f0b5c88b366d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:48.467423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a9ab4a2e-1425-47ee-a15a-f0b5c88b366d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.161805 Jul 26 18:49:48.467684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-95765403-1985-4963-82f3-23c13b65904e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.157166 Jul 26 18:49:48.467994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1507/2987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:48 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:48.468260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1481/2988] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:48 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:48.472874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6d407e2b-efba-4896-bc87-b4ba62d9ff5c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:48.473479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6d407e2b-efba-4896-bc87-b4ba62d9ff5c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:48.479568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d407e2b-efba-4896-bc87-b4ba62d9ff5c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:48.480026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d407e2b-efba-4896-bc87-b4ba62d9ff5c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:48.480548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f41f9d6c-7948-4a98-8eaf-83d63b42866e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:48.480790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d407e2b-efba-4896-bc87-b4ba62d9ff5c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:48.481331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d407e2b-efba-4896-bc87-b4ba62d9ff5c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:48.481933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f41f9d6c-7948-4a98-8eaf-83d63b42866e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:48.488361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f41f9d6c-7948-4a98-8eaf-83d63b42866e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:48.488895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f41f9d6c-7948-4a98-8eaf-83d63b42866e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:48.489680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f41f9d6c-7948-4a98-8eaf-83d63b42866e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:48.490106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f41f9d6c-7948-4a98-8eaf-83d63b42866e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:48.621359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6d407e2b-efba-4896-bc87-b4ba62d9ff5c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:48.625700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f41f9d6c-7948-4a98-8eaf-83d63b42866e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:48.629799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6d407e2b-efba-4896-bc87-b4ba62d9ff5c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.160552 Jul 26 18:49:48.630375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1508/2989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:48 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:48.634897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ce1d7dda-a67a-4887-a86a-e4be3649f688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:48.635542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ce1d7dda-a67a-4887-a86a-e4be3649f688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:48.637503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f41f9d6c-7948-4a98-8eaf-83d63b42866e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:48.638954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f41f9d6c-7948-4a98-8eaf-83d63b42866e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:48.640140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f41f9d6c-7948-4a98-8eaf-83d63b42866e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.165606 Jul 26 18:49:48.640885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1482/2990] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:48.641477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce1d7dda-a67a-4887-a86a-e4be3649f688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:48.641904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce1d7dda-a67a-4887-a86a-e4be3649f688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:48.642656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce1d7dda-a67a-4887-a86a-e4be3649f688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:48.643118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce1d7dda-a67a-4887-a86a-e4be3649f688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:48.777039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ce1d7dda-a67a-4887-a86a-e4be3649f688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:48.785759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ce1d7dda-a67a-4887-a86a-e4be3649f688 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154393 Jul 26 18:49:48.786307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1509/2991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:48 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:49.492441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c8d89fdc-57d6-492f-8c46-588c889af91f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:49.493403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c8d89fdc-57d6-492f-8c46-588c889af91f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:49.494403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-26b8e9b5-a13d-42a8-a3b0-4d4df03324e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:49.495457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-26b8e9b5-a13d-42a8-a3b0-4d4df03324e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:49.502623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c8d89fdc-57d6-492f-8c46-588c889af91f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:49.503068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c8d89fdc-57d6-492f-8c46-588c889af91f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:49.503867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c8d89fdc-57d6-492f-8c46-588c889af91f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:49.504301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c8d89fdc-57d6-492f-8c46-588c889af91f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:49.504457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26b8e9b5-a13d-42a8-a3b0-4d4df03324e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:49.504852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26b8e9b5-a13d-42a8-a3b0-4d4df03324e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:49.505619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26b8e9b5-a13d-42a8-a3b0-4d4df03324e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:49.506206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26b8e9b5-a13d-42a8-a3b0-4d4df03324e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:49.636537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c8d89fdc-57d6-492f-8c46-588c889af91f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:49.637217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-26b8e9b5-a13d-42a8-a3b0-4d4df03324e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:49.644809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c8d89fdc-57d6-492f-8c46-588c889af91f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158759 Jul 26 18:49:49.645589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1483/2992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:49 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:49.645968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-26b8e9b5-a13d-42a8-a3b0-4d4df03324e0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.157329 Jul 26 18:49:49.646568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1510/2993] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:49 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:49.652349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5b53188d-4e62-4cc9-8536-8d023af64a88 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:49.652949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5b53188d-4e62-4cc9-8536-8d023af64a88 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:49.660862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b53188d-4e62-4cc9-8536-8d023af64a88 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:49.661308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b53188d-4e62-4cc9-8536-8d023af64a88 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:49.662059 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b53188d-4e62-4cc9-8536-8d023af64a88 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:49.662469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b53188d-4e62-4cc9-8536-8d023af64a88 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:49.664285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5fd581c6-c4e2-4c18-b60b-8af41563c1d4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:49.664896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5fd581c6-c4e2-4c18-b60b-8af41563c1d4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:49.671298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fd581c6-c4e2-4c18-b60b-8af41563c1d4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:49.671747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fd581c6-c4e2-4c18-b60b-8af41563c1d4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:49.672543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fd581c6-c4e2-4c18-b60b-8af41563c1d4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:49.672976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fd581c6-c4e2-4c18-b60b-8af41563c1d4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:49.796721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5b53188d-4e62-4cc9-8536-8d023af64a88 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:49.804884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5b53188d-4e62-4cc9-8536-8d023af64a88 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156163 Jul 26 18:49:49.805458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1484/2994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:49 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:49.807808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5fd581c6-c4e2-4c18-b60b-8af41563c1d4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:49.814116 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-78b6700e-3968-47fc-9817-1f40769118c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:49.814979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-78b6700e-3968-47fc-9817-1f40769118c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:49.816463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5fd581c6-c4e2-4c18-b60b-8af41563c1d4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:49.817972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5fd581c6-c4e2-4c18-b60b-8af41563c1d4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:49.819168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5fd581c6-c4e2-4c18-b60b-8af41563c1d4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159852 Jul 26 18:49:49.819725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1511/2995] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:49 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:49.822735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78b6700e-3968-47fc-9817-1f40769118c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:49.823225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78b6700e-3968-47fc-9817-1f40769118c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:49.823994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78b6700e-3968-47fc-9817-1f40769118c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:49.824548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78b6700e-3968-47fc-9817-1f40769118c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:49.953586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-78b6700e-3968-47fc-9817-1f40769118c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:49.961907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-78b6700e-3968-47fc-9817-1f40769118c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152225 Jul 26 18:49:49.962485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1485/2996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:49 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:50.670860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5b876168-e349-4b16-994f-b5fc7867a385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:50.671913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5b876168-e349-4b16-994f-b5fc7867a385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:50.672253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-78d8fe7a-72b9-4300-a41e-74ce4c0111d4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:50.672891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-78d8fe7a-72b9-4300-a41e-74ce4c0111d4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:50.679373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b876168-e349-4b16-994f-b5fc7867a385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:50.679683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78d8fe7a-72b9-4300-a41e-74ce4c0111d4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:50.679811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b876168-e349-4b16-994f-b5fc7867a385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:50.680154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78d8fe7a-72b9-4300-a41e-74ce4c0111d4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:50.680571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b876168-e349-4b16-994f-b5fc7867a385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:50.680869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78d8fe7a-72b9-4300-a41e-74ce4c0111d4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:50.680997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b876168-e349-4b16-994f-b5fc7867a385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:50.681324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78d8fe7a-72b9-4300-a41e-74ce4c0111d4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:50.811765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-78d8fe7a-72b9-4300-a41e-74ce4c0111d4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:50.812086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5b876168-e349-4b16-994f-b5fc7867a385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:50.820085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-78d8fe7a-72b9-4300-a41e-74ce4c0111d4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154549 Jul 26 18:49:50.820450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5b876168-e349-4b16-994f-b5fc7867a385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156191 Jul 26 18:49:50.820971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1486/2997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:50 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:50.821451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1512/2998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:50 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:50.831759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-43f42e16-8c5e-4b2b-b333-0c6a426d03ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:50.832356 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-43f42e16-8c5e-4b2b-b333-0c6a426d03ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:50.838625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43f42e16-8c5e-4b2b-b333-0c6a426d03ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:50.839086 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43f42e16-8c5e-4b2b-b333-0c6a426d03ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:50.839832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43f42e16-8c5e-4b2b-b333-0c6a426d03ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:50.840382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43f42e16-8c5e-4b2b-b333-0c6a426d03ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:50.841884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-60141803-a8f2-463e-b8ce-684e96fb08a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:50.842634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-60141803-a8f2-463e-b8ce-684e96fb08a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:50.848995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60141803-a8f2-463e-b8ce-684e96fb08a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:50.849513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60141803-a8f2-463e-b8ce-684e96fb08a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:50.850330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60141803-a8f2-463e-b8ce-684e96fb08a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:50.850762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60141803-a8f2-463e-b8ce-684e96fb08a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:50.975266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-43f42e16-8c5e-4b2b-b333-0c6a426d03ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:50.988141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-43f42e16-8c5e-4b2b-b333-0c6a426d03ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.160011 Jul 26 18:49:50.988597 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-60141803-a8f2-463e-b8ce-684e96fb08a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:50.991057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1487/2999] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:50 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:50.994203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-23fe0ad5-ffef-4658-a553-70db1d58a00b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:50.994803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-23fe0ad5-ffef-4658-a553-70db1d58a00b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:50.997709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-60141803-a8f2-463e-b8ce-684e96fb08a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:50.999267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-60141803-a8f2-463e-b8ce-684e96fb08a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:51.000809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-60141803-a8f2-463e-b8ce-684e96fb08a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.163209 Jul 26 18:49:51.000933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23fe0ad5-ffef-4658-a553-70db1d58a00b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:51.001541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23fe0ad5-ffef-4658-a553-70db1d58a00b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:51.001673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1513/3000] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:50 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:51.002269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23fe0ad5-ffef-4658-a553-70db1d58a00b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:51.002702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-23fe0ad5-ffef-4658-a553-70db1d58a00b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:51.143420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-23fe0ad5-ffef-4658-a553-70db1d58a00b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:51.153631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-23fe0ad5-ffef-4658-a553-70db1d58a00b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.163189 Jul 26 18:49:51.154194 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1488/3001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:50 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:51.842475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1666893d-de30-4c0d-a5f2-e39effcc5bb0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:51.843300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1666893d-de30-4c0d-a5f2-e39effcc5bb0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:51.843504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-af890918-c576-4d25-aa0b-285f9a681c87 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:51.844315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-af890918-c576-4d25-aa0b-285f9a681c87 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:51.850740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1666893d-de30-4c0d-a5f2-e39effcc5bb0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:51.851227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1666893d-de30-4c0d-a5f2-e39effcc5bb0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:51.851482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af890918-c576-4d25-aa0b-285f9a681c87 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:51.851920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af890918-c576-4d25-aa0b-285f9a681c87 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:51.852092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1666893d-de30-4c0d-a5f2-e39effcc5bb0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:51.852400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1666893d-de30-4c0d-a5f2-e39effcc5bb0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:51.852674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af890918-c576-4d25-aa0b-285f9a681c87 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:51.853158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af890918-c576-4d25-aa0b-285f9a681c87 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:51.985793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1666893d-de30-4c0d-a5f2-e39effcc5bb0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:51.987756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-af890918-c576-4d25-aa0b-285f9a681c87 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:51.994762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1666893d-de30-4c0d-a5f2-e39effcc5bb0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156908 Jul 26 18:49:51.995250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1514/3002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:51 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:51.996110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-af890918-c576-4d25-aa0b-285f9a681c87 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157654 Jul 26 18:49:51.996827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1489/3003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:51 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:52.009590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f9ea4184-2be3-444a-b3e4-45b980e31799 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:52.010124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f9ea4184-2be3-444a-b3e4-45b980e31799 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:52.016385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9ea4184-2be3-444a-b3e4-45b980e31799 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:52.016956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9ea4184-2be3-444a-b3e4-45b980e31799 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:52.017845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9ea4184-2be3-444a-b3e4-45b980e31799 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:52.018574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9ea4184-2be3-444a-b3e4-45b980e31799 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:52.024275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e6081ab0-1b43-4fdc-9e99-6cbcc379a92a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:52.024975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e6081ab0-1b43-4fdc-9e99-6cbcc379a92a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:52.031336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6081ab0-1b43-4fdc-9e99-6cbcc379a92a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:52.031791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6081ab0-1b43-4fdc-9e99-6cbcc379a92a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:52.032552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6081ab0-1b43-4fdc-9e99-6cbcc379a92a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:52.032989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6081ab0-1b43-4fdc-9e99-6cbcc379a92a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:52.152272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f9ea4184-2be3-444a-b3e4-45b980e31799 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:52.160446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f9ea4184-2be3-444a-b3e4-45b980e31799 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154795 Jul 26 18:49:52.161166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1515/3004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:52 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:52.161611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e6081ab0-1b43-4fdc-9e99-6cbcc379a92a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:52.169984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e6081ab0-1b43-4fdc-9e99-6cbcc379a92a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:52.171552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e6081ab0-1b43-4fdc-9e99-6cbcc379a92a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:52.172782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e6081ab0-1b43-4fdc-9e99-6cbcc379a92a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.152906 Jul 26 18:49:52.173485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1490/3005] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:52.175436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-26b08657-b35a-4187-b169-a832b28fc924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:52.176060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-26b08657-b35a-4187-b169-a832b28fc924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:52.182069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26b08657-b35a-4187-b169-a832b28fc924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:52.182515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26b08657-b35a-4187-b169-a832b28fc924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:52.183287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26b08657-b35a-4187-b169-a832b28fc924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:52.183720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26b08657-b35a-4187-b169-a832b28fc924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:52.313669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-26b08657-b35a-4187-b169-a832b28fc924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:52.321994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-26b08657-b35a-4187-b169-a832b28fc924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150285 Jul 26 18:49:52.322574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1516/3006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:52 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:53.017556 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5b7bb0f4-e076-4da1-a3cf-c83e3c95cca9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:53.018137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5b7bb0f4-e076-4da1-a3cf-c83e3c95cca9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:53.018566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dd01e850-312d-4da8-b376-42ae61cb36b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:53.019310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dd01e850-312d-4da8-b376-42ae61cb36b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:53.025570 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b7bb0f4-e076-4da1-a3cf-c83e3c95cca9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:53.026013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b7bb0f4-e076-4da1-a3cf-c83e3c95cca9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:53.026429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd01e850-312d-4da8-b376-42ae61cb36b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:53.026798 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b7bb0f4-e076-4da1-a3cf-c83e3c95cca9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:53.026988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd01e850-312d-4da8-b376-42ae61cb36b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:53.027275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5b7bb0f4-e076-4da1-a3cf-c83e3c95cca9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:53.028368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd01e850-312d-4da8-b376-42ae61cb36b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:53.029123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd01e850-312d-4da8-b376-42ae61cb36b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:53.170806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5b7bb0f4-e076-4da1-a3cf-c83e3c95cca9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:53.171003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dd01e850-312d-4da8-b376-42ae61cb36b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:53.179509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5b7bb0f4-e076-4da1-a3cf-c83e3c95cca9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.167533 Jul 26 18:49:53.179703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dd01e850-312d-4da8-b376-42ae61cb36b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.166201 Jul 26 18:49:53.180275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1491/3007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:53 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:53.180416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1517/3008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:53 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:53.186856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fe4f5ade-b635-43d7-8343-8cdd554cdb25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:53.187530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fe4f5ade-b635-43d7-8343-8cdd554cdb25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:53.193894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe4f5ade-b635-43d7-8343-8cdd554cdb25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:53.194409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe4f5ade-b635-43d7-8343-8cdd554cdb25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:53.195100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe4f5ade-b635-43d7-8343-8cdd554cdb25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:53.195529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe4f5ade-b635-43d7-8343-8cdd554cdb25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:53.197988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-264a7324-0618-4309-aaaa-ade4cd31d400 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:53.198591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-264a7324-0618-4309-aaaa-ade4cd31d400 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:53.204920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-264a7324-0618-4309-aaaa-ade4cd31d400 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:53.205385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-264a7324-0618-4309-aaaa-ade4cd31d400 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:53.206256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-264a7324-0618-4309-aaaa-ade4cd31d400 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:53.206980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-264a7324-0618-4309-aaaa-ade4cd31d400 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:53.339811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fe4f5ade-b635-43d7-8343-8cdd554cdb25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:53.341984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-264a7324-0618-4309-aaaa-ade4cd31d400 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:53.348187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fe4f5ade-b635-43d7-8343-8cdd554cdb25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.167099 Jul 26 18:49:53.348766 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1492/3009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:53 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:53.350475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-264a7324-0618-4309-aaaa-ade4cd31d400 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:53.352030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-264a7324-0618-4309-aaaa-ade4cd31d400 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:53.353195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-82de7eae-baf5-4faf-a2d4-5aaa0caefd74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:53.353406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-264a7324-0618-4309-aaaa-ade4cd31d400 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159137 Jul 26 18:49:53.353787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-82de7eae-baf5-4faf-a2d4-5aaa0caefd74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:53.354133 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1518/3010] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:53.360109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-82de7eae-baf5-4faf-a2d4-5aaa0caefd74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:53.360557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-82de7eae-baf5-4faf-a2d4-5aaa0caefd74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:53.361315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-82de7eae-baf5-4faf-a2d4-5aaa0caefd74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:53.361744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-82de7eae-baf5-4faf-a2d4-5aaa0caefd74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:53.488564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-82de7eae-baf5-4faf-a2d4-5aaa0caefd74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:53.496588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-82de7eae-baf5-4faf-a2d4-5aaa0caefd74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.146870 Jul 26 18:49:53.497157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1493/3011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:53 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:54.200954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5924f3d9-1b49-4704-a936-4c0571da55a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:54.201566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-885ea6d5-4c68-4546-ac5b-f11d9cfdb975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:54.201968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5924f3d9-1b49-4704-a936-4c0571da55a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:54.202083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-885ea6d5-4c68-4546-ac5b-f11d9cfdb975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:54.209179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5924f3d9-1b49-4704-a936-4c0571da55a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:54.210266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5924f3d9-1b49-4704-a936-4c0571da55a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:54.211102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5924f3d9-1b49-4704-a936-4c0571da55a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:54.211541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5924f3d9-1b49-4704-a936-4c0571da55a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:54.212312 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-885ea6d5-4c68-4546-ac5b-f11d9cfdb975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:54.213107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-885ea6d5-4c68-4546-ac5b-f11d9cfdb975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:54.214776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-885ea6d5-4c68-4546-ac5b-f11d9cfdb975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:54.214776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-885ea6d5-4c68-4546-ac5b-f11d9cfdb975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:54.341095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5924f3d9-1b49-4704-a936-4c0571da55a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:54.344622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-885ea6d5-4c68-4546-ac5b-f11d9cfdb975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:54.349312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5924f3d9-1b49-4704-a936-4c0571da55a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152198 Jul 26 18:49:54.350161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1519/3012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:54 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:54.352625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-885ea6d5-4c68-4546-ac5b-f11d9cfdb975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155153 Jul 26 18:49:54.353182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1494/3013] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:54.373271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-846892b0-a991-4a5a-abf1-b3647e0e3599 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:54.373798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-846892b0-a991-4a5a-abf1-b3647e0e3599 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:54.375742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-182a5903-37ca-4031-b1b6-e7988049a731 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:54.376339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-182a5903-37ca-4031-b1b6-e7988049a731 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:54.380263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-846892b0-a991-4a5a-abf1-b3647e0e3599 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:54.380744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-846892b0-a991-4a5a-abf1-b3647e0e3599 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:54.381498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-846892b0-a991-4a5a-abf1-b3647e0e3599 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:54.381929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-846892b0-a991-4a5a-abf1-b3647e0e3599 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:54.382359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-182a5903-37ca-4031-b1b6-e7988049a731 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:54.382799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-182a5903-37ca-4031-b1b6-e7988049a731 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:54.383578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-182a5903-37ca-4031-b1b6-e7988049a731 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:54.384008 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-182a5903-37ca-4031-b1b6-e7988049a731 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:54.510866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-182a5903-37ca-4031-b1b6-e7988049a731 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:54.512895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-846892b0-a991-4a5a-abf1-b3647e0e3599 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:54.520369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-182a5903-37ca-4031-b1b6-e7988049a731 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:54.521329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-846892b0-a991-4a5a-abf1-b3647e0e3599 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151735 Jul 26 18:49:54.521876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-182a5903-37ca-4031-b1b6-e7988049a731 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:54.522041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1520/3014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:54 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:54.523407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-182a5903-37ca-4031-b1b6-e7988049a731 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.151281 Jul 26 18:49:54.530065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1495/3015] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:54 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:49:54.530264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-61c5c53a-1b70-49b8-b6f6-6f1864f34456 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:54.530264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-61c5c53a-1b70-49b8-b6f6-6f1864f34456 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:54.533263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61c5c53a-1b70-49b8-b6f6-6f1864f34456 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:54.533708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61c5c53a-1b70-49b8-b6f6-6f1864f34456 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:54.534468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61c5c53a-1b70-49b8-b6f6-6f1864f34456 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:54.534900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61c5c53a-1b70-49b8-b6f6-6f1864f34456 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:54.672165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-61c5c53a-1b70-49b8-b6f6-6f1864f34456 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:54.680823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-61c5c53a-1b70-49b8-b6f6-6f1864f34456 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157669 Jul 26 18:49:54.681426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1521/3016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:54 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:55.374706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2721e20b-b9b9-4bcf-b649-ca09d35e08a9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:55.376001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2721e20b-b9b9-4bcf-b649-ca09d35e08a9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:55.377475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d7585300-bb54-4c6a-905b-61431265408b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:55.378513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d7585300-bb54-4c6a-905b-61431265408b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:55.386285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2721e20b-b9b9-4bcf-b649-ca09d35e08a9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:55.387050 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2721e20b-b9b9-4bcf-b649-ca09d35e08a9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:55.388315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2721e20b-b9b9-4bcf-b649-ca09d35e08a9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:55.389029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2721e20b-b9b9-4bcf-b649-ca09d35e08a9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:55.389405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d7585300-bb54-4c6a-905b-61431265408b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:55.390159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d7585300-bb54-4c6a-905b-61431265408b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:55.391232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d7585300-bb54-4c6a-905b-61431265408b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:55.391662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d7585300-bb54-4c6a-905b-61431265408b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:55.405135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:55.407093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:49:55.524047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2721e20b-b9b9-4bcf-b649-ca09d35e08a9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:55.526486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d7585300-bb54-4c6a-905b-61431265408b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:55.532431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2721e20b-b9b9-4bcf-b649-ca09d35e08a9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.164109 Jul 26 18:49:55.533006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1496/3017] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:55 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:55.535432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d7585300-bb54-4c6a-905b-61431265408b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164260 Jul 26 18:49:55.536073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1522/3018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:55 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:55.546317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-87caf384-3766-4e9f-baae-50b7387a5fb2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:55.547117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-41ba6bdb-c95c-4f88-a983-6abfaa6fac47 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:55.547718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-41ba6bdb-c95c-4f88-a983-6abfaa6fac47 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:55.550699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-87caf384-3766-4e9f-baae-50b7387a5fb2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:55.553955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41ba6bdb-c95c-4f88-a983-6abfaa6fac47 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:55.554403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41ba6bdb-c95c-4f88-a983-6abfaa6fac47 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:55.555192 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41ba6bdb-c95c-4f88-a983-6abfaa6fac47 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:55.555628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41ba6bdb-c95c-4f88-a983-6abfaa6fac47 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:55.556663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87caf384-3766-4e9f-baae-50b7387a5fb2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:55.557104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87caf384-3766-4e9f-baae-50b7387a5fb2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:55.557847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87caf384-3766-4e9f-baae-50b7387a5fb2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:55.558273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87caf384-3766-4e9f-baae-50b7387a5fb2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:55.684899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-41ba6bdb-c95c-4f88-a983-6abfaa6fac47 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:55.693005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-87caf384-3766-4e9f-baae-50b7387a5fb2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:55.693463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-41ba6bdb-c95c-4f88-a983-6abfaa6fac47 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154783 Jul 26 18:49:55.694035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1497/3019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:55 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:55.701347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c5fd991e-666b-43ad-a0f4-f8afb64f8f25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:55.701921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-87caf384-3766-4e9f-baae-50b7387a5fb2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:55.702120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c5fd991e-666b-43ad-a0f4-f8afb64f8f25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:55.703456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-87caf384-3766-4e9f-baae-50b7387a5fb2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:55.704607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-87caf384-3766-4e9f-baae-50b7387a5fb2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161920 Jul 26 18:49:55.705141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1523/3020] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:55 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:55.710540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5fd991e-666b-43ad-a0f4-f8afb64f8f25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:55.710991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5fd991e-666b-43ad-a0f4-f8afb64f8f25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:55.711776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5fd991e-666b-43ad-a0f4-f8afb64f8f25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:55.712263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5fd991e-666b-43ad-a0f4-f8afb64f8f25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:55.848236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c5fd991e-666b-43ad-a0f4-f8afb64f8f25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:55.860630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c5fd991e-666b-43ad-a0f4-f8afb64f8f25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.162843 Jul 26 18:49:55.861177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1498/3021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:55 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:56.560426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6a4f9a40-99a9-43f0-928a-f7727835598d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:56.561448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6a4f9a40-99a9-43f0-928a-f7727835598d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:56.572659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a4f9a40-99a9-43f0-928a-f7727835598d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:56.573757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a4f9a40-99a9-43f0-928a-f7727835598d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:56.575107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a4f9a40-99a9-43f0-928a-f7727835598d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:56.575800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6a4f9a40-99a9-43f0-928a-f7727835598d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:56.730928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6b627a12-2e18-4e69-a12c-8587343aea2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:56.731578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6b627a12-2e18-4e69-a12c-8587343aea2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:56.738383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b627a12-2e18-4e69-a12c-8587343aea2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:56.738838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b627a12-2e18-4e69-a12c-8587343aea2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:56.739685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b627a12-2e18-4e69-a12c-8587343aea2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:56.740123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b627a12-2e18-4e69-a12c-8587343aea2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:56.874017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6b627a12-2e18-4e69-a12c-8587343aea2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:56.883592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6b627a12-2e18-4e69-a12c-8587343aea2b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.332348 Jul 26 18:49:56.884190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1524/3022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:56 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:56.889670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-72f01aa5-0fce-416f-99f8-00ba3a8fa381 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:56.890274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-72f01aa5-0fce-416f-99f8-00ba3a8fa381 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:56.898355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72f01aa5-0fce-416f-99f8-00ba3a8fa381 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:56.898820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72f01aa5-0fce-416f-99f8-00ba3a8fa381 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:56.899617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72f01aa5-0fce-416f-99f8-00ba3a8fa381 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:56.900071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72f01aa5-0fce-416f-99f8-00ba3a8fa381 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:56.940528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6a4f9a40-99a9-43f0-928a-f7727835598d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:56.948690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6a4f9a40-99a9-43f0-928a-f7727835598d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.394740 Jul 26 18:49:56.949276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1499/3023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:56 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:56.953986 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-798dcea4-bce3-46f0-8523-d413b7e15f57 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:56.954584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-798dcea4-bce3-46f0-8523-d413b7e15f57 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:56.960708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-798dcea4-bce3-46f0-8523-d413b7e15f57 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:56.961187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-798dcea4-bce3-46f0-8523-d413b7e15f57 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:56.962077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-798dcea4-bce3-46f0-8523-d413b7e15f57 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:56.962703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-798dcea4-bce3-46f0-8523-d413b7e15f57 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:57.034519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-72f01aa5-0fce-416f-99f8-00ba3a8fa381 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:57.042877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-72f01aa5-0fce-416f-99f8-00ba3a8fa381 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157485 Jul 26 18:49:57.043496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1525/3024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:56 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:57.047991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9070621e-69cd-4271-bad7-adae4335fb3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:57.048599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9070621e-69cd-4271-bad7-adae4335fb3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:57.054976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9070621e-69cd-4271-bad7-adae4335fb3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:57.056195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9070621e-69cd-4271-bad7-adae4335fb3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:57.056999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9070621e-69cd-4271-bad7-adae4335fb3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:57.057439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9070621e-69cd-4271-bad7-adae4335fb3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:57.091438 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-798dcea4-bce3-46f0-8523-d413b7e15f57 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:57.099959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-798dcea4-bce3-46f0-8523-d413b7e15f57 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:57.101455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-798dcea4-bce3-46f0-8523-d413b7e15f57 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:57.102612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-798dcea4-bce3-46f0-8523-d413b7e15f57 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.152235 Jul 26 18:49:57.103235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1500/3025] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:56 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:57.191705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9070621e-69cd-4271-bad7-adae4335fb3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:57.200009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9070621e-69cd-4271-bad7-adae4335fb3c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155575 Jul 26 18:49:57.200567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1526/3026] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:57 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:57.909577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f32391f7-d0f7-4dd9-92a8-068f2b99ee53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:57.910176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f32391f7-d0f7-4dd9-92a8-068f2b99ee53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:57.918470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f32391f7-d0f7-4dd9-92a8-068f2b99ee53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:57.918912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f32391f7-d0f7-4dd9-92a8-068f2b99ee53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:57.920062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f32391f7-d0f7-4dd9-92a8-068f2b99ee53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:57.920486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f32391f7-d0f7-4dd9-92a8-068f2b99ee53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:57.971723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b926508e-1bd8-4228-baf8-3272c46e7deb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:57.972432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b926508e-1bd8-4228-baf8-3272c46e7deb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:57.979114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b926508e-1bd8-4228-baf8-3272c46e7deb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:57.979562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b926508e-1bd8-4228-baf8-3272c46e7deb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:57.980306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b926508e-1bd8-4228-baf8-3272c46e7deb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:57.980730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b926508e-1bd8-4228-baf8-3272c46e7deb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:58.059052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f32391f7-d0f7-4dd9-92a8-068f2b99ee53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:58.067476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f32391f7-d0f7-4dd9-92a8-068f2b99ee53 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.164534 Jul 26 18:49:58.068053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1501/3027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:57 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:58.072736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0d885b84-384d-46ea-ab67-68c876882190 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:58.073335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0d885b84-384d-46ea-ab67-68c876882190 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:58.079333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d885b84-384d-46ea-ab67-68c876882190 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:58.079778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d885b84-384d-46ea-ab67-68c876882190 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:58.080806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d885b84-384d-46ea-ab67-68c876882190 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:58.081243 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d885b84-384d-46ea-ab67-68c876882190 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:58.115244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b926508e-1bd8-4228-baf8-3272c46e7deb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:58.123640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b926508e-1bd8-4228-baf8-3272c46e7deb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155718 Jul 26 18:49:58.124189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1527/3028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:57 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:58.128686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ca0c9dc2-2e71-42bf-8738-8ffb70475b61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:58.129434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ca0c9dc2-2e71-42bf-8738-8ffb70475b61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:58.135339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca0c9dc2-2e71-42bf-8738-8ffb70475b61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:58.135787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca0c9dc2-2e71-42bf-8738-8ffb70475b61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:58.136539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca0c9dc2-2e71-42bf-8738-8ffb70475b61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:58.137037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca0c9dc2-2e71-42bf-8738-8ffb70475b61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:58.209569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0d885b84-384d-46ea-ab67-68c876882190 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:58.217956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0d885b84-384d-46ea-ab67-68c876882190 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.148732 Jul 26 18:49:58.218535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1502/3029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:58 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:58.222918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-106f866c-b2a8-476b-be6c-038d70179e0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:58.223543 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-106f866c-b2a8-476b-be6c-038d70179e0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:58.229706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-106f866c-b2a8-476b-be6c-038d70179e0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:58.230153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-106f866c-b2a8-476b-be6c-038d70179e0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:58.230911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-106f866c-b2a8-476b-be6c-038d70179e0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:58.231365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-106f866c-b2a8-476b-be6c-038d70179e0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:58.265086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ca0c9dc2-2e71-42bf-8738-8ffb70475b61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:58.273873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ca0c9dc2-2e71-42bf-8738-8ffb70475b61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:58.275444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ca0c9dc2-2e71-42bf-8738-8ffb70475b61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:58.276607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ca0c9dc2-2e71-42bf-8738-8ffb70475b61 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.151481 Jul 26 18:49:58.277123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1528/3030] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:58.365172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-106f866c-b2a8-476b-be6c-038d70179e0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:58.378701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-106f866c-b2a8-476b-be6c-038d70179e0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158938 Jul 26 18:49:58.379661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1503/3031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:58 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:59.093023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-37460784-893b-4ce0-a9fb-0137a3e61cc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:59.093900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-37460784-893b-4ce0-a9fb-0137a3e61cc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:59.104909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37460784-893b-4ce0-a9fb-0137a3e61cc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:59.105609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37460784-893b-4ce0-a9fb-0137a3e61cc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:59.106840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37460784-893b-4ce0-a9fb-0137a3e61cc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:59.107614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37460784-893b-4ce0-a9fb-0137a3e61cc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:59.145473 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-837f5b6e-9613-4925-bd1c-6873b30add18 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:59.146094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-837f5b6e-9613-4925-bd1c-6873b30add18 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:59.153345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-837f5b6e-9613-4925-bd1c-6873b30add18 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:59.153752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-837f5b6e-9613-4925-bd1c-6873b30add18 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:59.154535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-837f5b6e-9613-4925-bd1c-6873b30add18 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:59.154961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-837f5b6e-9613-4925-bd1c-6873b30add18 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:59.237642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-37460784-893b-4ce0-a9fb-0137a3e61cc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:59.245902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-37460784-893b-4ce0-a9fb-0137a3e61cc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.159477 Jul 26 18:49:59.246489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1529/3032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:59 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:59.262079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0fdee03c-66fa-49fd-89ed-830f106ed402 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:59.264866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0fdee03c-66fa-49fd-89ed-830f106ed402 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:59.271681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0fdee03c-66fa-49fd-89ed-830f106ed402 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:59.272125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0fdee03c-66fa-49fd-89ed-830f106ed402 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:59.273230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0fdee03c-66fa-49fd-89ed-830f106ed402 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:59.273675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0fdee03c-66fa-49fd-89ed-830f106ed402 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:59.288098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-837f5b6e-9613-4925-bd1c-6873b30add18 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:59.296521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-837f5b6e-9613-4925-bd1c-6873b30add18 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154813 Jul 26 18:49:59.297134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1504/3033] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:59 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:49:59.301719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-24315766-b953-4e0c-b035-7fa8fcccb821 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:59.303354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-24315766-b953-4e0c-b035-7fa8fcccb821 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:59.309769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24315766-b953-4e0c-b035-7fa8fcccb821 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:59.310217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24315766-b953-4e0c-b035-7fa8fcccb821 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:59.311067 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24315766-b953-4e0c-b035-7fa8fcccb821 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:59.311554 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-24315766-b953-4e0c-b035-7fa8fcccb821 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:59.408744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0fdee03c-66fa-49fd-89ed-830f106ed402 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:59.417030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0fdee03c-66fa-49fd-89ed-830f106ed402 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.160477 Jul 26 18:49:59.417600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1530/3034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:59 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:49:59.426998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f6d8eab4-5b9d-457b-a928-fd89d6da49d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:49:59.427933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f6d8eab4-5b9d-457b-a928-fd89d6da49d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:49:59.434717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6d8eab4-5b9d-457b-a928-fd89d6da49d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:59.434717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6d8eab4-5b9d-457b-a928-fd89d6da49d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:59.435591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6d8eab4-5b9d-457b-a928-fd89d6da49d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:49:59.436020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6d8eab4-5b9d-457b-a928-fd89d6da49d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:49:59.444918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-24315766-b953-4e0c-b035-7fa8fcccb821 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:59.454044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-24315766-b953-4e0c-b035-7fa8fcccb821 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:59.456006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-24315766-b953-4e0c-b035-7fa8fcccb821 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:59.457168 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-24315766-b953-4e0c-b035-7fa8fcccb821 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159111 Jul 26 18:49:59.457944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1505/3035] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:49:59 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:49:59.567469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f6d8eab4-5b9d-457b-a928-fd89d6da49d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:49:59.576935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f6d8eab4-5b9d-457b-a928-fd89d6da49d1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158298 Jul 26 18:49:59.577910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1531/3036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:49:59 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:00.271309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ae698b0e-29d1-4809-99ba-c55305e1148e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:00.272532 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ae698b0e-29d1-4809-99ba-c55305e1148e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:00.282739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae698b0e-29d1-4809-99ba-c55305e1148e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:00.283217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae698b0e-29d1-4809-99ba-c55305e1148e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:00.283968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae698b0e-29d1-4809-99ba-c55305e1148e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:00.284394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae698b0e-29d1-4809-99ba-c55305e1148e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:00.317866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-36c352e8-82fa-4ad3-bf72-34a56d350b5b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:00.318461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-36c352e8-82fa-4ad3-bf72-34a56d350b5b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:00.328938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36c352e8-82fa-4ad3-bf72-34a56d350b5b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:00.329392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36c352e8-82fa-4ad3-bf72-34a56d350b5b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:00.330179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36c352e8-82fa-4ad3-bf72-34a56d350b5b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:00.330621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36c352e8-82fa-4ad3-bf72-34a56d350b5b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:00.424576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ae698b0e-29d1-4809-99ba-c55305e1148e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:00.432776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ae698b0e-29d1-4809-99ba-c55305e1148e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167899 Jul 26 18:50:00.433587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1506/3037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:00 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:00.437792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e51c5c58-7dfa-46a4-9094-a65cbf72a868 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:00.438414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e51c5c58-7dfa-46a4-9094-a65cbf72a868 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:00.444494 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e51c5c58-7dfa-46a4-9094-a65cbf72a868 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:00.444982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e51c5c58-7dfa-46a4-9094-a65cbf72a868 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:00.445690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e51c5c58-7dfa-46a4-9094-a65cbf72a868 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:00.446461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e51c5c58-7dfa-46a4-9094-a65cbf72a868 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:00.471738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-36c352e8-82fa-4ad3-bf72-34a56d350b5b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:00.480023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-36c352e8-82fa-4ad3-bf72-34a56d350b5b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165994 Jul 26 18:50:00.480573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1532/3038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:00 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:00.485928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b6c347cf-6a85-4a1d-b2e1-1c3e4c81ff6b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:00.486540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b6c347cf-6a85-4a1d-b2e1-1c3e4c81ff6b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:00.492405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6c347cf-6a85-4a1d-b2e1-1c3e4c81ff6b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:00.492855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6c347cf-6a85-4a1d-b2e1-1c3e4c81ff6b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:00.493620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6c347cf-6a85-4a1d-b2e1-1c3e4c81ff6b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:00.494050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6c347cf-6a85-4a1d-b2e1-1c3e4c81ff6b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:00.576979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e51c5c58-7dfa-46a4-9094-a65cbf72a868 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:00.585080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e51c5c58-7dfa-46a4-9094-a65cbf72a868 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.150757 Jul 26 18:50:00.585913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1507/3039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:00 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:00.599746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-743ca8a8-5187-479c-9c9f-6e2a35a70395 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:00.600423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-743ca8a8-5187-479c-9c9f-6e2a35a70395 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:00.606398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-743ca8a8-5187-479c-9c9f-6e2a35a70395 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:00.606843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-743ca8a8-5187-479c-9c9f-6e2a35a70395 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:00.607637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-743ca8a8-5187-479c-9c9f-6e2a35a70395 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:00.608066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-743ca8a8-5187-479c-9c9f-6e2a35a70395 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:00.624465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b6c347cf-6a85-4a1d-b2e1-1c3e4c81ff6b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:00.632966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b6c347cf-6a85-4a1d-b2e1-1c3e4c81ff6b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:00.634465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b6c347cf-6a85-4a1d-b2e1-1c3e4c81ff6b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:00.635656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b6c347cf-6a85-4a1d-b2e1-1c3e4c81ff6b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.154183 Jul 26 18:50:00.636221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1533/3040] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:00 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:00.740593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-743ca8a8-5187-479c-9c9f-6e2a35a70395 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:00.748996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-743ca8a8-5187-479c-9c9f-6e2a35a70395 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152803 Jul 26 18:50:00.749552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1508/3041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:00 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:01.457128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a777767d-7306-4e8e-89ae-4ab01934343d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:01.457994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a777767d-7306-4e8e-89ae-4ab01934343d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:01.467511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a777767d-7306-4e8e-89ae-4ab01934343d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:01.468144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a777767d-7306-4e8e-89ae-4ab01934343d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:01.469177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a777767d-7306-4e8e-89ae-4ab01934343d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:01.469606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a777767d-7306-4e8e-89ae-4ab01934343d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:01.500969 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-448fd4cd-943f-4974-af82-852b67eb14cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:01.501674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-448fd4cd-943f-4974-af82-852b67eb14cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:01.508470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-448fd4cd-943f-4974-af82-852b67eb14cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:01.508989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-448fd4cd-943f-4974-af82-852b67eb14cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:01.509743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-448fd4cd-943f-4974-af82-852b67eb14cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:01.510253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-448fd4cd-943f-4974-af82-852b67eb14cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:01.599573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a777767d-7306-4e8e-89ae-4ab01934343d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:01.607887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a777767d-7306-4e8e-89ae-4ab01934343d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156291 Jul 26 18:50:01.619372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1534/3042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:01 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:01.626793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-904c4d65-be8d-4067-83f3-706a9ace83ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:01.627428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-904c4d65-be8d-4067-83f3-706a9ace83ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:01.633351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-904c4d65-be8d-4067-83f3-706a9ace83ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:01.633794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-904c4d65-be8d-4067-83f3-706a9ace83ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:01.634548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-904c4d65-be8d-4067-83f3-706a9ace83ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:01.634975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-904c4d65-be8d-4067-83f3-706a9ace83ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:01.642937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-448fd4cd-943f-4974-af82-852b67eb14cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:01.651251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-448fd4cd-943f-4974-af82-852b67eb14cc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154126 Jul 26 18:50:01.651823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1509/3043] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:01 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:01.659185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-80a90f69-fa5b-472f-8f5a-1b029cbf969a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:01.659815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-80a90f69-fa5b-472f-8f5a-1b029cbf969a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:01.666436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80a90f69-fa5b-472f-8f5a-1b029cbf969a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:01.666885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80a90f69-fa5b-472f-8f5a-1b029cbf969a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:01.667667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80a90f69-fa5b-472f-8f5a-1b029cbf969a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:01.668106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80a90f69-fa5b-472f-8f5a-1b029cbf969a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:01.765747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-904c4d65-be8d-4067-83f3-706a9ace83ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:01.774190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-904c4d65-be8d-4067-83f3-706a9ace83ca tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153773 Jul 26 18:50:01.774728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1535/3044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:01 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:01.779147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f00f2b09-3284-4fd5-badf-8e29c8d2d67a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:01.779749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f00f2b09-3284-4fd5-badf-8e29c8d2d67a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:01.790189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f00f2b09-3284-4fd5-badf-8e29c8d2d67a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:01.790642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f00f2b09-3284-4fd5-badf-8e29c8d2d67a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:01.791443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f00f2b09-3284-4fd5-badf-8e29c8d2d67a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:01.791872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f00f2b09-3284-4fd5-badf-8e29c8d2d67a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:01.801865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80a90f69-fa5b-472f-8f5a-1b029cbf969a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:01.810426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80a90f69-fa5b-472f-8f5a-1b029cbf969a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:01.812026 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80a90f69-fa5b-472f-8f5a-1b029cbf969a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:01.813213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-80a90f69-fa5b-472f-8f5a-1b029cbf969a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157840 Jul 26 18:50:01.813775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1510/3045] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:01 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:01.925067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f00f2b09-3284-4fd5-badf-8e29c8d2d67a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:01.933268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f00f2b09-3284-4fd5-badf-8e29c8d2d67a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157555 Jul 26 18:50:01.933828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1536/3046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:01 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:02.636252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4e4ce0b3-bb6b-4dfe-9740-b52b5cacb0bc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:02.637207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4e4ce0b3-bb6b-4dfe-9740-b52b5cacb0bc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:02.644957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e4ce0b3-bb6b-4dfe-9740-b52b5cacb0bc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:02.645403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e4ce0b3-bb6b-4dfe-9740-b52b5cacb0bc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:02.646151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e4ce0b3-bb6b-4dfe-9740-b52b5cacb0bc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:02.646590 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e4ce0b3-bb6b-4dfe-9740-b52b5cacb0bc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:02.672973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b4706daf-35b2-495f-b5ea-ca6fe0c0174a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:02.673601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b4706daf-35b2-495f-b5ea-ca6fe0c0174a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:02.680478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4706daf-35b2-495f-b5ea-ca6fe0c0174a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:02.680952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4706daf-35b2-495f-b5ea-ca6fe0c0174a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:02.681773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4706daf-35b2-495f-b5ea-ca6fe0c0174a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:02.682146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4706daf-35b2-495f-b5ea-ca6fe0c0174a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:02.789032 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4e4ce0b3-bb6b-4dfe-9740-b52b5cacb0bc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:02.801503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4e4ce0b3-bb6b-4dfe-9740-b52b5cacb0bc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.171760 Jul 26 18:50:02.802126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1511/3047] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:02.806732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6810d56d-820b-434d-b01e-96c0e13553cf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:02.807374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6810d56d-820b-434d-b01e-96c0e13553cf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:02.816088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6810d56d-820b-434d-b01e-96c0e13553cf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:02.816240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b4706daf-35b2-495f-b5ea-ca6fe0c0174a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:02.816721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6810d56d-820b-434d-b01e-96c0e13553cf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:02.817496 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6810d56d-820b-434d-b01e-96c0e13553cf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:02.817925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6810d56d-820b-434d-b01e-96c0e13553cf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:02.824791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b4706daf-35b2-495f-b5ea-ca6fe0c0174a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155802 Jul 26 18:50:02.825377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1537/3048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:02 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:02.837582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6cb5fae6-c4fc-479a-900a-6be35f57d13a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:02.838402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6cb5fae6-c4fc-479a-900a-6be35f57d13a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:02.840285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:02.846088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6cb5fae6-c4fc-479a-900a-6be35f57d13a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:02.846533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6cb5fae6-c4fc-479a-900a-6be35f57d13a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:02.847362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6cb5fae6-c4fc-479a-900a-6be35f57d13a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:02.847792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6cb5fae6-c4fc-479a-900a-6be35f57d13a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:02.948489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6810d56d-820b-434d-b01e-96c0e13553cf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:02.956912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6810d56d-820b-434d-b01e-96c0e13553cf tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153840 Jul 26 18:50:02.957492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1512/3049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:02 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:02.962111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-32378fb4-5eb4-412a-9bc6-0fadf8d81cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:02.962921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-32378fb4-5eb4-412a-9bc6-0fadf8d81cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:02.968744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32378fb4-5eb4-412a-9bc6-0fadf8d81cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:02.969210 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32378fb4-5eb4-412a-9bc6-0fadf8d81cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:02.969949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32378fb4-5eb4-412a-9bc6-0fadf8d81cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:02.970379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32378fb4-5eb4-412a-9bc6-0fadf8d81cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:02.972941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:02.979888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6cb5fae6-c4fc-479a-900a-6be35f57d13a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:02.988494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6cb5fae6-c4fc-479a-900a-6be35f57d13a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:02.990176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6cb5fae6-c4fc-479a-900a-6be35f57d13a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:02.991476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6cb5fae6-c4fc-479a-900a-6be35f57d13a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157744 Jul 26 18:50:02.992224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1538/3050] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:02 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:03.107066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-32378fb4-5eb4-412a-9bc6-0fadf8d81cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:03.123471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-32378fb4-5eb4-412a-9bc6-0fadf8d81cd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.164446 Jul 26 18:50:03.124268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1513/3051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:02 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:03.824549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-526662f7-166d-43ea-b0f1-1cf3b85d3a28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:03.825189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-526662f7-166d-43ea-b0f1-1cf3b85d3a28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:03.832134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-526662f7-166d-43ea-b0f1-1cf3b85d3a28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:03.832609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-526662f7-166d-43ea-b0f1-1cf3b85d3a28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:03.833350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-526662f7-166d-43ea-b0f1-1cf3b85d3a28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:03.833778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-526662f7-166d-43ea-b0f1-1cf3b85d3a28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:03.836838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:03.846280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b35a9abd-f5f8-4779-b239-db2cd6a4b3e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:03.847303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b35a9abd-f5f8-4779-b239-db2cd6a4b3e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:03.853902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b35a9abd-f5f8-4779-b239-db2cd6a4b3e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:03.854487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b35a9abd-f5f8-4779-b239-db2cd6a4b3e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:03.855378 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b35a9abd-f5f8-4779-b239-db2cd6a4b3e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:03.856067 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b35a9abd-f5f8-4779-b239-db2cd6a4b3e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:03.993065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b35a9abd-f5f8-4779-b239-db2cd6a4b3e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:04.001693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b35a9abd-f5f8-4779-b239-db2cd6a4b3e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159297 Jul 26 18:50:04.002245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1514/3052] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:03 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:04.006833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-697ced23-5aec-4467-8285-380c78e34b37 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:04.007479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-697ced23-5aec-4467-8285-380c78e34b37 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:04.010377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:04.015008 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-697ced23-5aec-4467-8285-380c78e34b37 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:04.015451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-697ced23-5aec-4467-8285-380c78e34b37 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:04.016207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-697ced23-5aec-4467-8285-380c78e34b37 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:04.016635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-697ced23-5aec-4467-8285-380c78e34b37 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:04.150516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-697ced23-5aec-4467-8285-380c78e34b37 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:04.158771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-697ced23-5aec-4467-8285-380c78e34b37 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155572 Jul 26 18:50:04.159377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1515/3053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:04 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:04.163750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a981b441-d058-4563-be2c-f924dcc06db0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:04.164480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a981b441-d058-4563-be2c-f924dcc06db0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:04.170976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a981b441-d058-4563-be2c-f924dcc06db0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:04.171448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a981b441-d058-4563-be2c-f924dcc06db0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:04.172290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a981b441-d058-4563-be2c-f924dcc06db0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:04.172716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a981b441-d058-4563-be2c-f924dcc06db0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:04.192516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-526662f7-166d-43ea-b0f1-1cf3b85d3a28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:04.201462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-526662f7-166d-43ea-b0f1-1cf3b85d3a28 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.380744 Jul 26 18:50:04.201965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1539/3054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:03 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:04.216007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fc240c9c-8f32-4173-9803-5c48ab980e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:04.216690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fc240c9c-8f32-4173-9803-5c48ab980e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:04.223199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc240c9c-8f32-4173-9803-5c48ab980e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:04.223689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc240c9c-8f32-4173-9803-5c48ab980e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:04.224536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc240c9c-8f32-4173-9803-5c48ab980e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:04.225200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc240c9c-8f32-4173-9803-5c48ab980e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:04.303509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a981b441-d058-4563-be2c-f924dcc06db0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:04.312075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a981b441-d058-4563-be2c-f924dcc06db0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:04.313718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a981b441-d058-4563-be2c-f924dcc06db0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:04.314952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a981b441-d058-4563-be2c-f924dcc06db0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.154672 Jul 26 18:50:04.315993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1516/3055] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:04 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:04.438832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fc240c9c-8f32-4173-9803-5c48ab980e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:04.448063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fc240c9c-8f32-4173-9803-5c48ab980e6f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.243940 Jul 26 18:50:04.448656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1540/3056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:04 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:05.028691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8d6733cd-ddc1-417f-9426-769cf0e6725d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:05.029551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8d6733cd-ddc1-417f-9426-769cf0e6725d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:05.040648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d6733cd-ddc1-417f-9426-769cf0e6725d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:05.041387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d6733cd-ddc1-417f-9426-769cf0e6725d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:05.042624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d6733cd-ddc1-417f-9426-769cf0e6725d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:05.043441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d6733cd-ddc1-417f-9426-769cf0e6725d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:05.177641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8d6733cd-ddc1-417f-9426-769cf0e6725d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:05.180767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-30281685-387e-4eb0-8257-22421db7e95b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:05.181395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-30281685-387e-4eb0-8257-22421db7e95b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:05.185939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8d6733cd-ddc1-417f-9426-769cf0e6725d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164306 Jul 26 18:50:05.186517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1517/3057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:05 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:05.188172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30281685-387e-4eb0-8257-22421db7e95b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:05.188618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30281685-387e-4eb0-8257-22421db7e95b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:05.189365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30281685-387e-4eb0-8257-22421db7e95b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:05.189790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30281685-387e-4eb0-8257-22421db7e95b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:05.223159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9e2ab6a3-fe4b-48d5-8968-55b1d87c8bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:05.223757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9e2ab6a3-fe4b-48d5-8968-55b1d87c8bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:05.230077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e2ab6a3-fe4b-48d5-8968-55b1d87c8bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:05.230617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e2ab6a3-fe4b-48d5-8968-55b1d87c8bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:05.231392 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e2ab6a3-fe4b-48d5-8968-55b1d87c8bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:05.231824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e2ab6a3-fe4b-48d5-8968-55b1d87c8bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:05.323599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-30281685-387e-4eb0-8257-22421db7e95b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:05.331882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-30281685-387e-4eb0-8257-22421db7e95b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155069 Jul 26 18:50:05.332766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1541/3058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:05 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:05.337486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2f8c38c6-9572-4484-8365-8c45eff847a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:05.338050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2f8c38c6-9572-4484-8365-8c45eff847a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:05.344174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f8c38c6-9572-4484-8365-8c45eff847a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:05.344621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f8c38c6-9572-4484-8365-8c45eff847a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:05.345380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f8c38c6-9572-4484-8365-8c45eff847a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:05.345809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2f8c38c6-9572-4484-8365-8c45eff847a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:05.368320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9e2ab6a3-fe4b-48d5-8968-55b1d87c8bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:05.376609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9e2ab6a3-fe4b-48d5-8968-55b1d87c8bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157335 Jul 26 18:50:05.377263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1518/3059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:05 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:05.470328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-825637f2-859a-468a-91cf-995f07ddc6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:05.470949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-825637f2-859a-468a-91cf-995f07ddc6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:05.477498 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-825637f2-859a-468a-91cf-995f07ddc6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:05.477955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-825637f2-859a-468a-91cf-995f07ddc6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:05.479327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-825637f2-859a-468a-91cf-995f07ddc6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:05.479450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-825637f2-859a-468a-91cf-995f07ddc6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:05.479907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2f8c38c6-9572-4484-8365-8c45eff847a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:05.490073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2f8c38c6-9572-4484-8365-8c45eff847a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:05.491740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2f8c38c6-9572-4484-8365-8c45eff847a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:05.492950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2f8c38c6-9572-4484-8365-8c45eff847a0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159025 Jul 26 18:50:05.493716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1542/3060] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:05.614534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-825637f2-859a-468a-91cf-995f07ddc6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:05.627415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-825637f2-859a-468a-91cf-995f07ddc6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.160822 Jul 26 18:50:05.628165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1519/3061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:05 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:06.210582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d5a506c9-34b6-4f0e-b968-3cffa089b4f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:06.211527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d5a506c9-34b6-4f0e-b968-3cffa089b4f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:06.221053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5a506c9-34b6-4f0e-b968-3cffa089b4f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:06.221562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5a506c9-34b6-4f0e-b968-3cffa089b4f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:06.222323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5a506c9-34b6-4f0e-b968-3cffa089b4f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:06.222756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5a506c9-34b6-4f0e-b968-3cffa089b4f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:06.353172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a7cf58f7-dfc2-49f1-a110-804c662a1b71 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:06.353794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a7cf58f7-dfc2-49f1-a110-804c662a1b71 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:06.357666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d5a506c9-34b6-4f0e-b968-3cffa089b4f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:06.360374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7cf58f7-dfc2-49f1-a110-804c662a1b71 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:06.360789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7cf58f7-dfc2-49f1-a110-804c662a1b71 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:06.361539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7cf58f7-dfc2-49f1-a110-804c662a1b71 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:06.361968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a7cf58f7-dfc2-49f1-a110-804c662a1b71 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:06.366116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d5a506c9-34b6-4f0e-b968-3cffa089b4f7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.162097 Jul 26 18:50:06.366911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1543/3062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:06 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:06.397644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d89497c1-8432-4425-939f-e9bdb782cc16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:06.398386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d89497c1-8432-4425-939f-e9bdb782cc16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:06.404959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d89497c1-8432-4425-939f-e9bdb782cc16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:06.405408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d89497c1-8432-4425-939f-e9bdb782cc16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:06.406158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d89497c1-8432-4425-939f-e9bdb782cc16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:06.406570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d89497c1-8432-4425-939f-e9bdb782cc16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:06.494324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a7cf58f7-dfc2-49f1-a110-804c662a1b71 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:06.502475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a7cf58f7-dfc2-49f1-a110-804c662a1b71 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153253 Jul 26 18:50:06.503076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1520/3063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:06 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:06.515994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2592108a-db07-4eee-8452-3dc432118f4c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:06.516587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2592108a-db07-4eee-8452-3dc432118f4c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:06.522973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2592108a-db07-4eee-8452-3dc432118f4c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:06.523445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2592108a-db07-4eee-8452-3dc432118f4c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:06.524193 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2592108a-db07-4eee-8452-3dc432118f4c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:06.524650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2592108a-db07-4eee-8452-3dc432118f4c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:06.534555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d89497c1-8432-4425-939f-e9bdb782cc16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:06.542732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d89497c1-8432-4425-939f-e9bdb782cc16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.149195 Jul 26 18:50:06.543309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1544/3064] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:06 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:06.650374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-45268b78-1bc8-4e80-8334-67ac75a6091d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:06.650956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-45268b78-1bc8-4e80-8334-67ac75a6091d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:06.654003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2592108a-db07-4eee-8452-3dc432118f4c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:06.657429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45268b78-1bc8-4e80-8334-67ac75a6091d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:06.657905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45268b78-1bc8-4e80-8334-67ac75a6091d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:06.658659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45268b78-1bc8-4e80-8334-67ac75a6091d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:06.659118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45268b78-1bc8-4e80-8334-67ac75a6091d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:06.662453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2592108a-db07-4eee-8452-3dc432118f4c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:06.663976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2592108a-db07-4eee-8452-3dc432118f4c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:06.665147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2592108a-db07-4eee-8452-3dc432118f4c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.153050 Jul 26 18:50:06.665698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1521/3065] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:06 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:06.792151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-45268b78-1bc8-4e80-8334-67ac75a6091d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:06.807102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-45268b78-1bc8-4e80-8334-67ac75a6091d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.160077 Jul 26 18:50:06.807965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1545/3066] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:06 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:07.391439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d80c75b2-145d-4bd9-995c-9a24afaa6d8c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:07.392149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d80c75b2-145d-4bd9-995c-9a24afaa6d8c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:07.400892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d80c75b2-145d-4bd9-995c-9a24afaa6d8c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:07.401450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d80c75b2-145d-4bd9-995c-9a24afaa6d8c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:07.402384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d80c75b2-145d-4bd9-995c-9a24afaa6d8c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:07.402920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d80c75b2-145d-4bd9-995c-9a24afaa6d8c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:07.523352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a8f43db4-694e-47c0-9453-7732379e2a25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:07.523935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a8f43db4-694e-47c0-9453-7732379e2a25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:07.530625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8f43db4-694e-47c0-9453-7732379e2a25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:07.531232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8f43db4-694e-47c0-9453-7732379e2a25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:07.531961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8f43db4-694e-47c0-9453-7732379e2a25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:07.532467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8f43db4-694e-47c0-9453-7732379e2a25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:07.550818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d80c75b2-145d-4bd9-995c-9a24afaa6d8c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:07.559452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d80c75b2-145d-4bd9-995c-9a24afaa6d8c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.174273 Jul 26 18:50:07.560039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1522/3067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:07 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:07.564417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bc7c1752-2c5c-4551-8c9a-fa59c67953e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:07.565216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bc7c1752-2c5c-4551-8c9a-fa59c67953e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:07.571461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc7c1752-2c5c-4551-8c9a-fa59c67953e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:07.572113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc7c1752-2c5c-4551-8c9a-fa59c67953e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:07.573107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc7c1752-2c5c-4551-8c9a-fa59c67953e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:07.573539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc7c1752-2c5c-4551-8c9a-fa59c67953e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:07.664484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a8f43db4-694e-47c0-9453-7732379e2a25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:07.672673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a8f43db4-694e-47c0-9453-7732379e2a25 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153542 Jul 26 18:50:07.673259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1546/3068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:07 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:07.688596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b024b2ac-a622-4827-9362-731367a0537e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:07.689265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b024b2ac-a622-4827-9362-731367a0537e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:07.695296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b024b2ac-a622-4827-9362-731367a0537e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:07.695751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b024b2ac-a622-4827-9362-731367a0537e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:07.696520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b024b2ac-a622-4827-9362-731367a0537e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:07.696957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b024b2ac-a622-4827-9362-731367a0537e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:07.702328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bc7c1752-2c5c-4551-8c9a-fa59c67953e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:07.710427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bc7c1752-2c5c-4551-8c9a-fa59c67953e0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.149393 Jul 26 18:50:07.711001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1523/3069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:07 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:07.832147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9d492e50-f9e6-4f00-aa0b-eacdd9be6e23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:07.832754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9d492e50-f9e6-4f00-aa0b-eacdd9be6e23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:07.834103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b024b2ac-a622-4827-9362-731367a0537e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:07.838936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d492e50-f9e6-4f00-aa0b-eacdd9be6e23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:07.839486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d492e50-f9e6-4f00-aa0b-eacdd9be6e23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:07.840217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d492e50-f9e6-4f00-aa0b-eacdd9be6e23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:07.840651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d492e50-f9e6-4f00-aa0b-eacdd9be6e23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:07.843059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b024b2ac-a622-4827-9362-731367a0537e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:07.844583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b024b2ac-a622-4827-9362-731367a0537e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:07.845748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b024b2ac-a622-4827-9362-731367a0537e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161119 Jul 26 18:50:07.846330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1547/3070] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:07.970185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9d492e50-f9e6-4f00-aa0b-eacdd9be6e23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:07.978633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9d492e50-f9e6-4f00-aa0b-eacdd9be6e23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150417 Jul 26 18:50:07.979380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1524/3071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:07 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:08.584701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5b747cd5-f779-445a-a6cd-90fee49605c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:08.585752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5b747cd5-f779-445a-a6cd-90fee49605c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:08.596894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b747cd5-f779-445a-a6cd-90fee49605c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:08.597626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b747cd5-f779-445a-a6cd-90fee49605c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:08.599067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b747cd5-f779-445a-a6cd-90fee49605c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:08.599801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b747cd5-f779-445a-a6cd-90fee49605c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:08.693715 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-109f19c7-20aa-4eb1-9362-d1ac72a2e66f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:08.694318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-109f19c7-20aa-4eb1-9362-d1ac72a2e66f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:08.701706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-109f19c7-20aa-4eb1-9362-d1ac72a2e66f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:08.702154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-109f19c7-20aa-4eb1-9362-d1ac72a2e66f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:08.702999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-109f19c7-20aa-4eb1-9362-d1ac72a2e66f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:08.703533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-109f19c7-20aa-4eb1-9362-d1ac72a2e66f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:08.737916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5b747cd5-f779-445a-a6cd-90fee49605c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:08.746713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5b747cd5-f779-445a-a6cd-90fee49605c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.168557 Jul 26 18:50:08.747722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1548/3072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:08 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:08.752451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f485585b-208d-4e7e-8c41-9393dbd43fd9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:08.753048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f485585b-208d-4e7e-8c41-9393dbd43fd9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:08.759250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f485585b-208d-4e7e-8c41-9393dbd43fd9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:08.759702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f485585b-208d-4e7e-8c41-9393dbd43fd9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:08.760459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f485585b-208d-4e7e-8c41-9393dbd43fd9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:08.760891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f485585b-208d-4e7e-8c41-9393dbd43fd9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:08.842298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-109f19c7-20aa-4eb1-9362-d1ac72a2e66f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:08.850306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-109f19c7-20aa-4eb1-9362-d1ac72a2e66f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.160450 Jul 26 18:50:08.851090 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1525/3073] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:08 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:08.868339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9b64e766-68fb-47f3-aa2c-5c45678bcdba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:08.868948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9b64e766-68fb-47f3-aa2c-5c45678bcdba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:08.875048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b64e766-68fb-47f3-aa2c-5c45678bcdba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:08.875504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b64e766-68fb-47f3-aa2c-5c45678bcdba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:08.876268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b64e766-68fb-47f3-aa2c-5c45678bcdba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:08.876702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b64e766-68fb-47f3-aa2c-5c45678bcdba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:08.889370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f485585b-208d-4e7e-8c41-9393dbd43fd9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:08.897902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f485585b-208d-4e7e-8c41-9393dbd43fd9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.148829 Jul 26 18:50:08.898498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1549/3074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:09.000137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b31e184e-da27-422a-a42d-1bd40bb2f59e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:09.000743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b31e184e-da27-422a-a42d-1bd40bb2f59e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:09.005513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9b64e766-68fb-47f3-aa2c-5c45678bcdba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:09.007501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b31e184e-da27-422a-a42d-1bd40bb2f59e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:09.007974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b31e184e-da27-422a-a42d-1bd40bb2f59e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:09.008750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b31e184e-da27-422a-a42d-1bd40bb2f59e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:09.009241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b31e184e-da27-422a-a42d-1bd40bb2f59e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:09.014674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9b64e766-68fb-47f3-aa2c-5c45678bcdba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:09.016212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9b64e766-68fb-47f3-aa2c-5c45678bcdba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:09.017480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9b64e766-68fb-47f3-aa2c-5c45678bcdba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.153322 Jul 26 18:50:09.018094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1526/3075] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:08 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:09.144031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b31e184e-da27-422a-a42d-1bd40bb2f59e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:09.154507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b31e184e-da27-422a-a42d-1bd40bb2f59e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158387 Jul 26 18:50:09.155113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1550/3076] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:08 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:09.771524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-718cc8ae-50b5-41d4-abb9-e4a621f33306 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:09.772502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-718cc8ae-50b5-41d4-abb9-e4a621f33306 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:09.781388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-718cc8ae-50b5-41d4-abb9-e4a621f33306 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:09.781853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-718cc8ae-50b5-41d4-abb9-e4a621f33306 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:09.782703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-718cc8ae-50b5-41d4-abb9-e4a621f33306 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:09.783236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-718cc8ae-50b5-41d4-abb9-e4a621f33306 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:09.872348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c50e5be1-9d0c-4518-9cb4-1b04a6d26285 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:09.872952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c50e5be1-9d0c-4518-9cb4-1b04a6d26285 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:09.879739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c50e5be1-9d0c-4518-9cb4-1b04a6d26285 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:09.880186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c50e5be1-9d0c-4518-9cb4-1b04a6d26285 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:09.880939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c50e5be1-9d0c-4518-9cb4-1b04a6d26285 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:09.881367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c50e5be1-9d0c-4518-9cb4-1b04a6d26285 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:09.933545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-718cc8ae-50b5-41d4-abb9-e4a621f33306 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:09.942015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-718cc8ae-50b5-41d4-abb9-e4a621f33306 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.176811 Jul 26 18:50:09.942627 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1527/3077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:09 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:09.947322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a643598a-5ef6-4521-9bc5-b1a19e98395d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:09.947924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a643598a-5ef6-4521-9bc5-b1a19e98395d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:09.954024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a643598a-5ef6-4521-9bc5-b1a19e98395d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:09.954475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a643598a-5ef6-4521-9bc5-b1a19e98395d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:09.955264 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a643598a-5ef6-4521-9bc5-b1a19e98395d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:09.955800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a643598a-5ef6-4521-9bc5-b1a19e98395d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:10.011110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c50e5be1-9d0c-4518-9cb4-1b04a6d26285 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:10.019459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c50e5be1-9d0c-4518-9cb4-1b04a6d26285 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151061 Jul 26 18:50:10.020059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1551/3078] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:09 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:10.042111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0eb4d4ca-fa49-478b-8640-b1ab2e0acd23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:10.042708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0eb4d4ca-fa49-478b-8640-b1ab2e0acd23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:10.048884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0eb4d4ca-fa49-478b-8640-b1ab2e0acd23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:10.049354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0eb4d4ca-fa49-478b-8640-b1ab2e0acd23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:10.050102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0eb4d4ca-fa49-478b-8640-b1ab2e0acd23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:10.050526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0eb4d4ca-fa49-478b-8640-b1ab2e0acd23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:10.083683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a643598a-5ef6-4521-9bc5-b1a19e98395d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:10.092004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a643598a-5ef6-4521-9bc5-b1a19e98395d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.148330 Jul 26 18:50:10.092818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1528/3079] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:09 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:10.181467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0eb4d4ca-fa49-478b-8640-b1ab2e0acd23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:10.181650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-defe399e-24ac-4c02-97ba-55c37b782778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:10.182188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-defe399e-24ac-4c02-97ba-55c37b782778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:10.188236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-defe399e-24ac-4c02-97ba-55c37b782778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:10.188685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-defe399e-24ac-4c02-97ba-55c37b782778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:10.189449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-defe399e-24ac-4c02-97ba-55c37b782778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:10.189884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-defe399e-24ac-4c02-97ba-55c37b782778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:10.190281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0eb4d4ca-fa49-478b-8640-b1ab2e0acd23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:10.191845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0eb4d4ca-fa49-478b-8640-b1ab2e0acd23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:10.193028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0eb4d4ca-fa49-478b-8640-b1ab2e0acd23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.154750 Jul 26 18:50:10.195412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1552/3080] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:10 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:10.320691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-defe399e-24ac-4c02-97ba-55c37b782778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:10.322884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:10.330317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-defe399e-24ac-4c02-97ba-55c37b782778 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152491 Jul 26 18:50:10.330880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1529/3081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:10 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:10.967919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c4620e02-2725-4ab3-8d42-600c73b213b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:10.968876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c4620e02-2725-4ab3-8d42-600c73b213b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:10.980081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4620e02-2725-4ab3-8d42-600c73b213b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:10.980834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4620e02-2725-4ab3-8d42-600c73b213b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:10.982086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4620e02-2725-4ab3-8d42-600c73b213b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:10.982810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4620e02-2725-4ab3-8d42-600c73b213b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:11.041135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4f9aff13-68b1-42a7-b024-402513956f64 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:11.041715 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4f9aff13-68b1-42a7-b024-402513956f64 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:11.048623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4f9aff13-68b1-42a7-b024-402513956f64 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:11.049169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4f9aff13-68b1-42a7-b024-402513956f64 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:11.049846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4f9aff13-68b1-42a7-b024-402513956f64 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:11.050272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4f9aff13-68b1-42a7-b024-402513956f64 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:11.118615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c4620e02-2725-4ab3-8d42-600c73b213b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:11.126806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c4620e02-2725-4ab3-8d42-600c73b213b9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165347 Jul 26 18:50:11.127446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1553/3082] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:11.131969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6fcfc9ef-e27a-4090-b896-21366f6ec8f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:11.132415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6fcfc9ef-e27a-4090-b896-21366f6ec8f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:11.141022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6fcfc9ef-e27a-4090-b896-21366f6ec8f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:11.141541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6fcfc9ef-e27a-4090-b896-21366f6ec8f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:11.142368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6fcfc9ef-e27a-4090-b896-21366f6ec8f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:11.142905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6fcfc9ef-e27a-4090-b896-21366f6ec8f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:11.188197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4f9aff13-68b1-42a7-b024-402513956f64 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:11.206922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4f9aff13-68b1-42a7-b024-402513956f64 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.169677 Jul 26 18:50:11.207756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1530/3083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:11 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:11.217477 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-58b79984-33d8-46c5-bee8-9ac5dfa58309 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:11.218731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-58b79984-33d8-46c5-bee8-9ac5dfa58309 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:11.224824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58b79984-33d8-46c5-bee8-9ac5dfa58309 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:11.225350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58b79984-33d8-46c5-bee8-9ac5dfa58309 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:11.226178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58b79984-33d8-46c5-bee8-9ac5dfa58309 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:11.226676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58b79984-33d8-46c5-bee8-9ac5dfa58309 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:11.283964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6fcfc9ef-e27a-4090-b896-21366f6ec8f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:11.292085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6fcfc9ef-e27a-4090-b896-21366f6ec8f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163724 Jul 26 18:50:11.292740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1554/3084] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:11.352460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-39312871-8a4a-4560-9939-e33fe5c2f3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:11.353097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-39312871-8a4a-4560-9939-e33fe5c2f3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:11.359843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39312871-8a4a-4560-9939-e33fe5c2f3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:11.360506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39312871-8a4a-4560-9939-e33fe5c2f3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:11.361298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39312871-8a4a-4560-9939-e33fe5c2f3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:11.361732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39312871-8a4a-4560-9939-e33fe5c2f3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:11.366199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-58b79984-33d8-46c5-bee8-9ac5dfa58309 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:11.377271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-58b79984-33d8-46c5-bee8-9ac5dfa58309 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:11.378867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-58b79984-33d8-46c5-bee8-9ac5dfa58309 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:11.380126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-58b79984-33d8-46c5-bee8-9ac5dfa58309 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.166604 Jul 26 18:50:11.380790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1531/3085] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:11.505058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-39312871-8a4a-4560-9939-e33fe5c2f3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:11.507330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:11.514437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-39312871-8a4a-4560-9939-e33fe5c2f3e0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.166431 Jul 26 18:50:11.515036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1555/3086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:11 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:12.152318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-56783c06-83b7-4622-b954-3702ebaabc0e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:12.153350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-56783c06-83b7-4622-b954-3702ebaabc0e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:12.161313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56783c06-83b7-4622-b954-3702ebaabc0e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:12.161754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56783c06-83b7-4622-b954-3702ebaabc0e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:12.162509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56783c06-83b7-4622-b954-3702ebaabc0e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:12.162936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56783c06-83b7-4622-b954-3702ebaabc0e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:12.230099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-11ba843c-95c0-4832-8644-0c5491010467 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:12.230771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-11ba843c-95c0-4832-8644-0c5491010467 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:12.237917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11ba843c-95c0-4832-8644-0c5491010467 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:12.238368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11ba843c-95c0-4832-8644-0c5491010467 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:12.239150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11ba843c-95c0-4832-8644-0c5491010467 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:12.239760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-11ba843c-95c0-4832-8644-0c5491010467 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:12.311575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-56783c06-83b7-4622-b954-3702ebaabc0e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:12.320686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-56783c06-83b7-4622-b954-3702ebaabc0e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.174837 Jul 26 18:50:12.320986 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1532/3087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:12 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:12.325976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1b048dc5-6ab7-4111-b715-ac62054099ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:12.326589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1b048dc5-6ab7-4111-b715-ac62054099ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:12.333216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b048dc5-6ab7-4111-b715-ac62054099ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:12.333722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b048dc5-6ab7-4111-b715-ac62054099ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:12.334533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b048dc5-6ab7-4111-b715-ac62054099ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:12.335039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b048dc5-6ab7-4111-b715-ac62054099ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:12.373968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-11ba843c-95c0-4832-8644-0c5491010467 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:12.382272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-11ba843c-95c0-4832-8644-0c5491010467 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157815 Jul 26 18:50:12.382916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1556/3088] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:12 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:12.403349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5e4b820f-5cec-47fb-835b-ac0e2059ab50 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:12.404058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5e4b820f-5cec-47fb-835b-ac0e2059ab50 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:12.410180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e4b820f-5cec-47fb-835b-ac0e2059ab50 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:12.410628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e4b820f-5cec-47fb-835b-ac0e2059ab50 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:12.411417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e4b820f-5cec-47fb-835b-ac0e2059ab50 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:12.411846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e4b820f-5cec-47fb-835b-ac0e2059ab50 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:12.466334 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1b048dc5-6ab7-4111-b715-ac62054099ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:12.474827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1b048dc5-6ab7-4111-b715-ac62054099ec tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152504 Jul 26 18:50:12.475419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1533/3089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:12 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:12.536673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6d5cd6a9-8118-413f-9b87-17c6e455ee95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:12.537322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6d5cd6a9-8118-413f-9b87-17c6e455ee95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:12.544125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d5cd6a9-8118-413f-9b87-17c6e455ee95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:12.544324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5e4b820f-5cec-47fb-835b-ac0e2059ab50 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:12.544574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d5cd6a9-8118-413f-9b87-17c6e455ee95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:12.545341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d5cd6a9-8118-413f-9b87-17c6e455ee95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:12.545772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d5cd6a9-8118-413f-9b87-17c6e455ee95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:12.553582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5e4b820f-5cec-47fb-835b-ac0e2059ab50 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:12.555119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5e4b820f-5cec-47fb-835b-ac0e2059ab50 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:12.556636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5e4b820f-5cec-47fb-835b-ac0e2059ab50 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156881 Jul 26 18:50:12.557261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1557/3090] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:12 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:12.684693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6d5cd6a9-8118-413f-9b87-17c6e455ee95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:12.693702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6d5cd6a9-8118-413f-9b87-17c6e455ee95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161041 Jul 26 18:50:12.694279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1534/3091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:12 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:13.342753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e53a95f5-7662-44db-8ec1-5918ac6d1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:13.343594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e53a95f5-7662-44db-8ec1-5918ac6d1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:13.351405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e53a95f5-7662-44db-8ec1-5918ac6d1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:13.352158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e53a95f5-7662-44db-8ec1-5918ac6d1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:13.352919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e53a95f5-7662-44db-8ec1-5918ac6d1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:13.353468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e53a95f5-7662-44db-8ec1-5918ac6d1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:13.405451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2e61846c-b4fc-4fae-b3f3-2d0dc8b18a38 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:13.407246 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2e61846c-b4fc-4fae-b3f3-2d0dc8b18a38 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:13.416696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e61846c-b4fc-4fae-b3f3-2d0dc8b18a38 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:13.417348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e61846c-b4fc-4fae-b3f3-2d0dc8b18a38 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:13.418858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e61846c-b4fc-4fae-b3f3-2d0dc8b18a38 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:13.419330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e61846c-b4fc-4fae-b3f3-2d0dc8b18a38 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:13.494249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e53a95f5-7662-44db-8ec1-5918ac6d1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:13.503368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e53a95f5-7662-44db-8ec1-5918ac6d1b4d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165191 Jul 26 18:50:13.504212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1558/3092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:13.509074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f7488fb2-05f8-4da8-993d-258687762b27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:13.509668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f7488fb2-05f8-4da8-993d-258687762b27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:13.515952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7488fb2-05f8-4da8-993d-258687762b27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:13.516397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7488fb2-05f8-4da8-993d-258687762b27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:13.517147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7488fb2-05f8-4da8-993d-258687762b27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:13.518306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7488fb2-05f8-4da8-993d-258687762b27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:13.556084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2e61846c-b4fc-4fae-b3f3-2d0dc8b18a38 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:13.570051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2e61846c-b4fc-4fae-b3f3-2d0dc8b18a38 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.169220 Jul 26 18:50:13.572302 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1535/3093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:13 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:13.580761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-80f43e62-270c-4d79-9c69-e4b33f05fed2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:13.581638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-80f43e62-270c-4d79-9c69-e4b33f05fed2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:13.587813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80f43e62-270c-4d79-9c69-e4b33f05fed2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:13.588256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80f43e62-270c-4d79-9c69-e4b33f05fed2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:13.588996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80f43e62-270c-4d79-9c69-e4b33f05fed2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:13.589425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80f43e62-270c-4d79-9c69-e4b33f05fed2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:13.659478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f7488fb2-05f8-4da8-993d-258687762b27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:13.667699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f7488fb2-05f8-4da8-993d-258687762b27 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162341 Jul 26 18:50:13.668266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1559/3094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:13 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:13.720632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80f43e62-270c-4d79-9c69-e4b33f05fed2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:13.723059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c81af8de-49e2-4a91-aabb-ffee516c35b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:13.723697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c81af8de-49e2-4a91-aabb-ffee516c35b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:13.729495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80f43e62-270c-4d79-9c69-e4b33f05fed2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:13.729675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c81af8de-49e2-4a91-aabb-ffee516c35b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:13.730120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c81af8de-49e2-4a91-aabb-ffee516c35b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:13.730873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c81af8de-49e2-4a91-aabb-ffee516c35b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:13.731305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80f43e62-270c-4d79-9c69-e4b33f05fed2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:13.731514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c81af8de-49e2-4a91-aabb-ffee516c35b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:13.732469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-80f43e62-270c-4d79-9c69-e4b33f05fed2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155391 Jul 26 18:50:13.733004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1536/3095] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:13.873934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c81af8de-49e2-4a91-aabb-ffee516c35b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:13.886863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c81af8de-49e2-4a91-aabb-ffee516c35b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.167674 Jul 26 18:50:13.887752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1560/3096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:13 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:14.529365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ca5e4399-4b85-4936-b683-753d529c337d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:14.530357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ca5e4399-4b85-4936-b683-753d529c337d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:14.541674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca5e4399-4b85-4936-b683-753d529c337d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:14.542465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca5e4399-4b85-4936-b683-753d529c337d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:14.543771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca5e4399-4b85-4936-b683-753d529c337d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:14.544495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ca5e4399-4b85-4936-b683-753d529c337d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:14.597086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1624c707-c11d-42cf-9f15-2d562fb1f59c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:14.598234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1624c707-c11d-42cf-9f15-2d562fb1f59c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:14.605354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1624c707-c11d-42cf-9f15-2d562fb1f59c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:14.605929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1624c707-c11d-42cf-9f15-2d562fb1f59c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:14.606760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1624c707-c11d-42cf-9f15-2d562fb1f59c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:14.607219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1624c707-c11d-42cf-9f15-2d562fb1f59c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:14.684211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ca5e4399-4b85-4936-b683-753d529c337d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:14.692894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ca5e4399-4b85-4936-b683-753d529c337d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.170493 Jul 26 18:50:14.693463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1537/3097] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:14 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:14.708136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8f0c8fd7-84c3-4c26-b8a2-5d37e3669663 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:14.708741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8f0c8fd7-84c3-4c26-b8a2-5d37e3669663 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:14.714763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8f0c8fd7-84c3-4c26-b8a2-5d37e3669663 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:14.715241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8f0c8fd7-84c3-4c26-b8a2-5d37e3669663 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:14.716023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8f0c8fd7-84c3-4c26-b8a2-5d37e3669663 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:14.716454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8f0c8fd7-84c3-4c26-b8a2-5d37e3669663 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:14.746164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1624c707-c11d-42cf-9f15-2d562fb1f59c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:14.753126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1624c707-c11d-42cf-9f15-2d562fb1f59c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.165313 Jul 26 18:50:14.753742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1561/3098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:14 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:14.758296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b1901c07-041f-4b6d-8838-eb7aeba86523 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:14.758890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b1901c07-041f-4b6d-8838-eb7aeba86523 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:14.766680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1901c07-041f-4b6d-8838-eb7aeba86523 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:14.767500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1901c07-041f-4b6d-8838-eb7aeba86523 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:14.768270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1901c07-041f-4b6d-8838-eb7aeba86523 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:14.768705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1901c07-041f-4b6d-8838-eb7aeba86523 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:14.850329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8f0c8fd7-84c3-4c26-b8a2-5d37e3669663 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:14.858346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8f0c8fd7-84c3-4c26-b8a2-5d37e3669663 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154348 Jul 26 18:50:14.859129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1538/3099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:14 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:14.904870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b1901c07-041f-4b6d-8838-eb7aeba86523 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:14.910420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-78b4d84a-0b5c-4b97-b60d-2789b7d56c0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:14.911877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-78b4d84a-0b5c-4b97-b60d-2789b7d56c0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:14.913724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b1901c07-041f-4b6d-8838-eb7aeba86523 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:14.915265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b1901c07-041f-4b6d-8838-eb7aeba86523 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:14.916430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b1901c07-041f-4b6d-8838-eb7aeba86523 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161783 Jul 26 18:50:14.916993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1562/3100] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:14 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:14.918144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78b4d84a-0b5c-4b97-b60d-2789b7d56c0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:14.918590 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78b4d84a-0b5c-4b97-b60d-2789b7d56c0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:14.919398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78b4d84a-0b5c-4b97-b60d-2789b7d56c0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:14.919822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78b4d84a-0b5c-4b97-b60d-2789b7d56c0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:15.057325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-78b4d84a-0b5c-4b97-b60d-2789b7d56c0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:15.065615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-78b4d84a-0b5c-4b97-b60d-2789b7d56c0f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.159113 Jul 26 18:50:15.066239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1539/3101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:14 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:15.713994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ecc7860d-c65e-4a05-92a7-c82c365a3e1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:15.714591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ecc7860d-c65e-4a05-92a7-c82c365a3e1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:15.722430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ecc7860d-c65e-4a05-92a7-c82c365a3e1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:15.722838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ecc7860d-c65e-4a05-92a7-c82c365a3e1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:15.724182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ecc7860d-c65e-4a05-92a7-c82c365a3e1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:15.724182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ecc7860d-c65e-4a05-92a7-c82c365a3e1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:15.774856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-50c5246d-804e-4191-ab29-5498d495c106 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:15.775510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-50c5246d-804e-4191-ab29-5498d495c106 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:15.782519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50c5246d-804e-4191-ab29-5498d495c106 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:15.783003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50c5246d-804e-4191-ab29-5498d495c106 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:15.783833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50c5246d-804e-4191-ab29-5498d495c106 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:15.784399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50c5246d-804e-4191-ab29-5498d495c106 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:15.854400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ecc7860d-c65e-4a05-92a7-c82c365a3e1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:15.862687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ecc7860d-c65e-4a05-92a7-c82c365a3e1c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.152669 Jul 26 18:50:15.863380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1563/3102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:15 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:15.882489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-70b4c8ec-af37-402e-80c2-02eb68ec2526 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:15.883146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-70b4c8ec-af37-402e-80c2-02eb68ec2526 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:15.889157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-70b4c8ec-af37-402e-80c2-02eb68ec2526 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:15.889602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-70b4c8ec-af37-402e-80c2-02eb68ec2526 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:15.890343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-70b4c8ec-af37-402e-80c2-02eb68ec2526 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:15.890770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-70b4c8ec-af37-402e-80c2-02eb68ec2526 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:15.918271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-50c5246d-804e-4191-ab29-5498d495c106 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:15.927877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-50c5246d-804e-4191-ab29-5498d495c106 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157564 Jul 26 18:50:15.928683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1540/3103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:15 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:15.938569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8c4e6e02-ffc5-4036-8d28-874ce23d3abc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:15.939048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8c4e6e02-ffc5-4036-8d28-874ce23d3abc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:15.947649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c4e6e02-ffc5-4036-8d28-874ce23d3abc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:15.948124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c4e6e02-ffc5-4036-8d28-874ce23d3abc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:15.948895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c4e6e02-ffc5-4036-8d28-874ce23d3abc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:15.949593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c4e6e02-ffc5-4036-8d28-874ce23d3abc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:16.036950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-70b4c8ec-af37-402e-80c2-02eb68ec2526 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:16.045309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-70b4c8ec-af37-402e-80c2-02eb68ec2526 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.166588 Jul 26 18:50:16.046022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1564/3104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:16.087812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8c4e6e02-ffc5-4036-8d28-874ce23d3abc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:16.087995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4e918b72-64b6-4de0-97ac-eccbfb3f848b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:16.088611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4e918b72-64b6-4de0-97ac-eccbfb3f848b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:16.094765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4e918b72-64b6-4de0-97ac-eccbfb3f848b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:16.095248 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4e918b72-64b6-4de0-97ac-eccbfb3f848b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:16.096012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4e918b72-64b6-4de0-97ac-eccbfb3f848b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:16.096246 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8c4e6e02-ffc5-4036-8d28-874ce23d3abc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:16.096444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4e918b72-64b6-4de0-97ac-eccbfb3f848b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:16.097730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8c4e6e02-ffc5-4036-8d28-874ce23d3abc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:16.099106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8c4e6e02-ffc5-4036-8d28-874ce23d3abc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.164510 Jul 26 18:50:16.099693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1541/3105] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:15 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:16.233075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4e918b72-64b6-4de0-97ac-eccbfb3f848b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:16.241363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4e918b72-64b6-4de0-97ac-eccbfb3f848b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157267 Jul 26 18:50:16.241916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1565/3106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:16 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:16.886884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2353baef-f658-4dcf-a6f3-a40081e79e60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:16.887582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2353baef-f658-4dcf-a6f3-a40081e79e60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:16.897065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2353baef-f658-4dcf-a6f3-a40081e79e60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:16.897872 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2353baef-f658-4dcf-a6f3-a40081e79e60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:16.898654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2353baef-f658-4dcf-a6f3-a40081e79e60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:16.899106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2353baef-f658-4dcf-a6f3-a40081e79e60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:16.953272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-93991904-5c12-43e3-8627-0815eecc5a70 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:16.953897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-93991904-5c12-43e3-8627-0815eecc5a70 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:16.962292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93991904-5c12-43e3-8627-0815eecc5a70 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:16.962731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93991904-5c12-43e3-8627-0815eecc5a70 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:16.963503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93991904-5c12-43e3-8627-0815eecc5a70 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:16.963933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-93991904-5c12-43e3-8627-0815eecc5a70 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:17.037070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2353baef-f658-4dcf-a6f3-a40081e79e60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:17.045752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2353baef-f658-4dcf-a6f3-a40081e79e60 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164785 Jul 26 18:50:17.046329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1542/3107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:16 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:17.066529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-832da0ec-2446-48f7-850b-9f340b88c682 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:17.067380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-832da0ec-2446-48f7-850b-9f340b88c682 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:17.073663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-832da0ec-2446-48f7-850b-9f340b88c682 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:17.074189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-832da0ec-2446-48f7-850b-9f340b88c682 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:17.075033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-832da0ec-2446-48f7-850b-9f340b88c682 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:17.075734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-832da0ec-2446-48f7-850b-9f340b88c682 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:17.096293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-93991904-5c12-43e3-8627-0815eecc5a70 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:17.104338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-93991904-5c12-43e3-8627-0815eecc5a70 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155314 Jul 26 18:50:17.104897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1566/3108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:16 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:17.122913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b00593c6-6079-4dba-bcac-099dee13b432 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:17.123586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b00593c6-6079-4dba-bcac-099dee13b432 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:17.131184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b00593c6-6079-4dba-bcac-099dee13b432 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:17.131637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b00593c6-6079-4dba-bcac-099dee13b432 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:17.132395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b00593c6-6079-4dba-bcac-099dee13b432 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:17.132830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b00593c6-6079-4dba-bcac-099dee13b432 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:17.207558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-832da0ec-2446-48f7-850b-9f340b88c682 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:17.215913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-832da0ec-2446-48f7-850b-9f340b88c682 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.153172 Jul 26 18:50:17.216469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1543/3109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:17 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:17.263834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5dfbb810-c40b-4973-b047-40e30ce32efa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:17.264505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5dfbb810-c40b-4973-b047-40e30ce32efa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:17.265894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b00593c6-6079-4dba-bcac-099dee13b432 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:17.270833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5dfbb810-c40b-4973-b047-40e30ce32efa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:17.271308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5dfbb810-c40b-4973-b047-40e30ce32efa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:17.272063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5dfbb810-c40b-4973-b047-40e30ce32efa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:17.273182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5dfbb810-c40b-4973-b047-40e30ce32efa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:17.275112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b00593c6-6079-4dba-bcac-099dee13b432 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:17.276635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b00593c6-6079-4dba-bcac-099dee13b432 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:17.277838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b00593c6-6079-4dba-bcac-099dee13b432 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158842 Jul 26 18:50:17.278414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1567/3110] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:17.406951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5dfbb810-c40b-4973-b047-40e30ce32efa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:17.415683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5dfbb810-c40b-4973-b047-40e30ce32efa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155952 Jul 26 18:50:17.416251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1544/3111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:17 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:18.069794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ad127509-58c4-4a82-9575-524be80855f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:18.070359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ad127509-58c4-4a82-9575-524be80855f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:18.078659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad127509-58c4-4a82-9575-524be80855f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:18.079296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad127509-58c4-4a82-9575-524be80855f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:18.080186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad127509-58c4-4a82-9575-524be80855f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:18.080686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad127509-58c4-4a82-9575-524be80855f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:18.125820 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bc925bde-cd56-49af-843f-ec7023b9cef1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:18.126462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bc925bde-cd56-49af-843f-ec7023b9cef1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:18.134982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc925bde-cd56-49af-843f-ec7023b9cef1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:18.135458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc925bde-cd56-49af-843f-ec7023b9cef1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:18.136242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc925bde-cd56-49af-843f-ec7023b9cef1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:18.136667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc925bde-cd56-49af-843f-ec7023b9cef1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:18.217143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ad127509-58c4-4a82-9575-524be80855f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:18.225546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ad127509-58c4-4a82-9575-524be80855f0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161390 Jul 26 18:50:18.226159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1568/3112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:18 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:18.237489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8816c701-1c65-4fae-adc7-1471d565873b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:18.238417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8816c701-1c65-4fae-adc7-1471d565873b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:18.244891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8816c701-1c65-4fae-adc7-1471d565873b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:18.245339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8816c701-1c65-4fae-adc7-1471d565873b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:18.246097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8816c701-1c65-4fae-adc7-1471d565873b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:18.246530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8816c701-1c65-4fae-adc7-1471d565873b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:18.268602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bc925bde-cd56-49af-843f-ec7023b9cef1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:18.277196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bc925bde-cd56-49af-843f-ec7023b9cef1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155323 Jul 26 18:50:18.277765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1545/3113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:18 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:18.300788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-45540738-6dd9-404b-ac13-020d73bfe664 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:18.301510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-45540738-6dd9-404b-ac13-020d73bfe664 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:18.308064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45540738-6dd9-404b-ac13-020d73bfe664 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:18.308508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45540738-6dd9-404b-ac13-020d73bfe664 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:18.309294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45540738-6dd9-404b-ac13-020d73bfe664 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:18.309749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-45540738-6dd9-404b-ac13-020d73bfe664 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:18.325512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:18.377904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8816c701-1c65-4fae-adc7-1471d565873b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:18.386275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8816c701-1c65-4fae-adc7-1471d565873b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152682 Jul 26 18:50:18.386974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1569/3114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:18.438300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0ea05ae0-3f72-4c04-9c72-1238fe284bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:18.439092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0ea05ae0-3f72-4c04-9c72-1238fe284bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:18.445260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-45540738-6dd9-404b-ac13-020d73bfe664 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:18.446707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ea05ae0-3f72-4c04-9c72-1238fe284bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:18.447207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ea05ae0-3f72-4c04-9c72-1238fe284bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:18.447966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ea05ae0-3f72-4c04-9c72-1238fe284bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:18.448397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ea05ae0-3f72-4c04-9c72-1238fe284bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:18.454051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-45540738-6dd9-404b-ac13-020d73bfe664 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:18.455594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-45540738-6dd9-404b-ac13-020d73bfe664 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:18.456751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-45540738-6dd9-404b-ac13-020d73bfe664 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159847 Jul 26 18:50:18.457310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1546/3115] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:18 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:18.605083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0ea05ae0-3f72-4c04-9c72-1238fe284bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:18.617520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0ea05ae0-3f72-4c04-9c72-1238fe284bff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.183607 Jul 26 18:50:18.618441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1570/3116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:18 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:19.250978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5ad4aa85-d5bb-4e62-bcdf-83dd8c7921da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:19.251960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5ad4aa85-d5bb-4e62-bcdf-83dd8c7921da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:19.261362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ad4aa85-d5bb-4e62-bcdf-83dd8c7921da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:19.261802 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ad4aa85-d5bb-4e62-bcdf-83dd8c7921da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:19.262533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ad4aa85-d5bb-4e62-bcdf-83dd8c7921da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:19.262985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ad4aa85-d5bb-4e62-bcdf-83dd8c7921da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:19.297823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bae3df58-9146-45f8-bb8b-3b37dcc77121 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:19.298391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bae3df58-9146-45f8-bb8b-3b37dcc77121 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:19.305381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bae3df58-9146-45f8-bb8b-3b37dcc77121 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:19.305940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bae3df58-9146-45f8-bb8b-3b37dcc77121 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:19.307053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bae3df58-9146-45f8-bb8b-3b37dcc77121 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:19.307454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bae3df58-9146-45f8-bb8b-3b37dcc77121 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:19.394995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5ad4aa85-d5bb-4e62-bcdf-83dd8c7921da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:19.403942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5ad4aa85-d5bb-4e62-bcdf-83dd8c7921da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159341 Jul 26 18:50:19.404558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1547/3117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:19 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:19.409086 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5e09e62c-1848-40db-8d5a-d6979ecb1d77 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:19.409674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5e09e62c-1848-40db-8d5a-d6979ecb1d77 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:19.415775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e09e62c-1848-40db-8d5a-d6979ecb1d77 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:19.416226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e09e62c-1848-40db-8d5a-d6979ecb1d77 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:19.416981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e09e62c-1848-40db-8d5a-d6979ecb1d77 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:19.417413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e09e62c-1848-40db-8d5a-d6979ecb1d77 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:19.439160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bae3df58-9146-45f8-bb8b-3b37dcc77121 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:19.447560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bae3df58-9146-45f8-bb8b-3b37dcc77121 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153578 Jul 26 18:50:19.448139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1571/3118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:19 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:19.480302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5b3633cd-b221-4d13-8c20-f4afaa652db2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:19.480913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5b3633cd-b221-4d13-8c20-f4afaa652db2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:19.486910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b3633cd-b221-4d13-8c20-f4afaa652db2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:19.487413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b3633cd-b221-4d13-8c20-f4afaa652db2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:19.488162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b3633cd-b221-4d13-8c20-f4afaa652db2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:19.488591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b3633cd-b221-4d13-8c20-f4afaa652db2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:19.503614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:19.548150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5e09e62c-1848-40db-8d5a-d6979ecb1d77 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:19.556344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5e09e62c-1848-40db-8d5a-d6979ecb1d77 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.150825 Jul 26 18:50:19.556914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1548/3119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:19 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:19.626058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5b3633cd-b221-4d13-8c20-f4afaa652db2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:19.639219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5b3633cd-b221-4d13-8c20-f4afaa652db2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:19.641913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5b3633cd-b221-4d13-8c20-f4afaa652db2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:19.643707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5b3633cd-b221-4d13-8c20-f4afaa652db2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.167084 Jul 26 18:50:19.644541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1572/3120] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:19 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:19.646801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c9af1164-feb5-424e-960a-efcc4b621469 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:19.647895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c9af1164-feb5-424e-960a-efcc4b621469 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:19.654015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c9af1164-feb5-424e-960a-efcc4b621469 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:19.654456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c9af1164-feb5-424e-960a-efcc4b621469 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:19.655235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c9af1164-feb5-424e-960a-efcc4b621469 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:19.655667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c9af1164-feb5-424e-960a-efcc4b621469 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:19.797376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c9af1164-feb5-424e-960a-efcc4b621469 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:19.805954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c9af1164-feb5-424e-960a-efcc4b621469 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.164044 Jul 26 18:50:19.806546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1549/3121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:19 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:20.429656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b2c5bd77-5554-47de-af91-7bc912f43679 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:20.430398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b2c5bd77-5554-47de-af91-7bc912f43679 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:20.438769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2c5bd77-5554-47de-af91-7bc912f43679 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:20.439356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2c5bd77-5554-47de-af91-7bc912f43679 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:20.440290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2c5bd77-5554-47de-af91-7bc912f43679 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:20.440823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2c5bd77-5554-47de-af91-7bc912f43679 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:20.468675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ed231c29-abd6-4697-9d22-28a1636f6ea2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:20.469239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ed231c29-abd6-4697-9d22-28a1636f6ea2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:20.476317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed231c29-abd6-4697-9d22-28a1636f6ea2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:20.476790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed231c29-abd6-4697-9d22-28a1636f6ea2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:20.477546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed231c29-abd6-4697-9d22-28a1636f6ea2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:20.477970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed231c29-abd6-4697-9d22-28a1636f6ea2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:20.573158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b2c5bd77-5554-47de-af91-7bc912f43679 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:20.581548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b2c5bd77-5554-47de-af91-7bc912f43679 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158532 Jul 26 18:50:20.582200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1573/3122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:20.586817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-81e874f0-83dd-475a-a307-ed70bfb9a995 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:20.587809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-81e874f0-83dd-475a-a307-ed70bfb9a995 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:20.593724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81e874f0-83dd-475a-a307-ed70bfb9a995 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:20.594264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81e874f0-83dd-475a-a307-ed70bfb9a995 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:20.595104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81e874f0-83dd-475a-a307-ed70bfb9a995 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:20.595603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81e874f0-83dd-475a-a307-ed70bfb9a995 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:20.611869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ed231c29-abd6-4697-9d22-28a1636f6ea2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:20.620413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ed231c29-abd6-4697-9d22-28a1636f6ea2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155531 Jul 26 18:50:20.620999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1550/3123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:20 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:20.668264 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d54e7cf4-dad4-4bc2-9807-d9765ae6a131 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:20.668861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d54e7cf4-dad4-4bc2-9807-d9765ae6a131 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:20.675015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d54e7cf4-dad4-4bc2-9807-d9765ae6a131 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:20.675484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d54e7cf4-dad4-4bc2-9807-d9765ae6a131 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:20.676260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d54e7cf4-dad4-4bc2-9807-d9765ae6a131 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:20.676685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d54e7cf4-dad4-4bc2-9807-d9765ae6a131 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:20.727731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-81e874f0-83dd-475a-a307-ed70bfb9a995 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:20.735898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-81e874f0-83dd-475a-a307-ed70bfb9a995 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152693 Jul 26 18:50:20.736468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1574/3124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:20 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:20.810402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d54e7cf4-dad4-4bc2-9807-d9765ae6a131 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:20.819120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d54e7cf4-dad4-4bc2-9807-d9765ae6a131 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:20.820748 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d54e7cf4-dad4-4bc2-9807-d9765ae6a131 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:20.821923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d54e7cf4-dad4-4bc2-9807-d9765ae6a131 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157658 Jul 26 18:50:20.822468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1551/3125] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:20.827942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f9d65705-6539-4c9c-a7ec-125a89342077 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:20.828553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f9d65705-6539-4c9c-a7ec-125a89342077 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:20.834879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9d65705-6539-4c9c-a7ec-125a89342077 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:20.835380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9d65705-6539-4c9c-a7ec-125a89342077 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:20.836133 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9d65705-6539-4c9c-a7ec-125a89342077 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:20.836568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9d65705-6539-4c9c-a7ec-125a89342077 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:20.970008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f9d65705-6539-4c9c-a7ec-125a89342077 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:20.978308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f9d65705-6539-4c9c-a7ec-125a89342077 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154191 Jul 26 18:50:20.978854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1575/3126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:20 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:21.608727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-12487f22-8f0d-44f5-a5ad-354ec3ed02f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:21.609646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-12487f22-8f0d-44f5-a5ad-354ec3ed02f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:21.620813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12487f22-8f0d-44f5-a5ad-354ec3ed02f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:21.621658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12487f22-8f0d-44f5-a5ad-354ec3ed02f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:21.622906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12487f22-8f0d-44f5-a5ad-354ec3ed02f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:21.623689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12487f22-8f0d-44f5-a5ad-354ec3ed02f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:21.643252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-271448fe-7ec1-4f99-ab96-f056817e75d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:21.643974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-271448fe-7ec1-4f99-ab96-f056817e75d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:21.651805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-271448fe-7ec1-4f99-ab96-f056817e75d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:21.652256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-271448fe-7ec1-4f99-ab96-f056817e75d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:21.653010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-271448fe-7ec1-4f99-ab96-f056817e75d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:21.653437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-271448fe-7ec1-4f99-ab96-f056817e75d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:21.754722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-12487f22-8f0d-44f5-a5ad-354ec3ed02f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:21.762896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-12487f22-8f0d-44f5-a5ad-354ec3ed02f6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160617 Jul 26 18:50:21.763493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1552/3127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:21 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:21.779842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-17e1daaf-752b-41e4-80af-363b87d1295d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:21.780533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-17e1daaf-752b-41e4-80af-363b87d1295d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:21.785385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-271448fe-7ec1-4f99-ab96-f056817e75d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:21.786674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17e1daaf-752b-41e4-80af-363b87d1295d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:21.787189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17e1daaf-752b-41e4-80af-363b87d1295d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:21.787913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17e1daaf-752b-41e4-80af-363b87d1295d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:21.788446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17e1daaf-752b-41e4-80af-363b87d1295d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:21.794071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-271448fe-7ec1-4f99-ab96-f056817e75d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154940 Jul 26 18:50:21.794612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1576/3128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:21 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:21.844690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d3d853c6-1a6d-4a4b-bd20-35c56a912d00 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:21.845321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d3d853c6-1a6d-4a4b-bd20-35c56a912d00 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:21.851808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3d853c6-1a6d-4a4b-bd20-35c56a912d00 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:21.852254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3d853c6-1a6d-4a4b-bd20-35c56a912d00 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:21.853002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3d853c6-1a6d-4a4b-bd20-35c56a912d00 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:21.853424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3d853c6-1a6d-4a4b-bd20-35c56a912d00 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:21.917354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-17e1daaf-752b-41e4-80af-363b87d1295d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:21.925325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-17e1daaf-752b-41e4-80af-363b87d1295d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.149274 Jul 26 18:50:21.926140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1553/3129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:21.988966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d3d853c6-1a6d-4a4b-bd20-35c56a912d00 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:21.997900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d3d853c6-1a6d-4a4b-bd20-35c56a912d00 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:21.999239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9d41fa2c-00a9-4e3c-b5ac-d59ffb92fb96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:21.999428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d3d853c6-1a6d-4a4b-bd20-35c56a912d00 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:21.999851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9d41fa2c-00a9-4e3c-b5ac-d59ffb92fb96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:22.000604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d3d853c6-1a6d-4a4b-bd20-35c56a912d00 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159867 Jul 26 18:50:22.001205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1577/3130] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:21 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:22.006262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d41fa2c-00a9-4e3c-b5ac-d59ffb92fb96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:22.006713 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d41fa2c-00a9-4e3c-b5ac-d59ffb92fb96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:22.007540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d41fa2c-00a9-4e3c-b5ac-d59ffb92fb96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:22.007976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d41fa2c-00a9-4e3c-b5ac-d59ffb92fb96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:22.144326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9d41fa2c-00a9-4e3c-b5ac-d59ffb92fb96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:22.153075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9d41fa2c-00a9-4e3c-b5ac-d59ffb92fb96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157709 Jul 26 18:50:22.153652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1554/3131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:21 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:22.785122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1dc2d3bb-7689-4e9e-8e7e-7f9a9f9ef980 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:22.785766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1dc2d3bb-7689-4e9e-8e7e-7f9a9f9ef980 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:22.793130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1dc2d3bb-7689-4e9e-8e7e-7f9a9f9ef980 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:22.793600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1dc2d3bb-7689-4e9e-8e7e-7f9a9f9ef980 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:22.794394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1dc2d3bb-7689-4e9e-8e7e-7f9a9f9ef980 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:22.794852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1dc2d3bb-7689-4e9e-8e7e-7f9a9f9ef980 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:22.815703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c5435e80-611a-4d05-aab1-6f9d8e9cc9bc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:22.816361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c5435e80-611a-4d05-aab1-6f9d8e9cc9bc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:22.823660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5435e80-611a-4d05-aab1-6f9d8e9cc9bc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:22.824110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5435e80-611a-4d05-aab1-6f9d8e9cc9bc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:22.824897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5435e80-611a-4d05-aab1-6f9d8e9cc9bc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:22.825332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5435e80-611a-4d05-aab1-6f9d8e9cc9bc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:22.967414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c5435e80-611a-4d05-aab1-6f9d8e9cc9bc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:22.975787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c5435e80-611a-4d05-aab1-6f9d8e9cc9bc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.164113 Jul 26 18:50:22.976676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1555/3132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:22 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:22.980820 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cfbc109f-d648-4b66-989f-1df0aade96b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:22.981413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cfbc109f-d648-4b66-989f-1df0aade96b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:22.987299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbc109f-d648-4b66-989f-1df0aade96b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:22.987728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbc109f-d648-4b66-989f-1df0aade96b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:22.988470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbc109f-d648-4b66-989f-1df0aade96b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:22.988899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cfbc109f-d648-4b66-989f-1df0aade96b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:23.098016 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1dc2d3bb-7689-4e9e-8e7e-7f9a9f9ef980 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:23.106472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1dc2d3bb-7689-4e9e-8e7e-7f9a9f9ef980 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.325513 Jul 26 18:50:23.120944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1578/3133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:22 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:23.120944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c7923b6a-1063-4290-a572-b31d78b28eaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:23.120944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c7923b6a-1063-4290-a572-b31d78b28eaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:23.120944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c7923b6a-1063-4290-a572-b31d78b28eaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:23.121757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c7923b6a-1063-4290-a572-b31d78b28eaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:23.121757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c7923b6a-1063-4290-a572-b31d78b28eaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:23.121757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c7923b6a-1063-4290-a572-b31d78b28eaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:23.125206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cfbc109f-d648-4b66-989f-1df0aade96b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:23.133391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cfbc109f-d648-4b66-989f-1df0aade96b1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155993 Jul 26 18:50:23.134164 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1556/3134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:23.173662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bccc614e-abd9-4a50-9c98-f62e91f895ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:23.174270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bccc614e-abd9-4a50-9c98-f62e91f895ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:23.180534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bccc614e-abd9-4a50-9c98-f62e91f895ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:23.180979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bccc614e-abd9-4a50-9c98-f62e91f895ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:23.181733 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bccc614e-abd9-4a50-9c98-f62e91f895ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:23.182169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bccc614e-abd9-4a50-9c98-f62e91f895ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:23.260191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c7923b6a-1063-4290-a572-b31d78b28eaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:23.268853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c7923b6a-1063-4290-a572-b31d78b28eaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:23.270367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c7923b6a-1063-4290-a572-b31d78b28eaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:23.271560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c7923b6a-1063-4290-a572-b31d78b28eaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.163265 Jul 26 18:50:23.272419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1579/3135] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:23 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:23.308722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bccc614e-abd9-4a50-9c98-f62e91f895ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:23.316801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bccc614e-abd9-4a50-9c98-f62e91f895ce tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.147015 Jul 26 18:50:23.317370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1557/3136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:23 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:24.001094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-671b90c6-1b74-46f5-9b12-f71813b52f6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:24.004386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-671b90c6-1b74-46f5-9b12-f71813b52f6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:24.012587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-671b90c6-1b74-46f5-9b12-f71813b52f6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:24.013030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-671b90c6-1b74-46f5-9b12-f71813b52f6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:24.013788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-671b90c6-1b74-46f5-9b12-f71813b52f6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:24.014216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-671b90c6-1b74-46f5-9b12-f71813b52f6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:24.128133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c65d5128-1730-4cbf-974e-0592a4e1fac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:24.128904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c65d5128-1730-4cbf-974e-0592a4e1fac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:24.135907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c65d5128-1730-4cbf-974e-0592a4e1fac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:24.136352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c65d5128-1730-4cbf-974e-0592a4e1fac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:24.137081 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c65d5128-1730-4cbf-974e-0592a4e1fac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:24.137544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c65d5128-1730-4cbf-974e-0592a4e1fac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:24.153663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-671b90c6-1b74-46f5-9b12-f71813b52f6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:24.169310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-671b90c6-1b74-46f5-9b12-f71813b52f6e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.169015 Jul 26 18:50:24.170252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1580/3137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:23 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:24.174932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0f9f7945-4a60-40cd-b881-ab941f0d81cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:24.175694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f9f7945-4a60-40cd-b881-ab941f0d81cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:24.184747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f9f7945-4a60-40cd-b881-ab941f0d81cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:24.185358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f9f7945-4a60-40cd-b881-ab941f0d81cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:24.186250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f9f7945-4a60-40cd-b881-ab941f0d81cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:24.186817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f9f7945-4a60-40cd-b881-ab941f0d81cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:24.284932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c65d5128-1730-4cbf-974e-0592a4e1fac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:24.293303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c65d5128-1730-4cbf-974e-0592a4e1fac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.169068 Jul 26 18:50:24.293878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1558/3138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:24 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:24.298262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-91ff3d9b-dc8f-4536-ae1f-cca5c6ffcf4d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:24.298845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-91ff3d9b-dc8f-4536-ae1f-cca5c6ffcf4d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:24.305198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91ff3d9b-dc8f-4536-ae1f-cca5c6ffcf4d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:24.305832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91ff3d9b-dc8f-4536-ae1f-cca5c6ffcf4d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:24.306878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91ff3d9b-dc8f-4536-ae1f-cca5c6ffcf4d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:24.307388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91ff3d9b-dc8f-4536-ae1f-cca5c6ffcf4d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:24.328161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0f9f7945-4a60-40cd-b881-ab941f0d81cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:24.336977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0f9f7945-4a60-40cd-b881-ab941f0d81cd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.165792 Jul 26 18:50:24.337550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1581/3139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:24 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:24.347779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-569620c5-4d4d-4497-9854-ca47a7e813c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:24.348459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-569620c5-4d4d-4497-9854-ca47a7e813c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:24.354515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-569620c5-4d4d-4497-9854-ca47a7e813c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:24.355082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-569620c5-4d4d-4497-9854-ca47a7e813c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:24.355842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-569620c5-4d4d-4497-9854-ca47a7e813c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:24.356271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-569620c5-4d4d-4497-9854-ca47a7e813c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:24.436721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-91ff3d9b-dc8f-4536-ae1f-cca5c6ffcf4d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:24.445652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-91ff3d9b-dc8f-4536-ae1f-cca5c6ffcf4d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:24.447170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-91ff3d9b-dc8f-4536-ae1f-cca5c6ffcf4d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:24.448320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-91ff3d9b-dc8f-4536-ae1f-cca5c6ffcf4d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.153518 Jul 26 18:50:24.448874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1559/3140] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:24.488001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-569620c5-4d4d-4497-9854-ca47a7e813c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:24.496385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-569620c5-4d4d-4497-9854-ca47a7e813c7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152237 Jul 26 18:50:24.496953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1582/3141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:24 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:25.195273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e7299afc-22fc-444e-b540-274ea04fd961 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:25.196179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e7299afc-22fc-444e-b540-274ea04fd961 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:25.207322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7299afc-22fc-444e-b540-274ea04fd961 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:25.208100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7299afc-22fc-444e-b540-274ea04fd961 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:25.209317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7299afc-22fc-444e-b540-274ea04fd961 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:25.210175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7299afc-22fc-444e-b540-274ea04fd961 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:25.313728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c31cf1a0-bb79-4d52-af56-c9274951682a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:25.314332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c31cf1a0-bb79-4d52-af56-c9274951682a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:25.322213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c31cf1a0-bb79-4d52-af56-c9274951682a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:25.322980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c31cf1a0-bb79-4d52-af56-c9274951682a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:25.324361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c31cf1a0-bb79-4d52-af56-c9274951682a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:25.325009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c31cf1a0-bb79-4d52-af56-c9274951682a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:25.358015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e7299afc-22fc-444e-b540-274ea04fd961 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:25.367702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e7299afc-22fc-444e-b540-274ea04fd961 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.178952 Jul 26 18:50:25.368444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1560/3142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:25 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:25.373010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ecbe138f-2584-4b7c-a4ec-67b2b70a324c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:25.373604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ecbe138f-2584-4b7c-a4ec-67b2b70a324c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:25.379687 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ecbe138f-2584-4b7c-a4ec-67b2b70a324c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:25.380132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ecbe138f-2584-4b7c-a4ec-67b2b70a324c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:25.380844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ecbe138f-2584-4b7c-a4ec-67b2b70a324c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:25.381489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ecbe138f-2584-4b7c-a4ec-67b2b70a324c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:25.457694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c31cf1a0-bb79-4d52-af56-c9274951682a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:25.466095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c31cf1a0-bb79-4d52-af56-c9274951682a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156048 Jul 26 18:50:25.466687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1583/3143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:25 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:25.479326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8f148a64-c6f0-49d7-a918-3b5a060599ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:25.480522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8f148a64-c6f0-49d7-a918-3b5a060599ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:25.487490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f148a64-c6f0-49d7-a918-3b5a060599ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:25.487907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f148a64-c6f0-49d7-a918-3b5a060599ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:25.488672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f148a64-c6f0-49d7-a918-3b5a060599ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:25.489100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8f148a64-c6f0-49d7-a918-3b5a060599ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:25.517552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ecbe138f-2584-4b7c-a4ec-67b2b70a324c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:25.526192 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ecbe138f-2584-4b7c-a4ec-67b2b70a324c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156785 Jul 26 18:50:25.526760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1561/3144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:25 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:25.538681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-08eb85a0-1d44-4d56-8da6-7de2234798c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:25.538681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-08eb85a0-1d44-4d56-8da6-7de2234798c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:25.538681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08eb85a0-1d44-4d56-8da6-7de2234798c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:25.538681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08eb85a0-1d44-4d56-8da6-7de2234798c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:25.539147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08eb85a0-1d44-4d56-8da6-7de2234798c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:25.539460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08eb85a0-1d44-4d56-8da6-7de2234798c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:25.623468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8f148a64-c6f0-49d7-a918-3b5a060599ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:25.633835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8f148a64-c6f0-49d7-a918-3b5a060599ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:25.636493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8f148a64-c6f0-49d7-a918-3b5a060599ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:25.638480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8f148a64-c6f0-49d7-a918-3b5a060599ca tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.170571 Jul 26 18:50:25.639489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1584/3145] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:25.676113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-08eb85a0-1d44-4d56-8da6-7de2234798c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:25.684230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-08eb85a0-1d44-4d56-8da6-7de2234798c9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156454 Jul 26 18:50:25.684795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1562/3146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:25 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:26.388444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ed7661b5-c316-450f-9427-7db00c3eafa6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:26.389049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ed7661b5-c316-450f-9427-7db00c3eafa6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:26.396116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed7661b5-c316-450f-9427-7db00c3eafa6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:26.396562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed7661b5-c316-450f-9427-7db00c3eafa6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:26.397735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed7661b5-c316-450f-9427-7db00c3eafa6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:26.398168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ed7661b5-c316-450f-9427-7db00c3eafa6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:26.488023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-17e8a4a9-2371-48e0-9321-ceb465348241 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:26.488779 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-17e8a4a9-2371-48e0-9321-ceb465348241 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:26.496048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17e8a4a9-2371-48e0-9321-ceb465348241 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:26.496569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17e8a4a9-2371-48e0-9321-ceb465348241 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:26.497332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17e8a4a9-2371-48e0-9321-ceb465348241 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:26.497756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17e8a4a9-2371-48e0-9321-ceb465348241 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:26.500414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:26.537672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ed7661b5-c316-450f-9427-7db00c3eafa6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:26.546172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ed7661b5-c316-450f-9427-7db00c3eafa6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161589 Jul 26 18:50:26.546797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1585/3147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:26 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:26.551316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-452ce3c1-2e7a-4bbb-8796-c5032f979e3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:26.551906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-452ce3c1-2e7a-4bbb-8796-c5032f979e3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:26.557912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-452ce3c1-2e7a-4bbb-8796-c5032f979e3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:26.558354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-452ce3c1-2e7a-4bbb-8796-c5032f979e3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:26.559155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-452ce3c1-2e7a-4bbb-8796-c5032f979e3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:26.559593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-452ce3c1-2e7a-4bbb-8796-c5032f979e3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:26.631294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-17e8a4a9-2371-48e0-9321-ceb465348241 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:26.639297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-17e8a4a9-2371-48e0-9321-ceb465348241 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155291 Jul 26 18:50:26.639990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1563/3148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:26 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:26.664688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3d2a3ba2-2c8b-449c-86ba-a5f044f55ac5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:26.665291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3d2a3ba2-2c8b-449c-86ba-a5f044f55ac5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:26.671205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d2a3ba2-2c8b-449c-86ba-a5f044f55ac5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:26.671644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d2a3ba2-2c8b-449c-86ba-a5f044f55ac5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:26.672384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d2a3ba2-2c8b-449c-86ba-a5f044f55ac5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:26.672807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d2a3ba2-2c8b-449c-86ba-a5f044f55ac5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:26.691685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-452ce3c1-2e7a-4bbb-8796-c5032f979e3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:26.700636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-452ce3c1-2e7a-4bbb-8796-c5032f979e3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.151975 Jul 26 18:50:26.700636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1586/3149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:26 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:26.705742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-37cdd2be-174d-4f56-86a1-6d71f1dc67cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:26.706449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-37cdd2be-174d-4f56-86a1-6d71f1dc67cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:26.712828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37cdd2be-174d-4f56-86a1-6d71f1dc67cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:26.713389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37cdd2be-174d-4f56-86a1-6d71f1dc67cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:26.715603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37cdd2be-174d-4f56-86a1-6d71f1dc67cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:26.715603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37cdd2be-174d-4f56-86a1-6d71f1dc67cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:26.804236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3d2a3ba2-2c8b-449c-86ba-a5f044f55ac5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:26.812874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3d2a3ba2-2c8b-449c-86ba-a5f044f55ac5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:26.814439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3d2a3ba2-2c8b-449c-86ba-a5f044f55ac5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:26.815682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3d2a3ba2-2c8b-449c-86ba-a5f044f55ac5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.154881 Jul 26 18:50:26.816281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1564/3150] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:26.844667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-37cdd2be-174d-4f56-86a1-6d71f1dc67cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:26.852842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-37cdd2be-174d-4f56-86a1-6d71f1dc67cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150657 Jul 26 18:50:26.853416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1587/3151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:26 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:27.571673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7c072bfe-89c7-4ae1-8b40-3274438dddd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:27.572628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7c072bfe-89c7-4ae1-8b40-3274438dddd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:27.575751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:27.584939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c072bfe-89c7-4ae1-8b40-3274438dddd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:27.585676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c072bfe-89c7-4ae1-8b40-3274438dddd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:27.586919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c072bfe-89c7-4ae1-8b40-3274438dddd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:27.587686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7c072bfe-89c7-4ae1-8b40-3274438dddd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:27.661182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-af4d1c87-4a1f-4ad4-835b-69648da2e706 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:27.661771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-af4d1c87-4a1f-4ad4-835b-69648da2e706 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:27.664324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:27.670090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af4d1c87-4a1f-4ad4-835b-69648da2e706 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:27.670616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af4d1c87-4a1f-4ad4-835b-69648da2e706 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:27.671472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af4d1c87-4a1f-4ad4-835b-69648da2e706 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:27.671964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af4d1c87-4a1f-4ad4-835b-69648da2e706 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:27.728778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7c072bfe-89c7-4ae1-8b40-3274438dddd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:27.737173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7c072bfe-89c7-4ae1-8b40-3274438dddd2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.172328 Jul 26 18:50:27.737782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1565/3152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:27 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:27.755401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ed296cad-b833-4682-87db-6d204b61b1ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:27.756013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ed296cad-b833-4682-87db-6d204b61b1ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:27.762370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed296cad-b833-4682-87db-6d204b61b1ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:27.762840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed296cad-b833-4682-87db-6d204b61b1ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:27.763627 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed296cad-b833-4682-87db-6d204b61b1ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:27.764060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed296cad-b833-4682-87db-6d204b61b1ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:27.804176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-af4d1c87-4a1f-4ad4-835b-69648da2e706 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:27.812406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-af4d1c87-4a1f-4ad4-835b-69648da2e706 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155190 Jul 26 18:50:27.812990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1588/3153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:27.839567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-690ea408-df2e-43ac-8f95-e9321347e265 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:27.840295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-690ea408-df2e-43ac-8f95-e9321347e265 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:27.846760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-690ea408-df2e-43ac-8f95-e9321347e265 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:27.847261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-690ea408-df2e-43ac-8f95-e9321347e265 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:27.848028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-690ea408-df2e-43ac-8f95-e9321347e265 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:27.848465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-690ea408-df2e-43ac-8f95-e9321347e265 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:27.852444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:27.900213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ed296cad-b833-4682-87db-6d204b61b1ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:27.908347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ed296cad-b833-4682-87db-6d204b61b1ab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156688 Jul 26 18:50:27.908922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1566/3154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:27 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:27.913309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3b9f704f-bc0b-4355-8d31-6f9e48e90f3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:27.913835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3b9f704f-bc0b-4355-8d31-6f9e48e90f3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:27.920516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b9f704f-bc0b-4355-8d31-6f9e48e90f3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:27.921138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b9f704f-bc0b-4355-8d31-6f9e48e90f3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:27.922080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b9f704f-bc0b-4355-8d31-6f9e48e90f3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:27.922714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3b9f704f-bc0b-4355-8d31-6f9e48e90f3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:27.985135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-690ea408-df2e-43ac-8f95-e9321347e265 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:27.994296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-690ea408-df2e-43ac-8f95-e9321347e265 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:27.995855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-690ea408-df2e-43ac-8f95-e9321347e265 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:27.997043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-690ea408-df2e-43ac-8f95-e9321347e265 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161427 Jul 26 18:50:27.997603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1589/3155] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:27 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:28.061603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3b9f704f-bc0b-4355-8d31-6f9e48e90f3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:28.069698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3b9f704f-bc0b-4355-8d31-6f9e48e90f3d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.159815 Jul 26 18:50:28.070240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1567/3156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:27 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:28.762401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f0e62eae-be05-4353-98f3-d19034018f07 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:28.763463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f0e62eae-be05-4353-98f3-d19034018f07 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:28.774160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f0e62eae-be05-4353-98f3-d19034018f07 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:28.774585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f0e62eae-be05-4353-98f3-d19034018f07 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:28.775489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f0e62eae-be05-4353-98f3-d19034018f07 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:28.775925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f0e62eae-be05-4353-98f3-d19034018f07 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:28.834017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f31f1cd3-e617-4dc8-a0c4-2a4af6882d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:28.834629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f31f1cd3-e617-4dc8-a0c4-2a4af6882d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:28.841535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f31f1cd3-e617-4dc8-a0c4-2a4af6882d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:28.841977 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f31f1cd3-e617-4dc8-a0c4-2a4af6882d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:28.842723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f31f1cd3-e617-4dc8-a0c4-2a4af6882d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:28.843188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f31f1cd3-e617-4dc8-a0c4-2a4af6882d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:28.910393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f0e62eae-be05-4353-98f3-d19034018f07 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:28.918423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f0e62eae-be05-4353-98f3-d19034018f07 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.162523 Jul 26 18:50:28.918993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1590/3157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:28 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:28.929570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-860c4055-3428-47d8-b2cb-59c515100caf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:28.930157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-860c4055-3428-47d8-b2cb-59c515100caf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:28.936301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-860c4055-3428-47d8-b2cb-59c515100caf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:28.936743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-860c4055-3428-47d8-b2cb-59c515100caf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:28.937520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-860c4055-3428-47d8-b2cb-59c515100caf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:28.937948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-860c4055-3428-47d8-b2cb-59c515100caf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:28.981354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f31f1cd3-e617-4dc8-a0c4-2a4af6882d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:28.989480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f31f1cd3-e617-4dc8-a0c4-2a4af6882d34 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159467 Jul 26 18:50:28.990065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1568/3158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:28 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:29.025091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d7367912-ab32-4bb1-9a9c-748a5b74a12f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:29.025693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d7367912-ab32-4bb1-9a9c-748a5b74a12f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:29.032127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7367912-ab32-4bb1-9a9c-748a5b74a12f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:29.032576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7367912-ab32-4bb1-9a9c-748a5b74a12f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:29.033331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7367912-ab32-4bb1-9a9c-748a5b74a12f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:29.033783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d7367912-ab32-4bb1-9a9c-748a5b74a12f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:29.072195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-860c4055-3428-47d8-b2cb-59c515100caf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:29.080289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-860c4055-3428-47d8-b2cb-59c515100caf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154447 Jul 26 18:50:29.081048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1591/3159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:28 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:29.096784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ee9bd5cf-e59e-4b84-b3de-92397e49cf2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:29.097386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ee9bd5cf-e59e-4b84-b3de-92397e49cf2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:29.103699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ee9bd5cf-e59e-4b84-b3de-92397e49cf2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:29.104138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ee9bd5cf-e59e-4b84-b3de-92397e49cf2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:29.104893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ee9bd5cf-e59e-4b84-b3de-92397e49cf2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:29.105297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ee9bd5cf-e59e-4b84-b3de-92397e49cf2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:29.165040 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d7367912-ab32-4bb1-9a9c-748a5b74a12f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:29.173807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d7367912-ab32-4bb1-9a9c-748a5b74a12f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:29.175311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d7367912-ab32-4bb1-9a9c-748a5b74a12f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:29.176484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d7367912-ab32-4bb1-9a9c-748a5b74a12f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156887 Jul 26 18:50:29.177052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1569/3160] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:29.235669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ee9bd5cf-e59e-4b84-b3de-92397e49cf2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:29.243680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ee9bd5cf-e59e-4b84-b3de-92397e49cf2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150697 Jul 26 18:50:29.244242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1592/3161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:29 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:29.944215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3dfd19f3-6a26-44bc-a24f-748f6fb8e0a4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:29.944951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3dfd19f3-6a26-44bc-a24f-748f6fb8e0a4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:29.952323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dfd19f3-6a26-44bc-a24f-748f6fb8e0a4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:29.952761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dfd19f3-6a26-44bc-a24f-748f6fb8e0a4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:29.953518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dfd19f3-6a26-44bc-a24f-748f6fb8e0a4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:29.953948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dfd19f3-6a26-44bc-a24f-748f6fb8e0a4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:30.011674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-05f454de-101a-4b26-a76d-ea094b102d74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:30.012288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-05f454de-101a-4b26-a76d-ea094b102d74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:30.019267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-05f454de-101a-4b26-a76d-ea094b102d74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:30.019695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-05f454de-101a-4b26-a76d-ea094b102d74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:30.020444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-05f454de-101a-4b26-a76d-ea094b102d74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:30.020870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-05f454de-101a-4b26-a76d-ea094b102d74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:30.100138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3dfd19f3-6a26-44bc-a24f-748f6fb8e0a4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:30.108223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3dfd19f3-6a26-44bc-a24f-748f6fb8e0a4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.170595 Jul 26 18:50:30.108805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1570/3162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:29 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:30.113183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-844be3d8-2a86-419a-952b-0262406cf48b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:30.113780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-844be3d8-2a86-419a-952b-0262406cf48b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:30.119674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-844be3d8-2a86-419a-952b-0262406cf48b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:30.120586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-844be3d8-2a86-419a-952b-0262406cf48b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:30.120943 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-844be3d8-2a86-419a-952b-0262406cf48b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:30.121614 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-844be3d8-2a86-419a-952b-0262406cf48b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:30.153056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-05f454de-101a-4b26-a76d-ea094b102d74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:30.161221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-05f454de-101a-4b26-a76d-ea094b102d74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.153401 Jul 26 18:50:30.161820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1593/3163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:30 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:30.199328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a8e17989-4983-42b2-a9b8-878440781a75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:30.199929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a8e17989-4983-42b2-a9b8-878440781a75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:30.206165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8e17989-4983-42b2-a9b8-878440781a75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:30.206610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8e17989-4983-42b2-a9b8-878440781a75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:30.207401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8e17989-4983-42b2-a9b8-878440781a75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:30.207831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8e17989-4983-42b2-a9b8-878440781a75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:30.249502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-844be3d8-2a86-419a-952b-0262406cf48b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:30.257862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-844be3d8-2a86-419a-952b-0262406cf48b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.148098 Jul 26 18:50:30.258709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1571/3164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:30 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:30.343212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a8e17989-4983-42b2-a9b8-878440781a75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:30.351670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a8e17989-4983-42b2-a9b8-878440781a75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:30.353165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a8e17989-4983-42b2-a9b8-878440781a75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:30.354321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a8e17989-4983-42b2-a9b8-878440781a75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158998 Jul 26 18:50:30.354866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1594/3165] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:30.398576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b9b392a5-4123-47ee-914b-4c4a7e86e645 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:30.399207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b9b392a5-4123-47ee-914b-4c4a7e86e645 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:30.405142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9b392a5-4123-47ee-914b-4c4a7e86e645 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:30.405577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9b392a5-4123-47ee-914b-4c4a7e86e645 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:30.406315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9b392a5-4123-47ee-914b-4c4a7e86e645 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:30.406740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b9b392a5-4123-47ee-914b-4c4a7e86e645 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:30.535053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b9b392a5-4123-47ee-914b-4c4a7e86e645 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:30.543702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b9b392a5-4123-47ee-914b-4c4a7e86e645 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.283115 Jul 26 18:50:30.544296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1572/3166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:30 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:31.133573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6190f08a-d717-410e-9daa-dc219029a187 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:31.134538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6190f08a-d717-410e-9daa-dc219029a187 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:31.146007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6190f08a-d717-410e-9daa-dc219029a187 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:31.146759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6190f08a-d717-410e-9daa-dc219029a187 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:31.148187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6190f08a-d717-410e-9daa-dc219029a187 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:31.148614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6190f08a-d717-410e-9daa-dc219029a187 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:31.182010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7139854e-d820-4855-a41c-95e99453aa94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:31.182732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7139854e-d820-4855-a41c-95e99453aa94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:31.189778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7139854e-d820-4855-a41c-95e99453aa94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:31.190227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7139854e-d820-4855-a41c-95e99453aa94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:31.190994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7139854e-d820-4855-a41c-95e99453aa94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:31.191451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7139854e-d820-4855-a41c-95e99453aa94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:31.280637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6190f08a-d717-410e-9daa-dc219029a187 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:31.289137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6190f08a-d717-410e-9daa-dc219029a187 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.162110 Jul 26 18:50:31.289984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1595/3167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:31 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:31.294245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2286ce38-b073-444d-a0bc-a3f62209fcca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:31.294850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2286ce38-b073-444d-a0bc-a3f62209fcca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:31.300809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2286ce38-b073-444d-a0bc-a3f62209fcca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:31.301259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2286ce38-b073-444d-a0bc-a3f62209fcca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:31.302022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2286ce38-b073-444d-a0bc-a3f62209fcca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:31.302456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2286ce38-b073-444d-a0bc-a3f62209fcca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:31.326446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7139854e-d820-4855-a41c-95e99453aa94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:31.335004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7139854e-d820-4855-a41c-95e99453aa94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156967 Jul 26 18:50:31.335671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1573/3168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:31 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:31.377217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-78bf40a7-8754-4df7-851e-fb3102c80e3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:31.377822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-78bf40a7-8754-4df7-851e-fb3102c80e3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:31.383983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78bf40a7-8754-4df7-851e-fb3102c80e3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:31.384380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78bf40a7-8754-4df7-851e-fb3102c80e3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:31.385143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78bf40a7-8754-4df7-851e-fb3102c80e3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:31.385696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-78bf40a7-8754-4df7-851e-fb3102c80e3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:31.447234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2286ce38-b073-444d-a0bc-a3f62209fcca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:31.456287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2286ce38-b073-444d-a0bc-a3f62209fcca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.165411 Jul 26 18:50:31.457286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1596/3169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:31 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:31.522592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-78bf40a7-8754-4df7-851e-fb3102c80e3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:31.531562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-78bf40a7-8754-4df7-851e-fb3102c80e3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:31.533048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-78bf40a7-8754-4df7-851e-fb3102c80e3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:31.534208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-78bf40a7-8754-4df7-851e-fb3102c80e3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160859 Jul 26 18:50:31.534778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1574/3170] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:31.567982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-36375c18-ee0f-403b-9dcf-08c8d536620d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:31.568776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-36375c18-ee0f-403b-9dcf-08c8d536620d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:31.575328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36375c18-ee0f-403b-9dcf-08c8d536620d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:31.575771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36375c18-ee0f-403b-9dcf-08c8d536620d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:31.576526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36375c18-ee0f-403b-9dcf-08c8d536620d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:31.576955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36375c18-ee0f-403b-9dcf-08c8d536620d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:31.718237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-36375c18-ee0f-403b-9dcf-08c8d536620d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:31.731044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-36375c18-ee0f-403b-9dcf-08c8d536620d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.169044 Jul 26 18:50:31.731895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1597/3171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:31 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:32.314303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9c49b142-2ea7-417b-8b45-8fceb2ad321b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:32.315353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9c49b142-2ea7-417b-8b45-8fceb2ad321b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:32.323902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9c49b142-2ea7-417b-8b45-8fceb2ad321b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:32.324353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9c49b142-2ea7-417b-8b45-8fceb2ad321b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:32.325101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9c49b142-2ea7-417b-8b45-8fceb2ad321b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:32.325534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9c49b142-2ea7-417b-8b45-8fceb2ad321b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:32.356903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ccfc6ea9-e163-4a05-b10a-38fbaa91b133 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:32.357501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ccfc6ea9-e163-4a05-b10a-38fbaa91b133 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:32.364610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccfc6ea9-e163-4a05-b10a-38fbaa91b133 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:32.365058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccfc6ea9-e163-4a05-b10a-38fbaa91b133 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:32.365805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccfc6ea9-e163-4a05-b10a-38fbaa91b133 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:32.366368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccfc6ea9-e163-4a05-b10a-38fbaa91b133 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:32.459873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9c49b142-2ea7-417b-8b45-8fceb2ad321b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:32.468100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9c49b142-2ea7-417b-8b45-8fceb2ad321b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.160295 Jul 26 18:50:32.468745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1575/3172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:32 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:32.481676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b0ea56e0-c28c-451b-b0db-d50f84594503 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:32.482266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b0ea56e0-c28c-451b-b0db-d50f84594503 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:32.488629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0ea56e0-c28c-451b-b0db-d50f84594503 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:32.489113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0ea56e0-c28c-451b-b0db-d50f84594503 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:32.489906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0ea56e0-c28c-451b-b0db-d50f84594503 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:32.490351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0ea56e0-c28c-451b-b0db-d50f84594503 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:32.498824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ccfc6ea9-e163-4a05-b10a-38fbaa91b133 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:32.507244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ccfc6ea9-e163-4a05-b10a-38fbaa91b133 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154169 Jul 26 18:50:32.507810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1598/3173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:32 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:32.557478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8b78c3fe-db4e-4c49-965f-749563f0e3db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:32.558220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8b78c3fe-db4e-4c49-965f-749563f0e3db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:32.565274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b78c3fe-db4e-4c49-965f-749563f0e3db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:32.565674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b78c3fe-db4e-4c49-965f-749563f0e3db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:32.566520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b78c3fe-db4e-4c49-965f-749563f0e3db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:32.566960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b78c3fe-db4e-4c49-965f-749563f0e3db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:32.632073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b0ea56e0-c28c-451b-b0db-d50f84594503 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:32.640527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b0ea56e0-c28c-451b-b0db-d50f84594503 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163514 Jul 26 18:50:32.641097 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1576/3174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:32 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:32.698471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8b78c3fe-db4e-4c49-965f-749563f0e3db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:32.707959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8b78c3fe-db4e-4c49-965f-749563f0e3db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:32.709534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8b78c3fe-db4e-4c49-965f-749563f0e3db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:32.710809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8b78c3fe-db4e-4c49-965f-749563f0e3db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157479 Jul 26 18:50:32.711420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1599/3175] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:32 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:32.757068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-569629aa-320e-4d97-a8d5-b14913387c6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:32.757701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-569629aa-320e-4d97-a8d5-b14913387c6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:32.763979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-569629aa-320e-4d97-a8d5-b14913387c6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:32.764437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-569629aa-320e-4d97-a8d5-b14913387c6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:32.765186 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-569629aa-320e-4d97-a8d5-b14913387c6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:32.765615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-569629aa-320e-4d97-a8d5-b14913387c6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:32.896743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-569629aa-320e-4d97-a8d5-b14913387c6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:32.906025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-569629aa-320e-4d97-a8d5-b14913387c6d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153078 Jul 26 18:50:32.906654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1577/3176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:32 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:33.493571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-90d9b13e-71c3-496a-8a1c-eda43914085c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:33.494544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-90d9b13e-71c3-496a-8a1c-eda43914085c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:33.507830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90d9b13e-71c3-496a-8a1c-eda43914085c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:33.510378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90d9b13e-71c3-496a-8a1c-eda43914085c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:33.511183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90d9b13e-71c3-496a-8a1c-eda43914085c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:33.511617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90d9b13e-71c3-496a-8a1c-eda43914085c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:33.528492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4e9b12e4-99aa-451a-a109-e6b42b7e93f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:33.529192 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4e9b12e4-99aa-451a-a109-e6b42b7e93f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:33.536340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e9b12e4-99aa-451a-a109-e6b42b7e93f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:33.536795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e9b12e4-99aa-451a-a109-e6b42b7e93f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:33.537556 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e9b12e4-99aa-451a-a109-e6b42b7e93f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:33.537995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e9b12e4-99aa-451a-a109-e6b42b7e93f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:33.660580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-90d9b13e-71c3-496a-8a1c-eda43914085c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:33.668797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4e9b12e4-99aa-451a-a109-e6b42b7e93f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:33.669001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-90d9b13e-71c3-496a-8a1c-eda43914085c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.181777 Jul 26 18:50:33.669385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1600/3177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:33 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:33.673938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-475c36a0-f20f-4b46-914b-1040bf4b197e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:33.674565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-475c36a0-f20f-4b46-914b-1040bf4b197e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:33.677091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4e9b12e4-99aa-451a-a109-e6b42b7e93f5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.152353 Jul 26 18:50:33.677494 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1578/3178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:33 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:33.680776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-475c36a0-f20f-4b46-914b-1040bf4b197e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:33.681225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-475c36a0-f20f-4b46-914b-1040bf4b197e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:33.681974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-475c36a0-f20f-4b46-914b-1040bf4b197e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:33.682502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-475c36a0-f20f-4b46-914b-1040bf4b197e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:33.733925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-503f2981-4417-4d28-ae7b-1c2048bb15c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:33.734556 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-503f2981-4417-4d28-ae7b-1c2048bb15c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:33.740777 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-503f2981-4417-4d28-ae7b-1c2048bb15c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:33.741211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-503f2981-4417-4d28-ae7b-1c2048bb15c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:33.741957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-503f2981-4417-4d28-ae7b-1c2048bb15c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:33.742379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-503f2981-4417-4d28-ae7b-1c2048bb15c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:33.820866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-475c36a0-f20f-4b46-914b-1040bf4b197e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:33.829341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-475c36a0-f20f-4b46-914b-1040bf4b197e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158875 Jul 26 18:50:33.829942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1601/3179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:33 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:33.878374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-503f2981-4417-4d28-ae7b-1c2048bb15c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:33.881206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:33.893273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-503f2981-4417-4d28-ae7b-1c2048bb15c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:33.895567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-503f2981-4417-4d28-ae7b-1c2048bb15c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:33.897771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-503f2981-4417-4d28-ae7b-1c2048bb15c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.167162 Jul 26 18:50:33.898542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1579/3180] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:33.927826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7e6ed405-39f3-4da3-8076-59a37226e37e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:33.928438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7e6ed405-39f3-4da3-8076-59a37226e37e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:33.934950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e6ed405-39f3-4da3-8076-59a37226e37e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:33.935452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e6ed405-39f3-4da3-8076-59a37226e37e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:33.936212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e6ed405-39f3-4da3-8076-59a37226e37e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:33.936651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e6ed405-39f3-4da3-8076-59a37226e37e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:34.066309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7e6ed405-39f3-4da3-8076-59a37226e37e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:34.074767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7e6ed405-39f3-4da3-8076-59a37226e37e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150816 Jul 26 18:50:34.075372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1602/3181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:33 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:34.344247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:50:34.344642 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:50:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:50:34.694260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cab35b35-cba4-4e91-b09b-9e921733a038 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:34.695332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cab35b35-cba4-4e91-b09b-9e921733a038 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:34.701610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b19747d4-1ffd-4c53-9ee2-5a530e219485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:34.702606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b19747d4-1ffd-4c53-9ee2-5a530e219485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:34.706109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cab35b35-cba4-4e91-b09b-9e921733a038 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:34.706844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cab35b35-cba4-4e91-b09b-9e921733a038 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:34.708678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cab35b35-cba4-4e91-b09b-9e921733a038 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:34.709586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cab35b35-cba4-4e91-b09b-9e921733a038 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:34.712304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b19747d4-1ffd-4c53-9ee2-5a530e219485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:34.712759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b19747d4-1ffd-4c53-9ee2-5a530e219485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:34.713519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b19747d4-1ffd-4c53-9ee2-5a530e219485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:34.713958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b19747d4-1ffd-4c53-9ee2-5a530e219485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:34.847138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cab35b35-cba4-4e91-b09b-9e921733a038 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:34.850884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b19747d4-1ffd-4c53-9ee2-5a530e219485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:34.856062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cab35b35-cba4-4e91-b09b-9e921733a038 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.168807 Jul 26 18:50:34.856939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1580/3182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:34 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:34.860274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b19747d4-1ffd-4c53-9ee2-5a530e219485 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165185 Jul 26 18:50:34.863056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1603/3183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:34 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:34.863222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ba073714-5ed0-4ea5-9a21-88b03cd5275e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:34.863222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ba073714-5ed0-4ea5-9a21-88b03cd5275e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:34.868780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba073714-5ed0-4ea5-9a21-88b03cd5275e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:34.869270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba073714-5ed0-4ea5-9a21-88b03cd5275e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:34.870206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba073714-5ed0-4ea5-9a21-88b03cd5275e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:34.870741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ba073714-5ed0-4ea5-9a21-88b03cd5275e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:34.921394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d11f394b-df4b-489c-a097-17c3050fd278 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:34.922007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d11f394b-df4b-489c-a097-17c3050fd278 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:34.928147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d11f394b-df4b-489c-a097-17c3050fd278 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:34.928591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d11f394b-df4b-489c-a097-17c3050fd278 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:34.929422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d11f394b-df4b-489c-a097-17c3050fd278 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:34.929888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d11f394b-df4b-489c-a097-17c3050fd278 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:35.002684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ba073714-5ed0-4ea5-9a21-88b03cd5275e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:35.010823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ba073714-5ed0-4ea5-9a21-88b03cd5275e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152980 Jul 26 18:50:35.011418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1581/3184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:34 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:35.059940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d11f394b-df4b-489c-a097-17c3050fd278 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:35.069309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d11f394b-df4b-489c-a097-17c3050fd278 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:35.070991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d11f394b-df4b-489c-a097-17c3050fd278 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:35.072340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d11f394b-df4b-489c-a097-17c3050fd278 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155075 Jul 26 18:50:35.072870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1604/3185] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:34 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:35.097478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dd0a884b-029a-4f3f-98ff-e5e9a0a57eef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:35.098124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dd0a884b-029a-4f3f-98ff-e5e9a0a57eef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:35.104749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd0a884b-029a-4f3f-98ff-e5e9a0a57eef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:35.105204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd0a884b-029a-4f3f-98ff-e5e9a0a57eef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:35.105961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd0a884b-029a-4f3f-98ff-e5e9a0a57eef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:35.106399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd0a884b-029a-4f3f-98ff-e5e9a0a57eef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:35.247652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dd0a884b-029a-4f3f-98ff-e5e9a0a57eef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:35.259220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dd0a884b-029a-4f3f-98ff-e5e9a0a57eef tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.165802 Jul 26 18:50:35.259777 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1582/3186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:35 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:35.881451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fdf76b5e-7729-4c15-99ec-6e41ad5245d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:35.882470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fdf76b5e-7729-4c15-99ec-6e41ad5245d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:35.887402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6f5abc0a-c7f9-4706-9024-613db6cca9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:35.888033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6f5abc0a-c7f9-4706-9024-613db6cca9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:35.891398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdf76b5e-7729-4c15-99ec-6e41ad5245d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:35.891964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdf76b5e-7729-4c15-99ec-6e41ad5245d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:35.892849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdf76b5e-7729-4c15-99ec-6e41ad5245d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:35.893556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fdf76b5e-7729-4c15-99ec-6e41ad5245d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:35.895511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f5abc0a-c7f9-4706-9024-613db6cca9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:35.895959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f5abc0a-c7f9-4706-9024-613db6cca9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:35.896739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f5abc0a-c7f9-4706-9024-613db6cca9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:35.897484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6f5abc0a-c7f9-4706-9024-613db6cca9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:36.028787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fdf76b5e-7729-4c15-99ec-6e41ad5245d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:36.031243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:36.034858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6f5abc0a-c7f9-4706-9024-613db6cca9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:36.038464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fdf76b5e-7729-4c15-99ec-6e41ad5245d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.163708 Jul 26 18:50:36.043208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1605/3187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:35 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:36.043421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6f5abc0a-c7f9-4706-9024-613db6cca9d0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160017 Jul 26 18:50:36.044159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1583/3188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:35 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:36.048067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5933d1c7-1598-4cc4-9e81-eee6d6aa52ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:36.048692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5933d1c7-1598-4cc4-9e81-eee6d6aa52ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:36.054675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5933d1c7-1598-4cc4-9e81-eee6d6aa52ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:36.055154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5933d1c7-1598-4cc4-9e81-eee6d6aa52ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:36.055900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5933d1c7-1598-4cc4-9e81-eee6d6aa52ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:36.056330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5933d1c7-1598-4cc4-9e81-eee6d6aa52ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:36.103922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-043db40b-f7e3-4bad-b706-796721d0c308 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:36.104611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-043db40b-f7e3-4bad-b706-796721d0c308 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:36.110856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-043db40b-f7e3-4bad-b706-796721d0c308 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:36.111411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-043db40b-f7e3-4bad-b706-796721d0c308 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:36.112283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-043db40b-f7e3-4bad-b706-796721d0c308 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:36.112771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-043db40b-f7e3-4bad-b706-796721d0c308 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:36.189350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5933d1c7-1598-4cc4-9e81-eee6d6aa52ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:36.197699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5933d1c7-1598-4cc4-9e81-eee6d6aa52ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.153470 Jul 26 18:50:36.198300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1606/3189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:36 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:36.241907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-043db40b-f7e3-4bad-b706-796721d0c308 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:36.250456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-043db40b-f7e3-4bad-b706-796721d0c308 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:36.251949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-043db40b-f7e3-4bad-b706-796721d0c308 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:36.253086 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-043db40b-f7e3-4bad-b706-796721d0c308 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.153063 Jul 26 18:50:36.253639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1584/3190] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:36 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:36.284034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8b4d9c5b-7b3c-44e4-8d13-16291c368247 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:36.284762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8b4d9c5b-7b3c-44e4-8d13-16291c368247 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:36.294328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b4d9c5b-7b3c-44e4-8d13-16291c368247 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:36.294965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b4d9c5b-7b3c-44e4-8d13-16291c368247 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:36.296166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b4d9c5b-7b3c-44e4-8d13-16291c368247 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:36.296773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b4d9c5b-7b3c-44e4-8d13-16291c368247 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:36.436869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8b4d9c5b-7b3c-44e4-8d13-16291c368247 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:36.449089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8b4d9c5b-7b3c-44e4-8d13-16291c368247 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.171275 Jul 26 18:50:36.449864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1607/3191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:36 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:37.062935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f3e89829-ecfe-4b03-898f-14ab413192cc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:37.063976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f3e89829-ecfe-4b03-898f-14ab413192cc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:37.068356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aff884f7-55f8-4334-a01f-797c902b435e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:37.069317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aff884f7-55f8-4334-a01f-797c902b435e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:37.074889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3e89829-ecfe-4b03-898f-14ab413192cc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:37.075710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3e89829-ecfe-4b03-898f-14ab413192cc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:37.076918 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3e89829-ecfe-4b03-898f-14ab413192cc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:37.077625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f3e89829-ecfe-4b03-898f-14ab413192cc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:37.079513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aff884f7-55f8-4334-a01f-797c902b435e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:37.080261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aff884f7-55f8-4334-a01f-797c902b435e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:37.081522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aff884f7-55f8-4334-a01f-797c902b435e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:37.082239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aff884f7-55f8-4334-a01f-797c902b435e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:37.215400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-aff884f7-55f8-4334-a01f-797c902b435e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:37.219138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f3e89829-ecfe-4b03-898f-14ab413192cc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:37.223901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aff884f7-55f8-4334-a01f-797c902b435e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.162246 Jul 26 18:50:37.224517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1608/3192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:37 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:37.227820 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f3e89829-ecfe-4b03-898f-14ab413192cc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.171372 Jul 26 18:50:37.239081 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1585/3193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:37 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:37.239281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d18131f9-0816-41b2-99f8-99d88a28374f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:37.239281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d18131f9-0816-41b2-99f8-99d88a28374f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:37.239281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d18131f9-0816-41b2-99f8-99d88a28374f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:37.239281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d18131f9-0816-41b2-99f8-99d88a28374f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:37.239709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d18131f9-0816-41b2-99f8-99d88a28374f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:37.239709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d18131f9-0816-41b2-99f8-99d88a28374f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:37.278794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1c42e7d6-f4d3-403d-8fc2-1fd97f830a77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:37.279668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1c42e7d6-f4d3-403d-8fc2-1fd97f830a77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:37.287591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c42e7d6-f4d3-403d-8fc2-1fd97f830a77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:37.288203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c42e7d6-f4d3-403d-8fc2-1fd97f830a77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:37.289138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c42e7d6-f4d3-403d-8fc2-1fd97f830a77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:37.289580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c42e7d6-f4d3-403d-8fc2-1fd97f830a77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:37.373281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d18131f9-0816-41b2-99f8-99d88a28374f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:37.381554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d18131f9-0816-41b2-99f8-99d88a28374f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156099 Jul 26 18:50:37.382215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1609/3194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:37 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:37.419523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1c42e7d6-f4d3-403d-8fc2-1fd97f830a77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:37.428600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1c42e7d6-f4d3-403d-8fc2-1fd97f830a77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:37.430101 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1c42e7d6-f4d3-403d-8fc2-1fd97f830a77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:37.431316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1c42e7d6-f4d3-403d-8fc2-1fd97f830a77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159212 Jul 26 18:50:37.431920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1586/3195] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:37.473701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4f7c23c9-e092-47bb-967a-61830d319156 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:37.474555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4f7c23c9-e092-47bb-967a-61830d319156 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:37.482263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f7c23c9-e092-47bb-967a-61830d319156 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:37.482729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f7c23c9-e092-47bb-967a-61830d319156 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:37.483539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f7c23c9-e092-47bb-967a-61830d319156 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:37.483975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f7c23c9-e092-47bb-967a-61830d319156 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:37.632603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4f7c23c9-e092-47bb-967a-61830d319156 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:37.645744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4f7c23c9-e092-47bb-967a-61830d319156 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.178612 Jul 26 18:50:37.646599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1610/3196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:37 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:38.252369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-db252e5b-6aa9-43d2-8902-1ce61bcedec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:38.253320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-45b76302-8361-4262-970b-b6d57e97dce9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:38.253944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-db252e5b-6aa9-43d2-8902-1ce61bcedec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:38.255865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-45b76302-8361-4262-970b-b6d57e97dce9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:38.261813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db252e5b-6aa9-43d2-8902-1ce61bcedec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:38.262258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db252e5b-6aa9-43d2-8902-1ce61bcedec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:38.263053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db252e5b-6aa9-43d2-8902-1ce61bcedec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:38.263602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-db252e5b-6aa9-43d2-8902-1ce61bcedec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:38.263878 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45b76302-8361-4262-970b-b6d57e97dce9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:38.264332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45b76302-8361-4262-970b-b6d57e97dce9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:38.265105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45b76302-8361-4262-970b-b6d57e97dce9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:38.265538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45b76302-8361-4262-970b-b6d57e97dce9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:38.398338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-45b76302-8361-4262-970b-b6d57e97dce9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:38.398564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-db252e5b-6aa9-43d2-8902-1ce61bcedec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:38.406708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-45b76302-8361-4262-970b-b6d57e97dce9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.160351 Jul 26 18:50:38.406893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-db252e5b-6aa9-43d2-8902-1ce61bcedec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161704 Jul 26 18:50:38.407322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1611/3197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:38 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:38.407673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1587/3198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:38 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:38.415859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-981cef87-a86b-4aaa-aeb8-52857f0e34ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:38.416481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-981cef87-a86b-4aaa-aeb8-52857f0e34ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:38.422665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-981cef87-a86b-4aaa-aeb8-52857f0e34ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:38.423173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-981cef87-a86b-4aaa-aeb8-52857f0e34ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:38.423932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-981cef87-a86b-4aaa-aeb8-52857f0e34ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:38.424362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-981cef87-a86b-4aaa-aeb8-52857f0e34ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:38.456778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fc0e37d6-2567-4f18-8b07-8aaa375dbe2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:38.457362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fc0e37d6-2567-4f18-8b07-8aaa375dbe2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:38.463615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc0e37d6-2567-4f18-8b07-8aaa375dbe2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:38.464062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc0e37d6-2567-4f18-8b07-8aaa375dbe2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:38.464817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc0e37d6-2567-4f18-8b07-8aaa375dbe2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:38.465247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fc0e37d6-2567-4f18-8b07-8aaa375dbe2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:38.551704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-981cef87-a86b-4aaa-aeb8-52857f0e34ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:38.560093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-981cef87-a86b-4aaa-aeb8-52857f0e34ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.147884 Jul 26 18:50:38.560879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1612/3199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:38 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:38.593724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fc0e37d6-2567-4f18-8b07-8aaa375dbe2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:38.604044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fc0e37d6-2567-4f18-8b07-8aaa375dbe2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:38.605529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fc0e37d6-2567-4f18-8b07-8aaa375dbe2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:38.606675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fc0e37d6-2567-4f18-8b07-8aaa375dbe2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.153769 Jul 26 18:50:38.607278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1588/3200] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:38.671593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e49ce201-734b-41e2-9814-16e6b5996815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:38.672515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e49ce201-734b-41e2-9814-16e6b5996815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:38.681008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e49ce201-734b-41e2-9814-16e6b5996815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:38.681493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e49ce201-734b-41e2-9814-16e6b5996815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:38.682231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e49ce201-734b-41e2-9814-16e6b5996815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:38.682648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e49ce201-734b-41e2-9814-16e6b5996815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:38.824097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e49ce201-734b-41e2-9814-16e6b5996815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:38.832243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e49ce201-734b-41e2-9814-16e6b5996815 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.166214 Jul 26 18:50:38.832804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1613/3201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:38 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:39.430976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b0f41ba4-bd36-4cda-9059-68c5c11400dd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:39.431699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-39a27186-c72a-43b1-998f-58f83eed222d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:39.431699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-39a27186-c72a-43b1-998f-58f83eed222d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:39.432186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b0f41ba4-bd36-4cda-9059-68c5c11400dd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:39.438460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0f41ba4-bd36-4cda-9059-68c5c11400dd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:39.438651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39a27186-c72a-43b1-998f-58f83eed222d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:39.438924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0f41ba4-bd36-4cda-9059-68c5c11400dd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:39.439121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39a27186-c72a-43b1-998f-58f83eed222d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:39.439700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0f41ba4-bd36-4cda-9059-68c5c11400dd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:39.439859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39a27186-c72a-43b1-998f-58f83eed222d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:39.440129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0f41ba4-bd36-4cda-9059-68c5c11400dd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:39.440298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-39a27186-c72a-43b1-998f-58f83eed222d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:39.571183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b0f41ba4-bd36-4cda-9059-68c5c11400dd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:39.571397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-39a27186-c72a-43b1-998f-58f83eed222d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:39.579375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b0f41ba4-bd36-4cda-9059-68c5c11400dd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154391 Jul 26 18:50:39.579720 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-39a27186-c72a-43b1-998f-58f83eed222d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154743 Jul 26 18:50:39.579945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1614/3202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:39 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:39.583490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1589/3203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:39 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:39.584328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a086c2a8-f9ef-4148-b7cf-0a3926142774 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:39.584928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a086c2a8-f9ef-4148-b7cf-0a3926142774 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:39.591572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a086c2a8-f9ef-4148-b7cf-0a3926142774 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:39.592019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a086c2a8-f9ef-4148-b7cf-0a3926142774 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:39.592778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a086c2a8-f9ef-4148-b7cf-0a3926142774 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:39.593208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a086c2a8-f9ef-4148-b7cf-0a3926142774 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:39.630779 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dd6c8678-3267-4093-88ac-663abfda9ba9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:39.631403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dd6c8678-3267-4093-88ac-663abfda9ba9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:39.637755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd6c8678-3267-4093-88ac-663abfda9ba9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:39.638195 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd6c8678-3267-4093-88ac-663abfda9ba9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:39.638950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd6c8678-3267-4093-88ac-663abfda9ba9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:39.639406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd6c8678-3267-4093-88ac-663abfda9ba9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:39.730065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a086c2a8-f9ef-4148-b7cf-0a3926142774 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:39.738215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a086c2a8-f9ef-4148-b7cf-0a3926142774 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157308 Jul 26 18:50:39.738799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1615/3204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:39 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:39.771429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dd6c8678-3267-4093-88ac-663abfda9ba9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:39.780657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dd6c8678-3267-4093-88ac-663abfda9ba9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:39.782188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dd6c8678-3267-4093-88ac-663abfda9ba9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:39.783425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dd6c8678-3267-4093-88ac-663abfda9ba9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157867 Jul 26 18:50:39.784013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1590/3205] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:39.858563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9fd9aa01-ed08-4f45-9bc5-20fd28530532 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:39.859662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9fd9aa01-ed08-4f45-9bc5-20fd28530532 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:39.869461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fd9aa01-ed08-4f45-9bc5-20fd28530532 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:39.869960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fd9aa01-ed08-4f45-9bc5-20fd28530532 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:39.870889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fd9aa01-ed08-4f45-9bc5-20fd28530532 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:39.871345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fd9aa01-ed08-4f45-9bc5-20fd28530532 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:40.004099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9fd9aa01-ed08-4f45-9bc5-20fd28530532 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:40.012713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9fd9aa01-ed08-4f45-9bc5-20fd28530532 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161479 Jul 26 18:50:40.013281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1616/3206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:39 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:40.607203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f8600000-3474-4246-a85c-59cf78b982dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:40.608193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b6540b00-7567-49ac-9fbb-6470ae5b67db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:40.608924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f8600000-3474-4246-a85c-59cf78b982dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:40.609141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b6540b00-7567-49ac-9fbb-6470ae5b67db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:40.619360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8600000-3474-4246-a85c-59cf78b982dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:40.619689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6540b00-7567-49ac-9fbb-6470ae5b67db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:40.619845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8600000-3474-4246-a85c-59cf78b982dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:40.620144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6540b00-7567-49ac-9fbb-6470ae5b67db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:40.620513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8600000-3474-4246-a85c-59cf78b982dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:40.620909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6540b00-7567-49ac-9fbb-6470ae5b67db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:40.621134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8600000-3474-4246-a85c-59cf78b982dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:40.621328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6540b00-7567-49ac-9fbb-6470ae5b67db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:40.750653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b6540b00-7567-49ac-9fbb-6470ae5b67db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:40.751713 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f8600000-3474-4246-a85c-59cf78b982dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:40.759115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b6540b00-7567-49ac-9fbb-6470ae5b67db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.157228 Jul 26 18:50:40.759694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1617/3207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:40 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:40.761317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f8600000-3474-4246-a85c-59cf78b982dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.160546 Jul 26 18:50:40.761880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1591/3208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:40 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:40.764111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-00c0a83a-2dda-4daa-a25f-6e3e68276bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:40.764707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-00c0a83a-2dda-4daa-a25f-6e3e68276bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:40.770557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00c0a83a-2dda-4daa-a25f-6e3e68276bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:40.771236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00c0a83a-2dda-4daa-a25f-6e3e68276bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:40.772643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00c0a83a-2dda-4daa-a25f-6e3e68276bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:40.773257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-00c0a83a-2dda-4daa-a25f-6e3e68276bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:40.805903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5f6a64cd-1fb9-4c1b-a1ce-f80f2c18f889 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:40.806716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5f6a64cd-1fb9-4c1b-a1ce-f80f2c18f889 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:40.812993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f6a64cd-1fb9-4c1b-a1ce-f80f2c18f889 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:40.813547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f6a64cd-1fb9-4c1b-a1ce-f80f2c18f889 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:40.814362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f6a64cd-1fb9-4c1b-a1ce-f80f2c18f889 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:40.814853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f6a64cd-1fb9-4c1b-a1ce-f80f2c18f889 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:40.909147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-00c0a83a-2dda-4daa-a25f-6e3e68276bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:40.918171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-00c0a83a-2dda-4daa-a25f-6e3e68276bb1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157502 Jul 26 18:50:40.919459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1618/3209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:40 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:40.951000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5f6a64cd-1fb9-4c1b-a1ce-f80f2c18f889 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:40.959961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5f6a64cd-1fb9-4c1b-a1ce-f80f2c18f889 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:40.961468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5f6a64cd-1fb9-4c1b-a1ce-f80f2c18f889 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:40.962630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5f6a64cd-1fb9-4c1b-a1ce-f80f2c18f889 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160770 Jul 26 18:50:40.963216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1592/3210] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:40 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:41.039070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d50979aa-fd72-4ce2-8087-4ab76eef5527 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:41.040204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d50979aa-fd72-4ce2-8087-4ab76eef5527 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:41.046856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d50979aa-fd72-4ce2-8087-4ab76eef5527 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:41.047320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d50979aa-fd72-4ce2-8087-4ab76eef5527 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:41.048099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d50979aa-fd72-4ce2-8087-4ab76eef5527 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:41.048534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d50979aa-fd72-4ce2-8087-4ab76eef5527 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:41.181532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d50979aa-fd72-4ce2-8087-4ab76eef5527 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:41.194088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d50979aa-fd72-4ce2-8087-4ab76eef5527 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161231 Jul 26 18:50:41.194790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1619/3211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:41 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:41.782457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-43ed2f01-53b7-4c1d-92d4-7cdd32834a59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:41.783012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-35d4bbac-b314-491c-98ac-a14fff38b1a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:41.783488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-35d4bbac-b314-491c-98ac-a14fff38b1a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:41.783899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-43ed2f01-53b7-4c1d-92d4-7cdd32834a59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:41.791480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35d4bbac-b314-491c-98ac-a14fff38b1a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:41.791874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43ed2f01-53b7-4c1d-92d4-7cdd32834a59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:41.792030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35d4bbac-b314-491c-98ac-a14fff38b1a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:41.792322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43ed2f01-53b7-4c1d-92d4-7cdd32834a59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:41.792663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35d4bbac-b314-491c-98ac-a14fff38b1a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:41.793091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-35d4bbac-b314-491c-98ac-a14fff38b1a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:41.793245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43ed2f01-53b7-4c1d-92d4-7cdd32834a59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:41.793528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43ed2f01-53b7-4c1d-92d4-7cdd32834a59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:41.927599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-43ed2f01-53b7-4c1d-92d4-7cdd32834a59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:41.930101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-35d4bbac-b314-491c-98ac-a14fff38b1a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:41.935889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-43ed2f01-53b7-4c1d-92d4-7cdd32834a59 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158093 Jul 26 18:50:41.939061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1593/3212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:41 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:41.939237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-35d4bbac-b314-491c-98ac-a14fff38b1a2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.160285 Jul 26 18:50:41.939680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1620/3213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:41 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:41.944951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-437c319f-e768-4ab6-a188-63932441970c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:41.945552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-437c319f-e768-4ab6-a188-63932441970c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:41.954222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-437c319f-e768-4ab6-a188-63932441970c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:41.954659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-437c319f-e768-4ab6-a188-63932441970c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:41.955444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-437c319f-e768-4ab6-a188-63932441970c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:41.955869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-437c319f-e768-4ab6-a188-63932441970c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:41.985370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-82597a27-f110-4ea7-960c-b7071163e996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:41.985976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-82597a27-f110-4ea7-960c-b7071163e996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:41.992243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82597a27-f110-4ea7-960c-b7071163e996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:41.992679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82597a27-f110-4ea7-960c-b7071163e996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:41.993413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82597a27-f110-4ea7-960c-b7071163e996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:41.993838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82597a27-f110-4ea7-960c-b7071163e996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:42.088061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-437c319f-e768-4ab6-a188-63932441970c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:42.096572 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-437c319f-e768-4ab6-a188-63932441970c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.159092 Jul 26 18:50:42.097147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1594/3214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:41 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:42.122432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-82597a27-f110-4ea7-960c-b7071163e996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:42.130982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-82597a27-f110-4ea7-960c-b7071163e996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:42.132509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-82597a27-f110-4ea7-960c-b7071163e996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:42.133665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-82597a27-f110-4ea7-960c-b7071163e996 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.152137 Jul 26 18:50:42.134218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1621/3215] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:41 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:42.223684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-710cf25d-8626-4f2c-b12c-a298a19e0f73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:42.224676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-710cf25d-8626-4f2c-b12c-a298a19e0f73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:42.235238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-710cf25d-8626-4f2c-b12c-a298a19e0f73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:42.235984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-710cf25d-8626-4f2c-b12c-a298a19e0f73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:42.237275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-710cf25d-8626-4f2c-b12c-a298a19e0f73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:42.237983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-710cf25d-8626-4f2c-b12c-a298a19e0f73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:42.369202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-710cf25d-8626-4f2c-b12c-a298a19e0f73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:42.377972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-710cf25d-8626-4f2c-b12c-a298a19e0f73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.160814 Jul 26 18:50:42.378544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1595/3216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:42 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:42.468018 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:50:42.468236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:50:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:50:42.958652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-23d4700d-674b-4bbf-950b-f00847e2cf28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:42.959385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-23d4700d-674b-4bbf-950b-f00847e2cf28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:42.960792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bc3899d2-a18a-4aa1-bfd8-9c8e441d6e0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:42.961506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bc3899d2-a18a-4aa1-bfd8-9c8e441d6e0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:42.967426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23d4700d-674b-4bbf-950b-f00847e2cf28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:42.967926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23d4700d-674b-4bbf-950b-f00847e2cf28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:42.968751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23d4700d-674b-4bbf-950b-f00847e2cf28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:42.969191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-23d4700d-674b-4bbf-950b-f00847e2cf28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:42.970466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc3899d2-a18a-4aa1-bfd8-9c8e441d6e0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:42.970914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc3899d2-a18a-4aa1-bfd8-9c8e441d6e0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:42.971702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc3899d2-a18a-4aa1-bfd8-9c8e441d6e0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:42.972122 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bc3899d2-a18a-4aa1-bfd8-9c8e441d6e0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:42.984979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:42.987503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:43.103662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bc3899d2-a18a-4aa1-bfd8-9c8e441d6e0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:43.105220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-23d4700d-674b-4bbf-950b-f00847e2cf28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:43.113396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bc3899d2-a18a-4aa1-bfd8-9c8e441d6e0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155562 Jul 26 18:50:43.113396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1596/3217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:42 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:43.115067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-23d4700d-674b-4bbf-950b-f00847e2cf28 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160929 Jul 26 18:50:43.121158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1622/3218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:42 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:43.128156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-47cc3132-a1f2-410e-9f00-a32377be51b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:43.128802 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-47cc3132-a1f2-410e-9f00-a32377be51b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:43.135076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47cc3132-a1f2-410e-9f00-a32377be51b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:43.135549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47cc3132-a1f2-410e-9f00-a32377be51b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:43.136324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47cc3132-a1f2-410e-9f00-a32377be51b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:43.136755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47cc3132-a1f2-410e-9f00-a32377be51b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:43.156270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-76172c99-3797-486c-8633-7bc1be9983fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:43.156871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-76172c99-3797-486c-8633-7bc1be9983fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:43.162956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76172c99-3797-486c-8633-7bc1be9983fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:43.163430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76172c99-3797-486c-8633-7bc1be9983fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:43.164180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76172c99-3797-486c-8633-7bc1be9983fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:43.164609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76172c99-3797-486c-8633-7bc1be9983fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:43.271390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-47cc3132-a1f2-410e-9f00-a32377be51b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:43.280046 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-47cc3132-a1f2-410e-9f00-a32377be51b9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155640 Jul 26 18:50:43.280603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1597/3219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:43 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:43.296370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-76172c99-3797-486c-8633-7bc1be9983fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:43.304794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-76172c99-3797-486c-8633-7bc1be9983fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:43.306291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-76172c99-3797-486c-8633-7bc1be9983fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:43.307475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-76172c99-3797-486c-8633-7bc1be9983fb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155105 Jul 26 18:50:43.308063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1623/3220] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:43.412348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d509fa1c-e4f6-44a6-a810-688481edd059 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:43.413162 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d509fa1c-e4f6-44a6-a810-688481edd059 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:43.420210 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d509fa1c-e4f6-44a6-a810-688481edd059 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:43.420652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d509fa1c-e4f6-44a6-a810-688481edd059 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:43.421424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d509fa1c-e4f6-44a6-a810-688481edd059 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:43.421855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d509fa1c-e4f6-44a6-a810-688481edd059 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:43.563847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d509fa1c-e4f6-44a6-a810-688481edd059 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:43.577149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d509fa1c-e4f6-44a6-a810-688481edd059 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.170828 Jul 26 18:50:43.578024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1598/3221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:43 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:44.136573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0095bba1-38d0-43b9-b44f-d62f43f5a238 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:44.137186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0095bba1-38d0-43b9-b44f-d62f43f5a238 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:44.137862 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8684c9d3-98ec-4b89-9018-0a8cf0e1438a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:44.138462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8684c9d3-98ec-4b89-9018-0a8cf0e1438a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:44.144272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0095bba1-38d0-43b9-b44f-d62f43f5a238 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:44.144726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0095bba1-38d0-43b9-b44f-d62f43f5a238 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:44.145284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8684c9d3-98ec-4b89-9018-0a8cf0e1438a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:44.145453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0095bba1-38d0-43b9-b44f-d62f43f5a238 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:44.145759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8684c9d3-98ec-4b89-9018-0a8cf0e1438a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:44.145915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0095bba1-38d0-43b9-b44f-d62f43f5a238 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:44.146501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8684c9d3-98ec-4b89-9018-0a8cf0e1438a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:44.146898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8684c9d3-98ec-4b89-9018-0a8cf0e1438a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:44.276112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0095bba1-38d0-43b9-b44f-d62f43f5a238 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:44.281471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8684c9d3-98ec-4b89-9018-0a8cf0e1438a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:44.284446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0095bba1-38d0-43b9-b44f-d62f43f5a238 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153696 Jul 26 18:50:44.285028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1624/3222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:44 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:44.289658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8684c9d3-98ec-4b89-9018-0a8cf0e1438a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156169 Jul 26 18:50:44.290213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1599/3223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:44 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:44.302708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e0e03150-6e03-498c-8ae9-db878f592013 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:44.303341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e0e03150-6e03-498c-8ae9-db878f592013 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:44.309621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0e03150-6e03-498c-8ae9-db878f592013 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:44.310069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0e03150-6e03-498c-8ae9-db878f592013 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:44.310820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0e03150-6e03-498c-8ae9-db878f592013 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:44.311282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0e03150-6e03-498c-8ae9-db878f592013 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:44.330301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-13ad1551-ae86-4757-a3da-932fd0a649e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:44.331139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-13ad1551-ae86-4757-a3da-932fd0a649e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:44.337421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13ad1551-ae86-4757-a3da-932fd0a649e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:44.337869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13ad1551-ae86-4757-a3da-932fd0a649e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:44.338666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13ad1551-ae86-4757-a3da-932fd0a649e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:44.339124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13ad1551-ae86-4757-a3da-932fd0a649e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:44.453401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e0e03150-6e03-498c-8ae9-db878f592013 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:44.461461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e0e03150-6e03-498c-8ae9-db878f592013 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162460 Jul 26 18:50:44.462233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1625/3224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:44 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:44.472118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-13ad1551-ae86-4757-a3da-932fd0a649e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:44.480847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-13ad1551-ae86-4757-a3da-932fd0a649e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:44.482361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-13ad1551-ae86-4757-a3da-932fd0a649e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:44.483548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-13ad1551-ae86-4757-a3da-932fd0a649e0 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157579 Jul 26 18:50:44.484106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1600/3225] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:44 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:44.606492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5ebd7968-6c75-4385-826f-0b2b92132901 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:44.607149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5ebd7968-6c75-4385-826f-0b2b92132901 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:44.614322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ebd7968-6c75-4385-826f-0b2b92132901 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:44.614778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ebd7968-6c75-4385-826f-0b2b92132901 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:44.615600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ebd7968-6c75-4385-826f-0b2b92132901 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:44.616034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ebd7968-6c75-4385-826f-0b2b92132901 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:44.753172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5ebd7968-6c75-4385-826f-0b2b92132901 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:44.761717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5ebd7968-6c75-4385-826f-0b2b92132901 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.159520 Jul 26 18:50:44.762291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1626/3226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:44 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:45.309159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ece95f79-860d-4192-aff0-74bf7a144c21 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:45.309792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ece95f79-860d-4192-aff0-74bf7a144c21 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:45.312611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-149ab301-2d86-466e-b6a0-745c778cd564 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:45.313289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-149ab301-2d86-466e-b6a0-745c778cd564 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:45.317455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ece95f79-860d-4192-aff0-74bf7a144c21 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:45.317957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ece95f79-860d-4192-aff0-74bf7a144c21 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:45.318801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ece95f79-860d-4192-aff0-74bf7a144c21 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:45.319284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ece95f79-860d-4192-aff0-74bf7a144c21 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:45.320763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-149ab301-2d86-466e-b6a0-745c778cd564 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:45.321295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-149ab301-2d86-466e-b6a0-745c778cd564 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:45.322133 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-149ab301-2d86-466e-b6a0-745c778cd564 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:45.322611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-149ab301-2d86-466e-b6a0-745c778cd564 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:45.451281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ece95f79-860d-4192-aff0-74bf7a144c21 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:45.457245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-149ab301-2d86-466e-b6a0-745c778cd564 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:45.459736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ece95f79-860d-4192-aff0-74bf7a144c21 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156428 Jul 26 18:50:45.465688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-149ab301-2d86-466e-b6a0-745c778cd564 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.157260 Jul 26 18:50:45.469378 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1601/3227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:45 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:45.469667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1627/3228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:45 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:45.483939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2a1e44e3-d334-4f6e-9349-110cb52a3c7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:45.484819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2a1e44e3-d334-4f6e-9349-110cb52a3c7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:45.491411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a1e44e3-d334-4f6e-9349-110cb52a3c7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:45.492038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a1e44e3-d334-4f6e-9349-110cb52a3c7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:45.493038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a1e44e3-d334-4f6e-9349-110cb52a3c7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:45.493507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2a1e44e3-d334-4f6e-9349-110cb52a3c7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:45.510384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f4f266bd-565d-4899-8230-1fe2f4ece53c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:45.511289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f4f266bd-565d-4899-8230-1fe2f4ece53c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:45.517427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4f266bd-565d-4899-8230-1fe2f4ece53c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:45.517915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4f266bd-565d-4899-8230-1fe2f4ece53c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:45.518679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4f266bd-565d-4899-8230-1fe2f4ece53c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:45.519147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4f266bd-565d-4899-8230-1fe2f4ece53c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:45.633853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2a1e44e3-d334-4f6e-9349-110cb52a3c7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:45.641968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2a1e44e3-d334-4f6e-9349-110cb52a3c7d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162049 Jul 26 18:50:45.642767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1602/3229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:45 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:45.649056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f4f266bd-565d-4899-8230-1fe2f4ece53c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:45.657877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f4f266bd-565d-4899-8230-1fe2f4ece53c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:45.659407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f4f266bd-565d-4899-8230-1fe2f4ece53c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:45.660592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f4f266bd-565d-4899-8230-1fe2f4ece53c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.154391 Jul 26 18:50:45.661147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1628/3230] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:45.788274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8e7245ed-6208-44f3-aa8e-b61845940376 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:45.789313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8e7245ed-6208-44f3-aa8e-b61845940376 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:45.799380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e7245ed-6208-44f3-aa8e-b61845940376 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:45.800120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e7245ed-6208-44f3-aa8e-b61845940376 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:45.801353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e7245ed-6208-44f3-aa8e-b61845940376 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:45.802061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e7245ed-6208-44f3-aa8e-b61845940376 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:45.941151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8e7245ed-6208-44f3-aa8e-b61845940376 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:45.949813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8e7245ed-6208-44f3-aa8e-b61845940376 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.168365 Jul 26 18:50:45.950729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1603/3231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:45 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:46.485672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1ab377e3-8688-4a29-9269-895cd11c5d9b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:46.486683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1ab377e3-8688-4a29-9269-895cd11c5d9b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:46.490865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-61b0d7db-8be2-4241-b114-b4ba4248f958 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:46.491901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-61b0d7db-8be2-4241-b114-b4ba4248f958 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:46.498229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ab377e3-8688-4a29-9269-895cd11c5d9b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:46.498944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ab377e3-8688-4a29-9269-895cd11c5d9b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:46.500367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ab377e3-8688-4a29-9269-895cd11c5d9b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:46.501043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ab377e3-8688-4a29-9269-895cd11c5d9b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:46.503103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-61b0d7db-8be2-4241-b114-b4ba4248f958 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:46.503872 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-61b0d7db-8be2-4241-b114-b4ba4248f958 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:46.505123 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-61b0d7db-8be2-4241-b114-b4ba4248f958 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:46.505854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-61b0d7db-8be2-4241-b114-b4ba4248f958 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:46.640978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1ab377e3-8688-4a29-9269-895cd11c5d9b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:46.642995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-61b0d7db-8be2-4241-b114-b4ba4248f958 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:46.649546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1ab377e3-8688-4a29-9269-895cd11c5d9b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.170691 Jul 26 18:50:46.650115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1629/3232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:46 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:46.651204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-61b0d7db-8be2-4241-b114-b4ba4248f958 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.166914 Jul 26 18:50:46.651734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1604/3233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:46 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:46.663306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d58b14a3-50eb-4130-9942-e7b42d556476 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:46.663913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d58b14a3-50eb-4130-9942-e7b42d556476 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:46.669924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d58b14a3-50eb-4130-9942-e7b42d556476 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:46.670370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d58b14a3-50eb-4130-9942-e7b42d556476 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:46.671154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d58b14a3-50eb-4130-9942-e7b42d556476 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:46.671590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d58b14a3-50eb-4130-9942-e7b42d556476 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:46.682092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5bcea089-8d72-41b5-b23e-fde92684b5eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:46.682721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5bcea089-8d72-41b5-b23e-fde92684b5eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:46.689000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5bcea089-8d72-41b5-b23e-fde92684b5eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:46.689421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5bcea089-8d72-41b5-b23e-fde92684b5eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:46.690216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5bcea089-8d72-41b5-b23e-fde92684b5eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:46.690638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5bcea089-8d72-41b5-b23e-fde92684b5eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:46.804241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d58b14a3-50eb-4130-9942-e7b42d556476 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:46.812542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d58b14a3-50eb-4130-9942-e7b42d556476 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152872 Jul 26 18:50:46.813361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1630/3234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:46 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:46.821833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5bcea089-8d72-41b5-b23e-fde92684b5eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:46.830615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5bcea089-8d72-41b5-b23e-fde92684b5eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:46.832141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5bcea089-8d72-41b5-b23e-fde92684b5eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:46.833334 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5bcea089-8d72-41b5-b23e-fde92684b5eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155061 Jul 26 18:50:46.833920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1605/3235] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:46.977262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e36c3707-a98c-4067-a485-8c35a532368c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:46.978278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e36c3707-a98c-4067-a485-8c35a532368c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:46.987819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e36c3707-a98c-4067-a485-8c35a532368c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:46.988266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e36c3707-a98c-4067-a485-8c35a532368c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:46.989027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e36c3707-a98c-4067-a485-8c35a532368c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:46.989745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e36c3707-a98c-4067-a485-8c35a532368c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:47.133385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e36c3707-a98c-4067-a485-8c35a532368c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:47.142043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e36c3707-a98c-4067-a485-8c35a532368c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.172701 Jul 26 18:50:47.142612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1631/3236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:46 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:47.671396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9dba583f-432e-40d1-9981-baa443a225d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:47.672010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9dba583f-432e-40d1-9981-baa443a225d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:47.672812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a7eba6c0-9c95-4ae8-93f8-684403c1de74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:47.673423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a7eba6c0-9c95-4ae8-93f8-684403c1de74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:47.679246 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9dba583f-432e-40d1-9981-baa443a225d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:47.679690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9dba583f-432e-40d1-9981-baa443a225d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:47.680285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7eba6c0-9c95-4ae8-93f8-684403c1de74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:47.680458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9dba583f-432e-40d1-9981-baa443a225d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:47.680742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7eba6c0-9c95-4ae8-93f8-684403c1de74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:47.680911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9dba583f-432e-40d1-9981-baa443a225d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:47.681501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7eba6c0-9c95-4ae8-93f8-684403c1de74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:47.681940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a7eba6c0-9c95-4ae8-93f8-684403c1de74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:47.819988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a7eba6c0-9c95-4ae8-93f8-684403c1de74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:47.823382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9dba583f-432e-40d1-9981-baa443a225d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:47.828721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a7eba6c0-9c95-4ae8-93f8-684403c1de74 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159763 Jul 26 18:50:47.829487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1632/3237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:47 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:47.831799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9dba583f-432e-40d1-9981-baa443a225d8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.164332 Jul 26 18:50:47.832256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1606/3238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:47 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:47.839369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c046d41f-bb84-4d6c-aaa2-2050651c257d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:47.840006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c046d41f-bb84-4d6c-aaa2-2050651c257d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:47.846019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c046d41f-bb84-4d6c-aaa2-2050651c257d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:47.846460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c046d41f-bb84-4d6c-aaa2-2050651c257d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:47.847241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c046d41f-bb84-4d6c-aaa2-2050651c257d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:47.847699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c046d41f-bb84-4d6c-aaa2-2050651c257d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:47.856746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2269061a-62de-463e-8c59-88fe8777406c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:47.857336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2269061a-62de-463e-8c59-88fe8777406c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:47.863328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2269061a-62de-463e-8c59-88fe8777406c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:47.863774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2269061a-62de-463e-8c59-88fe8777406c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:47.864502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2269061a-62de-463e-8c59-88fe8777406c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:47.864928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2269061a-62de-463e-8c59-88fe8777406c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:47.978152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c046d41f-bb84-4d6c-aaa2-2050651c257d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:47.986682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c046d41f-bb84-4d6c-aaa2-2050651c257d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156267 Jul 26 18:50:47.987559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1633/3239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:47 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:47.995293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2269061a-62de-463e-8c59-88fe8777406c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:48.003893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2269061a-62de-463e-8c59-88fe8777406c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:48.005448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2269061a-62de-463e-8c59-88fe8777406c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:48.006625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2269061a-62de-463e-8c59-88fe8777406c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.153963 Jul 26 18:50:48.007256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1607/3240] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:47 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:50:48.168496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-898d84a5-72e1-4713-9b29-fcf9ca7e54fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:48.169410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-898d84a5-72e1-4713-9b29-fcf9ca7e54fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:48.179762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-898d84a5-72e1-4713-9b29-fcf9ca7e54fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:48.180523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-898d84a5-72e1-4713-9b29-fcf9ca7e54fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:48.181930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-898d84a5-72e1-4713-9b29-fcf9ca7e54fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:48.182725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-898d84a5-72e1-4713-9b29-fcf9ca7e54fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:48.316341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-898d84a5-72e1-4713-9b29-fcf9ca7e54fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:48.328705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-898d84a5-72e1-4713-9b29-fcf9ca7e54fa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.166616 Jul 26 18:50:48.329471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1634/3241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:48 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:48.853846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7848ca2d-355c-4a5e-a8d8-f6d83ee04a7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:48.854785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7848ca2d-355c-4a5e-a8d8-f6d83ee04a7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:48.856638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9dadf0df-5ab1-4da6-b0ea-d81d809747bd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:48.857603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9dadf0df-5ab1-4da6-b0ea-d81d809747bd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:48.865693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7848ca2d-355c-4a5e-a8d8-f6d83ee04a7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:48.866428 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7848ca2d-355c-4a5e-a8d8-f6d83ee04a7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:48.867705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7848ca2d-355c-4a5e-a8d8-f6d83ee04a7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:48.868414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7848ca2d-355c-4a5e-a8d8-f6d83ee04a7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:48.868884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9dadf0df-5ab1-4da6-b0ea-d81d809747bd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:48.869630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9dadf0df-5ab1-4da6-b0ea-d81d809747bd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:48.871221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9dadf0df-5ab1-4da6-b0ea-d81d809747bd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:48.871651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9dadf0df-5ab1-4da6-b0ea-d81d809747bd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:49.014282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9dadf0df-5ab1-4da6-b0ea-d81d809747bd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:49.015124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7848ca2d-355c-4a5e-a8d8-f6d83ee04a7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:49.025723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7848ca2d-355c-4a5e-a8d8-f6d83ee04a7b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.178098 Jul 26 18:50:49.026470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1608/3242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:48 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:49.027817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9dadf0df-5ab1-4da6-b0ea-d81d809747bd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.177422 Jul 26 18:50:49.028531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1635/3243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:48 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:49.032200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-838ca789-3a44-40aa-ab56-202645f006f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:49.033169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-73cb8cde-e158-4ec2-8dc0-11a8bf98322f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:49.033757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-838ca789-3a44-40aa-ab56-202645f006f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:49.033964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-73cb8cde-e158-4ec2-8dc0-11a8bf98322f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:49.042380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73cb8cde-e158-4ec2-8dc0-11a8bf98322f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:49.042855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73cb8cde-e158-4ec2-8dc0-11a8bf98322f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:49.043838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73cb8cde-e158-4ec2-8dc0-11a8bf98322f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:49.044278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73cb8cde-e158-4ec2-8dc0-11a8bf98322f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:49.045049 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-838ca789-3a44-40aa-ab56-202645f006f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:49.045587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-838ca789-3a44-40aa-ab56-202645f006f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:49.046412 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-838ca789-3a44-40aa-ab56-202645f006f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:49.046876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-838ca789-3a44-40aa-ab56-202645f006f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:49.184675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-73cb8cde-e158-4ec2-8dc0-11a8bf98322f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:49.185968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-838ca789-3a44-40aa-ab56-202645f006f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:49.193836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-838ca789-3a44-40aa-ab56-202645f006f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.166325 Jul 26 18:50:49.194007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-73cb8cde-e158-4ec2-8dc0-11a8bf98322f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:49.194324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1609/3244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:49 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:49.195628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-73cb8cde-e158-4ec2-8dc0-11a8bf98322f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:49.196861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-73cb8cde-e158-4ec2-8dc0-11a8bf98322f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.167474 Jul 26 18:50:49.197383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1636/3245] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:49 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:49.359066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-087c63dc-a7be-4dcb-9175-11175bca8045 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:49.360094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-087c63dc-a7be-4dcb-9175-11175bca8045 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:49.370429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-087c63dc-a7be-4dcb-9175-11175bca8045 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:49.371402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-087c63dc-a7be-4dcb-9175-11175bca8045 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:49.372455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-087c63dc-a7be-4dcb-9175-11175bca8045 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:49.373254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-087c63dc-a7be-4dcb-9175-11175bca8045 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:49.512355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-087c63dc-a7be-4dcb-9175-11175bca8045 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:49.520391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-087c63dc-a7be-4dcb-9175-11175bca8045 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.167857 Jul 26 18:50:49.520950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1610/3246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:49 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:50.048116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-430717b4-5605-4f6a-adc1-63654c0acc5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:50.048692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-430717b4-5605-4f6a-adc1-63654c0acc5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:50.053928 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b7372a5a-042a-44e8-b8b4-fcb7723df75d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:50.054536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b7372a5a-042a-44e8-b8b4-fcb7723df75d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:50.055969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-430717b4-5605-4f6a-adc1-63654c0acc5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:50.056416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-430717b4-5605-4f6a-adc1-63654c0acc5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:50.057173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-430717b4-5605-4f6a-adc1-63654c0acc5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:50.057604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-430717b4-5605-4f6a-adc1-63654c0acc5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:50.061199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7372a5a-042a-44e8-b8b4-fcb7723df75d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:50.061708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7372a5a-042a-44e8-b8b4-fcb7723df75d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:50.062588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7372a5a-042a-44e8-b8b4-fcb7723df75d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:50.063041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b7372a5a-042a-44e8-b8b4-fcb7723df75d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:50.191917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-430717b4-5605-4f6a-adc1-63654c0acc5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:50.197445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b7372a5a-042a-44e8-b8b4-fcb7723df75d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:50.200042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-430717b4-5605-4f6a-adc1-63654c0acc5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155943 Jul 26 18:50:50.201117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1637/3247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:50 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:50.205615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b7372a5a-042a-44e8-b8b4-fcb7723df75d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155604 Jul 26 18:50:50.206178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1611/3248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:50 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:50.218370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d380b150-977a-4f75-ae45-0a212f8cf8c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:50.218985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d380b150-977a-4f75-ae45-0a212f8cf8c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:50.219805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b8cba340-098f-4d3c-8d6a-e51f7fd4c43a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:50.220401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b8cba340-098f-4d3c-8d6a-e51f7fd4c43a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:50.221903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:50.225944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d380b150-977a-4f75-ae45-0a212f8cf8c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:50.226449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d380b150-977a-4f75-ae45-0a212f8cf8c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:50.226604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b8cba340-098f-4d3c-8d6a-e51f7fd4c43a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:50.226930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b8cba340-098f-4d3c-8d6a-e51f7fd4c43a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:50.227298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d380b150-977a-4f75-ae45-0a212f8cf8c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:50.227696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b8cba340-098f-4d3c-8d6a-e51f7fd4c43a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:50.227812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d380b150-977a-4f75-ae45-0a212f8cf8c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:50.228156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b8cba340-098f-4d3c-8d6a-e51f7fd4c43a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:50.356192 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b8cba340-098f-4d3c-8d6a-e51f7fd4c43a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:50.360914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d380b150-977a-4f75-ae45-0a212f8cf8c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:50.365355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b8cba340-098f-4d3c-8d6a-e51f7fd4c43a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:50.366877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b8cba340-098f-4d3c-8d6a-e51f7fd4c43a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:50.368072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b8cba340-098f-4d3c-8d6a-e51f7fd4c43a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.152008 Jul 26 18:50:50.368641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1612/3249] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:50 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:50.369060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d380b150-977a-4f75-ae45-0a212f8cf8c7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155341 Jul 26 18:50:50.369622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1638/3250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:50 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:50.546366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-13fd181d-856b-46a9-8a45-def4fe1d8fdb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:50.547441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-13fd181d-856b-46a9-8a45-def4fe1d8fdb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:50.557722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13fd181d-856b-46a9-8a45-def4fe1d8fdb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:50.558368 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13fd181d-856b-46a9-8a45-def4fe1d8fdb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:50.559435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13fd181d-856b-46a9-8a45-def4fe1d8fdb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:50.559876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-13fd181d-856b-46a9-8a45-def4fe1d8fdb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:50.562399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:50.693809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-13fd181d-856b-46a9-8a45-def4fe1d8fdb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:50.702411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-13fd181d-856b-46a9-8a45-def4fe1d8fdb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.162274 Jul 26 18:50:50.702987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1613/3251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:50 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:51.229969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-75f052e2-cc71-47d6-b638-2c8a203cce40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:51.230957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-75f052e2-cc71-47d6-b638-2c8a203cce40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:51.233963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-58ef88cd-9bf9-41fe-aa04-ff51452654e0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:51.234948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-58ef88cd-9bf9-41fe-aa04-ff51452654e0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:51.242246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75f052e2-cc71-47d6-b638-2c8a203cce40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:51.242995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75f052e2-cc71-47d6-b638-2c8a203cce40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:51.244328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75f052e2-cc71-47d6-b638-2c8a203cce40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:51.245088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75f052e2-cc71-47d6-b638-2c8a203cce40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:51.245714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58ef88cd-9bf9-41fe-aa04-ff51452654e0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:51.246508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58ef88cd-9bf9-41fe-aa04-ff51452654e0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:51.247401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58ef88cd-9bf9-41fe-aa04-ff51452654e0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:51.247835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58ef88cd-9bf9-41fe-aa04-ff51452654e0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:51.248476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:51.377219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-58ef88cd-9bf9-41fe-aa04-ff51452654e0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:51.380142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-75f052e2-cc71-47d6-b638-2c8a203cce40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:51.385886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-58ef88cd-9bf9-41fe-aa04-ff51452654e0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.159316 Jul 26 18:50:51.386780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1614/3252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:51 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:51.389150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-75f052e2-cc71-47d6-b638-2c8a203cce40 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.166044 Jul 26 18:50:51.389928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1639/3253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:51 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:51.394383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-39b5abf5-582a-40f6-98dc-e41ff2701e72 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:51.395095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-39b5abf5-582a-40f6-98dc-e41ff2701e72 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:51.401450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39b5abf5-582a-40f6-98dc-e41ff2701e72 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:51.401973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39b5abf5-582a-40f6-98dc-e41ff2701e72 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:51.402815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39b5abf5-582a-40f6-98dc-e41ff2701e72 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:51.403334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39b5abf5-582a-40f6-98dc-e41ff2701e72 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:51.404457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6ccce05d-4850-48e3-ac1b-0fb680972e2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:51.405070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6ccce05d-4850-48e3-ac1b-0fb680972e2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:51.407133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:51.413143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ccce05d-4850-48e3-ac1b-0fb680972e2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:51.413699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ccce05d-4850-48e3-ac1b-0fb680972e2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:51.415051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ccce05d-4850-48e3-ac1b-0fb680972e2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:51.415669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ccce05d-4850-48e3-ac1b-0fb680972e2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:51.534168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-39b5abf5-582a-40f6-98dc-e41ff2701e72 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:51.542640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-39b5abf5-582a-40f6-98dc-e41ff2701e72 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:51.542831 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6ccce05d-4850-48e3-ac1b-0fb680972e2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:51.544242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-39b5abf5-582a-40f6-98dc-e41ff2701e72 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:51.545418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-39b5abf5-582a-40f6-98dc-e41ff2701e72 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.154602 Jul 26 18:50:51.546263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1640/3254] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:51.551242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6ccce05d-4850-48e3-ac1b-0fb680972e2f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163547 Jul 26 18:50:51.551795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1615/3255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:51 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:51.729462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2b0bec3d-eed2-490a-ad4a-4244eecb9959 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:51.730480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2b0bec3d-eed2-490a-ad4a-4244eecb9959 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:51.737869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b0bec3d-eed2-490a-ad4a-4244eecb9959 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:51.738296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b0bec3d-eed2-490a-ad4a-4244eecb9959 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:51.739169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b0bec3d-eed2-490a-ad4a-4244eecb9959 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:51.739653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b0bec3d-eed2-490a-ad4a-4244eecb9959 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:51.879546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2b0bec3d-eed2-490a-ad4a-4244eecb9959 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:51.887746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2b0bec3d-eed2-490a-ad4a-4244eecb9959 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.164723 Jul 26 18:50:51.888277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1641/3256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:51 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:52.411893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6fb4a9ef-15ca-478f-ad3e-e350e639a087 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:52.412851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6fb4a9ef-15ca-478f-ad3e-e350e639a087 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:52.413420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cabfd60b-5092-4546-898c-21b188b45e09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:52.414422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cabfd60b-5092-4546-898c-21b188b45e09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:52.421889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6fb4a9ef-15ca-478f-ad3e-e350e639a087 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:52.422330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6fb4a9ef-15ca-478f-ad3e-e350e639a087 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:52.422732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cabfd60b-5092-4546-898c-21b188b45e09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:52.423083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6fb4a9ef-15ca-478f-ad3e-e350e639a087 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:52.423270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cabfd60b-5092-4546-898c-21b188b45e09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:52.423539 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6fb4a9ef-15ca-478f-ad3e-e350e639a087 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:52.423997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cabfd60b-5092-4546-898c-21b188b45e09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:52.424432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cabfd60b-5092-4546-898c-21b188b45e09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:52.556661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cabfd60b-5092-4546-898c-21b188b45e09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:52.565092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cabfd60b-5092-4546-898c-21b188b45e09 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.157961 Jul 26 18:50:52.565710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1642/3257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:52 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:52.571891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-eb7447d2-b777-43bc-921f-7c5e8a560e93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:52.572497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-eb7447d2-b777-43bc-921f-7c5e8a560e93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:52.578859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb7447d2-b777-43bc-921f-7c5e8a560e93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:52.579334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb7447d2-b777-43bc-921f-7c5e8a560e93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:52.580110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb7447d2-b777-43bc-921f-7c5e8a560e93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:52.580537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb7447d2-b777-43bc-921f-7c5e8a560e93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:52.714472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-eb7447d2-b777-43bc-921f-7c5e8a560e93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:52.723373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-eb7447d2-b777-43bc-921f-7c5e8a560e93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:52.724971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-eb7447d2-b777-43bc-921f-7c5e8a560e93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:52.726210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-eb7447d2-b777-43bc-921f-7c5e8a560e93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158087 Jul 26 18:50:52.726760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1643/3258] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:52.731210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cd008abc-7f44-4ce1-b855-2d441a0e3f26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:52.731806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cd008abc-7f44-4ce1-b855-2d441a0e3f26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:52.738105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd008abc-7f44-4ce1-b855-2d441a0e3f26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:52.738554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd008abc-7f44-4ce1-b855-2d441a0e3f26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:52.739333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd008abc-7f44-4ce1-b855-2d441a0e3f26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:52.739763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd008abc-7f44-4ce1-b855-2d441a0e3f26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:52.791450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6fb4a9ef-15ca-478f-ad3e-e350e639a087 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:52.799783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6fb4a9ef-15ca-478f-ad3e-e350e639a087 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.394765 Jul 26 18:50:52.800370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1616/3259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:52 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:52.877588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cd008abc-7f44-4ce1-b855-2d441a0e3f26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:52.889071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cd008abc-7f44-4ce1-b855-2d441a0e3f26 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.161342 Jul 26 18:50:52.889640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1644/3260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:52 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:52.909360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c02176cf-8676-44f1-9136-6f8d779d3c55 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:52.910031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c02176cf-8676-44f1-9136-6f8d779d3c55 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:52.916252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c02176cf-8676-44f1-9136-6f8d779d3c55 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:52.916690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c02176cf-8676-44f1-9136-6f8d779d3c55 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:52.917438 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c02176cf-8676-44f1-9136-6f8d779d3c55 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:52.917860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c02176cf-8676-44f1-9136-6f8d779d3c55 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:53.060503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c02176cf-8676-44f1-9136-6f8d779d3c55 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:53.073232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c02176cf-8676-44f1-9136-6f8d779d3c55 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.167457 Jul 26 18:50:53.073982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1617/3261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:52 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:53.590897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ff3a1948-d865-46d5-908d-0f5627c2f609 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:53.591950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ff3a1948-d865-46d5-908d-0f5627c2f609 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:53.602977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff3a1948-d865-46d5-908d-0f5627c2f609 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:53.603779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff3a1948-d865-46d5-908d-0f5627c2f609 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:53.605049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff3a1948-d865-46d5-908d-0f5627c2f609 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:53.605785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff3a1948-d865-46d5-908d-0f5627c2f609 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:53.749240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ff3a1948-d865-46d5-908d-0f5627c2f609 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:53.750318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dac2b9a1-5294-4ac7-90c4-680efbe4fb81 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:53.750927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dac2b9a1-5294-4ac7-90c4-680efbe4fb81 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:53.757498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ff3a1948-d865-46d5-908d-0f5627c2f609 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.173224 Jul 26 18:50:53.757830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dac2b9a1-5294-4ac7-90c4-680efbe4fb81 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:53.758443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1645/3262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:53 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:53.758647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dac2b9a1-5294-4ac7-90c4-680efbe4fb81 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:53.759266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dac2b9a1-5294-4ac7-90c4-680efbe4fb81 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:53.759706 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dac2b9a1-5294-4ac7-90c4-680efbe4fb81 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:53.820289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-650da7c9-4116-41f6-8f02-5b28b0d95573 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:53.820898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-650da7c9-4116-41f6-8f02-5b28b0d95573 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:53.827176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-650da7c9-4116-41f6-8f02-5b28b0d95573 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:53.827631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-650da7c9-4116-41f6-8f02-5b28b0d95573 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:53.828391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-650da7c9-4116-41f6-8f02-5b28b0d95573 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:53.828852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-650da7c9-4116-41f6-8f02-5b28b0d95573 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:53.895232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dac2b9a1-5294-4ac7-90c4-680efbe4fb81 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:53.904349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dac2b9a1-5294-4ac7-90c4-680efbe4fb81 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:53.905863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dac2b9a1-5294-4ac7-90c4-680efbe4fb81 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:53.907053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dac2b9a1-5294-4ac7-90c4-680efbe4fb81 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160989 Jul 26 18:50:53.907620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1618/3263] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:53.911902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3d376213-2113-4feb-9cd6-1ffe92c8230a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:53.912509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3d376213-2113-4feb-9cd6-1ffe92c8230a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:53.918626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d376213-2113-4feb-9cd6-1ffe92c8230a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:53.919112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d376213-2113-4feb-9cd6-1ffe92c8230a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:53.919870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d376213-2113-4feb-9cd6-1ffe92c8230a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:53.921229 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3d376213-2113-4feb-9cd6-1ffe92c8230a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:53.973062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-650da7c9-4116-41f6-8f02-5b28b0d95573 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:53.981198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-650da7c9-4116-41f6-8f02-5b28b0d95573 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.164839 Jul 26 18:50:53.981988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1646/3264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:53 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:50:54.050515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3d376213-2113-4feb-9cd6-1ffe92c8230a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:54.058937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3d376213-2113-4feb-9cd6-1ffe92c8230a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.150283 Jul 26 18:50:54.059546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1619/3265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:53 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:54.095911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a3a6fd2e-01d9-4c5f-9fca-89cbd958d998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:54.096450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a3a6fd2e-01d9-4c5f-9fca-89cbd958d998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:54.103937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3a6fd2e-01d9-4c5f-9fca-89cbd958d998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:54.104422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3a6fd2e-01d9-4c5f-9fca-89cbd958d998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:54.105191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3a6fd2e-01d9-4c5f-9fca-89cbd958d998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:54.105624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3a6fd2e-01d9-4c5f-9fca-89cbd958d998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:54.239060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a3a6fd2e-01d9-4c5f-9fca-89cbd958d998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:54.250538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a3a6fd2e-01d9-4c5f-9fca-89cbd958d998 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158660 Jul 26 18:50:54.251139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1647/3266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:54 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:54.780648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9d7a786a-addd-44fe-b192-7381dbcbd081 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:54.781227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9d7a786a-addd-44fe-b192-7381dbcbd081 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:54.788322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d7a786a-addd-44fe-b192-7381dbcbd081 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:54.788763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d7a786a-addd-44fe-b192-7381dbcbd081 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:54.789525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d7a786a-addd-44fe-b192-7381dbcbd081 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:54.789950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d7a786a-addd-44fe-b192-7381dbcbd081 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:54.930344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-640cdd2e-2b5e-4276-a8d8-dc91886565de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:54.930963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-640cdd2e-2b5e-4276-a8d8-dc91886565de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:54.937208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9d7a786a-addd-44fe-b192-7381dbcbd081 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:54.938160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-640cdd2e-2b5e-4276-a8d8-dc91886565de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:54.938640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-640cdd2e-2b5e-4276-a8d8-dc91886565de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:54.939436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-640cdd2e-2b5e-4276-a8d8-dc91886565de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:54.939863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-640cdd2e-2b5e-4276-a8d8-dc91886565de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:54.945645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9d7a786a-addd-44fe-b192-7381dbcbd081 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.169558 Jul 26 18:50:54.946652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1620/3267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:55.002439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6bfe65b9-5699-49df-ae97-62a6eb84abf3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:55.002939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6bfe65b9-5699-49df-ae97-62a6eb84abf3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:55.009387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6bfe65b9-5699-49df-ae97-62a6eb84abf3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:55.009811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6bfe65b9-5699-49df-ae97-62a6eb84abf3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:55.010598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6bfe65b9-5699-49df-ae97-62a6eb84abf3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:55.010992 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6bfe65b9-5699-49df-ae97-62a6eb84abf3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:55.091751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-640cdd2e-2b5e-4276-a8d8-dc91886565de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:55.100467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-640cdd2e-2b5e-4276-a8d8-dc91886565de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:55.101984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-640cdd2e-2b5e-4276-a8d8-dc91886565de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:55.103165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-640cdd2e-2b5e-4276-a8d8-dc91886565de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.177072 Jul 26 18:50:55.103724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1648/3268] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:54 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:55.108534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-34e71dfd-4950-4e81-810d-70a4b62065a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:55.109126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-34e71dfd-4950-4e81-810d-70a4b62065a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:55.116693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34e71dfd-4950-4e81-810d-70a4b62065a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:55.117137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34e71dfd-4950-4e81-810d-70a4b62065a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:55.117901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34e71dfd-4950-4e81-810d-70a4b62065a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:55.118332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34e71dfd-4950-4e81-810d-70a4b62065a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:55.145910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6bfe65b9-5699-49df-ae97-62a6eb84abf3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:55.155344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6bfe65b9-5699-49df-ae97-62a6eb84abf3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156766 Jul 26 18:50:55.155936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1621/3269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:54 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:55.272831 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8c770acb-062b-454f-8124-c60046994cc8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:55.273537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8c770acb-062b-454f-8124-c60046994cc8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:55.281688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c770acb-062b-454f-8124-c60046994cc8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:55.282455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c770acb-062b-454f-8124-c60046994cc8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:55.283421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c770acb-062b-454f-8124-c60046994cc8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:55.283858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8c770acb-062b-454f-8124-c60046994cc8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:55.429308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8c770acb-062b-454f-8124-c60046994cc8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:55.437563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8c770acb-062b-454f-8124-c60046994cc8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.169050 Jul 26 18:50:55.438151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1622/3270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:55 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:55.481130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-34e71dfd-4950-4e81-810d-70a4b62065a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:55.489734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-34e71dfd-4950-4e81-810d-70a4b62065a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.384837 Jul 26 18:50:55.490456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1649/3271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:55 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:56.040362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-79d6c99b-3d05-404a-9b14-40b75a23f695 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:56.040967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-79d6c99b-3d05-404a-9b14-40b75a23f695 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:56.047055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79d6c99b-3d05-404a-9b14-40b75a23f695 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:56.047512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79d6c99b-3d05-404a-9b14-40b75a23f695 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:56.048252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79d6c99b-3d05-404a-9b14-40b75a23f695 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:56.048677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-79d6c99b-3d05-404a-9b14-40b75a23f695 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:56.129131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8b1ac459-c4b9-408a-8638-af21365f0936 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:56.129692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8b1ac459-c4b9-408a-8638-af21365f0936 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:56.136551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b1ac459-c4b9-408a-8638-af21365f0936 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:56.137054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b1ac459-c4b9-408a-8638-af21365f0936 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:56.137790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b1ac459-c4b9-408a-8638-af21365f0936 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:56.138224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b1ac459-c4b9-408a-8638-af21365f0936 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:56.184260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-79d6c99b-3d05-404a-9b14-40b75a23f695 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:56.192608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-79d6c99b-3d05-404a-9b14-40b75a23f695 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.226137 Jul 26 18:50:56.193251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1623/3272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:55 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:56.197630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f9d2251b-743c-49df-90e6-8911335fab92 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:56.198221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f9d2251b-743c-49df-90e6-8911335fab92 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:56.204122 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9d2251b-743c-49df-90e6-8911335fab92 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:56.204571 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9d2251b-743c-49df-90e6-8911335fab92 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:56.205330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9d2251b-743c-49df-90e6-8911335fab92 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:56.205758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9d2251b-743c-49df-90e6-8911335fab92 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:56.269168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8b1ac459-c4b9-408a-8638-af21365f0936 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:56.278519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8b1ac459-c4b9-408a-8638-af21365f0936 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:56.280062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8b1ac459-c4b9-408a-8638-af21365f0936 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:56.281224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8b1ac459-c4b9-408a-8638-af21365f0936 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155995 Jul 26 18:50:56.281754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1650/3273] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:56 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:56.332189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f9d2251b-743c-49df-90e6-8911335fab92 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:56.340305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f9d2251b-743c-49df-90e6-8911335fab92 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.146097 Jul 26 18:50:56.340881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1624/3274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:56 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:56.463470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bb2ddef3-d1e9-4465-9f0f-7b787e55eb74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:56.464469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bb2ddef3-d1e9-4465-9f0f-7b787e55eb74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:56.471305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb2ddef3-d1e9-4465-9f0f-7b787e55eb74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:56.471782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb2ddef3-d1e9-4465-9f0f-7b787e55eb74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:56.472531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb2ddef3-d1e9-4465-9f0f-7b787e55eb74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:56.472955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb2ddef3-d1e9-4465-9f0f-7b787e55eb74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:56.512390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3aaea01b-f5a2-49db-853c-ffb916a72ccb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:56.512993 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3aaea01b-f5a2-49db-853c-ffb916a72ccb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:56.519545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3aaea01b-f5a2-49db-853c-ffb916a72ccb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:56.519927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3aaea01b-f5a2-49db-853c-ffb916a72ccb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:56.520686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3aaea01b-f5a2-49db-853c-ffb916a72ccb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:56.521151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3aaea01b-f5a2-49db-853c-ffb916a72ccb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:56.605220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bb2ddef3-d1e9-4465-9f0f-7b787e55eb74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:56.613855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bb2ddef3-d1e9-4465-9f0f-7b787e55eb74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156790 Jul 26 18:50:56.614478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1651/3275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:56 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:56.653870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3aaea01b-f5a2-49db-853c-ffb916a72ccb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:56.662216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3aaea01b-f5a2-49db-853c-ffb916a72ccb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.153780 Jul 26 18:50:56.662783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1625/3276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:56 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:57.214617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ff38fca8-243e-43d2-aca6-9d9c5b141969 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:57.215362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ff38fca8-243e-43d2-aca6-9d9c5b141969 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:57.222177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff38fca8-243e-43d2-aca6-9d9c5b141969 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:57.222625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff38fca8-243e-43d2-aca6-9d9c5b141969 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:57.223397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff38fca8-243e-43d2-aca6-9d9c5b141969 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:57.223832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff38fca8-243e-43d2-aca6-9d9c5b141969 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:57.304736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5ab0c263-e908-4c79-b1da-4e1b70fa7970 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:57.305445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5ab0c263-e908-4c79-b1da-4e1b70fa7970 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:57.313483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ab0c263-e908-4c79-b1da-4e1b70fa7970 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:57.313930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ab0c263-e908-4c79-b1da-4e1b70fa7970 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:57.314718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ab0c263-e908-4c79-b1da-4e1b70fa7970 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:57.315187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5ab0c263-e908-4c79-b1da-4e1b70fa7970 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:57.356850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ff38fca8-243e-43d2-aca6-9d9c5b141969 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:57.365063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ff38fca8-243e-43d2-aca6-9d9c5b141969 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154913 Jul 26 18:50:57.365646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1652/3277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:57 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:57.370057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-07ce257d-06e4-4cfd-bdd3-2b56d8fc7ccd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:57.370627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-07ce257d-06e4-4cfd-bdd3-2b56d8fc7ccd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:57.376810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07ce257d-06e4-4cfd-bdd3-2b56d8fc7ccd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:57.377242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07ce257d-06e4-4cfd-bdd3-2b56d8fc7ccd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:57.378022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07ce257d-06e4-4cfd-bdd3-2b56d8fc7ccd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:57.378459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07ce257d-06e4-4cfd-bdd3-2b56d8fc7ccd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:57.445874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5ab0c263-e908-4c79-b1da-4e1b70fa7970 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:57.454349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5ab0c263-e908-4c79-b1da-4e1b70fa7970 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:57.455881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5ab0c263-e908-4c79-b1da-4e1b70fa7970 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:57.457042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5ab0c263-e908-4c79-b1da-4e1b70fa7970 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156424 Jul 26 18:50:57.457633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1626/3278] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:57 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:57.509071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-07ce257d-06e4-4cfd-bdd3-2b56d8fc7ccd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:57.517670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-07ce257d-06e4-4cfd-bdd3-2b56d8fc7ccd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151084 Jul 26 18:50:57.518230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1653/3279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:57 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:57.638823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d24060fb-b92d-41f1-840a-e26973420182 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:57.639865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d24060fb-b92d-41f1-840a-e26973420182 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:57.650221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d24060fb-b92d-41f1-840a-e26973420182 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:57.650979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d24060fb-b92d-41f1-840a-e26973420182 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:57.652273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d24060fb-b92d-41f1-840a-e26973420182 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:57.652998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d24060fb-b92d-41f1-840a-e26973420182 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:57.683646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5a526f06-22ec-4346-bc3d-23c56420dd39 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:57.684261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5a526f06-22ec-4346-bc3d-23c56420dd39 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:57.690668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a526f06-22ec-4346-bc3d-23c56420dd39 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:57.691157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a526f06-22ec-4346-bc3d-23c56420dd39 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:57.691924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a526f06-22ec-4346-bc3d-23c56420dd39 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:57.692366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5a526f06-22ec-4346-bc3d-23c56420dd39 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:57.793103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d24060fb-b92d-41f1-840a-e26973420182 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:57.801282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d24060fb-b92d-41f1-840a-e26973420182 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.169068 Jul 26 18:50:57.802061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1627/3280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:57 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:57.822166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5a526f06-22ec-4346-bc3d-23c56420dd39 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:57.830201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5a526f06-22ec-4346-bc3d-23c56420dd39 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.150429 Jul 26 18:50:57.830767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1654/3281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:57 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:58.390348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9e1a3b3a-34be-4de5-a58c-63d21e3dffcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:58.391403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9e1a3b3a-34be-4de5-a58c-63d21e3dffcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:58.402699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e1a3b3a-34be-4de5-a58c-63d21e3dffcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:58.403497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e1a3b3a-34be-4de5-a58c-63d21e3dffcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:58.404744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e1a3b3a-34be-4de5-a58c-63d21e3dffcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:58.405461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e1a3b3a-34be-4de5-a58c-63d21e3dffcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:58.480183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b0db429b-3662-44af-b889-c5abb51d2286 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:58.480886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b0db429b-3662-44af-b889-c5abb51d2286 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:58.487470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0db429b-3662-44af-b889-c5abb51d2286 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:58.487919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0db429b-3662-44af-b889-c5abb51d2286 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:58.488679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0db429b-3662-44af-b889-c5abb51d2286 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:58.489110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0db429b-3662-44af-b889-c5abb51d2286 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:58.546054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9e1a3b3a-34be-4de5-a58c-63d21e3dffcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:58.554100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9e1a3b3a-34be-4de5-a58c-63d21e3dffcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.170209 Jul 26 18:50:58.554667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1628/3282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:58 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:58.559142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-49a3fb3f-0f49-499c-9155-d535743bca36 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:58.559733 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-49a3fb3f-0f49-499c-9155-d535743bca36 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:58.565518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49a3fb3f-0f49-499c-9155-d535743bca36 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:58.565962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49a3fb3f-0f49-499c-9155-d535743bca36 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:58.566701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49a3fb3f-0f49-499c-9155-d535743bca36 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:58.567164 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-49a3fb3f-0f49-499c-9155-d535743bca36 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:58.631664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b0db429b-3662-44af-b889-c5abb51d2286 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:58.633895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:58.641930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b0db429b-3662-44af-b889-c5abb51d2286 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:58.643451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b0db429b-3662-44af-b889-c5abb51d2286 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:58.644611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b0db429b-3662-44af-b889-c5abb51d2286 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.168499 Jul 26 18:50:58.645184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1655/3283] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:58.698884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-49a3fb3f-0f49-499c-9155-d535743bca36 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:58.701700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:50:58.711010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-49a3fb3f-0f49-499c-9155-d535743bca36 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155043 Jul 26 18:50:58.711769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1629/3284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:58 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:58.823556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-79c066bd-d458-4806-a145-6894ac5a3792 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:58.824167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-79c066bd-d458-4806-a145-6894ac5a3792 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:58.830705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79c066bd-d458-4806-a145-6894ac5a3792 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:58.831174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79c066bd-d458-4806-a145-6894ac5a3792 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:58.831927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79c066bd-d458-4806-a145-6894ac5a3792 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:58.832356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-79c066bd-d458-4806-a145-6894ac5a3792 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:58.851836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a19a78ba-848e-40c7-8819-107cf482df32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:58.852443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a19a78ba-848e-40c7-8819-107cf482df32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:58.858821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a19a78ba-848e-40c7-8819-107cf482df32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:58.859295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a19a78ba-848e-40c7-8819-107cf482df32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:58.860086 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a19a78ba-848e-40c7-8819-107cf482df32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:58.860578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a19a78ba-848e-40c7-8819-107cf482df32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:58.968438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-79c066bd-d458-4806-a145-6894ac5a3792 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:58.977075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-79c066bd-d458-4806-a145-6894ac5a3792 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157612 Jul 26 18:50:58.977642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1656/3285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:58 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:58.996578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a19a78ba-848e-40c7-8819-107cf482df32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:59.005175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a19a78ba-848e-40c7-8819-107cf482df32 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157176 Jul 26 18:50:59.005679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1630/3286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:58 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:59.579697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1e4bc049-fd16-426f-a6dc-df8b466ee3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:59.580572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1e4bc049-fd16-426f-a6dc-df8b466ee3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:59.591136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1e4bc049-fd16-426f-a6dc-df8b466ee3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:59.591589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1e4bc049-fd16-426f-a6dc-df8b466ee3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:59.592347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1e4bc049-fd16-426f-a6dc-df8b466ee3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:59.592779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1e4bc049-fd16-426f-a6dc-df8b466ee3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:59.667590 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d2b5ca9c-1fd9-4633-b681-2e2debfd3549 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:59.668250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d2b5ca9c-1fd9-4633-b681-2e2debfd3549 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:59.675274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2b5ca9c-1fd9-4633-b681-2e2debfd3549 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:59.675718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2b5ca9c-1fd9-4633-b681-2e2debfd3549 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:59.676594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2b5ca9c-1fd9-4633-b681-2e2debfd3549 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:59.677021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2b5ca9c-1fd9-4633-b681-2e2debfd3549 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:59.731850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1e4bc049-fd16-426f-a6dc-df8b466ee3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:59.740061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1e4bc049-fd16-426f-a6dc-df8b466ee3d8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.167024 Jul 26 18:50:59.740869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1657/3287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:59 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:50:59.745065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8cab5a42-a7d5-40c0-a3e2-62c2fac953b4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:50:59.745864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8cab5a42-a7d5-40c0-a3e2-62c2fac953b4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:50:59.751898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8cab5a42-a7d5-40c0-a3e2-62c2fac953b4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:59.752343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8cab5a42-a7d5-40c0-a3e2-62c2fac953b4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:59.753104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8cab5a42-a7d5-40c0-a3e2-62c2fac953b4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:50:59.753536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8cab5a42-a7d5-40c0-a3e2-62c2fac953b4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:50:59.808375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d2b5ca9c-1fd9-4633-b681-2e2debfd3549 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:59.817030 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d2b5ca9c-1fd9-4633-b681-2e2debfd3549 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:59.818531 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d2b5ca9c-1fd9-4633-b681-2e2debfd3549 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:59.819709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d2b5ca9c-1fd9-4633-b681-2e2debfd3549 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156099 Jul 26 18:50:59.820409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1631/3288] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:50:59 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:50:59.886977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8cab5a42-a7d5-40c0-a3e2-62c2fac953b4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:50:59.894955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8cab5a42-a7d5-40c0-a3e2-62c2fac953b4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153357 Jul 26 18:50:59.895549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1658/3289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:59 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:00.001519 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3ee67a3a-a9fb-4b76-a43b-366b64f6baec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:00.002291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3ee67a3a-a9fb-4b76-a43b-366b64f6baec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:00.010377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ee67a3a-a9fb-4b76-a43b-366b64f6baec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:00.010937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ee67a3a-a9fb-4b76-a43b-366b64f6baec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:00.011908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ee67a3a-a9fb-4b76-a43b-366b64f6baec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:00.012566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ee67a3a-a9fb-4b76-a43b-366b64f6baec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:00.083535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e8030045-bbd1-402f-85ad-f6cc88fd9ff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:00.084044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e8030045-bbd1-402f-85ad-f6cc88fd9ff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:00.090517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8030045-bbd1-402f-85ad-f6cc88fd9ff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:00.090967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8030045-bbd1-402f-85ad-f6cc88fd9ff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:00.091762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8030045-bbd1-402f-85ad-f6cc88fd9ff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:00.092260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8030045-bbd1-402f-85ad-f6cc88fd9ff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:00.150074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3ee67a3a-a9fb-4b76-a43b-366b64f6baec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:00.158140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3ee67a3a-a9fb-4b76-a43b-366b64f6baec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161351 Jul 26 18:51:00.158922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1632/3290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:50:59 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:00.224724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e8030045-bbd1-402f-85ad-f6cc88fd9ff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:00.233010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e8030045-bbd1-402f-85ad-f6cc88fd9ff7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.153471 Jul 26 18:51:00.233592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1659/3291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:00 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:00.764601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a6843f20-c7c0-417d-8cc7-a3fbf232372d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:00.765292 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a6843f20-c7c0-417d-8cc7-a3fbf232372d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:00.776105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6843f20-c7c0-417d-8cc7-a3fbf232372d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:00.776743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6843f20-c7c0-417d-8cc7-a3fbf232372d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:00.777780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6843f20-c7c0-417d-8cc7-a3fbf232372d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:00.778231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a6843f20-c7c0-417d-8cc7-a3fbf232372d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:00.842322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-267047fc-75fc-416a-832e-4f58fee336d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:00.842975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-267047fc-75fc-416a-832e-4f58fee336d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:00.849899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-267047fc-75fc-416a-832e-4f58fee336d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:00.850347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-267047fc-75fc-416a-832e-4f58fee336d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:00.851144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-267047fc-75fc-416a-832e-4f58fee336d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:00.851585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-267047fc-75fc-416a-832e-4f58fee336d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:00.909345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a6843f20-c7c0-417d-8cc7-a3fbf232372d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:00.917812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a6843f20-c7c0-417d-8cc7-a3fbf232372d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159241 Jul 26 18:51:00.918463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1633/3292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:00 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:00.923826 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c47cd7de-5363-4c2d-823f-b19804b1c21f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:00.924434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c47cd7de-5363-4c2d-823f-b19804b1c21f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:00.930604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c47cd7de-5363-4c2d-823f-b19804b1c21f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:00.930728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c47cd7de-5363-4c2d-823f-b19804b1c21f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:00.931504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c47cd7de-5363-4c2d-823f-b19804b1c21f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:00.931936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c47cd7de-5363-4c2d-823f-b19804b1c21f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:00.982236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-267047fc-75fc-416a-832e-4f58fee336d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:00.990971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-267047fc-75fc-416a-832e-4f58fee336d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:00.992582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-267047fc-75fc-416a-832e-4f58fee336d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:00.993744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-267047fc-75fc-416a-832e-4f58fee336d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155540 Jul 26 18:51:00.994309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1660/3293] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:00 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:01.060942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c47cd7de-5363-4c2d-823f-b19804b1c21f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:01.069344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c47cd7de-5363-4c2d-823f-b19804b1c21f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.149896 Jul 26 18:51:01.069916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1634/3294] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:00 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:01.185691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1d4b4a5e-6ff6-4467-bfa2-e856e39d7aba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:01.186694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1d4b4a5e-6ff6-4467-bfa2-e856e39d7aba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:01.197071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d4b4a5e-6ff6-4467-bfa2-e856e39d7aba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:01.197751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d4b4a5e-6ff6-4467-bfa2-e856e39d7aba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:01.199227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d4b4a5e-6ff6-4467-bfa2-e856e39d7aba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:01.199659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d4b4a5e-6ff6-4467-bfa2-e856e39d7aba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:01.253953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-458c55af-65fc-4845-8dfc-a7033cbfad4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:01.254661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-458c55af-65fc-4845-8dfc-a7033cbfad4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:01.261118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-458c55af-65fc-4845-8dfc-a7033cbfad4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:01.261626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-458c55af-65fc-4845-8dfc-a7033cbfad4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:01.262452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-458c55af-65fc-4845-8dfc-a7033cbfad4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:01.262955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-458c55af-65fc-4845-8dfc-a7033cbfad4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:01.336473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1d4b4a5e-6ff6-4467-bfa2-e856e39d7aba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:01.344639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1d4b4a5e-6ff6-4467-bfa2-e856e39d7aba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.165333 Jul 26 18:51:01.345218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1661/3295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:01 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:01.397490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-458c55af-65fc-4845-8dfc-a7033cbfad4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:01.406112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-458c55af-65fc-4845-8dfc-a7033cbfad4a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156142 Jul 26 18:51:01.406690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1635/3296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:01 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:01.941047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c4b5052a-6be3-425e-a6fd-b6ac431f68ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:01.941791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c4b5052a-6be3-425e-a6fd-b6ac431f68ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:01.950754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4b5052a-6be3-425e-a6fd-b6ac431f68ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:01.951238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4b5052a-6be3-425e-a6fd-b6ac431f68ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:01.952005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4b5052a-6be3-425e-a6fd-b6ac431f68ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:01.952417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4b5052a-6be3-425e-a6fd-b6ac431f68ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:02.016932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7a24bd7e-0153-4cc0-bbc2-bb733521289e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:02.017522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7a24bd7e-0153-4cc0-bbc2-bb733521289e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:02.024758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a24bd7e-0153-4cc0-bbc2-bb733521289e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:02.025204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a24bd7e-0153-4cc0-bbc2-bb733521289e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:02.025936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a24bd7e-0153-4cc0-bbc2-bb733521289e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:02.026396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7a24bd7e-0153-4cc0-bbc2-bb733521289e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:02.085097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c4b5052a-6be3-425e-a6fd-b6ac431f68ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:02.093454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c4b5052a-6be3-425e-a6fd-b6ac431f68ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.157083 Jul 26 18:51:02.094030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1662/3297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:01 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:02.098530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-12b44a09-5c77-433f-8357-8c586299de9e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:02.099157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-12b44a09-5c77-433f-8357-8c586299de9e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:02.105447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-12b44a09-5c77-433f-8357-8c586299de9e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:02.105895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-12b44a09-5c77-433f-8357-8c586299de9e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:02.106646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-12b44a09-5c77-433f-8357-8c586299de9e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:02.107095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-12b44a09-5c77-433f-8357-8c586299de9e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:02.157121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a24bd7e-0153-4cc0-bbc2-bb733521289e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:02.165629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a24bd7e-0153-4cc0-bbc2-bb733521289e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:02.167141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7a24bd7e-0153-4cc0-bbc2-bb733521289e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:02.168389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7a24bd7e-0153-4cc0-bbc2-bb733521289e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155599 Jul 26 18:51:02.168964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1636/3298] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:02 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:02.243051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-12b44a09-5c77-433f-8357-8c586299de9e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:02.251594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-12b44a09-5c77-433f-8357-8c586299de9e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156596 Jul 26 18:51:02.252164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1663/3299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:02 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:02.370185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-34c3cd3b-5c6c-4c63-bd43-9ecbacac1772 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:02.371174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-34c3cd3b-5c6c-4c63-bd43-9ecbacac1772 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:02.378959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34c3cd3b-5c6c-4c63-bd43-9ecbacac1772 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:02.379549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34c3cd3b-5c6c-4c63-bd43-9ecbacac1772 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:02.380474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34c3cd3b-5c6c-4c63-bd43-9ecbacac1772 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:02.381006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34c3cd3b-5c6c-4c63-bd43-9ecbacac1772 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:02.428580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1d9610f1-3db1-4c8e-a64c-0bcd522b5050 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:02.429192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1d9610f1-3db1-4c8e-a64c-0bcd522b5050 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:02.435447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d9610f1-3db1-4c8e-a64c-0bcd522b5050 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:02.435884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d9610f1-3db1-4c8e-a64c-0bcd522b5050 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:02.436632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d9610f1-3db1-4c8e-a64c-0bcd522b5050 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:02.437083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d9610f1-3db1-4c8e-a64c-0bcd522b5050 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:02.517565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-34c3cd3b-5c6c-4c63-bd43-9ecbacac1772 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:02.526390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-34c3cd3b-5c6c-4c63-bd43-9ecbacac1772 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.162683 Jul 26 18:51:02.526971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1637/3300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:02 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:02.584067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1d9610f1-3db1-4c8e-a64c-0bcd522b5050 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:02.592582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1d9610f1-3db1-4c8e-a64c-0bcd522b5050 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.168431 Jul 26 18:51:02.593159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1664/3301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:03.119658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-02f2e429-878e-4cfc-968a-02692d99dc82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:03.120567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-02f2e429-878e-4cfc-968a-02692d99dc82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:03.128419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02f2e429-878e-4cfc-968a-02692d99dc82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:03.128922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02f2e429-878e-4cfc-968a-02692d99dc82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:03.129765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02f2e429-878e-4cfc-968a-02692d99dc82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:03.130250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02f2e429-878e-4cfc-968a-02692d99dc82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:03.191406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b28cdd94-d4ac-40eb-a57a-a2f3e8de776d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:03.192000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b28cdd94-d4ac-40eb-a57a-a2f3e8de776d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:03.198705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b28cdd94-d4ac-40eb-a57a-a2f3e8de776d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:03.199175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b28cdd94-d4ac-40eb-a57a-a2f3e8de776d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:03.199928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b28cdd94-d4ac-40eb-a57a-a2f3e8de776d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:03.200357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b28cdd94-d4ac-40eb-a57a-a2f3e8de776d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:03.272449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-02f2e429-878e-4cfc-968a-02692d99dc82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:03.280793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-02f2e429-878e-4cfc-968a-02692d99dc82 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.167821 Jul 26 18:51:03.290431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1638/3302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:03 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:03.290431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1b90d6ee-ad1c-41e0-8d15-957a093a4de3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:03.290431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1b90d6ee-ad1c-41e0-8d15-957a093a4de3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:03.294312 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b90d6ee-ad1c-41e0-8d15-957a093a4de3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:03.295186 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b90d6ee-ad1c-41e0-8d15-957a093a4de3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:03.296137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b90d6ee-ad1c-41e0-8d15-957a093a4de3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:03.296573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1b90d6ee-ad1c-41e0-8d15-957a093a4de3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:03.358148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b28cdd94-d4ac-40eb-a57a-a2f3e8de776d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:03.367102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b28cdd94-d4ac-40eb-a57a-a2f3e8de776d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:03.368617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b28cdd94-d4ac-40eb-a57a-a2f3e8de776d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:03.369853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b28cdd94-d4ac-40eb-a57a-a2f3e8de776d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.182434 Jul 26 18:51:03.370597 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1665/3303] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:03 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:03.433305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1b90d6ee-ad1c-41e0-8d15-957a093a4de3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:03.441451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1b90d6ee-ad1c-41e0-8d15-957a093a4de3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.158925 Jul 26 18:51:03.442025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1639/3304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:03 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:03.552271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8faed2e7-9292-41e7-8cd0-d907aec907d2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:03.552794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8faed2e7-9292-41e7-8cd0-d907aec907d2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:03.559392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8faed2e7-9292-41e7-8cd0-d907aec907d2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:03.559842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8faed2e7-9292-41e7-8cd0-d907aec907d2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:03.560605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8faed2e7-9292-41e7-8cd0-d907aec907d2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:03.561041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8faed2e7-9292-41e7-8cd0-d907aec907d2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:03.614263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eace6286-9a27-42bd-be07-484d2cac956e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:03.614854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eace6286-9a27-42bd-be07-484d2cac956e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:03.621380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eace6286-9a27-42bd-be07-484d2cac956e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:03.621796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eace6286-9a27-42bd-be07-484d2cac956e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:03.622561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eace6286-9a27-42bd-be07-484d2cac956e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:03.623036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eace6286-9a27-42bd-be07-484d2cac956e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:03.757645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eace6286-9a27-42bd-be07-484d2cac956e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:03.766006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eace6286-9a27-42bd-be07-484d2cac956e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155769 Jul 26 18:51:03.766690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1640/3305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:03 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:03.777200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8faed2e7-9292-41e7-8cd0-d907aec907d2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:03.786116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8faed2e7-9292-41e7-8cd0-d907aec907d2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.237576 Jul 26 18:51:03.786964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1666/3306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:03 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:04.305966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b2f90329-7b49-4ce9-b750-a2395f9785e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:04.306906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b2f90329-7b49-4ce9-b750-a2395f9785e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:04.317924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2f90329-7b49-4ce9-b750-a2395f9785e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:04.318652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2f90329-7b49-4ce9-b750-a2395f9785e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:04.319962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2f90329-7b49-4ce9-b750-a2395f9785e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:04.320670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2f90329-7b49-4ce9-b750-a2395f9785e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:04.393042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f87697ee-157d-4072-982e-af5acd47e531 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:04.393679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f87697ee-157d-4072-982e-af5acd47e531 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:04.401471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f87697ee-157d-4072-982e-af5acd47e531 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:04.401941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f87697ee-157d-4072-982e-af5acd47e531 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:04.402695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f87697ee-157d-4072-982e-af5acd47e531 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:04.403155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f87697ee-157d-4072-982e-af5acd47e531 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:04.454226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b2f90329-7b49-4ce9-b750-a2395f9785e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:04.462691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b2f90329-7b49-4ce9-b750-a2395f9785e9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163321 Jul 26 18:51:04.463267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1641/3307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:04 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:04.470254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4cac0f17-0ca2-48b5-86e5-06e872dbfeb1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:04.470835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4cac0f17-0ca2-48b5-86e5-06e872dbfeb1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:04.476757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4cac0f17-0ca2-48b5-86e5-06e872dbfeb1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:04.477336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4cac0f17-0ca2-48b5-86e5-06e872dbfeb1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:04.478098 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4cac0f17-0ca2-48b5-86e5-06e872dbfeb1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:04.478530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4cac0f17-0ca2-48b5-86e5-06e872dbfeb1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:04.537560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f87697ee-157d-4072-982e-af5acd47e531 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:04.546211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f87697ee-157d-4072-982e-af5acd47e531 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:04.547756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f87697ee-157d-4072-982e-af5acd47e531 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:04.548919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f87697ee-157d-4072-982e-af5acd47e531 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159875 Jul 26 18:51:04.549488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1667/3308] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:04 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:51:04.611218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4cac0f17-0ca2-48b5-86e5-06e872dbfeb1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:04.620421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4cac0f17-0ca2-48b5-86e5-06e872dbfeb1 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153746 Jul 26 18:51:04.621062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1642/3309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:04 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:04.790492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3c768397-1a4b-49d6-9d5a-4fa4d9496ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:04.791453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3c768397-1a4b-49d6-9d5a-4fa4d9496ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:04.802310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c768397-1a4b-49d6-9d5a-4fa4d9496ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:04.803098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c768397-1a4b-49d6-9d5a-4fa4d9496ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:04.804243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c768397-1a4b-49d6-9d5a-4fa4d9496ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:04.804861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c768397-1a4b-49d6-9d5a-4fa4d9496ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:04.810607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5a7ad619-acad-4e78-bae7-eee27cc3a5e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:04.811187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5a7ad619-acad-4e78-bae7-eee27cc3a5e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:04.817660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a7ad619-acad-4e78-bae7-eee27cc3a5e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:04.818134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a7ad619-acad-4e78-bae7-eee27cc3a5e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:04.818903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a7ad619-acad-4e78-bae7-eee27cc3a5e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:04.819360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a7ad619-acad-4e78-bae7-eee27cc3a5e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:04.939334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3c768397-1a4b-49d6-9d5a-4fa4d9496ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:04.947433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3c768397-1a4b-49d6-9d5a-4fa4d9496ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162468 Jul 26 18:51:04.948010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1668/3310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:04 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:04.950746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5a7ad619-acad-4e78-bae7-eee27cc3a5e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:04.958978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5a7ad619-acad-4e78-bae7-eee27cc3a5e2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153701 Jul 26 18:51:04.959914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1643/3311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:04 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:05.484437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c81fde07-48d3-428f-9e26-8d719c70ae64 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:05.485091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c81fde07-48d3-428f-9e26-8d719c70ae64 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:05.492586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c81fde07-48d3-428f-9e26-8d719c70ae64 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:05.493117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c81fde07-48d3-428f-9e26-8d719c70ae64 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:05.494104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c81fde07-48d3-428f-9e26-8d719c70ae64 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:05.494716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c81fde07-48d3-428f-9e26-8d719c70ae64 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:05.576008 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-198963fc-3c23-4726-9991-2ba60439774b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:05.576552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-198963fc-3c23-4726-9991-2ba60439774b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:05.584243 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-198963fc-3c23-4726-9991-2ba60439774b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:05.584722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-198963fc-3c23-4726-9991-2ba60439774b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:05.585474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-198963fc-3c23-4726-9991-2ba60439774b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:05.585964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-198963fc-3c23-4726-9991-2ba60439774b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:05.628701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c81fde07-48d3-428f-9e26-8d719c70ae64 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:05.637061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c81fde07-48d3-428f-9e26-8d719c70ae64 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156719 Jul 26 18:51:05.637639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1669/3312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:05 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:05.642217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-04e59ad6-fdf5-4984-90f3-e8dbf555a4b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:05.642817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-04e59ad6-fdf5-4984-90f3-e8dbf555a4b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:05.649223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04e59ad6-fdf5-4984-90f3-e8dbf555a4b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:05.649668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04e59ad6-fdf5-4984-90f3-e8dbf555a4b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:05.650437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04e59ad6-fdf5-4984-90f3-e8dbf555a4b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:05.650840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04e59ad6-fdf5-4984-90f3-e8dbf555a4b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:05.724895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-198963fc-3c23-4726-9991-2ba60439774b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:05.733732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-198963fc-3c23-4726-9991-2ba60439774b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:05.735431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-198963fc-3c23-4726-9991-2ba60439774b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:05.736589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-198963fc-3c23-4726-9991-2ba60439774b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.165172 Jul 26 18:51:05.737414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1644/3313] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:51:05.792094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-04e59ad6-fdf5-4984-90f3-e8dbf555a4b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:05.800768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-04e59ad6-fdf5-4984-90f3-e8dbf555a4b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.162158 Jul 26 18:51:05.801313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1670/3314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:05 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:05.970312 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-de67774e-680b-4cd4-a4b7-3a705f036425 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:05.971038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-de67774e-680b-4cd4-a4b7-3a705f036425 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:05.978319 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de67774e-680b-4cd4-a4b7-3a705f036425 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:05.978812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de67774e-680b-4cd4-a4b7-3a705f036425 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:05.979674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de67774e-680b-4cd4-a4b7-3a705f036425 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:05.980236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de67774e-680b-4cd4-a4b7-3a705f036425 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:05.983168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dfccca2b-88e8-4a61-aaf8-cc9623d20471 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:05.983816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dfccca2b-88e8-4a61-aaf8-cc9623d20471 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:05.990340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfccca2b-88e8-4a61-aaf8-cc9623d20471 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:05.990725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfccca2b-88e8-4a61-aaf8-cc9623d20471 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:05.991578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfccca2b-88e8-4a61-aaf8-cc9623d20471 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:05.992023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfccca2b-88e8-4a61-aaf8-cc9623d20471 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:06.114678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-de67774e-680b-4cd4-a4b7-3a705f036425 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:06.123183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-de67774e-680b-4cd4-a4b7-3a705f036425 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157400 Jul 26 18:51:06.123763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1645/3315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:05 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:06.125169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dfccca2b-88e8-4a61-aaf8-cc9623d20471 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:06.133632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dfccca2b-88e8-4a61-aaf8-cc9623d20471 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154519 Jul 26 18:51:06.134303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1671/3316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:05 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:06.491689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:51:06.492091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:51:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:51:06.661837 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-03a21d1b-a0f5-429e-bdd2-aa5d75088770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:06.662933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-03a21d1b-a0f5-429e-bdd2-aa5d75088770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:06.671747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03a21d1b-a0f5-429e-bdd2-aa5d75088770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:06.672199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03a21d1b-a0f5-429e-bdd2-aa5d75088770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:06.672951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03a21d1b-a0f5-429e-bdd2-aa5d75088770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:06.673384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03a21d1b-a0f5-429e-bdd2-aa5d75088770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:06.688919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:06.761145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3d8cd875-8849-4286-b342-b06e7b79ef8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:06.761778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3d8cd875-8849-4286-b342-b06e7b79ef8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:06.768747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d8cd875-8849-4286-b342-b06e7b79ef8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:06.769196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d8cd875-8849-4286-b342-b06e7b79ef8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:06.769949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d8cd875-8849-4286-b342-b06e7b79ef8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:06.770367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d8cd875-8849-4286-b342-b06e7b79ef8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:06.788585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:06.808381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-03a21d1b-a0f5-429e-bdd2-aa5d75088770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:06.817591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-03a21d1b-a0f5-429e-bdd2-aa5d75088770 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161939 Jul 26 18:51:06.818159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1646/3317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:06 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:06.822889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e0a14702-7528-4d83-9e90-10aa47ef59f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:06.823518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e0a14702-7528-4d83-9e90-10aa47ef59f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:06.829814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e0a14702-7528-4d83-9e90-10aa47ef59f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:06.830259 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e0a14702-7528-4d83-9e90-10aa47ef59f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:06.831123 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e0a14702-7528-4d83-9e90-10aa47ef59f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:06.831549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e0a14702-7528-4d83-9e90-10aa47ef59f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:06.909491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3d8cd875-8849-4286-b342-b06e7b79ef8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:06.918964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3d8cd875-8849-4286-b342-b06e7b79ef8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:06.920531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3d8cd875-8849-4286-b342-b06e7b79ef8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:06.921780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3d8cd875-8849-4286-b342-b06e7b79ef8d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.164661 Jul 26 18:51:06.922368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1672/3318] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:06 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:06.963904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e0a14702-7528-4d83-9e90-10aa47ef59f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:06.971836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e0a14702-7528-4d83-9e90-10aa47ef59f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152724 Jul 26 18:51:06.972351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1647/3319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:06 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:07.149110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-31cdfb2a-fe79-476d-8342-dfbf79815c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:07.149945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-31cdfb2a-fe79-476d-8342-dfbf79815c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:07.159582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9eb710d4-24a8-4d81-85e3-48a949d04de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:07.160300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31cdfb2a-fe79-476d-8342-dfbf79815c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:07.160625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9eb710d4-24a8-4d81-85e3-48a949d04de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:07.161047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31cdfb2a-fe79-476d-8342-dfbf79815c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:07.162311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31cdfb2a-fe79-476d-8342-dfbf79815c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:07.163078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31cdfb2a-fe79-476d-8342-dfbf79815c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:07.169740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9eb710d4-24a8-4d81-85e3-48a949d04de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:07.170190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9eb710d4-24a8-4d81-85e3-48a949d04de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:07.170949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9eb710d4-24a8-4d81-85e3-48a949d04de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:07.171418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9eb710d4-24a8-4d81-85e3-48a949d04de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:07.297428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-31cdfb2a-fe79-476d-8342-dfbf79815c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:07.301111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9eb710d4-24a8-4d81-85e3-48a949d04de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:07.305870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-31cdfb2a-fe79-476d-8342-dfbf79815c5e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163739 Jul 26 18:51:07.306444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1673/3320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:07 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:07.309418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9eb710d4-24a8-4d81-85e3-48a949d04de8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156172 Jul 26 18:51:07.309999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1648/3321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:07 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:07.838091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0473361b-9b2c-4bb5-8780-825ebb13312e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:07.838795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0473361b-9b2c-4bb5-8780-825ebb13312e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:07.845946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0473361b-9b2c-4bb5-8780-825ebb13312e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:07.846541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0473361b-9b2c-4bb5-8780-825ebb13312e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:07.847291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0473361b-9b2c-4bb5-8780-825ebb13312e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:07.847723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0473361b-9b2c-4bb5-8780-825ebb13312e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:07.944375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e906d3a8-3300-48a4-8192-6f90b16f899c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:07.944954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e906d3a8-3300-48a4-8192-6f90b16f899c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:07.951708 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e906d3a8-3300-48a4-8192-6f90b16f899c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:07.952158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e906d3a8-3300-48a4-8192-6f90b16f899c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:07.952916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e906d3a8-3300-48a4-8192-6f90b16f899c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:07.953349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e906d3a8-3300-48a4-8192-6f90b16f899c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:07.978449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0473361b-9b2c-4bb5-8780-825ebb13312e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:07.986730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0473361b-9b2c-4bb5-8780-825ebb13312e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.152670 Jul 26 18:51:07.987365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1674/3322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:07 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:07.993361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7500481f-dcd8-4ea1-80e5-1b7c154872bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:07.994046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7500481f-dcd8-4ea1-80e5-1b7c154872bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:08.002095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7500481f-dcd8-4ea1-80e5-1b7c154872bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:08.002471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7500481f-dcd8-4ea1-80e5-1b7c154872bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:08.003266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7500481f-dcd8-4ea1-80e5-1b7c154872bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:08.003702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7500481f-dcd8-4ea1-80e5-1b7c154872bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:08.092081 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e906d3a8-3300-48a4-8192-6f90b16f899c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:08.100878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e906d3a8-3300-48a4-8192-6f90b16f899c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:08.102442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e906d3a8-3300-48a4-8192-6f90b16f899c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:08.103619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e906d3a8-3300-48a4-8192-6f90b16f899c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.163151 Jul 26 18:51:08.104175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1649/3323] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:08.137774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7500481f-dcd8-4ea1-80e5-1b7c154872bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:08.146110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7500481f-dcd8-4ea1-80e5-1b7c154872bb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156299 Jul 26 18:51:08.146670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1675/3324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:07 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:08.331466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2c4b05c9-6718-4082-b130-498a2473b105 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:08.332357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2c4b05c9-6718-4082-b130-498a2473b105 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:08.335139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-72d8f867-c7d1-4b62-ba4f-8b5978a14fa3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:08.336276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-72d8f867-c7d1-4b62-ba4f-8b5978a14fa3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:08.342677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c4b05c9-6718-4082-b130-498a2473b105 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:08.343487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c4b05c9-6718-4082-b130-498a2473b105 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:08.344741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c4b05c9-6718-4082-b130-498a2473b105 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:08.345448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2c4b05c9-6718-4082-b130-498a2473b105 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:08.345970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72d8f867-c7d1-4b62-ba4f-8b5978a14fa3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:08.346701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72d8f867-c7d1-4b62-ba4f-8b5978a14fa3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:08.348008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72d8f867-c7d1-4b62-ba4f-8b5978a14fa3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:08.348768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72d8f867-c7d1-4b62-ba4f-8b5978a14fa3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:08.483084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2c4b05c9-6718-4082-b130-498a2473b105 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:08.484144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-72d8f867-c7d1-4b62-ba4f-8b5978a14fa3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:08.491997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2c4b05c9-6718-4082-b130-498a2473b105 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167404 Jul 26 18:51:08.492558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1650/3325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:08.492775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-72d8f867-c7d1-4b62-ba4f-8b5978a14fa3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.164314 Jul 26 18:51:08.493397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1676/3326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:08 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:09.014656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9c54c00d-3c7d-4649-b983-6bc401c1c13e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:09.015321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9c54c00d-3c7d-4649-b983-6bc401c1c13e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:09.022697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9c54c00d-3c7d-4649-b983-6bc401c1c13e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:09.023156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9c54c00d-3c7d-4649-b983-6bc401c1c13e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:09.023906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9c54c00d-3c7d-4649-b983-6bc401c1c13e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:09.024327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9c54c00d-3c7d-4649-b983-6bc401c1c13e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:09.126583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b30b07be-8e48-4007-a9cd-4b52b654fcb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:09.127179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b30b07be-8e48-4007-a9cd-4b52b654fcb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:09.133941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b30b07be-8e48-4007-a9cd-4b52b654fcb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:09.134388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b30b07be-8e48-4007-a9cd-4b52b654fcb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:09.135183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b30b07be-8e48-4007-a9cd-4b52b654fcb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:09.135618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b30b07be-8e48-4007-a9cd-4b52b654fcb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:09.153553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9c54c00d-3c7d-4649-b983-6bc401c1c13e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:09.161604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9c54c00d-3c7d-4649-b983-6bc401c1c13e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154477 Jul 26 18:51:09.175245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1651/3327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:09 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:09.175245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-18b07e34-35a6-4910-ae08-e3a971f99a82 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:09.175245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-18b07e34-35a6-4910-ae08-e3a971f99a82 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:09.175245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-18b07e34-35a6-4910-ae08-e3a971f99a82 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:09.175763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-18b07e34-35a6-4910-ae08-e3a971f99a82 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:09.175763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-18b07e34-35a6-4910-ae08-e3a971f99a82 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:09.175763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-18b07e34-35a6-4910-ae08-e3a971f99a82 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:09.270457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b30b07be-8e48-4007-a9cd-4b52b654fcb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:09.279553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b30b07be-8e48-4007-a9cd-4b52b654fcb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:09.281063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b30b07be-8e48-4007-a9cd-4b52b654fcb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:09.282225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b30b07be-8e48-4007-a9cd-4b52b654fcb6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159604 Jul 26 18:51:09.283000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1677/3328] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:09 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:09.307565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-18b07e34-35a6-4910-ae08-e3a971f99a82 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:09.315620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-18b07e34-35a6-4910-ae08-e3a971f99a82 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152193 Jul 26 18:51:09.316180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1652/3329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:09 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:09.513118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c2d9565b-bc65-4169-92d6-3bbf2fb2974d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:09.513722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4ae96d91-60bd-4fe8-94e5-88acdc97d0e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:09.513897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c2d9565b-bc65-4169-92d6-3bbf2fb2974d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:09.514329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4ae96d91-60bd-4fe8-94e5-88acdc97d0e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:09.520500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2d9565b-bc65-4169-92d6-3bbf2fb2974d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:09.520824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ae96d91-60bd-4fe8-94e5-88acdc97d0e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:09.520992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2d9565b-bc65-4169-92d6-3bbf2fb2974d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:09.521376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ae96d91-60bd-4fe8-94e5-88acdc97d0e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:09.521595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2d9565b-bc65-4169-92d6-3bbf2fb2974d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:09.522359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2d9565b-bc65-4169-92d6-3bbf2fb2974d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:09.522517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ae96d91-60bd-4fe8-94e5-88acdc97d0e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:09.522859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ae96d91-60bd-4fe8-94e5-88acdc97d0e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:09.656060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4ae96d91-60bd-4fe8-94e5-88acdc97d0e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:09.664255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c2d9565b-bc65-4169-92d6-3bbf2fb2974d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:09.668767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4ae96d91-60bd-4fe8-94e5-88acdc97d0e3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158791 Jul 26 18:51:09.669393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1653/3330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:09 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:09.672476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c2d9565b-bc65-4169-92d6-3bbf2fb2974d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163296 Jul 26 18:51:09.673030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1678/3331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:09 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:10.188216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f9cd947a-f731-4ab3-aba6-2bc024ee538f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:10.189217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f9cd947a-f731-4ab3-aba6-2bc024ee538f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:10.200353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9cd947a-f731-4ab3-aba6-2bc024ee538f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:10.200991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9cd947a-f731-4ab3-aba6-2bc024ee538f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:10.202246 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9cd947a-f731-4ab3-aba6-2bc024ee538f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:10.202951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9cd947a-f731-4ab3-aba6-2bc024ee538f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:10.305554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e0872648-e00f-4d4a-957b-a130a8e006c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:10.306141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e0872648-e00f-4d4a-957b-a130a8e006c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:10.313222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0872648-e00f-4d4a-957b-a130a8e006c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:10.313671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0872648-e00f-4d4a-957b-a130a8e006c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:10.314447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0872648-e00f-4d4a-957b-a130a8e006c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:10.314865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0872648-e00f-4d4a-957b-a130a8e006c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:10.340883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f9cd947a-f731-4ab3-aba6-2bc024ee538f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:10.349131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f9cd947a-f731-4ab3-aba6-2bc024ee538f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.167588 Jul 26 18:51:10.349702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1654/3332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:10.354094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2560b456-854b-4d07-a34c-e8b3c9b0ac11 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:10.354707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2560b456-854b-4d07-a34c-e8b3c9b0ac11 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:10.360684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2560b456-854b-4d07-a34c-e8b3c9b0ac11 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:10.361131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2560b456-854b-4d07-a34c-e8b3c9b0ac11 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:10.361886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2560b456-854b-4d07-a34c-e8b3c9b0ac11 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:10.362316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2560b456-854b-4d07-a34c-e8b3c9b0ac11 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:10.450471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e0872648-e00f-4d4a-957b-a130a8e006c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:10.458901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e0872648-e00f-4d4a-957b-a130a8e006c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:10.460432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e0872648-e00f-4d4a-957b-a130a8e006c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:10.461590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e0872648-e00f-4d4a-957b-a130a8e006c4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160234 Jul 26 18:51:10.462163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1679/3333] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:10 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:10.493095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2560b456-854b-4d07-a34c-e8b3c9b0ac11 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:10.505355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2560b456-854b-4d07-a34c-e8b3c9b0ac11 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154436 Jul 26 18:51:10.506152 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1655/3334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:10 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:10.694654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6d8c0143-1c16-429f-8585-f8b97b24f1ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:10.696195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6d8c0143-1c16-429f-8585-f8b97b24f1ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:10.698898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-10490898-7137-4a4a-b9b8-048ee4d36b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:10.699898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-10490898-7137-4a4a-b9b8-048ee4d36b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:10.704958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d8c0143-1c16-429f-8585-f8b97b24f1ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:10.705748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d8c0143-1c16-429f-8585-f8b97b24f1ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:10.706444 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10490898-7137-4a4a-b9b8-048ee4d36b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:10.706850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d8c0143-1c16-429f-8585-f8b97b24f1ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:10.706998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10490898-7137-4a4a-b9b8-048ee4d36b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:10.707331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d8c0143-1c16-429f-8585-f8b97b24f1ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:10.707670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10490898-7137-4a4a-b9b8-048ee4d36b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:10.708094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10490898-7137-4a4a-b9b8-048ee4d36b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:10.840990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6d8c0143-1c16-429f-8585-f8b97b24f1ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:10.844197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-10490898-7137-4a4a-b9b8-048ee4d36b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:10.849110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6d8c0143-1c16-429f-8585-f8b97b24f1ac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161707 Jul 26 18:51:10.849777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1680/3335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:10 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:10.852475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-10490898-7137-4a4a-b9b8-048ee4d36b9b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.159798 Jul 26 18:51:10.853035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1656/3336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:10 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:11.376656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a273129f-704b-46a9-b69a-745a0898e2df tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:11.377498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a273129f-704b-46a9-b69a-745a0898e2df tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:11.388442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a273129f-704b-46a9-b69a-745a0898e2df tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:11.388889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a273129f-704b-46a9-b69a-745a0898e2df tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:11.389647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a273129f-704b-46a9-b69a-745a0898e2df tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:11.390087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a273129f-704b-46a9-b69a-745a0898e2df tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:11.484016 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-30f566ef-4256-4783-87cc-4abb82845085 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:11.484613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-30f566ef-4256-4783-87cc-4abb82845085 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:11.491410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30f566ef-4256-4783-87cc-4abb82845085 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:11.491855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30f566ef-4256-4783-87cc-4abb82845085 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:11.492598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30f566ef-4256-4783-87cc-4abb82845085 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:11.493020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30f566ef-4256-4783-87cc-4abb82845085 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:11.522572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a273129f-704b-46a9-b69a-745a0898e2df tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:11.531058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a273129f-704b-46a9-b69a-745a0898e2df tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161067 Jul 26 18:51:11.531646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1681/3337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:11 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:11.536132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5690d5c0-6d46-4c58-8ca9-6b0d20058177 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:11.536761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5690d5c0-6d46-4c58-8ca9-6b0d20058177 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:11.543171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5690d5c0-6d46-4c58-8ca9-6b0d20058177 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:11.543694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5690d5c0-6d46-4c58-8ca9-6b0d20058177 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:11.544567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5690d5c0-6d46-4c58-8ca9-6b0d20058177 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:11.545067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5690d5c0-6d46-4c58-8ca9-6b0d20058177 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:11.628165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-30f566ef-4256-4783-87cc-4abb82845085 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:11.637528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-30f566ef-4256-4783-87cc-4abb82845085 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:11.639182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-30f566ef-4256-4783-87cc-4abb82845085 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:11.640433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-30f566ef-4256-4783-87cc-4abb82845085 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160419 Jul 26 18:51:11.647135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1657/3338] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:11.687714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5690d5c0-6d46-4c58-8ca9-6b0d20058177 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:11.695948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5690d5c0-6d46-4c58-8ca9-6b0d20058177 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.163358 Jul 26 18:51:11.696521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1682/3339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:11 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:11.871786 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c42104af-bad6-4d74-a22a-f4b306031e2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:11.872471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c42104af-bad6-4d74-a22a-f4b306031e2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:11.872670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0d0a258d-4f47-4314-9bd6-3b1ad6310d11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:11.873291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0d0a258d-4f47-4314-9bd6-3b1ad6310d11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:11.879164 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c42104af-bad6-4d74-a22a-f4b306031e2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:11.879530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d0a258d-4f47-4314-9bd6-3b1ad6310d11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:11.879705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c42104af-bad6-4d74-a22a-f4b306031e2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:11.879972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d0a258d-4f47-4314-9bd6-3b1ad6310d11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:11.880320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c42104af-bad6-4d74-a22a-f4b306031e2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:11.880704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d0a258d-4f47-4314-9bd6-3b1ad6310d11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:11.880828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c42104af-bad6-4d74-a22a-f4b306031e2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:11.881156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0d0a258d-4f47-4314-9bd6-3b1ad6310d11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:12.014266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c42104af-bad6-4d74-a22a-f4b306031e2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:12.014599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0d0a258d-4f47-4314-9bd6-3b1ad6310d11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:12.024261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0d0a258d-4f47-4314-9bd6-3b1ad6310d11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155306 Jul 26 18:51:12.024601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c42104af-bad6-4d74-a22a-f4b306031e2d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156376 Jul 26 18:51:12.025891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1658/3340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:11 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:12.026661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1683/3341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:12.556893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-30578335-ed63-4fdc-a088-cfcb53748ac0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:12.557934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-30578335-ed63-4fdc-a088-cfcb53748ac0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:12.565660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30578335-ed63-4fdc-a088-cfcb53748ac0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:12.566110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30578335-ed63-4fdc-a088-cfcb53748ac0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:12.566873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30578335-ed63-4fdc-a088-cfcb53748ac0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:12.567337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30578335-ed63-4fdc-a088-cfcb53748ac0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:12.664025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7ef7aba5-08f6-4673-bca6-bf417c5e71e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:12.664605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7ef7aba5-08f6-4673-bca6-bf417c5e71e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:12.671800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ef7aba5-08f6-4673-bca6-bf417c5e71e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:12.672823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ef7aba5-08f6-4673-bca6-bf417c5e71e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:12.673600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ef7aba5-08f6-4673-bca6-bf417c5e71e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:12.674037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ef7aba5-08f6-4673-bca6-bf417c5e71e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:12.721228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-30578335-ed63-4fdc-a088-cfcb53748ac0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:12.729424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-30578335-ed63-4fdc-a088-cfcb53748ac0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.178999 Jul 26 18:51:12.730023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1659/3342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:12 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:12.739240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-703f84bd-88e8-47a3-8a73-bb57f8ecf197 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:12.739838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-703f84bd-88e8-47a3-8a73-bb57f8ecf197 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:12.749076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-703f84bd-88e8-47a3-8a73-bb57f8ecf197 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:12.749491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-703f84bd-88e8-47a3-8a73-bb57f8ecf197 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:12.750257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-703f84bd-88e8-47a3-8a73-bb57f8ecf197 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:12.750685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-703f84bd-88e8-47a3-8a73-bb57f8ecf197 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:12.809612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7ef7aba5-08f6-4673-bca6-bf417c5e71e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:12.818063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7ef7aba5-08f6-4673-bca6-bf417c5e71e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:12.819593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7ef7aba5-08f6-4673-bca6-bf417c5e71e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:12.820762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7ef7aba5-08f6-4673-bca6-bf417c5e71e5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160677 Jul 26 18:51:12.821389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1684/3343] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:12 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:12.877894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-703f84bd-88e8-47a3-8a73-bb57f8ecf197 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:12.889244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-703f84bd-88e8-47a3-8a73-bb57f8ecf197 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153619 Jul 26 18:51:12.889842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1660/3344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:12 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:13.051689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e3b542c6-6b43-4933-9e64-0e1891234a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:13.052492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e3b542c6-6b43-4933-9e64-0e1891234a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:13.057066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cc31b2d1-12fe-495d-8b5e-bde8356b5ab9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:13.057895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cc31b2d1-12fe-495d-8b5e-bde8356b5ab9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:13.060820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e3b542c6-6b43-4933-9e64-0e1891234a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:13.061418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e3b542c6-6b43-4933-9e64-0e1891234a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:13.062425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e3b542c6-6b43-4933-9e64-0e1891234a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:13.063015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e3b542c6-6b43-4933-9e64-0e1891234a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:13.066564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cc31b2d1-12fe-495d-8b5e-bde8356b5ab9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:13.067236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cc31b2d1-12fe-495d-8b5e-bde8356b5ab9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:13.068206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cc31b2d1-12fe-495d-8b5e-bde8356b5ab9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:13.068776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cc31b2d1-12fe-495d-8b5e-bde8356b5ab9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:13.198630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e3b542c6-6b43-4933-9e64-0e1891234a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:13.205165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cc31b2d1-12fe-495d-8b5e-bde8356b5ab9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:13.206827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e3b542c6-6b43-4933-9e64-0e1891234a7f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160301 Jul 26 18:51:13.207600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1685/3345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:13 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:13.213036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cc31b2d1-12fe-495d-8b5e-bde8356b5ab9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161377 Jul 26 18:51:13.213583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1661/3346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:13 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:13.752071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5e37fb69-66a2-445b-b876-cb167c20acff tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:13.753031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5e37fb69-66a2-445b-b876-cb167c20acff tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:13.763430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e37fb69-66a2-445b-b876-cb167c20acff tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:13.763875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e37fb69-66a2-445b-b876-cb167c20acff tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:13.764617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e37fb69-66a2-445b-b876-cb167c20acff tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:13.765046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e37fb69-66a2-445b-b876-cb167c20acff tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:13.843836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0aa0894b-5bd9-4359-94e2-715985e1c015 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:13.844466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0aa0894b-5bd9-4359-94e2-715985e1c015 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:13.851641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0aa0894b-5bd9-4359-94e2-715985e1c015 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:13.852085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0aa0894b-5bd9-4359-94e2-715985e1c015 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:13.852846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0aa0894b-5bd9-4359-94e2-715985e1c015 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:13.853248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0aa0894b-5bd9-4359-94e2-715985e1c015 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:13.909825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5e37fb69-66a2-445b-b876-cb167c20acff tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:13.918422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5e37fb69-66a2-445b-b876-cb167c20acff tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.171553 Jul 26 18:51:13.919042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1686/3347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:13.923431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b03bef10-822c-4b94-b68d-45945d73fbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:13.924025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b03bef10-822c-4b94-b68d-45945d73fbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:13.929989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b03bef10-822c-4b94-b68d-45945d73fbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:13.930436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b03bef10-822c-4b94-b68d-45945d73fbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:13.931222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b03bef10-822c-4b94-b68d-45945d73fbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:13.931657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b03bef10-822c-4b94-b68d-45945d73fbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:13.983647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0aa0894b-5bd9-4359-94e2-715985e1c015 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:13.992550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0aa0894b-5bd9-4359-94e2-715985e1c015 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:13.994148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0aa0894b-5bd9-4359-94e2-715985e1c015 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:13.995431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0aa0894b-5bd9-4359-94e2-715985e1c015 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155489 Jul 26 18:51:13.996153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1662/3348] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:14.065363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b03bef10-822c-4b94-b68d-45945d73fbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:14.073818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b03bef10-822c-4b94-b68d-45945d73fbc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153836 Jul 26 18:51:14.074629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1687/3349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:13 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:14.228468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-62c5bf00-e30e-4157-a010-0679c3fef990 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:14.229365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-62c5bf00-e30e-4157-a010-0679c3fef990 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:14.233774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-89239180-3229-4137-9ef2-e0f5b9292e83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:14.234368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-89239180-3229-4137-9ef2-e0f5b9292e83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:14.235604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62c5bf00-e30e-4157-a010-0679c3fef990 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:14.235968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62c5bf00-e30e-4157-a010-0679c3fef990 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:14.236278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:14.236917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62c5bf00-e30e-4157-a010-0679c3fef990 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:14.237236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62c5bf00-e30e-4157-a010-0679c3fef990 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:14.240188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:14.242116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89239180-3229-4137-9ef2-e0f5b9292e83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:14.242557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89239180-3229-4137-9ef2-e0f5b9292e83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:14.243355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89239180-3229-4137-9ef2-e0f5b9292e83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:14.243787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89239180-3229-4137-9ef2-e0f5b9292e83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:14.372913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-62c5bf00-e30e-4157-a010-0679c3fef990 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:14.381268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-62c5bf00-e30e-4157-a010-0679c3fef990 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156548 Jul 26 18:51:14.381888 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1663/3350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:14 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:14.382012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-89239180-3229-4137-9ef2-e0f5b9292e83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:14.390642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-89239180-3229-4137-9ef2-e0f5b9292e83 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.160868 Jul 26 18:51:14.391260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1688/3351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:14 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:14.944701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-52bd4bdc-60ef-48ea-8768-e40940dfb668 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:14.945678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-52bd4bdc-60ef-48ea-8768-e40940dfb668 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:14.956644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52bd4bdc-60ef-48ea-8768-e40940dfb668 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:14.957364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52bd4bdc-60ef-48ea-8768-e40940dfb668 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:14.958592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52bd4bdc-60ef-48ea-8768-e40940dfb668 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:14.959357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-52bd4bdc-60ef-48ea-8768-e40940dfb668 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:15.018527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-15905b67-d0aa-4cfe-8efb-8a3e548aa42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:15.019117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-15905b67-d0aa-4cfe-8efb-8a3e548aa42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:15.026076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15905b67-d0aa-4cfe-8efb-8a3e548aa42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:15.026520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15905b67-d0aa-4cfe-8efb-8a3e548aa42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:15.027299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15905b67-d0aa-4cfe-8efb-8a3e548aa42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:15.027730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15905b67-d0aa-4cfe-8efb-8a3e548aa42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:15.030358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:15.100613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-52bd4bdc-60ef-48ea-8768-e40940dfb668 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:15.109065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-52bd4bdc-60ef-48ea-8768-e40940dfb668 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.170970 Jul 26 18:51:15.110085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1664/3352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:14 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:15.114055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d71dda50-5f87-4193-bac2-d08ce74846eb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:15.114654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d71dda50-5f87-4193-bac2-d08ce74846eb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:15.116388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:15.122360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d71dda50-5f87-4193-bac2-d08ce74846eb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:15.122801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d71dda50-5f87-4193-bac2-d08ce74846eb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:15.123577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d71dda50-5f87-4193-bac2-d08ce74846eb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:15.124006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d71dda50-5f87-4193-bac2-d08ce74846eb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:15.162301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15905b67-d0aa-4cfe-8efb-8a3e548aa42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:15.171151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15905b67-d0aa-4cfe-8efb-8a3e548aa42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:15.172659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15905b67-d0aa-4cfe-8efb-8a3e548aa42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:15.173821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-15905b67-d0aa-4cfe-8efb-8a3e548aa42f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159405 Jul 26 18:51:15.174387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1689/3353] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:15 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:51:15.250296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d71dda50-5f87-4193-bac2-d08ce74846eb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:15.258894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d71dda50-5f87-4193-bac2-d08ce74846eb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.148295 Jul 26 18:51:15.259496 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1665/3354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:15 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:15.407830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-284a318a-a483-44c8-b0c7-42eea1200785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:15.408992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-284a318a-a483-44c8-b0c7-42eea1200785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:15.416379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b018460d-5c91-41c6-96d3-e44f2af8c20c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:15.417386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b018460d-5c91-41c6-96d3-e44f2af8c20c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:15.419244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-284a318a-a483-44c8-b0c7-42eea1200785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:15.420065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-284a318a-a483-44c8-b0c7-42eea1200785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:15.421387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-284a318a-a483-44c8-b0c7-42eea1200785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:15.422214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-284a318a-a483-44c8-b0c7-42eea1200785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:15.427202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b018460d-5c91-41c6-96d3-e44f2af8c20c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:15.427931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b018460d-5c91-41c6-96d3-e44f2af8c20c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:15.429159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b018460d-5c91-41c6-96d3-e44f2af8c20c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:15.430278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b018460d-5c91-41c6-96d3-e44f2af8c20c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:15.569780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-284a318a-a483-44c8-b0c7-42eea1200785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:15.570828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b018460d-5c91-41c6-96d3-e44f2af8c20c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:15.577965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-284a318a-a483-44c8-b0c7-42eea1200785 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.176581 Jul 26 18:51:15.578507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1690/3355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:15.578861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b018460d-5c91-41c6-96d3-e44f2af8c20c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.168887 Jul 26 18:51:15.579638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1666/3356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:15 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:16.134044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cb370f99-f2b3-4c04-8f35-2fdd3ac78ddd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:16.135084 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cb370f99-f2b3-4c04-8f35-2fdd3ac78ddd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:16.145378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb370f99-f2b3-4c04-8f35-2fdd3ac78ddd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:16.146074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb370f99-f2b3-4c04-8f35-2fdd3ac78ddd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:16.147638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb370f99-f2b3-4c04-8f35-2fdd3ac78ddd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:16.148313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb370f99-f2b3-4c04-8f35-2fdd3ac78ddd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:16.197059 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-455b1ca0-9834-42ce-a8e0-8b1d57726d74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:16.197617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-455b1ca0-9834-42ce-a8e0-8b1d57726d74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:16.204607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-455b1ca0-9834-42ce-a8e0-8b1d57726d74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:16.205115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-455b1ca0-9834-42ce-a8e0-8b1d57726d74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:16.206120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-455b1ca0-9834-42ce-a8e0-8b1d57726d74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:16.206555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-455b1ca0-9834-42ce-a8e0-8b1d57726d74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:16.282945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cb370f99-f2b3-4c04-8f35-2fdd3ac78ddd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:16.291106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cb370f99-f2b3-4c04-8f35-2fdd3ac78ddd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163006 Jul 26 18:51:16.291712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1691/3357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:16 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:16.296109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f3b62018-2705-4da4-8ba6-e45a9122c9d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:16.296740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f3b62018-2705-4da4-8ba6-e45a9122c9d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:16.302867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3b62018-2705-4da4-8ba6-e45a9122c9d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:16.303570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3b62018-2705-4da4-8ba6-e45a9122c9d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:16.305166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3b62018-2705-4da4-8ba6-e45a9122c9d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:16.305644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3b62018-2705-4da4-8ba6-e45a9122c9d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:16.337339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-455b1ca0-9834-42ce-a8e0-8b1d57726d74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:16.347353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-455b1ca0-9834-42ce-a8e0-8b1d57726d74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:16.348893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-455b1ca0-9834-42ce-a8e0-8b1d57726d74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:16.350067 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-455b1ca0-9834-42ce-a8e0-8b1d57726d74 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157094 Jul 26 18:51:16.363564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1667/3358] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:16 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:16.434094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f3b62018-2705-4da4-8ba6-e45a9122c9d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:16.442626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f3b62018-2705-4da4-8ba6-e45a9122c9d0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.149980 Jul 26 18:51:16.443243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1692/3359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:16 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:16.603573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bbdfcc94-d316-40a2-82c6-e7ea7ae13dfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:16.604003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8c7552f0-4a4a-4588-aa64-0f8d91427b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:16.604569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bbdfcc94-d316-40a2-82c6-e7ea7ae13dfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:16.604914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8c7552f0-4a4a-4588-aa64-0f8d91427b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:16.611877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c7552f0-4a4a-4588-aa64-0f8d91427b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:16.612075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bbdfcc94-d316-40a2-82c6-e7ea7ae13dfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:16.612327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c7552f0-4a4a-4588-aa64-0f8d91427b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:16.612491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bbdfcc94-d316-40a2-82c6-e7ea7ae13dfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:16.613055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c7552f0-4a4a-4588-aa64-0f8d91427b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:16.613207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bbdfcc94-d316-40a2-82c6-e7ea7ae13dfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:16.613515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c7552f0-4a4a-4588-aa64-0f8d91427b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:16.613697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bbdfcc94-d316-40a2-82c6-e7ea7ae13dfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:16.741027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8c7552f0-4a4a-4588-aa64-0f8d91427b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:16.744979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bbdfcc94-d316-40a2-82c6-e7ea7ae13dfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:16.750448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8c7552f0-4a4a-4588-aa64-0f8d91427b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152749 Jul 26 18:51:16.751174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1693/3360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:16 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:16.752927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bbdfcc94-d316-40a2-82c6-e7ea7ae13dfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155815 Jul 26 18:51:16.753454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1668/3361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:17.316387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ddb27da7-deaf-4ff5-bcc8-1fa93c1a8faf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:17.317390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ddb27da7-deaf-4ff5-bcc8-1fa93c1a8faf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:17.327505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ddb27da7-deaf-4ff5-bcc8-1fa93c1a8faf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:17.327967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ddb27da7-deaf-4ff5-bcc8-1fa93c1a8faf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:17.328754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ddb27da7-deaf-4ff5-bcc8-1fa93c1a8faf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:17.329185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ddb27da7-deaf-4ff5-bcc8-1fa93c1a8faf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:17.373598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-00809570-7b76-4e79-b42c-d04e2116280b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:17.374233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-00809570-7b76-4e79-b42c-d04e2116280b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:17.381200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00809570-7b76-4e79-b42c-d04e2116280b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:17.381654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00809570-7b76-4e79-b42c-d04e2116280b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:17.382408 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00809570-7b76-4e79-b42c-d04e2116280b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:17.382843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-00809570-7b76-4e79-b42c-d04e2116280b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:17.469668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ddb27da7-deaf-4ff5-bcc8-1fa93c1a8faf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:17.477411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ddb27da7-deaf-4ff5-bcc8-1fa93c1a8faf tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.167402 Jul 26 18:51:17.477955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1694/3362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:17 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:17.482493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0b81654a-05f3-4db4-8541-e60670f6aecc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:17.483255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0b81654a-05f3-4db4-8541-e60670f6aecc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:17.489469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b81654a-05f3-4db4-8541-e60670f6aecc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:17.489917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b81654a-05f3-4db4-8541-e60670f6aecc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:17.490670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b81654a-05f3-4db4-8541-e60670f6aecc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:17.491568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b81654a-05f3-4db4-8541-e60670f6aecc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:17.524885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-00809570-7b76-4e79-b42c-d04e2116280b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:17.533538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-00809570-7b76-4e79-b42c-d04e2116280b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:17.535056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-00809570-7b76-4e79-b42c-d04e2116280b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:17.536215 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-00809570-7b76-4e79-b42c-d04e2116280b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.166601 Jul 26 18:51:17.536778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1669/3363] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:17.623680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0b81654a-05f3-4db4-8541-e60670f6aecc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:17.631998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0b81654a-05f3-4db4-8541-e60670f6aecc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153099 Jul 26 18:51:17.632606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1695/3364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:17 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:17.776490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d8869aaa-f4c4-467c-829b-66e8755cbc04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:17.777729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d8869aaa-f4c4-467c-829b-66e8755cbc04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:17.778005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-182f10f6-a361-49c5-a170-da422288b4df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:17.778835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-182f10f6-a361-49c5-a170-da422288b4df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:17.784487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8869aaa-f4c4-467c-829b-66e8755cbc04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:17.784936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8869aaa-f4c4-467c-829b-66e8755cbc04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:17.785100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-182f10f6-a361-49c5-a170-da422288b4df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:17.785483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-182f10f6-a361-49c5-a170-da422288b4df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:17.785694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8869aaa-f4c4-467c-829b-66e8755cbc04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:17.786115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8869aaa-f4c4-467c-829b-66e8755cbc04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:17.786260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-182f10f6-a361-49c5-a170-da422288b4df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:17.786676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-182f10f6-a361-49c5-a170-da422288b4df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:17.921204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-182f10f6-a361-49c5-a170-da422288b4df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:17.923632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d8869aaa-f4c4-467c-829b-66e8755cbc04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:17.929836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-182f10f6-a361-49c5-a170-da422288b4df tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158684 Jul 26 18:51:17.930414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1696/3365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:17 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:17.932009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d8869aaa-f4c4-467c-829b-66e8755cbc04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.162286 Jul 26 18:51:17.932561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1670/3366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:17 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:18.499498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8fbca32c-d5b7-462e-b7cd-42187bbeaf1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:18.500758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8fbca32c-d5b7-462e-b7cd-42187bbeaf1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:18.507572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fbca32c-d5b7-462e-b7cd-42187bbeaf1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:18.508027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fbca32c-d5b7-462e-b7cd-42187bbeaf1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:18.508792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fbca32c-d5b7-462e-b7cd-42187bbeaf1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:18.509224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8fbca32c-d5b7-462e-b7cd-42187bbeaf1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:18.558299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4a605223-6a77-4c49-a2cd-c0303fd84897 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:18.558887 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4a605223-6a77-4c49-a2cd-c0303fd84897 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:18.565702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a605223-6a77-4c49-a2cd-c0303fd84897 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:18.566150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a605223-6a77-4c49-a2cd-c0303fd84897 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:18.566898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a605223-6a77-4c49-a2cd-c0303fd84897 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:18.567358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a605223-6a77-4c49-a2cd-c0303fd84897 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:18.638953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8fbca32c-d5b7-462e-b7cd-42187bbeaf1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:18.647364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8fbca32c-d5b7-462e-b7cd-42187bbeaf1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.151420 Jul 26 18:51:18.648011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1697/3367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:18 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:18.653331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0e1ea365-cde3-4b2e-9b98-24dd7496a070 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:18.653939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0e1ea365-cde3-4b2e-9b98-24dd7496a070 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:18.660235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e1ea365-cde3-4b2e-9b98-24dd7496a070 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:18.660679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e1ea365-cde3-4b2e-9b98-24dd7496a070 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:18.661461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e1ea365-cde3-4b2e-9b98-24dd7496a070 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:18.662028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e1ea365-cde3-4b2e-9b98-24dd7496a070 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:18.703722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4a605223-6a77-4c49-a2cd-c0303fd84897 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:18.712400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4a605223-6a77-4c49-a2cd-c0303fd84897 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:18.713839 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4a605223-6a77-4c49-a2cd-c0303fd84897 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:18.715004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4a605223-6a77-4c49-a2cd-c0303fd84897 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160669 Jul 26 18:51:18.715583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1671/3368] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:18 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:18.792028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0e1ea365-cde3-4b2e-9b98-24dd7496a070 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:18.800557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0e1ea365-cde3-4b2e-9b98-24dd7496a070 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151631 Jul 26 18:51:18.801130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1698/3369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:18 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:18.954529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0173953e-b6a6-4c49-ae3a-9dcf641b5075 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:18.955410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0173953e-b6a6-4c49-ae3a-9dcf641b5075 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:18.955972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2e17d9d1-1445-4ab9-b1ab-2f9d70270dbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:18.956800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2e17d9d1-1445-4ab9-b1ab-2f9d70270dbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:18.964595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0173953e-b6a6-4c49-ae3a-9dcf641b5075 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:18.964790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0173953e-b6a6-4c49-ae3a-9dcf641b5075 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:18.965683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e17d9d1-1445-4ab9-b1ab-2f9d70270dbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:18.965923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0173953e-b6a6-4c49-ae3a-9dcf641b5075 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:18.966281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e17d9d1-1445-4ab9-b1ab-2f9d70270dbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:18.966452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0173953e-b6a6-4c49-ae3a-9dcf641b5075 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:18.967340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e17d9d1-1445-4ab9-b1ab-2f9d70270dbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:18.967976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e17d9d1-1445-4ab9-b1ab-2f9d70270dbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:19.101033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0173953e-b6a6-4c49-ae3a-9dcf641b5075 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:19.103207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2e17d9d1-1445-4ab9-b1ab-2f9d70270dbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:19.109488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0173953e-b6a6-4c49-ae3a-9dcf641b5075 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160475 Jul 26 18:51:19.110046 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1672/3370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:19.111502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2e17d9d1-1445-4ab9-b1ab-2f9d70270dbe tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.160558 Jul 26 18:51:19.112062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1699/3371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:18 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:19.671342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1c1e6319-3e83-419d-96b5-f163313f64ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:19.671946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1c1e6319-3e83-419d-96b5-f163313f64ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:19.678971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c1e6319-3e83-419d-96b5-f163313f64ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:19.679450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c1e6319-3e83-419d-96b5-f163313f64ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:19.680202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c1e6319-3e83-419d-96b5-f163313f64ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:19.680630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c1e6319-3e83-419d-96b5-f163313f64ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:19.739413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f242f629-4f5a-492b-8940-e7242794fcff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:19.740052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f242f629-4f5a-492b-8940-e7242794fcff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:19.747199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f242f629-4f5a-492b-8940-e7242794fcff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:19.747644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f242f629-4f5a-492b-8940-e7242794fcff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:19.748401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f242f629-4f5a-492b-8940-e7242794fcff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:19.748835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f242f629-4f5a-492b-8940-e7242794fcff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:19.820958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1c1e6319-3e83-419d-96b5-f163313f64ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:19.829564 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1c1e6319-3e83-419d-96b5-f163313f64ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163588 Jul 26 18:51:19.830512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1673/3372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:19 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:19.835035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c726e975-9c72-4668-93e6-b22b9cb76ac6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:19.835914 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c726e975-9c72-4668-93e6-b22b9cb76ac6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:19.842619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c726e975-9c72-4668-93e6-b22b9cb76ac6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:19.843395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c726e975-9c72-4668-93e6-b22b9cb76ac6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:19.844161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c726e975-9c72-4668-93e6-b22b9cb76ac6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:19.845032 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c726e975-9c72-4668-93e6-b22b9cb76ac6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:19.883853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f242f629-4f5a-492b-8940-e7242794fcff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:19.897035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f242f629-4f5a-492b-8940-e7242794fcff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:19.899864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f242f629-4f5a-492b-8940-e7242794fcff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:19.901855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f242f629-4f5a-492b-8940-e7242794fcff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.166219 Jul 26 18:51:19.902656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1700/3373] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:19 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:19.977926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c726e975-9c72-4668-93e6-b22b9cb76ac6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:19.986186 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c726e975-9c72-4668-93e6-b22b9cb76ac6 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154570 Jul 26 18:51:19.986784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1674/3374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:19 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:20.135859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b5b929f2-c558-437a-b245-cb5a6ed91b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:20.136789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b5b929f2-c558-437a-b245-cb5a6ed91b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:20.137754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ab71e904-7096-40d9-b5fa-910d99eeaa4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:20.138824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ab71e904-7096-40d9-b5fa-910d99eeaa4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:20.148220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5b929f2-c558-437a-b245-cb5a6ed91b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:20.148952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5b929f2-c558-437a-b245-cb5a6ed91b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:20.149878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab71e904-7096-40d9-b5fa-910d99eeaa4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:20.150217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5b929f2-c558-437a-b245-cb5a6ed91b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:20.150730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab71e904-7096-40d9-b5fa-910d99eeaa4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:20.151188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5b929f2-c558-437a-b245-cb5a6ed91b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:20.152048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab71e904-7096-40d9-b5fa-910d99eeaa4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:20.152772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab71e904-7096-40d9-b5fa-910d99eeaa4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:20.283844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ab71e904-7096-40d9-b5fa-910d99eeaa4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:20.284563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b5b929f2-c558-437a-b245-cb5a6ed91b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:20.292131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ab71e904-7096-40d9-b5fa-910d99eeaa4d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161596 Jul 26 18:51:20.292538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b5b929f2-c558-437a-b245-cb5a6ed91b76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163994 Jul 26 18:51:20.293345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1675/3375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:20 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:20.293613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1701/3376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:20 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:20.850669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d98674be-e76f-422d-ba22-a38995a534ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:20.851728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d98674be-e76f-422d-ba22-a38995a534ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:20.861432 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d98674be-e76f-422d-ba22-a38995a534ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:20.861881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d98674be-e76f-422d-ba22-a38995a534ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:20.862693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d98674be-e76f-422d-ba22-a38995a534ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:20.863154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d98674be-e76f-422d-ba22-a38995a534ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:20.925690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-04431cdd-4e5e-49ed-966b-187b210c3594 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:20.926351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-04431cdd-4e5e-49ed-966b-187b210c3594 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:20.933462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04431cdd-4e5e-49ed-966b-187b210c3594 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:20.933913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04431cdd-4e5e-49ed-966b-187b210c3594 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:20.934741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04431cdd-4e5e-49ed-966b-187b210c3594 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:20.935200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04431cdd-4e5e-49ed-966b-187b210c3594 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:21.007666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d98674be-e76f-422d-ba22-a38995a534ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:21.016073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d98674be-e76f-422d-ba22-a38995a534ac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.169923 Jul 26 18:51:21.016632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1676/3377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:21.020960 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-96fda3f0-ef41-4d5f-8163-d9f45b493788 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:21.021546 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-96fda3f0-ef41-4d5f-8163-d9f45b493788 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:21.027754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96fda3f0-ef41-4d5f-8163-d9f45b493788 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:21.028223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96fda3f0-ef41-4d5f-8163-d9f45b493788 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:21.028961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96fda3f0-ef41-4d5f-8163-d9f45b493788 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:21.029386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-96fda3f0-ef41-4d5f-8163-d9f45b493788 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:21.073809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-04431cdd-4e5e-49ed-966b-187b210c3594 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:21.082622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-04431cdd-4e5e-49ed-966b-187b210c3594 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:21.084161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-04431cdd-4e5e-49ed-966b-187b210c3594 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:21.085326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-04431cdd-4e5e-49ed-966b-187b210c3594 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.163877 Jul 26 18:51:21.085891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1702/3378] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:51:21.158540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-96fda3f0-ef41-4d5f-8163-d9f45b493788 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:21.167761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-96fda3f0-ef41-4d5f-8163-d9f45b493788 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.150137 Jul 26 18:51:21.168341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1677/3379] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:21 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:21.317595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b85c1a24-4808-4469-8bcf-b1bb7b5e4666 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:21.317971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-47eff2ea-052d-4fe9-bab4-667bc969a646 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:21.318567 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-47eff2ea-052d-4fe9-bab4-667bc969a646 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:21.318850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b85c1a24-4808-4469-8bcf-b1bb7b5e4666 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:21.327478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47eff2ea-052d-4fe9-bab4-667bc969a646 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:21.327669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b85c1a24-4808-4469-8bcf-b1bb7b5e4666 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:21.327919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47eff2ea-052d-4fe9-bab4-667bc969a646 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:21.328073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b85c1a24-4808-4469-8bcf-b1bb7b5e4666 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:21.328674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47eff2ea-052d-4fe9-bab4-667bc969a646 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:21.328835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b85c1a24-4808-4469-8bcf-b1bb7b5e4666 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:21.329102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-47eff2ea-052d-4fe9-bab4-667bc969a646 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:21.329273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b85c1a24-4808-4469-8bcf-b1bb7b5e4666 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:21.464008 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-47eff2ea-052d-4fe9-bab4-667bc969a646 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:21.470361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b85c1a24-4808-4469-8bcf-b1bb7b5e4666 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:21.472156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-47eff2ea-052d-4fe9-bab4-667bc969a646 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.160937 Jul 26 18:51:21.472731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1678/3380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:21 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:21.478613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b85c1a24-4808-4469-8bcf-b1bb7b5e4666 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167416 Jul 26 18:51:21.479175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1703/3381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:22.037735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-32c2af0f-3a37-484f-b430-0bd5b5d3de19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:22.038347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-32c2af0f-3a37-484f-b430-0bd5b5d3de19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:22.045133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32c2af0f-3a37-484f-b430-0bd5b5d3de19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:22.045580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32c2af0f-3a37-484f-b430-0bd5b5d3de19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:22.046329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32c2af0f-3a37-484f-b430-0bd5b5d3de19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:22.046761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-32c2af0f-3a37-484f-b430-0bd5b5d3de19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:22.108718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a1837762-f723-444d-88ce-ff7f8fdfdf77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:22.109423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a1837762-f723-444d-88ce-ff7f8fdfdf77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:22.116435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1837762-f723-444d-88ce-ff7f8fdfdf77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:22.116883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1837762-f723-444d-88ce-ff7f8fdfdf77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:22.117636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1837762-f723-444d-88ce-ff7f8fdfdf77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:22.118067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1837762-f723-444d-88ce-ff7f8fdfdf77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:22.179452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-32c2af0f-3a37-484f-b430-0bd5b5d3de19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:22.181670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:22.189822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-32c2af0f-3a37-484f-b430-0bd5b5d3de19 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155961 Jul 26 18:51:22.190423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1679/3382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:22 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:22.195080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4ae772fa-259d-4722-843b-9bd9e1948d9d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:22.195698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4ae772fa-259d-4722-843b-9bd9e1948d9d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:22.201697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ae772fa-259d-4722-843b-9bd9e1948d9d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:22.202201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ae772fa-259d-4722-843b-9bd9e1948d9d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:22.202898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ae772fa-259d-4722-843b-9bd9e1948d9d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:22.203451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ae772fa-259d-4722-843b-9bd9e1948d9d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:22.249207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a1837762-f723-444d-88ce-ff7f8fdfdf77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:22.257631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a1837762-f723-444d-88ce-ff7f8fdfdf77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:22.259177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a1837762-f723-444d-88ce-ff7f8fdfdf77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:22.260433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a1837762-f723-444d-88ce-ff7f8fdfdf77 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156011 Jul 26 18:51:22.261010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1704/3383] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:22 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:22.332557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4ae772fa-259d-4722-843b-9bd9e1948d9d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:22.340475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4ae772fa-259d-4722-843b-9bd9e1948d9d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.149126 Jul 26 18:51:22.341121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1680/3384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:22 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:22.498401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-60c77cf3-55b4-4528-919c-0a14610b70c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:22.499465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-60c77cf3-55b4-4528-919c-0a14610b70c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:22.503317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6711d548-7a5c-4a42-b4d8-660a2bdf1aca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:22.504350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6711d548-7a5c-4a42-b4d8-660a2bdf1aca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:22.509750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60c77cf3-55b4-4528-919c-0a14610b70c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:22.510510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60c77cf3-55b4-4528-919c-0a14610b70c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:22.511830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60c77cf3-55b4-4528-919c-0a14610b70c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:22.512740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60c77cf3-55b4-4528-919c-0a14610b70c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:22.513718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6711d548-7a5c-4a42-b4d8-660a2bdf1aca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:22.514181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6711d548-7a5c-4a42-b4d8-660a2bdf1aca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:22.514916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6711d548-7a5c-4a42-b4d8-660a2bdf1aca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:22.515373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6711d548-7a5c-4a42-b4d8-660a2bdf1aca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:22.643806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-60c77cf3-55b4-4528-919c-0a14610b70c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:22.646032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:22.650383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6711d548-7a5c-4a42-b4d8-660a2bdf1aca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:22.653782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-60c77cf3-55b4-4528-919c-0a14610b70c2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161899 Jul 26 18:51:22.654365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1705/3385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:22 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:22.658726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6711d548-7a5c-4a42-b4d8-660a2bdf1aca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.161660 Jul 26 18:51:22.659400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1681/3386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:23.215906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ac1dc8cc-d2af-4df9-be14-fed5912f4c1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:23.216595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ac1dc8cc-d2af-4df9-be14-fed5912f4c1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:23.224444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac1dc8cc-d2af-4df9-be14-fed5912f4c1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:23.224936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac1dc8cc-d2af-4df9-be14-fed5912f4c1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:23.225777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac1dc8cc-d2af-4df9-be14-fed5912f4c1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:23.226259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac1dc8cc-d2af-4df9-be14-fed5912f4c1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:23.283528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a26bbd16-7554-4dff-8fbe-a6b916adf929 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:23.284165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a26bbd16-7554-4dff-8fbe-a6b916adf929 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:23.290823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a26bbd16-7554-4dff-8fbe-a6b916adf929 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:23.291292 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a26bbd16-7554-4dff-8fbe-a6b916adf929 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:23.292034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a26bbd16-7554-4dff-8fbe-a6b916adf929 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:23.292457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a26bbd16-7554-4dff-8fbe-a6b916adf929 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:23.363782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ac1dc8cc-d2af-4df9-be14-fed5912f4c1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:23.372021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ac1dc8cc-d2af-4df9-be14-fed5912f4c1a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.162646 Jul 26 18:51:23.372834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1706/3387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:23 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:23.382225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f1cf5387-cbd0-4615-800f-14bcfa59cf33 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:23.382840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f1cf5387-cbd0-4615-800f-14bcfa59cf33 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:23.389291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1cf5387-cbd0-4615-800f-14bcfa59cf33 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:23.389739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1cf5387-cbd0-4615-800f-14bcfa59cf33 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:23.390501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1cf5387-cbd0-4615-800f-14bcfa59cf33 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:23.390930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1cf5387-cbd0-4615-800f-14bcfa59cf33 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:23.424105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a26bbd16-7554-4dff-8fbe-a6b916adf929 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:23.432877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a26bbd16-7554-4dff-8fbe-a6b916adf929 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:23.434427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a26bbd16-7554-4dff-8fbe-a6b916adf929 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:23.435700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a26bbd16-7554-4dff-8fbe-a6b916adf929 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156137 Jul 26 18:51:23.436292 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1682/3388] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:23 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:51:23.521365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f1cf5387-cbd0-4615-800f-14bcfa59cf33 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:23.536206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f1cf5387-cbd0-4615-800f-14bcfa59cf33 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.162309 Jul 26 18:51:23.537004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1707/3389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:23 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:23.679013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d994fb99-8d5e-4062-bd6f-3db9a8823b27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:23.680080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d994fb99-8d5e-4062-bd6f-3db9a8823b27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:23.685074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-709bf851-11c5-4e4b-bf06-9fb8b63079fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:23.685690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-709bf851-11c5-4e4b-bf06-9fb8b63079fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:23.688207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d994fb99-8d5e-4062-bd6f-3db9a8823b27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:23.688636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d994fb99-8d5e-4062-bd6f-3db9a8823b27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:23.689394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d994fb99-8d5e-4062-bd6f-3db9a8823b27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:23.689821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d994fb99-8d5e-4062-bd6f-3db9a8823b27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:23.692076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-709bf851-11c5-4e4b-bf06-9fb8b63079fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:23.692734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-709bf851-11c5-4e4b-bf06-9fb8b63079fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:23.693507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-709bf851-11c5-4e4b-bf06-9fb8b63079fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:23.693959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-709bf851-11c5-4e4b-bf06-9fb8b63079fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:23.841285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-709bf851-11c5-4e4b-bf06-9fb8b63079fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:23.850205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-709bf851-11c5-4e4b-bf06-9fb8b63079fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.172402 Jul 26 18:51:23.855300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1708/3390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:23 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:23.982223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d994fb99-8d5e-4062-bd6f-3db9a8823b27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:23.990881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d994fb99-8d5e-4062-bd6f-3db9a8823b27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.318198 Jul 26 18:51:23.992042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1683/3391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:23 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:24.397739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1437b9df-53b0-4560-bc19-5f231c773242 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:24.398689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1437b9df-53b0-4560-bc19-5f231c773242 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:24.407615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1437b9df-53b0-4560-bc19-5f231c773242 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:24.408059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1437b9df-53b0-4560-bc19-5f231c773242 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:24.408815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1437b9df-53b0-4560-bc19-5f231c773242 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:24.409245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1437b9df-53b0-4560-bc19-5f231c773242 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:24.458593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3f6f2910-daef-4637-86e5-80604abb0517 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:24.459333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3f6f2910-daef-4637-86e5-80604abb0517 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:24.466420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3f6f2910-daef-4637-86e5-80604abb0517 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:24.466836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3f6f2910-daef-4637-86e5-80604abb0517 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:24.467638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3f6f2910-daef-4637-86e5-80604abb0517 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:24.468066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3f6f2910-daef-4637-86e5-80604abb0517 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:24.547109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1437b9df-53b0-4560-bc19-5f231c773242 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:24.555474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1437b9df-53b0-4560-bc19-5f231c773242 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164656 Jul 26 18:51:24.556083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1709/3392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:24 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:24.560715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-837930f8-cb99-4f91-acd7-21a075e7cdb3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:24.561323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-837930f8-cb99-4f91-acd7-21a075e7cdb3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:24.568201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-837930f8-cb99-4f91-acd7-21a075e7cdb3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:24.568963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-837930f8-cb99-4f91-acd7-21a075e7cdb3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:24.569753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-837930f8-cb99-4f91-acd7-21a075e7cdb3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:24.570200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-837930f8-cb99-4f91-acd7-21a075e7cdb3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:24.606033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3f6f2910-daef-4637-86e5-80604abb0517 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:24.615828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3f6f2910-daef-4637-86e5-80604abb0517 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:24.617362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3f6f2910-daef-4637-86e5-80604abb0517 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:24.618477 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3f6f2910-daef-4637-86e5-80604abb0517 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.164207 Jul 26 18:51:24.619041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1684/3393] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:24.706770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-837930f8-cb99-4f91-acd7-21a075e7cdb3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:24.715323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-837930f8-cb99-4f91-acd7-21a075e7cdb3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.158140 Jul 26 18:51:24.715977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1710/3394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:24 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:24.876724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1c205664-93ca-4cd2-aa72-16717c452257 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:24.877725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1c205664-93ca-4cd2-aa72-16717c452257 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:24.888908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c205664-93ca-4cd2-aa72-16717c452257 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:24.889659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c205664-93ca-4cd2-aa72-16717c452257 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:24.890955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c205664-93ca-4cd2-aa72-16717c452257 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:24.891742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1c205664-93ca-4cd2-aa72-16717c452257 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:25.012681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c407df8d-d66b-4cc5-a45a-752f18cc6cfa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:25.013289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c407df8d-d66b-4cc5-a45a-752f18cc6cfa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:25.019745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c407df8d-d66b-4cc5-a45a-752f18cc6cfa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:25.020198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c407df8d-d66b-4cc5-a45a-752f18cc6cfa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:25.021041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c407df8d-d66b-4cc5-a45a-752f18cc6cfa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:25.021976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c407df8d-d66b-4cc5-a45a-752f18cc6cfa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:25.029282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1c205664-93ca-4cd2-aa72-16717c452257 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:25.037847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1c205664-93ca-4cd2-aa72-16717c452257 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.168316 Jul 26 18:51:25.038424 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1685/3395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:24 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:25.161643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c407df8d-d66b-4cc5-a45a-752f18cc6cfa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:25.174076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c407df8d-d66b-4cc5-a45a-752f18cc6cfa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.165082 Jul 26 18:51:25.174863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1711/3396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:25 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:25.577557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-70c049fa-12ef-45ba-a160-0c15c8fcdde0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:25.578132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-70c049fa-12ef-45ba-a160-0c15c8fcdde0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:25.585383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70c049fa-12ef-45ba-a160-0c15c8fcdde0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:25.585828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70c049fa-12ef-45ba-a160-0c15c8fcdde0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:25.586611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70c049fa-12ef-45ba-a160-0c15c8fcdde0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:25.587051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-70c049fa-12ef-45ba-a160-0c15c8fcdde0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:25.642701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7d331c80-52fd-453f-870f-1a62fcbfd8e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:25.643493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7d331c80-52fd-453f-870f-1a62fcbfd8e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:25.651209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d331c80-52fd-453f-870f-1a62fcbfd8e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:25.651690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d331c80-52fd-453f-870f-1a62fcbfd8e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:25.652485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d331c80-52fd-453f-870f-1a62fcbfd8e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:25.652929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d331c80-52fd-453f-870f-1a62fcbfd8e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:25.731041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-70c049fa-12ef-45ba-a160-0c15c8fcdde0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:25.739390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-70c049fa-12ef-45ba-a160-0c15c8fcdde0 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165918 Jul 26 18:51:25.739955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1686/3397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:25 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:25.749484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7fde6a29-9d0e-42a8-bb83-c5e5eaad9dd0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:25.751622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7fde6a29-9d0e-42a8-bb83-c5e5eaad9dd0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:25.758046 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fde6a29-9d0e-42a8-bb83-c5e5eaad9dd0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:25.758650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fde6a29-9d0e-42a8-bb83-c5e5eaad9dd0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:25.759476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fde6a29-9d0e-42a8-bb83-c5e5eaad9dd0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:25.759897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fde6a29-9d0e-42a8-bb83-c5e5eaad9dd0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:25.797805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7d331c80-52fd-453f-870f-1a62fcbfd8e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:25.806612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7d331c80-52fd-453f-870f-1a62fcbfd8e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:25.808154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7d331c80-52fd-453f-870f-1a62fcbfd8e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:25.809391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7d331c80-52fd-453f-870f-1a62fcbfd8e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.171055 Jul 26 18:51:25.809989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1712/3398] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:25.890200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7fde6a29-9d0e-42a8-bb83-c5e5eaad9dd0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:25.903102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7fde6a29-9d0e-42a8-bb83-c5e5eaad9dd0 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161523 Jul 26 18:51:25.903734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1687/3399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:25 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:26.059679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4ebd5198-3ebd-4b1c-ae37-cb63eed3493d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:26.060217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4ebd5198-3ebd-4b1c-ae37-cb63eed3493d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:26.066660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ebd5198-3ebd-4b1c-ae37-cb63eed3493d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:26.067152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ebd5198-3ebd-4b1c-ae37-cb63eed3493d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:26.067914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ebd5198-3ebd-4b1c-ae37-cb63eed3493d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:26.068349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ebd5198-3ebd-4b1c-ae37-cb63eed3493d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:26.199692 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6626a39b-cb2e-4c6f-a2ad-2c1b819c723b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:26.200301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6626a39b-cb2e-4c6f-a2ad-2c1b819c723b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:26.206464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6626a39b-cb2e-4c6f-a2ad-2c1b819c723b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:26.206919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6626a39b-cb2e-4c6f-a2ad-2c1b819c723b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:26.207852 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6626a39b-cb2e-4c6f-a2ad-2c1b819c723b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:26.208227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4ebd5198-3ebd-4b1c-ae37-cb63eed3493d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:26.208379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6626a39b-cb2e-4c6f-a2ad-2c1b819c723b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:26.216657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4ebd5198-3ebd-4b1c-ae37-cb63eed3493d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.161038 Jul 26 18:51:26.217261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1713/3400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:26 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:26.342009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6626a39b-cb2e-4c6f-a2ad-2c1b819c723b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:26.350617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6626a39b-cb2e-4c6f-a2ad-2c1b819c723b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154854 Jul 26 18:51:26.351214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1688/3401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:26 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:26.762779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-852e4a7d-e6f4-4c5c-a545-ed14c64a4b58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:26.763628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-852e4a7d-e6f4-4c5c-a545-ed14c64a4b58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:26.772972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-852e4a7d-e6f4-4c5c-a545-ed14c64a4b58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:26.773569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-852e4a7d-e6f4-4c5c-a545-ed14c64a4b58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:26.774570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-852e4a7d-e6f4-4c5c-a545-ed14c64a4b58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:26.775179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-852e4a7d-e6f4-4c5c-a545-ed14c64a4b58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:26.832435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c5c59c93-8754-415a-b953-c2e705ae3ddb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:26.833159 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c5c59c93-8754-415a-b953-c2e705ae3ddb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:26.840301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5c59c93-8754-415a-b953-c2e705ae3ddb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:26.840978 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5c59c93-8754-415a-b953-c2e705ae3ddb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:26.841773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5c59c93-8754-415a-b953-c2e705ae3ddb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:26.842216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c5c59c93-8754-415a-b953-c2e705ae3ddb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:26.907319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-852e4a7d-e6f4-4c5c-a545-ed14c64a4b58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:26.915802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-852e4a7d-e6f4-4c5c-a545-ed14c64a4b58 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158172 Jul 26 18:51:26.916351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1714/3402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:26 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:26.924469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d339a4d7-d732-4d5c-bf0d-fb0fe2c4e579 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:26.925086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d339a4d7-d732-4d5c-bf0d-fb0fe2c4e579 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:26.931398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d339a4d7-d732-4d5c-bf0d-fb0fe2c4e579 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:26.931847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d339a4d7-d732-4d5c-bf0d-fb0fe2c4e579 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:26.932611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d339a4d7-d732-4d5c-bf0d-fb0fe2c4e579 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:26.933043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d339a4d7-d732-4d5c-bf0d-fb0fe2c4e579 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:26.972989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c5c59c93-8754-415a-b953-c2e705ae3ddb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:26.981608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c5c59c93-8754-415a-b953-c2e705ae3ddb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:26.983185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c5c59c93-8754-415a-b953-c2e705ae3ddb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:26.984336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c5c59c93-8754-415a-b953-c2e705ae3ddb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155921 Jul 26 18:51:26.984890 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1689/3403] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:27.065200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d339a4d7-d732-4d5c-bf0d-fb0fe2c4e579 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:27.073321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d339a4d7-d732-4d5c-bf0d-fb0fe2c4e579 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153016 Jul 26 18:51:27.073885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1715/3404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:26 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:27.238140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4aebcad3-c848-48d8-965e-c3e8bb1da083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:27.238741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4aebcad3-c848-48d8-965e-c3e8bb1da083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:27.245575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4aebcad3-c848-48d8-965e-c3e8bb1da083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:27.246033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4aebcad3-c848-48d8-965e-c3e8bb1da083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:27.246786 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4aebcad3-c848-48d8-965e-c3e8bb1da083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:27.247258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4aebcad3-c848-48d8-965e-c3e8bb1da083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:27.372803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7a681236-fc8f-4a38-b7f3-2e9bb7ee375e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:27.373825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7a681236-fc8f-4a38-b7f3-2e9bb7ee375e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:27.380401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a681236-fc8f-4a38-b7f3-2e9bb7ee375e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:27.380858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a681236-fc8f-4a38-b7f3-2e9bb7ee375e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:27.381656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a681236-fc8f-4a38-b7f3-2e9bb7ee375e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:27.382077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a681236-fc8f-4a38-b7f3-2e9bb7ee375e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:27.384354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4aebcad3-c848-48d8-965e-c3e8bb1da083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:27.392560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4aebcad3-c848-48d8-965e-c3e8bb1da083 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158357 Jul 26 18:51:27.393125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1690/3405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:27 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:27.510774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7a681236-fc8f-4a38-b7f3-2e9bb7ee375e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:27.519465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7a681236-fc8f-4a38-b7f3-2e9bb7ee375e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150764 Jul 26 18:51:27.520048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1716/3406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:27 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:27.937814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ea4f4709-989c-49f5-a42b-582618cce517 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:27.938427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ea4f4709-989c-49f5-a42b-582618cce517 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:27.945465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ea4f4709-989c-49f5-a42b-582618cce517 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:27.945916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ea4f4709-989c-49f5-a42b-582618cce517 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:27.946693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ea4f4709-989c-49f5-a42b-582618cce517 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:27.947161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ea4f4709-989c-49f5-a42b-582618cce517 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:28.007546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e62eff5d-5534-4547-a00f-0d1ce79845fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:28.008122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e62eff5d-5534-4547-a00f-0d1ce79845fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:28.015275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e62eff5d-5534-4547-a00f-0d1ce79845fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:28.015755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e62eff5d-5534-4547-a00f-0d1ce79845fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:28.016519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e62eff5d-5534-4547-a00f-0d1ce79845fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:28.016950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e62eff5d-5534-4547-a00f-0d1ce79845fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:28.079905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ea4f4709-989c-49f5-a42b-582618cce517 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:28.088255 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ea4f4709-989c-49f5-a42b-582618cce517 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154334 Jul 26 18:51:28.089362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1691/3407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:28.093757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7b34e1ac-320d-4980-aef8-a8a8ec02bbc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:28.094458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7b34e1ac-320d-4980-aef8-a8a8ec02bbc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:28.100436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b34e1ac-320d-4980-aef8-a8a8ec02bbc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:28.100891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b34e1ac-320d-4980-aef8-a8a8ec02bbc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:28.101650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b34e1ac-320d-4980-aef8-a8a8ec02bbc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:28.102079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7b34e1ac-320d-4980-aef8-a8a8ec02bbc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:28.169837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e62eff5d-5534-4547-a00f-0d1ce79845fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:28.178490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e62eff5d-5534-4547-a00f-0d1ce79845fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:28.180008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e62eff5d-5534-4547-a00f-0d1ce79845fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:28.181171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e62eff5d-5534-4547-a00f-0d1ce79845fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.177822 Jul 26 18:51:28.191067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1717/3408] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:51:28.234880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7b34e1ac-320d-4980-aef8-a8a8ec02bbc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:28.246975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7b34e1ac-320d-4980-aef8-a8a8ec02bbc9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156124 Jul 26 18:51:28.247888 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1692/3409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:28 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:28.415153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aaf62ae0-ee45-4697-a4d1-0ee16c44d72d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:28.415792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aaf62ae0-ee45-4697-a4d1-0ee16c44d72d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:28.423161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aaf62ae0-ee45-4697-a4d1-0ee16c44d72d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:28.423660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aaf62ae0-ee45-4697-a4d1-0ee16c44d72d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:28.424497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aaf62ae0-ee45-4697-a4d1-0ee16c44d72d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:28.424980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aaf62ae0-ee45-4697-a4d1-0ee16c44d72d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:28.541060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-132b5642-0e34-49a1-a118-bb37d1a717ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:28.541762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-132b5642-0e34-49a1-a118-bb37d1a717ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:28.548269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-132b5642-0e34-49a1-a118-bb37d1a717ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:28.548716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-132b5642-0e34-49a1-a118-bb37d1a717ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:28.549491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-132b5642-0e34-49a1-a118-bb37d1a717ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:28.549905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-132b5642-0e34-49a1-a118-bb37d1a717ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:28.573298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-aaf62ae0-ee45-4697-a4d1-0ee16c44d72d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:28.581896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aaf62ae0-ee45-4697-a4d1-0ee16c44d72d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.171192 Jul 26 18:51:28.582529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1718/3410] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:28 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:28.677453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-132b5642-0e34-49a1-a118-bb37d1a717ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:28.685755 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-132b5642-0e34-49a1-a118-bb37d1a717ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.148625 Jul 26 18:51:28.686328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1693/3411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:28 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:29.112938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-90293299-2e01-4f7c-9c93-0d2fa0eff20a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:29.113831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-90293299-2e01-4f7c-9c93-0d2fa0eff20a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:29.124532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90293299-2e01-4f7c-9c93-0d2fa0eff20a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:29.124951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90293299-2e01-4f7c-9c93-0d2fa0eff20a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:29.125717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90293299-2e01-4f7c-9c93-0d2fa0eff20a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:29.126152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90293299-2e01-4f7c-9c93-0d2fa0eff20a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:29.204443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7bc8c9fe-6e1f-48fd-9439-52d332fd9e4e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:29.205036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7bc8c9fe-6e1f-48fd-9439-52d332fd9e4e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:29.211677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bc8c9fe-6e1f-48fd-9439-52d332fd9e4e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:29.212128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bc8c9fe-6e1f-48fd-9439-52d332fd9e4e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:29.212872 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bc8c9fe-6e1f-48fd-9439-52d332fd9e4e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:29.213309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7bc8c9fe-6e1f-48fd-9439-52d332fd9e4e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:29.256418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-90293299-2e01-4f7c-9c93-0d2fa0eff20a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:29.264645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-90293299-2e01-4f7c-9c93-0d2fa0eff20a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.157751 Jul 26 18:51:29.265220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1719/3412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:29 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:29.275569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3a831f1b-8260-4027-ab19-f78c3c794e2c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:29.276436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3a831f1b-8260-4027-ab19-f78c3c794e2c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:29.282976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a831f1b-8260-4027-ab19-f78c3c794e2c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:29.283535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a831f1b-8260-4027-ab19-f78c3c794e2c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:29.284214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a831f1b-8260-4027-ab19-f78c3c794e2c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:29.284666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a831f1b-8260-4027-ab19-f78c3c794e2c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:29.349919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7bc8c9fe-6e1f-48fd-9439-52d332fd9e4e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:29.359584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7bc8c9fe-6e1f-48fd-9439-52d332fd9e4e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:29.361087 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7bc8c9fe-6e1f-48fd-9439-52d332fd9e4e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:29.362250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7bc8c9fe-6e1f-48fd-9439-52d332fd9e4e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162094 Jul 26 18:51:29.362811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1694/3413] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:29.433439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3a831f1b-8260-4027-ab19-f78c3c794e2c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:29.442284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3a831f1b-8260-4027-ab19-f78c3c794e2c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.170912 Jul 26 18:51:29.442857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1720/3414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:29 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:29.606916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-03e97107-86ad-48cd-93bd-3d8bbd465fa5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:29.607823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-03e97107-86ad-48cd-93bd-3d8bbd465fa5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:29.617788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03e97107-86ad-48cd-93bd-3d8bbd465fa5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:29.618403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03e97107-86ad-48cd-93bd-3d8bbd465fa5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:29.619612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03e97107-86ad-48cd-93bd-3d8bbd465fa5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:29.620257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-03e97107-86ad-48cd-93bd-3d8bbd465fa5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:29.707492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-42bd5c1a-1c08-4847-be42-c372e29e5e6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:29.708097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-42bd5c1a-1c08-4847-be42-c372e29e5e6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:29.714514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42bd5c1a-1c08-4847-be42-c372e29e5e6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:29.714964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42bd5c1a-1c08-4847-be42-c372e29e5e6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:29.715753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42bd5c1a-1c08-4847-be42-c372e29e5e6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:29.716186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42bd5c1a-1c08-4847-be42-c372e29e5e6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:29.760232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-03e97107-86ad-48cd-93bd-3d8bbd465fa5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:29.768841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-03e97107-86ad-48cd-93bd-3d8bbd465fa5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.168406 Jul 26 18:51:29.769667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1695/3415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:29 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:29.845810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-42bd5c1a-1c08-4847-be42-c372e29e5e6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:29.854273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-42bd5c1a-1c08-4847-be42-c372e29e5e6e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150539 Jul 26 18:51:29.855143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1721/3416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:29 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:30.289511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bb19ebdc-8e55-4778-9f61-825bd0fc1b7d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:30.290092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bb19ebdc-8e55-4778-9f61-825bd0fc1b7d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:30.298791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb19ebdc-8e55-4778-9f61-825bd0fc1b7d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:30.299271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb19ebdc-8e55-4778-9f61-825bd0fc1b7d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:30.300027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb19ebdc-8e55-4778-9f61-825bd0fc1b7d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:30.300461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb19ebdc-8e55-4778-9f61-825bd0fc1b7d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:30.315760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:30.385497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e2322350-cf60-4cc3-a161-3dfbb6498578 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:30.386116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e2322350-cf60-4cc3-a161-3dfbb6498578 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:30.393042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2322350-cf60-4cc3-a161-3dfbb6498578 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:30.393508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2322350-cf60-4cc3-a161-3dfbb6498578 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:30.394269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2322350-cf60-4cc3-a161-3dfbb6498578 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:30.394676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e2322350-cf60-4cc3-a161-3dfbb6498578 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:30.410669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:30.440409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bb19ebdc-8e55-4778-9f61-825bd0fc1b7d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:30.448503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bb19ebdc-8e55-4778-9f61-825bd0fc1b7d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165056 Jul 26 18:51:30.449042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1696/3417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:30 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:30.466589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-84271e7f-c684-4a8d-80a3-690f29e61c8e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:30.467140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-84271e7f-c684-4a8d-80a3-690f29e61c8e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:30.473430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84271e7f-c684-4a8d-80a3-690f29e61c8e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:30.473573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84271e7f-c684-4a8d-80a3-690f29e61c8e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:30.474293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84271e7f-c684-4a8d-80a3-690f29e61c8e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:30.474698 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84271e7f-c684-4a8d-80a3-690f29e61c8e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:30.524510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e2322350-cf60-4cc3-a161-3dfbb6498578 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:30.534898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e2322350-cf60-4cc3-a161-3dfbb6498578 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:30.536445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e2322350-cf60-4cc3-a161-3dfbb6498578 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:30.537646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e2322350-cf60-4cc3-a161-3dfbb6498578 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156160 Jul 26 18:51:30.538206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1722/3418] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:30.607534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-84271e7f-c684-4a8d-80a3-690f29e61c8e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:30.619435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-84271e7f-c684-4a8d-80a3-690f29e61c8e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156298 Jul 26 18:51:30.620149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1697/3419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:30 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:30.791425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7e30df34-63cc-4315-9844-e47e5533082e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:30.792197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7e30df34-63cc-4315-9844-e47e5533082e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:30.799574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e30df34-63cc-4315-9844-e47e5533082e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:30.800024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e30df34-63cc-4315-9844-e47e5533082e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:30.800784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e30df34-63cc-4315-9844-e47e5533082e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:30.801218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e30df34-63cc-4315-9844-e47e5533082e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:30.883180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f48ab982-fdfb-464b-a9f0-3d03c9a0916d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:30.883785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f48ab982-fdfb-464b-a9f0-3d03c9a0916d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:30.890412 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f48ab982-fdfb-464b-a9f0-3d03c9a0916d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:30.890868 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f48ab982-fdfb-464b-a9f0-3d03c9a0916d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:30.891639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f48ab982-fdfb-464b-a9f0-3d03c9a0916d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:30.892064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f48ab982-fdfb-464b-a9f0-3d03c9a0916d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:30.935109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7e30df34-63cc-4315-9844-e47e5533082e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:30.943287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7e30df34-63cc-4315-9844-e47e5533082e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156662 Jul 26 18:51:30.943857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1723/3420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:30 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:31.027478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f48ab982-fdfb-464b-a9f0-3d03c9a0916d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:31.036390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f48ab982-fdfb-464b-a9f0-3d03c9a0916d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157256 Jul 26 18:51:31.036963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1698/3421] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:30 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:31.469778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-856275c9-9608-46c8-9e07-0f985919cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:31.470418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-856275c9-9608-46c8-9e07-0f985919cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:31.477630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-856275c9-9608-46c8-9e07-0f985919cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:31.478081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-856275c9-9608-46c8-9e07-0f985919cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:31.478864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-856275c9-9608-46c8-9e07-0f985919cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:31.479370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-856275c9-9608-46c8-9e07-0f985919cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:31.560681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e6932e29-b215-4ef4-ad44-0de627f5ecc7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:31.561284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e6932e29-b215-4ef4-ad44-0de627f5ecc7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:31.567990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6932e29-b215-4ef4-ad44-0de627f5ecc7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:31.568437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6932e29-b215-4ef4-ad44-0de627f5ecc7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:31.569193 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6932e29-b215-4ef4-ad44-0de627f5ecc7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:31.569628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e6932e29-b215-4ef4-ad44-0de627f5ecc7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:31.609968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-856275c9-9608-46c8-9e07-0f985919cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:31.622529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-856275c9-9608-46c8-9e07-0f985919cd22 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156392 Jul 26 18:51:31.623559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1724/3422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:31 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:31.640535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-735b5d4c-a9d3-466b-9aa7-36e692c4fdb2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:31.641214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-735b5d4c-a9d3-466b-9aa7-36e692c4fdb2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:31.647652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-735b5d4c-a9d3-466b-9aa7-36e692c4fdb2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:31.648164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-735b5d4c-a9d3-466b-9aa7-36e692c4fdb2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:31.649004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-735b5d4c-a9d3-466b-9aa7-36e692c4fdb2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:31.649415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-735b5d4c-a9d3-466b-9aa7-36e692c4fdb2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:31.717740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e6932e29-b215-4ef4-ad44-0de627f5ecc7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:31.726758 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e6932e29-b215-4ef4-ad44-0de627f5ecc7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:31.728303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e6932e29-b215-4ef4-ad44-0de627f5ecc7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:31.729495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e6932e29-b215-4ef4-ad44-0de627f5ecc7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.172800 Jul 26 18:51:31.730453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1699/3423] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:51:31.779617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-735b5d4c-a9d3-466b-9aa7-36e692c4fdb2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:31.788008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-735b5d4c-a9d3-466b-9aa7-36e692c4fdb2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151229 Jul 26 18:51:31.788529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1725/3424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:31 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:31.968310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-34168ea5-49ac-423d-a661-c12cb5c700b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:31.968917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-34168ea5-49ac-423d-a661-c12cb5c700b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:31.975174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34168ea5-49ac-423d-a661-c12cb5c700b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:31.975606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34168ea5-49ac-423d-a661-c12cb5c700b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:31.976371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34168ea5-49ac-423d-a661-c12cb5c700b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:31.976805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-34168ea5-49ac-423d-a661-c12cb5c700b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:32.057991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e9924640-1985-4300-aeb8-65dcec641526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:32.058751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e9924640-1985-4300-aeb8-65dcec641526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:32.065352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9924640-1985-4300-aeb8-65dcec641526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:32.065809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9924640-1985-4300-aeb8-65dcec641526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:32.066608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9924640-1985-4300-aeb8-65dcec641526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:32.067136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e9924640-1985-4300-aeb8-65dcec641526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:32.116930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-34168ea5-49ac-423d-a661-c12cb5c700b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:32.125529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-34168ea5-49ac-423d-a661-c12cb5c700b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163589 Jul 26 18:51:32.126082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1700/3425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:31 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:32.199406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e9924640-1985-4300-aeb8-65dcec641526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:32.208156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e9924640-1985-4300-aeb8-65dcec641526 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154181 Jul 26 18:51:32.208668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1726/3426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:32 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:32.660467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0b5f76d2-1445-44df-a969-290aa58983a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:32.661392 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0b5f76d2-1445-44df-a969-290aa58983a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:32.672667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b5f76d2-1445-44df-a969-290aa58983a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:32.677156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b5f76d2-1445-44df-a969-290aa58983a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:32.677156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b5f76d2-1445-44df-a969-290aa58983a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:32.677156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b5f76d2-1445-44df-a969-290aa58983a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:32.753062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cd715db5-8e5f-4c43-81c5-a94db865b30b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:32.753864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cd715db5-8e5f-4c43-81c5-a94db865b30b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:32.760379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd715db5-8e5f-4c43-81c5-a94db865b30b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:32.760898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd715db5-8e5f-4c43-81c5-a94db865b30b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:32.761722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd715db5-8e5f-4c43-81c5-a94db865b30b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:32.762154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd715db5-8e5f-4c43-81c5-a94db865b30b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:32.817000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0b5f76d2-1445-44df-a969-290aa58983a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:32.825396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0b5f76d2-1445-44df-a969-290aa58983a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.171633 Jul 26 18:51:32.825999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1701/3427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:32 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:32.839372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8fa021f9-a49d-49e1-8a55-852da73cb384 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:32.840009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8fa021f9-a49d-49e1-8a55-852da73cb384 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:32.846660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fa021f9-a49d-49e1-8a55-852da73cb384 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:32.847149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fa021f9-a49d-49e1-8a55-852da73cb384 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:32.847929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fa021f9-a49d-49e1-8a55-852da73cb384 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:32.848376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8fa021f9-a49d-49e1-8a55-852da73cb384 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:32.897397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cd715db5-8e5f-4c43-81c5-a94db865b30b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:32.906335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cd715db5-8e5f-4c43-81c5-a94db865b30b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:32.907886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cd715db5-8e5f-4c43-81c5-a94db865b30b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:32.909027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cd715db5-8e5f-4c43-81c5-a94db865b30b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159869 Jul 26 18:51:32.909605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1727/3428] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:32 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:32.981746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8fa021f9-a49d-49e1-8a55-852da73cb384 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:32.990142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8fa021f9-a49d-49e1-8a55-852da73cb384 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.163131 Jul 26 18:51:32.990724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1702/3429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:32 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:33.148190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-16df3aa6-51bc-49a3-b873-49698c7caef0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:33.148803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-16df3aa6-51bc-49a3-b873-49698c7caef0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:33.155368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16df3aa6-51bc-49a3-b873-49698c7caef0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:33.155843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16df3aa6-51bc-49a3-b873-49698c7caef0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:33.156604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16df3aa6-51bc-49a3-b873-49698c7caef0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:33.157037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16df3aa6-51bc-49a3-b873-49698c7caef0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:33.228955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e4e8d8b2-0d6b-4a68-95e1-269a58a24d0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:33.229560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e4e8d8b2-0d6b-4a68-95e1-269a58a24d0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:33.236077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e4e8d8b2-0d6b-4a68-95e1-269a58a24d0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:33.236524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e4e8d8b2-0d6b-4a68-95e1-269a58a24d0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:33.237245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e4e8d8b2-0d6b-4a68-95e1-269a58a24d0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:33.237690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e4e8d8b2-0d6b-4a68-95e1-269a58a24d0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:33.288402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-16df3aa6-51bc-49a3-b873-49698c7caef0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:33.296485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-16df3aa6-51bc-49a3-b873-49698c7caef0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152740 Jul 26 18:51:33.297087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1728/3430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:33 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:33.364300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e4e8d8b2-0d6b-4a68-95e1-269a58a24d0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:33.372555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e4e8d8b2-0d6b-4a68-95e1-269a58a24d0a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.147501 Jul 26 18:51:33.373158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1703/3431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:33 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:33.851614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ff6c6967-902b-43fe-8ebd-a1906cb3abae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:33.852599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ff6c6967-902b-43fe-8ebd-a1906cb3abae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:33.861663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff6c6967-902b-43fe-8ebd-a1906cb3abae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:33.862116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff6c6967-902b-43fe-8ebd-a1906cb3abae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:33.862877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff6c6967-902b-43fe-8ebd-a1906cb3abae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:33.863355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff6c6967-902b-43fe-8ebd-a1906cb3abae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:33.932051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b934428e-45f7-4436-a895-189b0bd84659 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:33.932688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b934428e-45f7-4436-a895-189b0bd84659 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:33.939660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b934428e-45f7-4436-a895-189b0bd84659 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:33.940107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b934428e-45f7-4436-a895-189b0bd84659 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:33.940856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b934428e-45f7-4436-a895-189b0bd84659 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:33.941470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b934428e-45f7-4436-a895-189b0bd84659 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:33.996252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ff6c6967-902b-43fe-8ebd-a1906cb3abae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:34.004644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ff6c6967-902b-43fe-8ebd-a1906cb3abae tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159601 Jul 26 18:51:34.005399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1729/3432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:33 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:34.011166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-932d18de-20f8-416f-ab97-e2b2173dc35f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:34.011734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-932d18de-20f8-416f-ab97-e2b2173dc35f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:34.017835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-932d18de-20f8-416f-ab97-e2b2173dc35f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:34.018291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-932d18de-20f8-416f-ab97-e2b2173dc35f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:34.019063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-932d18de-20f8-416f-ab97-e2b2173dc35f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:34.019526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-932d18de-20f8-416f-ab97-e2b2173dc35f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:34.078211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b934428e-45f7-4436-a895-189b0bd84659 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:34.086915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b934428e-45f7-4436-a895-189b0bd84659 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:34.088443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b934428e-45f7-4436-a895-189b0bd84659 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:34.089588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b934428e-45f7-4436-a895-189b0bd84659 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161536 Jul 26 18:51:34.090138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1704/3433] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:34.150995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-932d18de-20f8-416f-ab97-e2b2173dc35f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:34.159154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-932d18de-20f8-416f-ab97-e2b2173dc35f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151974 Jul 26 18:51:34.159725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1730/3434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:34 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:34.322043 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6b66b036-e8e4-4ecc-8e11-e9865dc30917 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:34.322908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6b66b036-e8e4-4ecc-8e11-e9865dc30917 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:34.333099 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b66b036-e8e4-4ecc-8e11-e9865dc30917 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:34.333836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b66b036-e8e4-4ecc-8e11-e9865dc30917 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:34.335090 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b66b036-e8e4-4ecc-8e11-e9865dc30917 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:34.335827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6b66b036-e8e4-4ecc-8e11-e9865dc30917 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:34.393889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1880ceb4-fbf0-4690-ba15-786c8e7aa30a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:34.394492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1880ceb4-fbf0-4690-ba15-786c8e7aa30a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:34.401240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1880ceb4-fbf0-4690-ba15-786c8e7aa30a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:34.401683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1880ceb4-fbf0-4690-ba15-786c8e7aa30a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:34.402448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1880ceb4-fbf0-4690-ba15-786c8e7aa30a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:34.402930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1880ceb4-fbf0-4690-ba15-786c8e7aa30a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:34.473987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6b66b036-e8e4-4ecc-8e11-e9865dc30917 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:34.483363 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6b66b036-e8e4-4ecc-8e11-e9865dc30917 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167997 Jul 26 18:51:34.484022 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1705/3435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:34 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:34.539443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1880ceb4-fbf0-4690-ba15-786c8e7aa30a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:34.547859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1880ceb4-fbf0-4690-ba15-786c8e7aa30a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157821 Jul 26 18:51:34.548453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1731/3436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:34 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:35.030077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ccde3c4a-f23f-4719-a994-e8fafc11d3a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:35.031009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ccde3c4a-f23f-4719-a994-e8fafc11d3a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:35.037948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ccde3c4a-f23f-4719-a994-e8fafc11d3a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:35.038389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ccde3c4a-f23f-4719-a994-e8fafc11d3a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:35.039436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ccde3c4a-f23f-4719-a994-e8fafc11d3a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:35.039867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ccde3c4a-f23f-4719-a994-e8fafc11d3a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:35.113103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e66fa73f-2ace-4061-b091-ae92a789bd2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:35.113804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e66fa73f-2ace-4061-b091-ae92a789bd2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:35.120286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e66fa73f-2ace-4061-b091-ae92a789bd2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:35.120805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e66fa73f-2ace-4061-b091-ae92a789bd2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:35.121736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e66fa73f-2ace-4061-b091-ae92a789bd2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:35.122240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e66fa73f-2ace-4061-b091-ae92a789bd2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:35.178523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ccde3c4a-f23f-4719-a994-e8fafc11d3a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:35.186722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ccde3c4a-f23f-4719-a994-e8fafc11d3a6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163182 Jul 26 18:51:35.187349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1706/3437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:35 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:35.191764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0ec00fa6-45b3-491b-b2cd-f0bb7a43fa6f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:35.192328 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0ec00fa6-45b3-491b-b2cd-f0bb7a43fa6f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:35.198561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ec00fa6-45b3-491b-b2cd-f0bb7a43fa6f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:35.198982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ec00fa6-45b3-491b-b2cd-f0bb7a43fa6f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:35.199797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ec00fa6-45b3-491b-b2cd-f0bb7a43fa6f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:35.200233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ec00fa6-45b3-491b-b2cd-f0bb7a43fa6f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:35.257571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e66fa73f-2ace-4061-b091-ae92a789bd2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:35.267205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e66fa73f-2ace-4061-b091-ae92a789bd2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:35.268717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e66fa73f-2ace-4061-b091-ae92a789bd2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:35.269884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e66fa73f-2ace-4061-b091-ae92a789bd2f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160916 Jul 26 18:51:35.270461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1732/3438] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:35 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:35.332910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0ec00fa6-45b3-491b-b2cd-f0bb7a43fa6f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:35.345298 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0ec00fa6-45b3-491b-b2cd-f0bb7a43fa6f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156716 Jul 26 18:51:35.346147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1707/3439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:35 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:35.511799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c20a000a-d4e2-43c6-8ce8-95c25f2d256d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:35.512600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c20a000a-d4e2-43c6-8ce8-95c25f2d256d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:35.519554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c20a000a-d4e2-43c6-8ce8-95c25f2d256d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:35.520009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c20a000a-d4e2-43c6-8ce8-95c25f2d256d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:35.520773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c20a000a-d4e2-43c6-8ce8-95c25f2d256d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:35.521191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c20a000a-d4e2-43c6-8ce8-95c25f2d256d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:35.569781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-820e3a8d-f6cc-498c-9de6-be763655fc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:35.570386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-820e3a8d-f6cc-498c-9de6-be763655fc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:35.576400 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-820e3a8d-f6cc-498c-9de6-be763655fc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:35.576836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-820e3a8d-f6cc-498c-9de6-be763655fc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:35.577620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-820e3a8d-f6cc-498c-9de6-be763655fc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:35.578051 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-820e3a8d-f6cc-498c-9de6-be763655fc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:35.653988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c20a000a-d4e2-43c6-8ce8-95c25f2d256d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:35.662154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c20a000a-d4e2-43c6-8ce8-95c25f2d256d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155174 Jul 26 18:51:35.662756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1733/3440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:35 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:35.704624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-820e3a8d-f6cc-498c-9de6-be763655fc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:35.712605 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-820e3a8d-f6cc-498c-9de6-be763655fc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.146684 Jul 26 18:51:35.713166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1708/3441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:35 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:36.212427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5f7c48d9-4f1c-437c-ab9d-a0c323d5eeac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:36.213268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5f7c48d9-4f1c-437c-ab9d-a0c323d5eeac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:36.224414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f7c48d9-4f1c-437c-ab9d-a0c323d5eeac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:36.225119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f7c48d9-4f1c-437c-ab9d-a0c323d5eeac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:36.226348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f7c48d9-4f1c-437c-ab9d-a0c323d5eeac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:36.227100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f7c48d9-4f1c-437c-ab9d-a0c323d5eeac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:36.293243 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-08437844-b32a-4213-a41a-387f9ba18560 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:36.293827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-08437844-b32a-4213-a41a-387f9ba18560 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:36.300811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08437844-b32a-4213-a41a-387f9ba18560 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:36.301258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08437844-b32a-4213-a41a-387f9ba18560 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:36.302021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08437844-b32a-4213-a41a-387f9ba18560 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:36.302453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-08437844-b32a-4213-a41a-387f9ba18560 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:36.357296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5f7c48d9-4f1c-437c-ab9d-a0c323d5eeac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:36.366170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5f7c48d9-4f1c-437c-ab9d-a0c323d5eeac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160371 Jul 26 18:51:36.366743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1734/3442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:36 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:36.371400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cfd4319e-d1c1-47e2-aefc-9ae3b3f24b0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:36.371994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cfd4319e-d1c1-47e2-aefc-9ae3b3f24b0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:36.377949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfd4319e-d1c1-47e2-aefc-9ae3b3f24b0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:36.378390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfd4319e-d1c1-47e2-aefc-9ae3b3f24b0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:36.379180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfd4319e-d1c1-47e2-aefc-9ae3b3f24b0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:36.379617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cfd4319e-d1c1-47e2-aefc-9ae3b3f24b0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:36.449528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-08437844-b32a-4213-a41a-387f9ba18560 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:36.458236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-08437844-b32a-4213-a41a-387f9ba18560 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:36.459765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-08437844-b32a-4213-a41a-387f9ba18560 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:36.460922 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-08437844-b32a-4213-a41a-387f9ba18560 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.171726 Jul 26 18:51:36.461538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1709/3443] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:36 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:36.512775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cfd4319e-d1c1-47e2-aefc-9ae3b3f24b0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:36.520813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cfd4319e-d1c1-47e2-aefc-9ae3b3f24b0b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152927 Jul 26 18:51:36.521404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1735/3444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:36 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:36.687337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8511a07e-a7b1-4033-8f45-731f4ab52aaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:36.688323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8511a07e-a7b1-4033-8f45-731f4ab52aaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:36.699268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8511a07e-a7b1-4033-8f45-731f4ab52aaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:36.700015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8511a07e-a7b1-4033-8f45-731f4ab52aaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:36.701270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8511a07e-a7b1-4033-8f45-731f4ab52aaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:36.701988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8511a07e-a7b1-4033-8f45-731f4ab52aaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:36.733733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2178d86d-d697-4185-95a3-5657260c005f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:36.734530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2178d86d-d697-4185-95a3-5657260c005f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:36.741117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2178d86d-d697-4185-95a3-5657260c005f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:36.741573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2178d86d-d697-4185-95a3-5657260c005f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:36.742340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2178d86d-d697-4185-95a3-5657260c005f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:36.742775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2178d86d-d697-4185-95a3-5657260c005f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:36.838712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8511a07e-a7b1-4033-8f45-731f4ab52aaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:36.846919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8511a07e-a7b1-4033-8f45-731f4ab52aaa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.166155 Jul 26 18:51:36.847550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1710/3445] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:36 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:36.875109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2178d86d-d697-4185-95a3-5657260c005f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:36.883253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2178d86d-d697-4185-95a3-5657260c005f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153335 Jul 26 18:51:36.883848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1736/3446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:36 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:37.391926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4bee9aa5-5d7d-4799-9dad-9fce3924a611 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:37.392870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4bee9aa5-5d7d-4799-9dad-9fce3924a611 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:37.404227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bee9aa5-5d7d-4799-9dad-9fce3924a611 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:37.404972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bee9aa5-5d7d-4799-9dad-9fce3924a611 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:37.406150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bee9aa5-5d7d-4799-9dad-9fce3924a611 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:37.406585 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4bee9aa5-5d7d-4799-9dad-9fce3924a611 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:37.483958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5844fe6d-504a-4f22-a986-e3630111f439 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:37.484560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5844fe6d-504a-4f22-a986-e3630111f439 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:37.491601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5844fe6d-504a-4f22-a986-e3630111f439 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:37.492041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5844fe6d-504a-4f22-a986-e3630111f439 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:37.492800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5844fe6d-504a-4f22-a986-e3630111f439 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:37.493231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5844fe6d-504a-4f22-a986-e3630111f439 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:37.532713 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4bee9aa5-5d7d-4799-9dad-9fce3924a611 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:37.541478 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4bee9aa5-5d7d-4799-9dad-9fce3924a611 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155948 Jul 26 18:51:37.542056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1711/3447] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:37 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:37.546520 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5da9e4be-63d5-4264-897f-1134f1f436ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:37.547176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5da9e4be-63d5-4264-897f-1134f1f436ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:37.553182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5da9e4be-63d5-4264-897f-1134f1f436ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:37.553636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5da9e4be-63d5-4264-897f-1134f1f436ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:37.554393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5da9e4be-63d5-4264-897f-1134f1f436ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:37.554825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5da9e4be-63d5-4264-897f-1134f1f436ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:37.628725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5844fe6d-504a-4f22-a986-e3630111f439 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:37.641701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5844fe6d-504a-4f22-a986-e3630111f439 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:37.643465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5844fe6d-504a-4f22-a986-e3630111f439 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:37.644739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5844fe6d-504a-4f22-a986-e3630111f439 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.164830 Jul 26 18:51:37.645526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1737/3448] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:37.689754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5da9e4be-63d5-4264-897f-1134f1f436ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:37.697982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5da9e4be-63d5-4264-897f-1134f1f436ef tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154993 Jul 26 18:51:37.698543 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1712/3449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:37 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:37.872414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6d6e85bf-6daa-4c9e-9ecd-351e88446c31 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:37.873408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6d6e85bf-6daa-4c9e-9ecd-351e88446c31 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:37.875722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:37.881381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d6e85bf-6daa-4c9e-9ecd-351e88446c31 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:37.881822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d6e85bf-6daa-4c9e-9ecd-351e88446c31 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:37.882576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d6e85bf-6daa-4c9e-9ecd-351e88446c31 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:37.883001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d6e85bf-6daa-4c9e-9ecd-351e88446c31 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:37.905221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ed836850-afde-4df2-956c-bb1a40a54813 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:37.905935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ed836850-afde-4df2-956c-bb1a40a54813 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:37.912398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed836850-afde-4df2-956c-bb1a40a54813 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:37.912850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed836850-afde-4df2-956c-bb1a40a54813 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:37.913599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed836850-afde-4df2-956c-bb1a40a54813 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:37.914028 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed836850-afde-4df2-956c-bb1a40a54813 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:37.916623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:38.014859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6d6e85bf-6daa-4c9e-9ecd-351e88446c31 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:38.023511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6d6e85bf-6daa-4c9e-9ecd-351e88446c31 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157492 Jul 26 18:51:38.024081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1738/3450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:37 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:38.044045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ed836850-afde-4df2-956c-bb1a40a54813 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:38.052214 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ed836850-afde-4df2-956c-bb1a40a54813 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150993 Jul 26 18:51:38.052777 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1713/3451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:37 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:38.566254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b69ba740-8894-47d3-9bf7-ac84455f6428 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:38.567259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b69ba740-8894-47d3-9bf7-ac84455f6428 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:38.578221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b69ba740-8894-47d3-9bf7-ac84455f6428 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:38.578967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b69ba740-8894-47d3-9bf7-ac84455f6428 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:38.580288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b69ba740-8894-47d3-9bf7-ac84455f6428 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:38.581051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b69ba740-8894-47d3-9bf7-ac84455f6428 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:38.585265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:38.668074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ea406a0f-f095-4842-8fe9-4df50a91effa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:38.668700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ea406a0f-f095-4842-8fe9-4df50a91effa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:38.675467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ea406a0f-f095-4842-8fe9-4df50a91effa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:38.676314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ea406a0f-f095-4842-8fe9-4df50a91effa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:38.676675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ea406a0f-f095-4842-8fe9-4df50a91effa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:38.677091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ea406a0f-f095-4842-8fe9-4df50a91effa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:38.733163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b69ba740-8894-47d3-9bf7-ac84455f6428 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:38.748710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b69ba740-8894-47d3-9bf7-ac84455f6428 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.188796 Jul 26 18:51:38.750254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1739/3452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:38 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:38.764716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-54641f9b-532e-419b-bcb9-97fe8a73a3f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:38.765356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-54641f9b-532e-419b-bcb9-97fe8a73a3f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:38.771545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54641f9b-532e-419b-bcb9-97fe8a73a3f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:38.772293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54641f9b-532e-419b-bcb9-97fe8a73a3f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:38.773045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54641f9b-532e-419b-bcb9-97fe8a73a3f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:38.773470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54641f9b-532e-419b-bcb9-97fe8a73a3f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:38.819485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ea406a0f-f095-4842-8fe9-4df50a91effa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:38.827999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ea406a0f-f095-4842-8fe9-4df50a91effa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:38.829611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ea406a0f-f095-4842-8fe9-4df50a91effa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:38.830811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ea406a0f-f095-4842-8fe9-4df50a91effa tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.167246 Jul 26 18:51:38.831401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1714/3453] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:38.901781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-54641f9b-532e-419b-bcb9-97fe8a73a3f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:38.909854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-54641f9b-532e-419b-bcb9-97fe8a73a3f3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.158672 Jul 26 18:51:38.910507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1740/3454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:38 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:39.048321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9d874fb5-ef4a-4df7-b0c7-a7c3dc0f7581 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:39.048987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9d874fb5-ef4a-4df7-b0c7-a7c3dc0f7581 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:39.050947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:39.056655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d874fb5-ef4a-4df7-b0c7-a7c3dc0f7581 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:39.057124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d874fb5-ef4a-4df7-b0c7-a7c3dc0f7581 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:39.057919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d874fb5-ef4a-4df7-b0c7-a7c3dc0f7581 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:39.058373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9d874fb5-ef4a-4df7-b0c7-a7c3dc0f7581 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:39.074543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6edfefa1-707f-4ff4-b601-23c3167e0bde tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:39.075136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6edfefa1-707f-4ff4-b601-23c3167e0bde tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:39.081473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6edfefa1-707f-4ff4-b601-23c3167e0bde tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:39.081918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6edfefa1-707f-4ff4-b601-23c3167e0bde tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:39.082653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6edfefa1-707f-4ff4-b601-23c3167e0bde tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:39.083117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6edfefa1-707f-4ff4-b601-23c3167e0bde tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:39.189035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9d874fb5-ef4a-4df7-b0c7-a7c3dc0f7581 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:39.197670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9d874fb5-ef4a-4df7-b0c7-a7c3dc0f7581 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155053 Jul 26 18:51:39.198236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1715/3455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:39 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:39.215927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6edfefa1-707f-4ff4-b601-23c3167e0bde tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:39.224018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6edfefa1-707f-4ff4-b601-23c3167e0bde tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153674 Jul 26 18:51:39.224611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1741/3456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:39 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:39.769974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5dbe86ed-e076-4125-89b6-a2a84ed8cf2f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:39.770631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5dbe86ed-e076-4125-89b6-a2a84ed8cf2f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:39.777702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5dbe86ed-e076-4125-89b6-a2a84ed8cf2f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:39.778157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5dbe86ed-e076-4125-89b6-a2a84ed8cf2f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:39.778901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5dbe86ed-e076-4125-89b6-a2a84ed8cf2f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:39.779359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5dbe86ed-e076-4125-89b6-a2a84ed8cf2f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:39.854142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6c2b6960-c518-4f0c-84ae-baf3cbae45c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:39.855821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6c2b6960-c518-4f0c-84ae-baf3cbae45c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:39.862589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c2b6960-c518-4f0c-84ae-baf3cbae45c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:39.863051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c2b6960-c518-4f0c-84ae-baf3cbae45c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:39.863810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c2b6960-c518-4f0c-84ae-baf3cbae45c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:39.864242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c2b6960-c518-4f0c-84ae-baf3cbae45c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:39.917296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5dbe86ed-e076-4125-89b6-a2a84ed8cf2f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:39.925894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5dbe86ed-e076-4125-89b6-a2a84ed8cf2f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159759 Jul 26 18:51:39.929625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1716/3457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:39 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:39.932341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-494795d9-454e-411c-907b-9f1189108071 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:39.933037 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-494795d9-454e-411c-907b-9f1189108071 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:39.939151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-494795d9-454e-411c-907b-9f1189108071 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:39.939597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-494795d9-454e-411c-907b-9f1189108071 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:39.940361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-494795d9-454e-411c-907b-9f1189108071 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:39.940769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-494795d9-454e-411c-907b-9f1189108071 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:39.998979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6c2b6960-c518-4f0c-84ae-baf3cbae45c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:40.007683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6c2b6960-c518-4f0c-84ae-baf3cbae45c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:40.009092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6c2b6960-c518-4f0c-84ae-baf3cbae45c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:40.010268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6c2b6960-c518-4f0c-84ae-baf3cbae45c8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160430 Jul 26 18:51:40.011048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1742/3458] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:40.068929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-494795d9-454e-411c-907b-9f1189108071 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:40.081222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-494795d9-454e-411c-907b-9f1189108071 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152348 Jul 26 18:51:40.082036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1717/3459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:39 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:40.223677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bf6dffc0-e3f3-40b2-a200-8f8b7091ba84 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:40.224729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bf6dffc0-e3f3-40b2-a200-8f8b7091ba84 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:40.235263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf6dffc0-e3f3-40b2-a200-8f8b7091ba84 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:40.236008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf6dffc0-e3f3-40b2-a200-8f8b7091ba84 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:40.237251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf6dffc0-e3f3-40b2-a200-8f8b7091ba84 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:40.237973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bf6dffc0-e3f3-40b2-a200-8f8b7091ba84 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:40.249204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c01aecf3-f307-460d-9531-2113a49ab042 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:40.250065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c01aecf3-f307-460d-9531-2113a49ab042 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:40.256393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c01aecf3-f307-460d-9531-2113a49ab042 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:40.256833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c01aecf3-f307-460d-9531-2113a49ab042 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:40.257593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c01aecf3-f307-460d-9531-2113a49ab042 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:40.258081 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c01aecf3-f307-460d-9531-2113a49ab042 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:40.371246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bf6dffc0-e3f3-40b2-a200-8f8b7091ba84 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:40.379452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bf6dffc0-e3f3-40b2-a200-8f8b7091ba84 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162300 Jul 26 18:51:40.380057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1743/3460] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:40 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:40.385873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c01aecf3-f307-460d-9531-2113a49ab042 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:40.394034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c01aecf3-f307-460d-9531-2113a49ab042 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151191 Jul 26 18:51:40.394603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1718/3461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:40 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:40.951792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-be58c324-38b6-49e7-b1b9-39e2f4fe53bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:40.952772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-be58c324-38b6-49e7-b1b9-39e2f4fe53bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:40.964178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be58c324-38b6-49e7-b1b9-39e2f4fe53bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:40.964928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be58c324-38b6-49e7-b1b9-39e2f4fe53bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:40.966208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be58c324-38b6-49e7-b1b9-39e2f4fe53bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:40.966936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be58c324-38b6-49e7-b1b9-39e2f4fe53bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:41.034073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c03b88a2-42fd-4c90-8387-79abf9530b9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:41.034693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c03b88a2-42fd-4c90-8387-79abf9530b9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:41.041743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c03b88a2-42fd-4c90-8387-79abf9530b9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:41.042197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c03b88a2-42fd-4c90-8387-79abf9530b9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:41.042949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c03b88a2-42fd-4c90-8387-79abf9530b9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:41.043412 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c03b88a2-42fd-4c90-8387-79abf9530b9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:41.184756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c03b88a2-42fd-4c90-8387-79abf9530b9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:41.194563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c03b88a2-42fd-4c90-8387-79abf9530b9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:41.196135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c03b88a2-42fd-4c90-8387-79abf9530b9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:41.197411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c03b88a2-42fd-4c90-8387-79abf9530b9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.167644 Jul 26 18:51:41.198014 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1719/3462] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:41 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:41.203042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-62373ea0-e5f4-4c8d-a57d-da63c2253baa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:41.203641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-62373ea0-e5f4-4c8d-a57d-da63c2253baa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:41.210129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62373ea0-e5f4-4c8d-a57d-da63c2253baa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:41.210580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62373ea0-e5f4-4c8d-a57d-da63c2253baa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:41.211373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62373ea0-e5f4-4c8d-a57d-da63c2253baa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:41.211803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-62373ea0-e5f4-4c8d-a57d-da63c2253baa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:41.341714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-be58c324-38b6-49e7-b1b9-39e2f4fe53bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:41.345535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-62373ea0-e5f4-4c8d-a57d-da63c2253baa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:41.353725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-be58c324-38b6-49e7-b1b9-39e2f4fe53bc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.408305 Jul 26 18:51:41.354483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1744/3463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:40 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:41.356314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-62373ea0-e5f4-4c8d-a57d-da63c2253baa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157293 Jul 26 18:51:41.356902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1720/3464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:41 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:41.400775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5b10c781-6e06-467c-b7df-6b317925d2d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:41.401370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5b10c781-6e06-467c-b7df-6b317925d2d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:41.408098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b10c781-6e06-467c-b7df-6b317925d2d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:41.408515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b10c781-6e06-467c-b7df-6b317925d2d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:41.409487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b10c781-6e06-467c-b7df-6b317925d2d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:41.410093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b10c781-6e06-467c-b7df-6b317925d2d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:41.423206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f0ccf7fa-2885-4bf9-8901-1d3552d67620 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:41.423900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f0ccf7fa-2885-4bf9-8901-1d3552d67620 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:41.430216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0ccf7fa-2885-4bf9-8901-1d3552d67620 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:41.430662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0ccf7fa-2885-4bf9-8901-1d3552d67620 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:41.431569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0ccf7fa-2885-4bf9-8901-1d3552d67620 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:41.432065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0ccf7fa-2885-4bf9-8901-1d3552d67620 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:41.541044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5b10c781-6e06-467c-b7df-6b317925d2d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:41.549496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5b10c781-6e06-467c-b7df-6b317925d2d7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152818 Jul 26 18:51:41.550132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1745/3465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:41 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:41.563623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f0ccf7fa-2885-4bf9-8901-1d3552d67620 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:41.572084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f0ccf7fa-2885-4bf9-8901-1d3552d67620 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153000 Jul 26 18:51:41.572666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1721/3466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:41 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:42.225779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-07893c84-6fa3-4a36-8ee2-bde6e48fe39f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:42.226990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-07893c84-6fa3-4a36-8ee2-bde6e48fe39f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:42.236707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07893c84-6fa3-4a36-8ee2-bde6e48fe39f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:42.237145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07893c84-6fa3-4a36-8ee2-bde6e48fe39f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:42.237893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07893c84-6fa3-4a36-8ee2-bde6e48fe39f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:42.238340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07893c84-6fa3-4a36-8ee2-bde6e48fe39f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:42.369897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-07893c84-6fa3-4a36-8ee2-bde6e48fe39f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:42.375176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bac50d07-abf6-4f58-9d95-de855b6756c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:42.375806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bac50d07-abf6-4f58-9d95-de855b6756c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:42.379624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-07893c84-6fa3-4a36-8ee2-bde6e48fe39f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:42.381174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-07893c84-6fa3-4a36-8ee2-bde6e48fe39f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:42.382339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-07893c84-6fa3-4a36-8ee2-bde6e48fe39f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.163114 Jul 26 18:51:42.383413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1746/3467] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:42.383550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bac50d07-abf6-4f58-9d95-de855b6756c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:42.383550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bac50d07-abf6-4f58-9d95-de855b6756c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:42.384248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bac50d07-abf6-4f58-9d95-de855b6756c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:42.384675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bac50d07-abf6-4f58-9d95-de855b6756c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:42.387442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-213ab888-8b21-49f6-bc33-2e3881c86484 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:42.388043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-213ab888-8b21-49f6-bc33-2e3881c86484 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:42.394000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-213ab888-8b21-49f6-bc33-2e3881c86484 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:42.394449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-213ab888-8b21-49f6-bc33-2e3881c86484 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:42.395456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-213ab888-8b21-49f6-bc33-2e3881c86484 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:42.396021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-213ab888-8b21-49f6-bc33-2e3881c86484 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:42.510976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bac50d07-abf6-4f58-9d95-de855b6756c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:42.518996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bac50d07-abf6-4f58-9d95-de855b6756c9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.147863 Jul 26 18:51:42.519623 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1722/3468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:42 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:42.525454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-213ab888-8b21-49f6-bc33-2e3881c86484 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:42.533733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-213ab888-8b21-49f6-bc33-2e3881c86484 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.149847 Jul 26 18:51:42.534309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1747/3469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:42 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:42.572463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cae06db8-4d24-452a-903f-a164798fb353 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:42.573072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cae06db8-4d24-452a-903f-a164798fb353 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:42.579166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cae06db8-4d24-452a-903f-a164798fb353 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:42.579612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cae06db8-4d24-452a-903f-a164798fb353 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:42.580366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cae06db8-4d24-452a-903f-a164798fb353 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:42.580794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cae06db8-4d24-452a-903f-a164798fb353 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:42.593428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-356682b3-205b-485f-85f8-4af4801fc491 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:42.594063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-356682b3-205b-485f-85f8-4af4801fc491 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:42.600461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-356682b3-205b-485f-85f8-4af4801fc491 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:42.600906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-356682b3-205b-485f-85f8-4af4801fc491 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:42.601660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-356682b3-205b-485f-85f8-4af4801fc491 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:42.602085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-356682b3-205b-485f-85f8-4af4801fc491 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:42.709489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cae06db8-4d24-452a-903f-a164798fb353 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:42.717678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cae06db8-4d24-452a-903f-a164798fb353 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.149236 Jul 26 18:51:42.718349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1723/3470] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:42 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:42.730647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-356682b3-205b-485f-85f8-4af4801fc491 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:42.739064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-356682b3-205b-485f-85f8-4af4801fc491 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.149472 Jul 26 18:51:42.739619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1748/3471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:42 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:43.410857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-69e638ad-f691-498a-be04-29528a3d730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:43.412109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-69e638ad-f691-498a-be04-29528a3d730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:43.422425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69e638ad-f691-498a-be04-29528a3d730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:43.422879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69e638ad-f691-498a-be04-29528a3d730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:43.423667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69e638ad-f691-498a-be04-29528a3d730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:43.424097 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-69e638ad-f691-498a-be04-29528a3d730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:43.540241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2a863c81-af08-4372-9e8c-758755135f36 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:43.540851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2a863c81-af08-4372-9e8c-758755135f36 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:43.548389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a863c81-af08-4372-9e8c-758755135f36 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:43.548932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a863c81-af08-4372-9e8c-758755135f36 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:43.549738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a863c81-af08-4372-9e8c-758755135f36 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:43.550179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a863c81-af08-4372-9e8c-758755135f36 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:43.562343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-69e638ad-f691-498a-be04-29528a3d730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:43.571561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-69e638ad-f691-498a-be04-29528a3d730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:43.573134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-69e638ad-f691-498a-be04-29528a3d730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:43.574374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-69e638ad-f691-498a-be04-29528a3d730c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.170209 Jul 26 18:51:43.575012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1724/3472] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:43.579751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-363d3732-f106-4ae4-8dab-c9789292b677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:43.580318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-363d3732-f106-4ae4-8dab-c9789292b677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:43.588351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-363d3732-f106-4ae4-8dab-c9789292b677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:43.588904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-363d3732-f106-4ae4-8dab-c9789292b677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:43.589767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-363d3732-f106-4ae4-8dab-c9789292b677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:43.590509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-363d3732-f106-4ae4-8dab-c9789292b677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:43.682349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2a863c81-af08-4372-9e8c-758755135f36 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:43.690715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2a863c81-af08-4372-9e8c-758755135f36 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154487 Jul 26 18:51:43.691328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1749/3473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:43 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:43.720139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-363d3732-f106-4ae4-8dab-c9789292b677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:43.728232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-363d3732-f106-4ae4-8dab-c9789292b677 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152236 Jul 26 18:51:43.728796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1725/3474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:43 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:43.738804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f9b4f8c2-f66b-44f5-85d7-d63aec42635d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:43.739456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f9b4f8c2-f66b-44f5-85d7-d63aec42635d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:43.745915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9b4f8c2-f66b-44f5-85d7-d63aec42635d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:43.746664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9b4f8c2-f66b-44f5-85d7-d63aec42635d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:43.747474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9b4f8c2-f66b-44f5-85d7-d63aec42635d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:43.748318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9b4f8c2-f66b-44f5-85d7-d63aec42635d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:43.761408 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c3bcaa5f-ee57-4569-ab66-2b79c2296b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:43.762038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c3bcaa5f-ee57-4569-ab66-2b79c2296b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:43.768147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa5f-ee57-4569-ab66-2b79c2296b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:43.768646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa5f-ee57-4569-ab66-2b79c2296b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:43.769394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa5f-ee57-4569-ab66-2b79c2296b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:43.769844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa5f-ee57-4569-ab66-2b79c2296b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:43.883747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f9b4f8c2-f66b-44f5-85d7-d63aec42635d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:43.891896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f9b4f8c2-f66b-44f5-85d7-d63aec42635d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156928 Jul 26 18:51:43.892458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1750/3475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:43 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:43.908007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c3bcaa5f-ee57-4569-ab66-2b79c2296b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:43.916526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c3bcaa5f-ee57-4569-ab66-2b79c2296b97 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.159381 Jul 26 18:51:43.917105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1726/3476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:43 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:44.601381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0f427816-198e-4772-8d0a-3ead097193de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:44.602216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f427816-198e-4772-8d0a-3ead097193de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:44.613261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f427816-198e-4772-8d0a-3ead097193de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:44.614004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f427816-198e-4772-8d0a-3ead097193de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:44.615314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f427816-198e-4772-8d0a-3ead097193de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:44.616027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f427816-198e-4772-8d0a-3ead097193de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:44.712419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9f0f18d4-a061-48fe-a200-0ad6e867ee06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:44.712975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9f0f18d4-a061-48fe-a200-0ad6e867ee06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:44.720004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f0f18d4-a061-48fe-a200-0ad6e867ee06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:44.720442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f0f18d4-a061-48fe-a200-0ad6e867ee06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:44.721163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f0f18d4-a061-48fe-a200-0ad6e867ee06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:44.721607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9f0f18d4-a061-48fe-a200-0ad6e867ee06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:44.755560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0f427816-198e-4772-8d0a-3ead097193de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:44.764112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0f427816-198e-4772-8d0a-3ead097193de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:44.765656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0f427816-198e-4772-8d0a-3ead097193de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:44.766809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0f427816-198e-4772-8d0a-3ead097193de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.172189 Jul 26 18:51:44.767402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1751/3477] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:44 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:44.773308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1946a05c-892e-4bfb-9b5f-efa65527e81f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:44.774102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1946a05c-892e-4bfb-9b5f-efa65527e81f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:44.780156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1946a05c-892e-4bfb-9b5f-efa65527e81f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:44.780672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1946a05c-892e-4bfb-9b5f-efa65527e81f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:44.781396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1946a05c-892e-4bfb-9b5f-efa65527e81f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:44.781826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1946a05c-892e-4bfb-9b5f-efa65527e81f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:44.849218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9f0f18d4-a061-48fe-a200-0ad6e867ee06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:44.857394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9f0f18d4-a061-48fe-a200-0ad6e867ee06 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.148669 Jul 26 18:51:44.857883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1727/3478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:44 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:44.913812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7fdab13c-1968-4606-8741-ae39718519c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:44.914516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7fdab13c-1968-4606-8741-ae39718519c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:44.919239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1946a05c-892e-4bfb-9b5f-efa65527e81f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:44.922627 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fdab13c-1968-4606-8741-ae39718519c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:44.923091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fdab13c-1968-4606-8741-ae39718519c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:44.923886 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fdab13c-1968-4606-8741-ae39718519c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:44.924323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7fdab13c-1968-4606-8741-ae39718519c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:44.929117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1946a05c-892e-4bfb-9b5f-efa65527e81f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.160520 Jul 26 18:51:44.929694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1752/3479] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:44 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:44.939381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-eb5ad5f3-acc1-4f6b-8e14-0c0c7a404f9b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:44.940140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-eb5ad5f3-acc1-4f6b-8e14-0c0c7a404f9b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:44.946879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb5ad5f3-acc1-4f6b-8e14-0c0c7a404f9b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:44.947379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb5ad5f3-acc1-4f6b-8e14-0c0c7a404f9b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:44.948135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb5ad5f3-acc1-4f6b-8e14-0c0c7a404f9b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:44.948571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb5ad5f3-acc1-4f6b-8e14-0c0c7a404f9b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:45.057873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7fdab13c-1968-4606-8741-ae39718519c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:45.066203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7fdab13c-1968-4606-8741-ae39718519c6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156307 Jul 26 18:51:45.066752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1728/3480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:44 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:45.080893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-eb5ad5f3-acc1-4f6b-8e14-0c0c7a404f9b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:45.090328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-eb5ad5f3-acc1-4f6b-8e14-0c0c7a404f9b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155987 Jul 26 18:51:45.090872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1753/3481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:44 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:45.789932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3736d41b-f36c-4b2c-95da-de6c3f36170c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:45.790573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3736d41b-f36c-4b2c-95da-de6c3f36170c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:45.797527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3736d41b-f36c-4b2c-95da-de6c3f36170c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:45.797999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3736d41b-f36c-4b2c-95da-de6c3f36170c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:45.798732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3736d41b-f36c-4b2c-95da-de6c3f36170c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:45.799202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3736d41b-f36c-4b2c-95da-de6c3f36170c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:45.888593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9ab2396b-23d1-4ed5-a86f-dce4425b9a97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:45.889207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9ab2396b-23d1-4ed5-a86f-dce4425b9a97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:45.896327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ab2396b-23d1-4ed5-a86f-dce4425b9a97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:45.897089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ab2396b-23d1-4ed5-a86f-dce4425b9a97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:45.897850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ab2396b-23d1-4ed5-a86f-dce4425b9a97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:45.898286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ab2396b-23d1-4ed5-a86f-dce4425b9a97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:45.944824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3736d41b-f36c-4b2c-95da-de6c3f36170c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:45.946942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:45.957723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3736d41b-f36c-4b2c-95da-de6c3f36170c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:45.959526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3736d41b-f36c-4b2c-95da-de6c3f36170c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:45.960681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3736d41b-f36c-4b2c-95da-de6c3f36170c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.174813 Jul 26 18:51:45.961510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1729/3482] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:45.965936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e7ed1cf0-674d-49f7-9bf3-e5f627b312b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:45.966538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e7ed1cf0-674d-49f7-9bf3-e5f627b312b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:45.973938 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7ed1cf0-674d-49f7-9bf3-e5f627b312b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:45.974388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7ed1cf0-674d-49f7-9bf3-e5f627b312b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:45.975173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7ed1cf0-674d-49f7-9bf3-e5f627b312b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:45.975608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7ed1cf0-674d-49f7-9bf3-e5f627b312b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:46.049520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9ab2396b-23d1-4ed5-a86f-dce4425b9a97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:46.057801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9ab2396b-23d1-4ed5-a86f-dce4425b9a97 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.173801 Jul 26 18:51:46.058335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1754/3483] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:45 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:46.087835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7f598509-4e2c-489a-b86f-a5fe92d7dc71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:46.088438 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7f598509-4e2c-489a-b86f-a5fe92d7dc71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:46.094603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f598509-4e2c-489a-b86f-a5fe92d7dc71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:46.095060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f598509-4e2c-489a-b86f-a5fe92d7dc71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:46.095813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f598509-4e2c-489a-b86f-a5fe92d7dc71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:46.096244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f598509-4e2c-489a-b86f-a5fe92d7dc71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:46.103279 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e7ed1cf0-674d-49f7-9bf3-e5f627b312b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:46.111690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e7ed1cf0-674d-49f7-9bf3-e5f627b312b3 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.149379 Jul 26 18:51:46.112259 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1730/3484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:45 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:46.116788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0b9e5d0d-2dfb-45f2-8241-b857151750a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:46.117383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0b9e5d0d-2dfb-45f2-8241-b857151750a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:46.123157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b9e5d0d-2dfb-45f2-8241-b857151750a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:46.123633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b9e5d0d-2dfb-45f2-8241-b857151750a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:46.124366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b9e5d0d-2dfb-45f2-8241-b857151750a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:46.124859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b9e5d0d-2dfb-45f2-8241-b857151750a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:46.234473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7f598509-4e2c-489a-b86f-a5fe92d7dc71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:46.236756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:46.244411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7f598509-4e2c-489a-b86f-a5fe92d7dc71 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160469 Jul 26 18:51:46.255129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1755/3485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:46 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:46.258488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0b9e5d0d-2dfb-45f2-8241-b857151750a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:46.266702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0b9e5d0d-2dfb-45f2-8241-b857151750a4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153520 Jul 26 18:51:46.267295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1731/3486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:46 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:46.989194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b99e06c3-5e78-4edb-ad93-df3ed026b844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:46.990184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b99e06c3-5e78-4edb-ad93-df3ed026b844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:47.000943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b99e06c3-5e78-4edb-ad93-df3ed026b844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:47.001394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b99e06c3-5e78-4edb-ad93-df3ed026b844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:47.002213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b99e06c3-5e78-4edb-ad93-df3ed026b844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:47.002587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b99e06c3-5e78-4edb-ad93-df3ed026b844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:47.079062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b124efd8-945c-4172-b7ed-836a7f02be2e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:47.079647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b124efd8-945c-4172-b7ed-836a7f02be2e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:47.086448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b124efd8-945c-4172-b7ed-836a7f02be2e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:47.086896 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b124efd8-945c-4172-b7ed-836a7f02be2e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:47.087678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b124efd8-945c-4172-b7ed-836a7f02be2e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:47.088102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b124efd8-945c-4172-b7ed-836a7f02be2e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:47.137189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b99e06c3-5e78-4edb-ad93-df3ed026b844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:47.145891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b99e06c3-5e78-4edb-ad93-df3ed026b844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:47.147854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b99e06c3-5e78-4edb-ad93-df3ed026b844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:47.149012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b99e06c3-5e78-4edb-ad93-df3ed026b844 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.166409 Jul 26 18:51:47.149573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1756/3487] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:47.154207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bfb90f4b-c545-4cee-9623-8e72c96c54d5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:47.154779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bfb90f4b-c545-4cee-9623-8e72c96c54d5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:47.161266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfb90f4b-c545-4cee-9623-8e72c96c54d5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:47.161710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfb90f4b-c545-4cee-9623-8e72c96c54d5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:47.162465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfb90f4b-c545-4cee-9623-8e72c96c54d5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:47.162895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfb90f4b-c545-4cee-9623-8e72c96c54d5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:47.219998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b124efd8-945c-4172-b7ed-836a7f02be2e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:47.229456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b124efd8-945c-4172-b7ed-836a7f02be2e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154166 Jul 26 18:51:47.230401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1732/3488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:47 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:47.265663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-46b2f18c-e115-445b-a9d6-00beedd8dd11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:47.266266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-46b2f18c-e115-445b-a9d6-00beedd8dd11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:47.272576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46b2f18c-e115-445b-a9d6-00beedd8dd11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:47.273020 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46b2f18c-e115-445b-a9d6-00beedd8dd11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:47.273764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46b2f18c-e115-445b-a9d6-00beedd8dd11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:47.274186 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46b2f18c-e115-445b-a9d6-00beedd8dd11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:47.297933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bfb90f4b-c545-4cee-9623-8e72c96c54d5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:47.306090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bfb90f4b-c545-4cee-9623-8e72c96c54d5 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155557 Jul 26 18:51:47.306682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1757/3489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:47 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:47.311121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-71603aab-02fb-4dc1-816e-1eab4d0e6e9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:47.311723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-71603aab-02fb-4dc1-816e-1eab4d0e6e9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:47.317665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71603aab-02fb-4dc1-816e-1eab4d0e6e9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:47.318107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71603aab-02fb-4dc1-816e-1eab4d0e6e9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:47.318861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71603aab-02fb-4dc1-816e-1eab4d0e6e9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:47.319319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71603aab-02fb-4dc1-816e-1eab4d0e6e9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:47.457073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-71603aab-02fb-4dc1-816e-1eab4d0e6e9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:47.465829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-71603aab-02fb-4dc1-816e-1eab4d0e6e9e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158045 Jul 26 18:51:47.466418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1758/3490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:47 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:47.635086 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-46b2f18c-e115-445b-a9d6-00beedd8dd11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:47.647526 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-46b2f18c-e115-445b-a9d6-00beedd8dd11 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.385681 Jul 26 18:51:47.648373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1733/3491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:47 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:48.174604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e705e778-e359-4f65-be98-8258e5941d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:48.175290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e705e778-e359-4f65-be98-8258e5941d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:48.183589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e705e778-e359-4f65-be98-8258e5941d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:48.184114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e705e778-e359-4f65-be98-8258e5941d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:48.184995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e705e778-e359-4f65-be98-8258e5941d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:48.185504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e705e778-e359-4f65-be98-8258e5941d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:48.253137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-68e1b104-57b3-4eb3-b510-640acdf6ba94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:48.253697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-68e1b104-57b3-4eb3-b510-640acdf6ba94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:48.260280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68e1b104-57b3-4eb3-b510-640acdf6ba94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:48.260723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68e1b104-57b3-4eb3-b510-640acdf6ba94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:48.261483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68e1b104-57b3-4eb3-b510-640acdf6ba94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:48.262029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-68e1b104-57b3-4eb3-b510-640acdf6ba94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:48.329905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e705e778-e359-4f65-be98-8258e5941d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:48.338657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e705e778-e359-4f65-be98-8258e5941d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:48.340200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e705e778-e359-4f65-be98-8258e5941d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:48.341385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e705e778-e359-4f65-be98-8258e5941d2c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.172641 Jul 26 18:51:48.341954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1759/3492] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:48.348105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-446a4220-74cc-43a8-87c4-f6ffc65a640c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:48.348768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-446a4220-74cc-43a8-87c4-f6ffc65a640c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:48.354979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-446a4220-74cc-43a8-87c4-f6ffc65a640c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:48.355524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-446a4220-74cc-43a8-87c4-f6ffc65a640c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:48.356475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-446a4220-74cc-43a8-87c4-f6ffc65a640c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:48.357130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-446a4220-74cc-43a8-87c4-f6ffc65a640c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:48.394739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-68e1b104-57b3-4eb3-b510-640acdf6ba94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:48.403222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-68e1b104-57b3-4eb3-b510-640acdf6ba94 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156851 Jul 26 18:51:48.403893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1734/3493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:48 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:48.484793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-446a4220-74cc-43a8-87c4-f6ffc65a640c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:48.488364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-128591e7-cc66-40ff-9980-f0031d6dd5ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:48.489005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-128591e7-cc66-40ff-9980-f0031d6dd5ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:48.493058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-446a4220-74cc-43a8-87c4-f6ffc65a640c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.150112 Jul 26 18:51:48.493614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1760/3494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:48 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:48.496536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-128591e7-cc66-40ff-9980-f0031d6dd5ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:48.497115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-128591e7-cc66-40ff-9980-f0031d6dd5ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:48.498251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-128591e7-cc66-40ff-9980-f0031d6dd5ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:48.498869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-128591e7-cc66-40ff-9980-f0031d6dd5ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:48.629473 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-128591e7-cc66-40ff-9980-f0031d6dd5ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:48.637467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-128591e7-cc66-40ff-9980-f0031d6dd5ec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153090 Jul 26 18:51:48.638034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1735/3495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:48 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:48.669050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6a6e05d5-cbec-46a4-a109-939e3b072cbf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:48.669662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6a6e05d5-cbec-46a4-a109-939e3b072cbf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:48.675959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6a6e05d5-cbec-46a4-a109-939e3b072cbf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:48.677498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6a6e05d5-cbec-46a4-a109-939e3b072cbf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:48.677498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6a6e05d5-cbec-46a4-a109-939e3b072cbf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:48.677747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6a6e05d5-cbec-46a4-a109-939e3b072cbf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:48.824286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6a6e05d5-cbec-46a4-a109-939e3b072cbf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:48.832923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6a6e05d5-cbec-46a4-a109-939e3b072cbf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167723 Jul 26 18:51:48.833429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1761/3496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:48 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:49.364359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-17e9acab-f488-40de-9f2c-3abe6dd8157d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:49.364954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-17e9acab-f488-40de-9f2c-3abe6dd8157d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:49.371411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17e9acab-f488-40de-9f2c-3abe6dd8157d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:49.371855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17e9acab-f488-40de-9f2c-3abe6dd8157d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:49.372602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17e9acab-f488-40de-9f2c-3abe6dd8157d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:49.373031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-17e9acab-f488-40de-9f2c-3abe6dd8157d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:49.424635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-014963e1-917d-4e6a-9b53-faae1767196a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:49.425223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-014963e1-917d-4e6a-9b53-faae1767196a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:49.432217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-014963e1-917d-4e6a-9b53-faae1767196a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:49.432633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-014963e1-917d-4e6a-9b53-faae1767196a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:49.433385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-014963e1-917d-4e6a-9b53-faae1767196a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:49.433812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-014963e1-917d-4e6a-9b53-faae1767196a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:49.506396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-17e9acab-f488-40de-9f2c-3abe6dd8157d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:49.515957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-17e9acab-f488-40de-9f2c-3abe6dd8157d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:49.517459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-17e9acab-f488-40de-9f2c-3abe6dd8157d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:49.518638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-17e9acab-f488-40de-9f2c-3abe6dd8157d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158055 Jul 26 18:51:49.519222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1736/3497] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:49 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:49.524451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f9c6700a-2fba-424d-861e-8f8613a46e68 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:49.524627 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f9c6700a-2fba-424d-861e-8f8613a46e68 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:49.530917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9c6700a-2fba-424d-861e-8f8613a46e68 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:49.530917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9c6700a-2fba-424d-861e-8f8613a46e68 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:49.531697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9c6700a-2fba-424d-861e-8f8613a46e68 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:49.532172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f9c6700a-2fba-424d-861e-8f8613a46e68 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:49.563012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-014963e1-917d-4e6a-9b53-faae1767196a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:49.571356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-014963e1-917d-4e6a-9b53-faae1767196a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.150571 Jul 26 18:51:49.572074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1762/3498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:49 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:49.659161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f9c6700a-2fba-424d-861e-8f8613a46e68 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:49.659829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7ef8d55a-48be-4610-a855-f92ab1ab706f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:49.660436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7ef8d55a-48be-4610-a855-f92ab1ab706f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:49.667042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ef8d55a-48be-4610-a855-f92ab1ab706f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:49.667496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ef8d55a-48be-4610-a855-f92ab1ab706f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:49.667964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f9c6700a-2fba-424d-861e-8f8613a46e68 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.147755 Jul 26 18:51:49.668258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ef8d55a-48be-4610-a855-f92ab1ab706f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:49.668684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7ef8d55a-48be-4610-a855-f92ab1ab706f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:49.668806 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1737/3499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:49 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:49.831591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7ef8d55a-48be-4610-a855-f92ab1ab706f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:49.843443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7ef8d55a-48be-4610-a855-f92ab1ab706f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.187205 Jul 26 18:51:49.844167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1763/3500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:49 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:49.856682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cbdf3a83-3f5f-499b-937b-a2192da04850 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:49.857506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cbdf3a83-3f5f-499b-937b-a2192da04850 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:49.863838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbdf3a83-3f5f-499b-937b-a2192da04850 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:49.864287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbdf3a83-3f5f-499b-937b-a2192da04850 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:49.865041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbdf3a83-3f5f-499b-937b-a2192da04850 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:49.865508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbdf3a83-3f5f-499b-937b-a2192da04850 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:50.001530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cbdf3a83-3f5f-499b-937b-a2192da04850 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:50.014575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cbdf3a83-3f5f-499b-937b-a2192da04850 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162133 Jul 26 18:51:50.015345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1738/3501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:49 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:50.545921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3024126b-8294-442c-860b-8458ac5159e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:50.546877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3024126b-8294-442c-860b-8458ac5159e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:50.558148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3024126b-8294-442c-860b-8458ac5159e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:50.558883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3024126b-8294-442c-860b-8458ac5159e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:50.560239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3024126b-8294-442c-860b-8458ac5159e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:50.560954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3024126b-8294-442c-860b-8458ac5159e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:50.593144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6ad652ef-e6de-451d-97bf-10f728d7d246 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:50.594023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6ad652ef-e6de-451d-97bf-10f728d7d246 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:50.601185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ad652ef-e6de-451d-97bf-10f728d7d246 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:50.601710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ad652ef-e6de-451d-97bf-10f728d7d246 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:50.602515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ad652ef-e6de-451d-97bf-10f728d7d246 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:50.602949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6ad652ef-e6de-451d-97bf-10f728d7d246 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:50.702068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3024126b-8294-442c-860b-8458ac5159e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:50.714941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3024126b-8294-442c-860b-8458ac5159e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:50.717399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3024126b-8294-442c-860b-8458ac5159e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:50.719197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3024126b-8294-442c-860b-8458ac5159e6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.179633 Jul 26 18:51:50.719862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1764/3502] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:50 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:50.724449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-54724e70-63c3-466c-a9c6-b41179cbd6da tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:50.725304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-54724e70-63c3-466c-a9c6-b41179cbd6da tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:50.733841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54724e70-63c3-466c-a9c6-b41179cbd6da tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:50.734401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54724e70-63c3-466c-a9c6-b41179cbd6da tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:50.735224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54724e70-63c3-466c-a9c6-b41179cbd6da tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:50.735640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54724e70-63c3-466c-a9c6-b41179cbd6da tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:50.753102 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6ad652ef-e6de-451d-97bf-10f728d7d246 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:50.761295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6ad652ef-e6de-451d-97bf-10f728d7d246 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.172314 Jul 26 18:51:50.761942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1739/3503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:50 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:50.865088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-54724e70-63c3-466c-a9c6-b41179cbd6da tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:50.866355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5c37c2df-816d-4f56-a9ba-dfb9581a44e9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:50.866985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5c37c2df-816d-4f56-a9ba-dfb9581a44e9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:50.873666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c37c2df-816d-4f56-a9ba-dfb9581a44e9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:50.874087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-54724e70-63c3-466c-a9c6-b41179cbd6da tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153268 Jul 26 18:51:50.874230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c37c2df-816d-4f56-a9ba-dfb9581a44e9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:50.874701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1765/3504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:50 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:50.875103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c37c2df-816d-4f56-a9ba-dfb9581a44e9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:50.875530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c37c2df-816d-4f56-a9ba-dfb9581a44e9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:51.013049 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5c37c2df-816d-4f56-a9ba-dfb9581a44e9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:51.021417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5c37c2df-816d-4f56-a9ba-dfb9581a44e9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.159144 Jul 26 18:51:51.022307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1740/3505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:50 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:51.041450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f6a44c66-267a-49e6-aa44-e8e7ee7a12d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:51.042055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f6a44c66-267a-49e6-aa44-e8e7ee7a12d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:51.048681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6a44c66-267a-49e6-aa44-e8e7ee7a12d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:51.049129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6a44c66-267a-49e6-aa44-e8e7ee7a12d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:51.049887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6a44c66-267a-49e6-aa44-e8e7ee7a12d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:51.050338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6a44c66-267a-49e6-aa44-e8e7ee7a12d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:51.198754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f6a44c66-267a-49e6-aa44-e8e7ee7a12d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:51.207253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f6a44c66-267a-49e6-aa44-e8e7ee7a12d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.169715 Jul 26 18:51:51.207844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1766/3506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:51 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:51.746431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f0dc473b-eef0-47d4-ba44-cbcd5b38b51c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:51.747414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f0dc473b-eef0-47d4-ba44-cbcd5b38b51c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:51.758637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0dc473b-eef0-47d4-ba44-cbcd5b38b51c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:51.759431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0dc473b-eef0-47d4-ba44-cbcd5b38b51c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:51.760683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0dc473b-eef0-47d4-ba44-cbcd5b38b51c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:51.761396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0dc473b-eef0-47d4-ba44-cbcd5b38b51c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:51.783467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a2a73d6e-1c37-4809-b463-52a84973a91a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:51.784199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a2a73d6e-1c37-4809-b463-52a84973a91a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:51.791151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2a73d6e-1c37-4809-b463-52a84973a91a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:51.791702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2a73d6e-1c37-4809-b463-52a84973a91a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:51.792606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2a73d6e-1c37-4809-b463-52a84973a91a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:51.793110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a2a73d6e-1c37-4809-b463-52a84973a91a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:51.897309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f0dc473b-eef0-47d4-ba44-cbcd5b38b51c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:51.906208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f0dc473b-eef0-47d4-ba44-cbcd5b38b51c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:51.907884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f0dc473b-eef0-47d4-ba44-cbcd5b38b51c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:51.909033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f0dc473b-eef0-47d4-ba44-cbcd5b38b51c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.169649 Jul 26 18:51:51.909584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1741/3507] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:51.913966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dc9d598c-faa6-4bc2-af83-69f4e41fde4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:51.914554 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dc9d598c-faa6-4bc2-af83-69f4e41fde4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:51.920360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc9d598c-faa6-4bc2-af83-69f4e41fde4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:51.920805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc9d598c-faa6-4bc2-af83-69f4e41fde4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:51.921566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc9d598c-faa6-4bc2-af83-69f4e41fde4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:51.922106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dc9d598c-faa6-4bc2-af83-69f4e41fde4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:51.927292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a2a73d6e-1c37-4809-b463-52a84973a91a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:51.935367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a2a73d6e-1c37-4809-b463-52a84973a91a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156060 Jul 26 18:51:51.935934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1767/3508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:51 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:52.043062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cd57289d-1276-4d2f-83b4-d904f8abc380 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:52.043919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cd57289d-1276-4d2f-83b4-d904f8abc380 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:52.050889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd57289d-1276-4d2f-83b4-d904f8abc380 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:52.051713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd57289d-1276-4d2f-83b4-d904f8abc380 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:52.052717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd57289d-1276-4d2f-83b4-d904f8abc380 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:52.053414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cd57289d-1276-4d2f-83b4-d904f8abc380 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:52.070841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dc9d598c-faa6-4bc2-af83-69f4e41fde4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:52.079691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dc9d598c-faa6-4bc2-af83-69f4e41fde4d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.169080 Jul 26 18:51:52.080299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1742/3509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:51 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:52.189678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cd57289d-1276-4d2f-83b4-d904f8abc380 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:52.197817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cd57289d-1276-4d2f-83b4-d904f8abc380 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158618 Jul 26 18:51:52.198354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1768/3510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:52 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:52.231471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8eb7d044-875e-4c05-b86b-b16cd8178dc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:52.232437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8eb7d044-875e-4c05-b86b-b16cd8178dc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:52.241651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8eb7d044-875e-4c05-b86b-b16cd8178dc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:52.242220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8eb7d044-875e-4c05-b86b-b16cd8178dc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:52.243401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8eb7d044-875e-4c05-b86b-b16cd8178dc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:52.244000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8eb7d044-875e-4c05-b86b-b16cd8178dc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:52.405805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8eb7d044-875e-4c05-b86b-b16cd8178dc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:52.414084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8eb7d044-875e-4c05-b86b-b16cd8178dc7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.188838 Jul 26 18:51:52.414659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1743/3511] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:52 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:52.936919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b4e99780-e79f-4e09-8d00-cb37091774c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:52.937853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b4e99780-e79f-4e09-8d00-cb37091774c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:52.946082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4e99780-e79f-4e09-8d00-cb37091774c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:52.946579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4e99780-e79f-4e09-8d00-cb37091774c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:52.947477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4e99780-e79f-4e09-8d00-cb37091774c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:52.947967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4e99780-e79f-4e09-8d00-cb37091774c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:52.957161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8879a9dc-e137-4247-b192-1f456ef4c05d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:52.957833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8879a9dc-e137-4247-b192-1f456ef4c05d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:52.966039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8879a9dc-e137-4247-b192-1f456ef4c05d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:52.966541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8879a9dc-e137-4247-b192-1f456ef4c05d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:52.967454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8879a9dc-e137-4247-b192-1f456ef4c05d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:52.967936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8879a9dc-e137-4247-b192-1f456ef4c05d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:53.083688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b4e99780-e79f-4e09-8d00-cb37091774c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:53.092557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b4e99780-e79f-4e09-8d00-cb37091774c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:53.094049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b4e99780-e79f-4e09-8d00-cb37091774c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:53.096704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b4e99780-e79f-4e09-8d00-cb37091774c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.165318 Jul 26 18:51:53.096704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1769/3512] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:53.100390 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8879a9dc-e137-4247-b192-1f456ef4c05d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:53.101407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ddac1f3c-0f8f-4d3f-850e-74bd4dc537fb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:53.102024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ddac1f3c-0f8f-4d3f-850e-74bd4dc537fb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:53.108152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ddac1f3c-0f8f-4d3f-850e-74bd4dc537fb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:53.108586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ddac1f3c-0f8f-4d3f-850e-74bd4dc537fb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:53.109340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ddac1f3c-0f8f-4d3f-850e-74bd4dc537fb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:53.109770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ddac1f3c-0f8f-4d3f-850e-74bd4dc537fb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:53.116068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8879a9dc-e137-4247-b192-1f456ef4c05d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163322 Jul 26 18:51:53.116658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1744/3513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:52 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:53.219732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8d6c78e8-3f53-4adf-b21d-57f57824e7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:53.220332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8d6c78e8-3f53-4adf-b21d-57f57824e7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:53.226920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d6c78e8-3f53-4adf-b21d-57f57824e7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:53.227513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d6c78e8-3f53-4adf-b21d-57f57824e7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:53.228281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d6c78e8-3f53-4adf-b21d-57f57824e7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:53.228709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d6c78e8-3f53-4adf-b21d-57f57824e7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:53.254068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ddac1f3c-0f8f-4d3f-850e-74bd4dc537fb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:53.262496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ddac1f3c-0f8f-4d3f-850e-74bd4dc537fb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.164653 Jul 26 18:51:53.263124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1770/3514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:53 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:53.373260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8d6c78e8-3f53-4adf-b21d-57f57824e7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:53.385627 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8d6c78e8-3f53-4adf-b21d-57f57824e7a7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.169694 Jul 26 18:51:53.386378 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1745/3515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:53 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:53.437764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aef33224-3e51-4132-a12f-5c522a85e05b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:53.438368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aef33224-3e51-4132-a12f-5c522a85e05b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:53.444702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aef33224-3e51-4132-a12f-5c522a85e05b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:53.445163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aef33224-3e51-4132-a12f-5c522a85e05b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:53.445915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aef33224-3e51-4132-a12f-5c522a85e05b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:53.446349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aef33224-3e51-4132-a12f-5c522a85e05b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:53.575774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-aef33224-3e51-4132-a12f-5c522a85e05b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:53.584382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aef33224-3e51-4132-a12f-5c522a85e05b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.150470 Jul 26 18:51:53.584927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1771/3516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:53 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:54.123751 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ed325e3a-3b0a-49fa-b6be-1bb0927eb120 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:54.124737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ed325e3a-3b0a-49fa-b6be-1bb0927eb120 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:54.135962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed325e3a-3b0a-49fa-b6be-1bb0927eb120 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:54.136709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed325e3a-3b0a-49fa-b6be-1bb0927eb120 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:54.138011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed325e3a-3b0a-49fa-b6be-1bb0927eb120 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:54.138684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ed325e3a-3b0a-49fa-b6be-1bb0927eb120 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:54.141103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d15e38e6-052f-4196-8568-916d20c9a98f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:54.141944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d15e38e6-052f-4196-8568-916d20c9a98f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:54.149164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d15e38e6-052f-4196-8568-916d20c9a98f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:54.149638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d15e38e6-052f-4196-8568-916d20c9a98f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:54.150413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d15e38e6-052f-4196-8568-916d20c9a98f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:54.150845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d15e38e6-052f-4196-8568-916d20c9a98f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:54.155663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:54.166352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:51:54.277902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ed325e3a-3b0a-49fa-b6be-1bb0927eb120 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:54.285558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d15e38e6-052f-4196-8568-916d20c9a98f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:54.287836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ed325e3a-3b0a-49fa-b6be-1bb0927eb120 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:54.289360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ed325e3a-3b0a-49fa-b6be-1bb0927eb120 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:54.290553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ed325e3a-3b0a-49fa-b6be-1bb0927eb120 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.174000 Jul 26 18:51:54.291146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1746/3517] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:54 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:54.294266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d15e38e6-052f-4196-8568-916d20c9a98f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159734 Jul 26 18:51:54.295053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1772/3518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:54.299290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0fc61aa8-4fbe-41cf-9577-cc909bddc561 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:54.299904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0fc61aa8-4fbe-41cf-9577-cc909bddc561 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:54.306324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fc61aa8-4fbe-41cf-9577-cc909bddc561 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:54.306767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fc61aa8-4fbe-41cf-9577-cc909bddc561 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:54.307552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fc61aa8-4fbe-41cf-9577-cc909bddc561 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:54.308046 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0fc61aa8-4fbe-41cf-9577-cc909bddc561 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:54.409169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7eba2e00-2888-49f9-8db8-cfbadfa1591b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:54.409811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7eba2e00-2888-49f9-8db8-cfbadfa1591b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:54.416313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7eba2e00-2888-49f9-8db8-cfbadfa1591b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:54.416790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7eba2e00-2888-49f9-8db8-cfbadfa1591b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:54.417553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7eba2e00-2888-49f9-8db8-cfbadfa1591b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:54.417985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7eba2e00-2888-49f9-8db8-cfbadfa1591b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:54.449111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0fc61aa8-4fbe-41cf-9577-cc909bddc561 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:54.457604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0fc61aa8-4fbe-41cf-9577-cc909bddc561 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.162183 Jul 26 18:51:54.458228 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1747/3519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:54 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:54.555775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7eba2e00-2888-49f9-8db8-cfbadfa1591b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:54.564903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7eba2e00-2888-49f9-8db8-cfbadfa1591b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.159671 Jul 26 18:51:54.565476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1773/3520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:54 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:54.605834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a4024392-9db4-4f18-887b-b35d0035de3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:54.606442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a4024392-9db4-4f18-887b-b35d0035de3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:54.612949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4024392-9db4-4f18-887b-b35d0035de3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:54.613408 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4024392-9db4-4f18-887b-b35d0035de3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:54.614187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4024392-9db4-4f18-887b-b35d0035de3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:54.614631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4024392-9db4-4f18-887b-b35d0035de3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:54.755587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a4024392-9db4-4f18-887b-b35d0035de3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:54.764138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a4024392-9db4-4f18-887b-b35d0035de3d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162202 Jul 26 18:51:54.764709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1748/3521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:54 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:55.316974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0b1d7268-6208-462e-9048-733b6592556c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:55.317558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0b1d7268-6208-462e-9048-733b6592556c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:55.317813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e9c009b8-f59f-483f-9265-571e91cc0ee8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:55.318431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e9c009b8-f59f-483f-9265-571e91cc0ee8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:55.325169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b1d7268-6208-462e-9048-733b6592556c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:55.325359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9c009b8-f59f-483f-9265-571e91cc0ee8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:55.325694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b1d7268-6208-462e-9048-733b6592556c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:55.326036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9c009b8-f59f-483f-9265-571e91cc0ee8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:55.326573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b1d7268-6208-462e-9048-733b6592556c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:55.326745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9c009b8-f59f-483f-9265-571e91cc0ee8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:55.327129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b1d7268-6208-462e-9048-733b6592556c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:55.327278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e9c009b8-f59f-483f-9265-571e91cc0ee8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:55.467227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e9c009b8-f59f-483f-9265-571e91cc0ee8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:55.472688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0b1d7268-6208-462e-9048-733b6592556c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:55.477728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e9c009b8-f59f-483f-9265-571e91cc0ee8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164131 Jul 26 18:51:55.478702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1749/3522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:55 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:55.482000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0b1d7268-6208-462e-9048-733b6592556c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:55.483316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-77f203ef-9b25-431f-8620-a2c171e9cc6b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:55.483919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-77f203ef-9b25-431f-8620-a2c171e9cc6b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:55.485435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0b1d7268-6208-462e-9048-733b6592556c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:55.487113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0b1d7268-6208-462e-9048-733b6592556c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.175537 Jul 26 18:51:55.487628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1774/3523] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:55 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:55.490500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77f203ef-9b25-431f-8620-a2c171e9cc6b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:55.490953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77f203ef-9b25-431f-8620-a2c171e9cc6b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:55.491742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77f203ef-9b25-431f-8620-a2c171e9cc6b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:55.492176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-77f203ef-9b25-431f-8620-a2c171e9cc6b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:55.588821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7c2a4b94-5518-4fd2-9f5b-c3a8df32214f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:55.589864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7c2a4b94-5518-4fd2-9f5b-c3a8df32214f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:55.599700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c2a4b94-5518-4fd2-9f5b-c3a8df32214f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:55.600264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c2a4b94-5518-4fd2-9f5b-c3a8df32214f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:55.601495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c2a4b94-5518-4fd2-9f5b-c3a8df32214f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:55.602170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c2a4b94-5518-4fd2-9f5b-c3a8df32214f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:55.647220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-77f203ef-9b25-431f-8620-a2c171e9cc6b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:55.655281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-77f203ef-9b25-431f-8620-a2c171e9cc6b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.175402 Jul 26 18:51:55.655855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1750/3524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:55 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:55.742917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7c2a4b94-5518-4fd2-9f5b-c3a8df32214f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:55.752463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7c2a4b94-5518-4fd2-9f5b-c3a8df32214f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.170114 Jul 26 18:51:55.753118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1775/3525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:55 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:55.787039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-541f14e6-8212-4383-a658-90bf6731f334 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:55.787756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-541f14e6-8212-4383-a658-90bf6731f334 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:55.796398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-541f14e6-8212-4383-a658-90bf6731f334 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:55.796945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-541f14e6-8212-4383-a658-90bf6731f334 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:55.798119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-541f14e6-8212-4383-a658-90bf6731f334 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:55.799380 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-541f14e6-8212-4383-a658-90bf6731f334 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:55.946454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-541f14e6-8212-4383-a658-90bf6731f334 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:55.962528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-541f14e6-8212-4383-a658-90bf6731f334 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.179382 Jul 26 18:51:55.963160 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1751/3526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:55 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:56.510144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1f59b197-0e93-483e-87cf-d4ca8d9bb62a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:56.511339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1f59b197-0e93-483e-87cf-d4ca8d9bb62a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:56.512996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fe7b73de-bf25-419e-8b58-07684997036e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:56.513973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fe7b73de-bf25-419e-8b58-07684997036e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:56.522564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f59b197-0e93-483e-87cf-d4ca8d9bb62a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:56.523432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f59b197-0e93-483e-87cf-d4ca8d9bb62a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:56.524744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f59b197-0e93-483e-87cf-d4ca8d9bb62a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:56.524999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe7b73de-bf25-419e-8b58-07684997036e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:56.525465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f59b197-0e93-483e-87cf-d4ca8d9bb62a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:56.525721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe7b73de-bf25-419e-8b58-07684997036e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:56.526981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe7b73de-bf25-419e-8b58-07684997036e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:56.527773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe7b73de-bf25-419e-8b58-07684997036e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:56.659185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1f59b197-0e93-483e-87cf-d4ca8d9bb62a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:56.663242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fe7b73de-bf25-419e-8b58-07684997036e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:56.667447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1f59b197-0e93-483e-87cf-d4ca8d9bb62a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163689 Jul 26 18:51:56.668030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1776/3527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:56 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:56.673490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fe7b73de-bf25-419e-8b58-07684997036e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:56.675173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fe7b73de-bf25-419e-8b58-07684997036e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:56.676358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fe7b73de-bf25-419e-8b58-07684997036e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.169703 Jul 26 18:51:56.677084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1752/3528] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:56 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:56.677235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8596c020-38d5-4c8d-9fce-597f652ce865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:56.677751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8596c020-38d5-4c8d-9fce-597f652ce865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:56.683926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8596c020-38d5-4c8d-9fce-597f652ce865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:56.684374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8596c020-38d5-4c8d-9fce-597f652ce865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:56.685135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8596c020-38d5-4c8d-9fce-597f652ce865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:56.685568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8596c020-38d5-4c8d-9fce-597f652ce865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:56.773999 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-85b72e9c-d3d8-4429-96b3-9b409f903bba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:56.774607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-85b72e9c-d3d8-4429-96b3-9b409f903bba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:56.780985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85b72e9c-d3d8-4429-96b3-9b409f903bba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:56.781437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85b72e9c-d3d8-4429-96b3-9b409f903bba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:56.786666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85b72e9c-d3d8-4429-96b3-9b409f903bba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:56.786666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85b72e9c-d3d8-4429-96b3-9b409f903bba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:56.820923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8596c020-38d5-4c8d-9fce-597f652ce865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:56.832701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8596c020-38d5-4c8d-9fce-597f652ce865 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157084 Jul 26 18:51:56.832701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1777/3529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:56 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:56.918495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-85b72e9c-d3d8-4429-96b3-9b409f903bba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:56.926814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-85b72e9c-d3d8-4429-96b3-9b409f903bba tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156957 Jul 26 18:51:56.927419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1753/3530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:56 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:56.991261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8c37def6-16d0-4ac9-9f6f-22a1698c6242 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:56.992260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8c37def6-16d0-4ac9-9f6f-22a1698c6242 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:57.002531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c37def6-16d0-4ac9-9f6f-22a1698c6242 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:57.003339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c37def6-16d0-4ac9-9f6f-22a1698c6242 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:57.004600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c37def6-16d0-4ac9-9f6f-22a1698c6242 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:57.005323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c37def6-16d0-4ac9-9f6f-22a1698c6242 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:57.149216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8c37def6-16d0-4ac9-9f6f-22a1698c6242 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:57.161432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8c37def6-16d0-4ac9-9f6f-22a1698c6242 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.176518 Jul 26 18:51:57.162174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1778/3531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:56 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:57.694365 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-223be098-59fd-4235-b919-412e21351fd3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:57.695479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-223be098-59fd-4235-b919-412e21351fd3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:57.706130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-223be098-59fd-4235-b919-412e21351fd3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:57.706581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-223be098-59fd-4235-b919-412e21351fd3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:57.706751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-80074837-8677-49dd-b81a-800562b86d48 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:57.707239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-80074837-8677-49dd-b81a-800562b86d48 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:57.707354 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-223be098-59fd-4235-b919-412e21351fd3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:57.707807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-223be098-59fd-4235-b919-412e21351fd3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:57.715440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80074837-8677-49dd-b81a-800562b86d48 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:57.715964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80074837-8677-49dd-b81a-800562b86d48 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:57.716722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80074837-8677-49dd-b81a-800562b86d48 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:57.717153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80074837-8677-49dd-b81a-800562b86d48 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:57.842172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-223be098-59fd-4235-b919-412e21351fd3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:57.847364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-80074837-8677-49dd-b81a-800562b86d48 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:57.850700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-223be098-59fd-4235-b919-412e21351fd3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163214 Jul 26 18:51:57.851322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1754/3532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:57 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:57.855734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0973919a-aa50-4ae0-a72a-10ea1b7b0bfc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:57.856329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0973919a-aa50-4ae0-a72a-10ea1b7b0bfc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:57.858268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-80074837-8677-49dd-b81a-800562b86d48 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:57.860091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-80074837-8677-49dd-b81a-800562b86d48 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:57.861622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-80074837-8677-49dd-b81a-800562b86d48 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.163936 Jul 26 18:51:57.862724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1779/3533] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:57 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:57.862921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0973919a-aa50-4ae0-a72a-10ea1b7b0bfc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:57.863898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0973919a-aa50-4ae0-a72a-10ea1b7b0bfc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:57.864988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0973919a-aa50-4ae0-a72a-10ea1b7b0bfc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:57.865431 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0973919a-aa50-4ae0-a72a-10ea1b7b0bfc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:57.948770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e602fdc1-c505-4da0-92ab-5823fbf27f04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:57.949294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e602fdc1-c505-4da0-92ab-5823fbf27f04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:57.955667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e602fdc1-c505-4da0-92ab-5823fbf27f04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:57.956194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e602fdc1-c505-4da0-92ab-5823fbf27f04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:57.956953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e602fdc1-c505-4da0-92ab-5823fbf27f04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:57.957388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e602fdc1-c505-4da0-92ab-5823fbf27f04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:58.008587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0973919a-aa50-4ae0-a72a-10ea1b7b0bfc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:58.017471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0973919a-aa50-4ae0-a72a-10ea1b7b0bfc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.165067 Jul 26 18:51:58.018275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1755/3534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:57 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:58.092572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e602fdc1-c505-4da0-92ab-5823fbf27f04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:58.101757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e602fdc1-c505-4da0-92ab-5823fbf27f04 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157079 Jul 26 18:51:58.102412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1780/3535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:57 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:58.191145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f0f05ff1-f24a-4df5-96bd-e220cf40dac1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:58.192009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f0f05ff1-f24a-4df5-96bd-e220cf40dac1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:58.201867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0f05ff1-f24a-4df5-96bd-e220cf40dac1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:58.202397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0f05ff1-f24a-4df5-96bd-e220cf40dac1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:58.203630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0f05ff1-f24a-4df5-96bd-e220cf40dac1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:58.204202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f0f05ff1-f24a-4df5-96bd-e220cf40dac1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:58.346961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f0f05ff1-f24a-4df5-96bd-e220cf40dac1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:58.357349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f0f05ff1-f24a-4df5-96bd-e220cf40dac1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.172789 Jul 26 18:51:58.357952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1756/3536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:58 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:58.876825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9fa67896-c2bd-4f81-aae7-7f793e324dbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:58.877867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9fa67896-c2bd-4f81-aae7-7f793e324dbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:58.884851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-46f94630-9ab1-4626-9898-2276e5bae15a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:58.885353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fa67896-c2bd-4f81-aae7-7f793e324dbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:58.885514 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-46f94630-9ab1-4626-9898-2276e5bae15a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:58.885630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fa67896-c2bd-4f81-aae7-7f793e324dbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:58.886221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fa67896-c2bd-4f81-aae7-7f793e324dbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:58.886647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fa67896-c2bd-4f81-aae7-7f793e324dbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:58.892373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46f94630-9ab1-4626-9898-2276e5bae15a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:58.892833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46f94630-9ab1-4626-9898-2276e5bae15a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:58.893963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46f94630-9ab1-4626-9898-2276e5bae15a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:58.894516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-46f94630-9ab1-4626-9898-2276e5bae15a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:59.028766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9fa67896-c2bd-4f81-aae7-7f793e324dbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:59.037346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9fa67896-c2bd-4f81-aae7-7f793e324dbc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.167333 Jul 26 18:51:59.037913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1781/3537] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:58 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:59.042112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-46f94630-9ab1-4626-9898-2276e5bae15a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:59.044160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ff1302fd-218b-489a-b537-01f4098a9f75 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:59.045008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ff1302fd-218b-489a-b537-01f4098a9f75 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:59.051522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff1302fd-218b-489a-b537-01f4098a9f75 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:59.051980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff1302fd-218b-489a-b537-01f4098a9f75 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:59.052252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-46f94630-9ab1-4626-9898-2276e5bae15a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:59.052744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff1302fd-218b-489a-b537-01f4098a9f75 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:59.053174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff1302fd-218b-489a-b537-01f4098a9f75 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:59.053763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-46f94630-9ab1-4626-9898-2276e5bae15a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:59.055201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-46f94630-9ab1-4626-9898-2276e5bae15a tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.174361 Jul 26 18:51:59.055727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1757/3538] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:51:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:51:59.123311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eb7baa9d-23de-445d-be4a-048e6bfd20c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:59.123903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eb7baa9d-23de-445d-be4a-048e6bfd20c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:59.130114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb7baa9d-23de-445d-be4a-048e6bfd20c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:59.130553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb7baa9d-23de-445d-be4a-048e6bfd20c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:59.131323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb7baa9d-23de-445d-be4a-048e6bfd20c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:59.131741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb7baa9d-23de-445d-be4a-048e6bfd20c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:59.190249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ff1302fd-218b-489a-b537-01f4098a9f75 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:59.198426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ff1302fd-218b-489a-b537-01f4098a9f75 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.158180 Jul 26 18:51:59.198994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1782/3539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:59 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:51:59.261665 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eb7baa9d-23de-445d-be4a-048e6bfd20c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:59.269836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eb7baa9d-23de-445d-be4a-048e6bfd20c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150621 Jul 26 18:51:59.270394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1758/3540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:59 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:51:59.382921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4bda0d63-b2e4-4054-830a-2e4c79e45896 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:51:59.383825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4bda0d63-b2e4-4054-830a-2e4c79e45896 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:51:59.393889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4bda0d63-b2e4-4054-830a-2e4c79e45896 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:59.394346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4bda0d63-b2e4-4054-830a-2e4c79e45896 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:59.395129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4bda0d63-b2e4-4054-830a-2e4c79e45896 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:51:59.395562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4bda0d63-b2e4-4054-830a-2e4c79e45896 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:51:59.532093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4bda0d63-b2e4-4054-830a-2e4c79e45896 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:51:59.540379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4bda0d63-b2e4-4054-830a-2e4c79e45896 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.164354 Jul 26 18:51:59.540958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1783/3541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:51:59 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:00.059523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fcdc9191-17f6-45b8-a354-97effee40795 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:00.060109 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fcdc9191-17f6-45b8-a354-97effee40795 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:00.067011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fcdc9191-17f6-45b8-a354-97effee40795 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:00.067507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fcdc9191-17f6-45b8-a354-97effee40795 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:00.068271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fcdc9191-17f6-45b8-a354-97effee40795 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:00.068705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fcdc9191-17f6-45b8-a354-97effee40795 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:00.077814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3e7f0c0c-1daf-409e-a198-968ea133cdf1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:00.078408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3e7f0c0c-1daf-409e-a198-968ea133cdf1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:00.085242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e7f0c0c-1daf-409e-a198-968ea133cdf1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:00.085679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e7f0c0c-1daf-409e-a198-968ea133cdf1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:00.086427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e7f0c0c-1daf-409e-a198-968ea133cdf1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:00.086854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e7f0c0c-1daf-409e-a198-968ea133cdf1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:00.205397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fcdc9191-17f6-45b8-a354-97effee40795 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:00.214218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fcdc9191-17f6-45b8-a354-97effee40795 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158688 Jul 26 18:52:00.214789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1759/3542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:00 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:00.221443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3e7f0c0c-1daf-409e-a198-968ea133cdf1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:00.221984 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d74c6eb5-2348-4874-9ae5-24341ad89855 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:00.222598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d74c6eb5-2348-4874-9ae5-24341ad89855 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:00.229693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d74c6eb5-2348-4874-9ae5-24341ad89855 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:00.230145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d74c6eb5-2348-4874-9ae5-24341ad89855 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:00.230566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3e7f0c0c-1daf-409e-a198-968ea133cdf1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:00.230910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d74c6eb5-2348-4874-9ae5-24341ad89855 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:00.231366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d74c6eb5-2348-4874-9ae5-24341ad89855 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:00.232112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3e7f0c0c-1daf-409e-a198-968ea133cdf1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:00.233431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3e7f0c0c-1daf-409e-a198-968ea133cdf1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159450 Jul 26 18:52:00.234024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1784/3543] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:00 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:52:00.292314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-194de1ba-e733-497b-a830-7f7f78a29511 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:00.292931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-194de1ba-e733-497b-a830-7f7f78a29511 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:00.299360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-194de1ba-e733-497b-a830-7f7f78a29511 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:00.299822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-194de1ba-e733-497b-a830-7f7f78a29511 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:00.300596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-194de1ba-e733-497b-a830-7f7f78a29511 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:00.301032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-194de1ba-e733-497b-a830-7f7f78a29511 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:00.365095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d74c6eb5-2348-4874-9ae5-24341ad89855 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:00.373377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d74c6eb5-2348-4874-9ae5-24341ad89855 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157324 Jul 26 18:52:00.374033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1760/3544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:00 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:00.440589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-194de1ba-e733-497b-a830-7f7f78a29511 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:00.448691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-194de1ba-e733-497b-a830-7f7f78a29511 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.160253 Jul 26 18:52:00.449269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1785/3545] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:00 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:00.574815 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-821a4534-f581-4de2-8e5b-710bfc1b2d25 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:00.575757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-821a4534-f581-4de2-8e5b-710bfc1b2d25 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:00.584002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-821a4534-f581-4de2-8e5b-710bfc1b2d25 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:00.584448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-821a4534-f581-4de2-8e5b-710bfc1b2d25 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:00.585198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-821a4534-f581-4de2-8e5b-710bfc1b2d25 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:00.585630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-821a4534-f581-4de2-8e5b-710bfc1b2d25 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:00.728516 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-821a4534-f581-4de2-8e5b-710bfc1b2d25 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:00.737038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-821a4534-f581-4de2-8e5b-710bfc1b2d25 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.168588 Jul 26 18:52:00.737582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1761/3546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:00 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:01.239660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-621fb681-f564-4e59-b473-e9cebfcb3d9e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:01.240599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-621fb681-f564-4e59-b473-e9cebfcb3d9e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:01.252019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-621fb681-f564-4e59-b473-e9cebfcb3d9e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:01.252947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-621fb681-f564-4e59-b473-e9cebfcb3d9e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:01.253713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-621fb681-f564-4e59-b473-e9cebfcb3d9e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:01.254139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-621fb681-f564-4e59-b473-e9cebfcb3d9e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:01.257272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4785d5a1-22ad-499f-9bc4-90913bf9e0d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:01.257884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4785d5a1-22ad-499f-9bc4-90913bf9e0d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:01.264864 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4785d5a1-22ad-499f-9bc4-90913bf9e0d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:01.265305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4785d5a1-22ad-499f-9bc4-90913bf9e0d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:01.266089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4785d5a1-22ad-499f-9bc4-90913bf9e0d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:01.266522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4785d5a1-22ad-499f-9bc4-90913bf9e0d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:01.385263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-621fb681-f564-4e59-b473-e9cebfcb3d9e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:01.393273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-621fb681-f564-4e59-b473-e9cebfcb3d9e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160078 Jul 26 18:52:01.393942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1786/3547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:01 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:01.400626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4785d5a1-22ad-499f-9bc4-90913bf9e0d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:01.401607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-173270aa-80be-4364-915c-6a3ed7a2ea53 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:01.402220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-173270aa-80be-4364-915c-6a3ed7a2ea53 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:01.409311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4785d5a1-22ad-499f-9bc4-90913bf9e0d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:01.409909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-173270aa-80be-4364-915c-6a3ed7a2ea53 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:01.410457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-173270aa-80be-4364-915c-6a3ed7a2ea53 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:01.410812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4785d5a1-22ad-499f-9bc4-90913bf9e0d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:01.411117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-173270aa-80be-4364-915c-6a3ed7a2ea53 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:01.411547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-173270aa-80be-4364-915c-6a3ed7a2ea53 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:01.411995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4785d5a1-22ad-499f-9bc4-90913bf9e0d6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159059 Jul 26 18:52:01.412550 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1762/3548] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:01 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:01.469878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dafdbf8c-f9a5-4422-8c83-f074ed6a0b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:01.470482 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dafdbf8c-f9a5-4422-8c83-f074ed6a0b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:01.478142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dafdbf8c-f9a5-4422-8c83-f074ed6a0b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:01.478639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dafdbf8c-f9a5-4422-8c83-f074ed6a0b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:01.479932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dafdbf8c-f9a5-4422-8c83-f074ed6a0b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:01.480376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dafdbf8c-f9a5-4422-8c83-f074ed6a0b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:01.484783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:01.547997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-173270aa-80be-4364-915c-6a3ed7a2ea53 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:01.556163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-173270aa-80be-4364-915c-6a3ed7a2ea53 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161231 Jul 26 18:52:01.556734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1787/3549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:01 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:01.608169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dafdbf8c-f9a5-4422-8c83-f074ed6a0b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:01.616612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dafdbf8c-f9a5-4422-8c83-f074ed6a0b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150631 Jul 26 18:52:01.617172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1763/3550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:01 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:01.759929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-daf459ad-249b-44c8-99c4-ebb63389485c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:01.760644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-daf459ad-249b-44c8-99c4-ebb63389485c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:01.762767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:01.769389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-daf459ad-249b-44c8-99c4-ebb63389485c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:01.769921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-daf459ad-249b-44c8-99c4-ebb63389485c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:01.770818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-daf459ad-249b-44c8-99c4-ebb63389485c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:01.771366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-daf459ad-249b-44c8-99c4-ebb63389485c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:01.909529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-daf459ad-249b-44c8-99c4-ebb63389485c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:01.918248 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-daf459ad-249b-44c8-99c4-ebb63389485c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162987 Jul 26 18:52:01.918826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1788/3551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:01 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:02.418498 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e2f146b6-f262-4bdb-9948-5ba8e0f978bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:02.419460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e2f146b6-f262-4bdb-9948-5ba8e0f978bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:02.428726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e2f146b6-f262-4bdb-9948-5ba8e0f978bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:02.429167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e2f146b6-f262-4bdb-9948-5ba8e0f978bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:02.429912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e2f146b6-f262-4bdb-9948-5ba8e0f978bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:02.430340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e2f146b6-f262-4bdb-9948-5ba8e0f978bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:02.434295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bbcbfc84-1a01-4014-bf9f-14963d0230bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:02.434916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bbcbfc84-1a01-4014-bf9f-14963d0230bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:02.441929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bbcbfc84-1a01-4014-bf9f-14963d0230bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:02.442372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bbcbfc84-1a01-4014-bf9f-14963d0230bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:02.443152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bbcbfc84-1a01-4014-bf9f-14963d0230bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:02.443578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bbcbfc84-1a01-4014-bf9f-14963d0230bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:02.446115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:02.563895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e2f146b6-f262-4bdb-9948-5ba8e0f978bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:02.572066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e2f146b6-f262-4bdb-9948-5ba8e0f978bb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160034 Jul 26 18:52:02.572620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1764/3552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:02 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:02.572780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bbcbfc84-1a01-4014-bf9f-14963d0230bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:02.577069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3a9ba017-9c43-4ba5-8c05-1dab8309d284 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:02.577810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3a9ba017-9c43-4ba5-8c05-1dab8309d284 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:02.580598 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:02.583917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bbcbfc84-1a01-4014-bf9f-14963d0230bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:02.585436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a9ba017-9c43-4ba5-8c05-1dab8309d284 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:02.585568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bbcbfc84-1a01-4014-bf9f-14963d0230bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:02.585882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a9ba017-9c43-4ba5-8c05-1dab8309d284 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:02.586638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a9ba017-9c43-4ba5-8c05-1dab8309d284 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:02.586770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bbcbfc84-1a01-4014-bf9f-14963d0230bc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156372 Jul 26 18:52:02.587083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a9ba017-9c43-4ba5-8c05-1dab8309d284 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:02.587256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1789/3553] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:02 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:02.637453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d1f44450-ad9c-4a65-b5b8-68983982efd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:02.638068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d1f44450-ad9c-4a65-b5b8-68983982efd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:02.644120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1f44450-ad9c-4a65-b5b8-68983982efd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:02.644562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1f44450-ad9c-4a65-b5b8-68983982efd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:02.645307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1f44450-ad9c-4a65-b5b8-68983982efd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:02.645741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1f44450-ad9c-4a65-b5b8-68983982efd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:02.724741 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3a9ba017-9c43-4ba5-8c05-1dab8309d284 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:02.733304 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3a9ba017-9c43-4ba5-8c05-1dab8309d284 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.159691 Jul 26 18:52:02.733891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1765/3554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:02 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:02.777924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d1f44450-ad9c-4a65-b5b8-68983982efd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:02.786737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d1f44450-ad9c-4a65-b5b8-68983982efd5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153145 Jul 26 18:52:02.791172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1790/3555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:02 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:02.952287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e564d02d-f8b6-456e-b063-0d0bf4b051ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:02.953280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e564d02d-f8b6-456e-b063-0d0bf4b051ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:02.961025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e564d02d-f8b6-456e-b063-0d0bf4b051ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:02.961470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e564d02d-f8b6-456e-b063-0d0bf4b051ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:02.962209 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e564d02d-f8b6-456e-b063-0d0bf4b051ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:02.962634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e564d02d-f8b6-456e-b063-0d0bf4b051ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:03.092842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e564d02d-f8b6-456e-b063-0d0bf4b051ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:03.100964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e564d02d-f8b6-456e-b063-0d0bf4b051ea tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155278 Jul 26 18:52:03.101548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1766/3556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:03.594830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cb1bd649-829b-4c20-86de-c0e19d9d99a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:03.595492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cb1bd649-829b-4c20-86de-c0e19d9d99a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:03.603708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb1bd649-829b-4c20-86de-c0e19d9d99a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:03.604152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb1bd649-829b-4c20-86de-c0e19d9d99a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:03.604969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb1bd649-829b-4c20-86de-c0e19d9d99a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:03.605401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb1bd649-829b-4c20-86de-c0e19d9d99a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:03.609738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4d359250-7f52-4055-819a-7ad638907b75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:03.610338 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4d359250-7f52-4055-819a-7ad638907b75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:03.616956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d359250-7f52-4055-819a-7ad638907b75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:03.617402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d359250-7f52-4055-819a-7ad638907b75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:03.618166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d359250-7f52-4055-819a-7ad638907b75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:03.618594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d359250-7f52-4055-819a-7ad638907b75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:03.759462 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4d359250-7f52-4055-819a-7ad638907b75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:03.768364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4d359250-7f52-4055-819a-7ad638907b75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:03.770019 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4d359250-7f52-4055-819a-7ad638907b75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:03.771216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4d359250-7f52-4055-819a-7ad638907b75 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.165343 Jul 26 18:52:03.772301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1767/3557] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:03 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:03.777314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6d1fdf3e-1be1-46fd-b41f-527f7b8d295b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:03.778072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6d1fdf3e-1be1-46fd-b41f-527f7b8d295b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:03.789563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d1fdf3e-1be1-46fd-b41f-527f7b8d295b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:03.789983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d1fdf3e-1be1-46fd-b41f-527f7b8d295b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:03.790763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d1fdf3e-1be1-46fd-b41f-527f7b8d295b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:03.791233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d1fdf3e-1be1-46fd-b41f-527f7b8d295b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:03.830631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cb1bd649-829b-4c20-86de-c0e19d9d99a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:03.839285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cb1bd649-829b-4c20-86de-c0e19d9d99a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.249483 Jul 26 18:52:03.839966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1791/3558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:03 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:03.844725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-523fc054-7cf4-4502-9305-42efb669ce54 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:03.845597 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-523fc054-7cf4-4502-9305-42efb669ce54 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:03.852014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-523fc054-7cf4-4502-9305-42efb669ce54 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:03.852756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-523fc054-7cf4-4502-9305-42efb669ce54 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:03.853529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-523fc054-7cf4-4502-9305-42efb669ce54 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:03.854184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-523fc054-7cf4-4502-9305-42efb669ce54 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:03.935155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6d1fdf3e-1be1-46fd-b41f-527f7b8d295b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:03.943727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6d1fdf3e-1be1-46fd-b41f-527f7b8d295b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.170581 Jul 26 18:52:03.944296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1768/3559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:03 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:04.085059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-523fc054-7cf4-4502-9305-42efb669ce54 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:04.094963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-523fc054-7cf4-4502-9305-42efb669ce54 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.253728 Jul 26 18:52:04.095580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1792/3560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:03 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:04.121997 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-85491dd0-ad0b-4d1c-aa8c-9e6325defa72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:04.122608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-85491dd0-ad0b-4d1c-aa8c-9e6325defa72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:04.130563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85491dd0-ad0b-4d1c-aa8c-9e6325defa72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:04.131065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85491dd0-ad0b-4d1c-aa8c-9e6325defa72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:04.132026 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85491dd0-ad0b-4d1c-aa8c-9e6325defa72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:04.132542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85491dd0-ad0b-4d1c-aa8c-9e6325defa72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:04.277260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-85491dd0-ad0b-4d1c-aa8c-9e6325defa72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:04.285707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-85491dd0-ad0b-4d1c-aa8c-9e6325defa72 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167613 Jul 26 18:52:04.286276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1769/3561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:04 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:04.794810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2ec5d183-217e-4c09-a8b9-64eb675a82ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:04.795444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2ec5d183-217e-4c09-a8b9-64eb675a82ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:04.802888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ec5d183-217e-4c09-a8b9-64eb675a82ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:04.803358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ec5d183-217e-4c09-a8b9-64eb675a82ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:04.804114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ec5d183-217e-4c09-a8b9-64eb675a82ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:04.804545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ec5d183-217e-4c09-a8b9-64eb675a82ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:04.860605 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-df214b8b-6c8c-4668-8509-0c9be69d3a08 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:04.861313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-df214b8b-6c8c-4668-8509-0c9be69d3a08 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:04.868696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df214b8b-6c8c-4668-8509-0c9be69d3a08 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:04.869149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df214b8b-6c8c-4668-8509-0c9be69d3a08 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:04.869923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df214b8b-6c8c-4668-8509-0c9be69d3a08 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:04.870359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-df214b8b-6c8c-4668-8509-0c9be69d3a08 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:04.938864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2ec5d183-217e-4c09-a8b9-64eb675a82ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:04.948087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2ec5d183-217e-4c09-a8b9-64eb675a82ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:04.949619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2ec5d183-217e-4c09-a8b9-64eb675a82ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:04.950790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2ec5d183-217e-4c09-a8b9-64eb675a82ab tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160044 Jul 26 18:52:04.951360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1793/3562] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:04 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:04.964758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-988c4459-037a-4ccd-b3bb-b66fcaef8137 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:04.965531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-988c4459-037a-4ccd-b3bb-b66fcaef8137 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:04.971886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-988c4459-037a-4ccd-b3bb-b66fcaef8137 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:04.972452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-988c4459-037a-4ccd-b3bb-b66fcaef8137 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:04.973449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-988c4459-037a-4ccd-b3bb-b66fcaef8137 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:04.973898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-988c4459-037a-4ccd-b3bb-b66fcaef8137 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:04.998170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-df214b8b-6c8c-4668-8509-0c9be69d3a08 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:05.006294 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-df214b8b-6c8c-4668-8509-0c9be69d3a08 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.149670 Jul 26 18:52:05.006944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1770/3563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:04 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:05.108694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-988c4459-037a-4ccd-b3bb-b66fcaef8137 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:05.117123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-988c4459-037a-4ccd-b3bb-b66fcaef8137 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156027 Jul 26 18:52:05.117331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d9342d18-a020-4469-8b1e-84064707919b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:05.117700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1794/3564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:04 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:05.118108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d9342d18-a020-4469-8b1e-84064707919b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:05.126578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9342d18-a020-4469-8b1e-84064707919b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:05.127167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9342d18-a020-4469-8b1e-84064707919b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:05.128305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9342d18-a020-4469-8b1e-84064707919b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:05.128950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9342d18-a020-4469-8b1e-84064707919b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:05.270605 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d9342d18-a020-4469-8b1e-84064707919b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:05.279453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d9342d18-a020-4469-8b1e-84064707919b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.166209 Jul 26 18:52:05.280058 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1771/3565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:05 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:05.307128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4b11b85f-0ba7-416b-aa8b-8fe1e6383a38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:05.307732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4b11b85f-0ba7-416b-aa8b-8fe1e6383a38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:05.313884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b11b85f-0ba7-416b-aa8b-8fe1e6383a38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:05.314323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b11b85f-0ba7-416b-aa8b-8fe1e6383a38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:05.315223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b11b85f-0ba7-416b-aa8b-8fe1e6383a38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:05.315541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4b11b85f-0ba7-416b-aa8b-8fe1e6383a38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:05.450871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4b11b85f-0ba7-416b-aa8b-8fe1e6383a38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:05.459651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4b11b85f-0ba7-416b-aa8b-8fe1e6383a38 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156428 Jul 26 18:52:05.460235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1795/3566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:05 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:05.976351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-053752db-d7c0-4657-b127-bb7bf93e4d69 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:05.977130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-053752db-d7c0-4657-b127-bb7bf93e4d69 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:05.986137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-053752db-d7c0-4657-b127-bb7bf93e4d69 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:05.986740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-053752db-d7c0-4657-b127-bb7bf93e4d69 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:05.987879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-053752db-d7c0-4657-b127-bb7bf93e4d69 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:05.988309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-053752db-d7c0-4657-b127-bb7bf93e4d69 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:06.028729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3e92b3fe-a370-40de-8660-dd8aae5b111e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:06.029296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3e92b3fe-a370-40de-8660-dd8aae5b111e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:06.038773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e92b3fe-a370-40de-8660-dd8aae5b111e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:06.039430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e92b3fe-a370-40de-8660-dd8aae5b111e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:06.040594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e92b3fe-a370-40de-8660-dd8aae5b111e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:06.041147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e92b3fe-a370-40de-8660-dd8aae5b111e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:06.124883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-053752db-d7c0-4657-b127-bb7bf93e4d69 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:06.133695 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-053752db-d7c0-4657-b127-bb7bf93e4d69 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:06.135262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-053752db-d7c0-4657-b127-bb7bf93e4d69 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:06.136447 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-053752db-d7c0-4657-b127-bb7bf93e4d69 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.165537 Jul 26 18:52:06.137288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1772/3567] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:06.143008 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-18720e49-af80-4f90-9605-57db5bbc03b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:06.143883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-18720e49-af80-4f90-9605-57db5bbc03b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:06.154713 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-18720e49-af80-4f90-9605-57db5bbc03b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:06.155295 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-18720e49-af80-4f90-9605-57db5bbc03b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:06.156146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-18720e49-af80-4f90-9605-57db5bbc03b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:06.156581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-18720e49-af80-4f90-9605-57db5bbc03b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:06.176019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3e92b3fe-a370-40de-8660-dd8aae5b111e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:06.185414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3e92b3fe-a370-40de-8660-dd8aae5b111e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160655 Jul 26 18:52:06.185987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1796/3568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:06 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:06.296666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-18720e49-af80-4f90-9605-57db5bbc03b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:06.300663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-84870040-e770-44ac-98b6-a98397c9ca49 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:06.301272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-84870040-e770-44ac-98b6-a98397c9ca49 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:06.305250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-18720e49-af80-4f90-9605-57db5bbc03b7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.165895 Jul 26 18:52:06.306039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1773/3569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:06 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:06.307564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-84870040-e770-44ac-98b6-a98397c9ca49 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:06.308013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-84870040-e770-44ac-98b6-a98397c9ca49 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:06.308786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-84870040-e770-44ac-98b6-a98397c9ca49 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:06.309210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-84870040-e770-44ac-98b6-a98397c9ca49 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:06.449875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-84870040-e770-44ac-98b6-a98397c9ca49 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:06.458395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-84870040-e770-44ac-98b6-a98397c9ca49 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161574 Jul 26 18:52:06.458951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1797/3570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:06 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:06.485588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3480fd94-6487-4e90-b7ea-5b0917b546f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:06.486199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3480fd94-6487-4e90-b7ea-5b0917b546f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:06.492534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3480fd94-6487-4e90-b7ea-5b0917b546f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:06.492982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3480fd94-6487-4e90-b7ea-5b0917b546f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:06.493728 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3480fd94-6487-4e90-b7ea-5b0917b546f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:06.494155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3480fd94-6487-4e90-b7ea-5b0917b546f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:06.633111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3480fd94-6487-4e90-b7ea-5b0917b546f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:06.641747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3480fd94-6487-4e90-b7ea-5b0917b546f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160021 Jul 26 18:52:06.642288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1774/3571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:06 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:07.162508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d9304b9a-ed69-41ba-842a-c8107d450ebf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:07.163250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d9304b9a-ed69-41ba-842a-c8107d450ebf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:07.170310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d9304b9a-ed69-41ba-842a-c8107d450ebf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:07.170762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d9304b9a-ed69-41ba-842a-c8107d450ebf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:07.171591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d9304b9a-ed69-41ba-842a-c8107d450ebf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:07.172026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d9304b9a-ed69-41ba-842a-c8107d450ebf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:07.205762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b3476f86-3be5-4f71-92a5-1ab5b2645f72 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:07.206371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b3476f86-3be5-4f71-92a5-1ab5b2645f72 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:07.213189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3476f86-3be5-4f71-92a5-1ab5b2645f72 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:07.213666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3476f86-3be5-4f71-92a5-1ab5b2645f72 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:07.214425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3476f86-3be5-4f71-92a5-1ab5b2645f72 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:07.214860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3476f86-3be5-4f71-92a5-1ab5b2645f72 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:07.308103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d9304b9a-ed69-41ba-842a-c8107d450ebf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:07.317079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d9304b9a-ed69-41ba-842a-c8107d450ebf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:07.318901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d9304b9a-ed69-41ba-842a-c8107d450ebf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:07.321724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d9304b9a-ed69-41ba-842a-c8107d450ebf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.164018 Jul 26 18:52:07.322303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1798/3572] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:07.326660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fb459095-cfc8-4d8e-9ad3-a464d25be5be tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:07.327312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fb459095-cfc8-4d8e-9ad3-a464d25be5be tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:07.333499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb459095-cfc8-4d8e-9ad3-a464d25be5be tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:07.334185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb459095-cfc8-4d8e-9ad3-a464d25be5be tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:07.335233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb459095-cfc8-4d8e-9ad3-a464d25be5be tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:07.335625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb459095-cfc8-4d8e-9ad3-a464d25be5be tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:07.349291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b3476f86-3be5-4f71-92a5-1ab5b2645f72 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:07.357359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b3476f86-3be5-4f71-92a5-1ab5b2645f72 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155429 Jul 26 18:52:07.357927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1775/3573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:07 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:07.464470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fb459095-cfc8-4d8e-9ad3-a464d25be5be tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:07.473068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fb459095-cfc8-4d8e-9ad3-a464d25be5be tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.149819 Jul 26 18:52:07.473821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1799/3574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:07 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:07.483943 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3c8c988e-72e5-4ebc-af3b-f0c45b08a8dc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:07.484609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3c8c988e-72e5-4ebc-af3b-f0c45b08a8dc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:07.490906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c8c988e-72e5-4ebc-af3b-f0c45b08a8dc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:07.491406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c8c988e-72e5-4ebc-af3b-f0c45b08a8dc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:07.492125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c8c988e-72e5-4ebc-af3b-f0c45b08a8dc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:07.492551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3c8c988e-72e5-4ebc-af3b-f0c45b08a8dc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:07.631723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3c8c988e-72e5-4ebc-af3b-f0c45b08a8dc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:07.639795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3c8c988e-72e5-4ebc-af3b-f0c45b08a8dc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.159681 Jul 26 18:52:07.640337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1776/3575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:07 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:07.666572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f6737e9f-fba1-4dcd-baa6-1bee22f217bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:07.667384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f6737e9f-fba1-4dcd-baa6-1bee22f217bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:07.676254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6737e9f-fba1-4dcd-baa6-1bee22f217bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:07.676708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6737e9f-fba1-4dcd-baa6-1bee22f217bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:07.677506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6737e9f-fba1-4dcd-baa6-1bee22f217bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:07.677945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6737e9f-fba1-4dcd-baa6-1bee22f217bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:07.818480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f6737e9f-fba1-4dcd-baa6-1bee22f217bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:07.826804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f6737e9f-fba1-4dcd-baa6-1bee22f217bb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.166609 Jul 26 18:52:07.827422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1800/3576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:07 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:08.349307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-27c51948-0d63-4bbc-b6b3-fd7dd348fdbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:08.350223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-27c51948-0d63-4bbc-b6b3-fd7dd348fdbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:08.361153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27c51948-0d63-4bbc-b6b3-fd7dd348fdbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:08.361898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27c51948-0d63-4bbc-b6b3-fd7dd348fdbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:08.363058 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27c51948-0d63-4bbc-b6b3-fd7dd348fdbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:08.363502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-27c51948-0d63-4bbc-b6b3-fd7dd348fdbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:08.379250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-268d8328-ba78-4fc1-9e41-9f3ef8e48ac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:08.379845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-268d8328-ba78-4fc1-9e41-9f3ef8e48ac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:08.386792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-268d8328-ba78-4fc1-9e41-9f3ef8e48ac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:08.387261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-268d8328-ba78-4fc1-9e41-9f3ef8e48ac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:08.388028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-268d8328-ba78-4fc1-9e41-9f3ef8e48ac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:08.388464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-268d8328-ba78-4fc1-9e41-9f3ef8e48ac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:08.499791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-27c51948-0d63-4bbc-b6b3-fd7dd348fdbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:08.509930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-27c51948-0d63-4bbc-b6b3-fd7dd348fdbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:08.511471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-27c51948-0d63-4bbc-b6b3-fd7dd348fdbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:08.512625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-27c51948-0d63-4bbc-b6b3-fd7dd348fdbf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.170077 Jul 26 18:52:08.513602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1777/3577] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:08 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:08.518467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-50a0f14b-18fb-440a-9836-92fba3d13f02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:08.519120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-50a0f14b-18fb-440a-9836-92fba3d13f02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:08.526173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50a0f14b-18fb-440a-9836-92fba3d13f02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:08.526602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50a0f14b-18fb-440a-9836-92fba3d13f02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:08.527585 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50a0f14b-18fb-440a-9836-92fba3d13f02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:08.528494 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-50a0f14b-18fb-440a-9836-92fba3d13f02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:08.537896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-268d8328-ba78-4fc1-9e41-9f3ef8e48ac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:08.545915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-268d8328-ba78-4fc1-9e41-9f3ef8e48ac1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.170585 Jul 26 18:52:08.546488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1801/3578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:08 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:08.659063 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-50a0f14b-18fb-440a-9836-92fba3d13f02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:08.662004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-15ad838a-3795-4dcd-9b54-a96b96b31890 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:08.662781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-15ad838a-3795-4dcd-9b54-a96b96b31890 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:08.667525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-50a0f14b-18fb-440a-9836-92fba3d13f02 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152772 Jul 26 18:52:08.668129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1778/3579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:08 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:08.669039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15ad838a-3795-4dcd-9b54-a96b96b31890 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:08.669494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15ad838a-3795-4dcd-9b54-a96b96b31890 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:08.670259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15ad838a-3795-4dcd-9b54-a96b96b31890 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:08.670692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15ad838a-3795-4dcd-9b54-a96b96b31890 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:08.801443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15ad838a-3795-4dcd-9b54-a96b96b31890 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:08.809716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-15ad838a-3795-4dcd-9b54-a96b96b31890 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151664 Jul 26 18:52:08.810285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1802/3580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:08 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:08.848524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-04f528a2-25e2-43ee-8c68-11f6aecfcf9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:08.849166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-04f528a2-25e2-43ee-8c68-11f6aecfcf9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:08.855926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04f528a2-25e2-43ee-8c68-11f6aecfcf9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:08.856318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04f528a2-25e2-43ee-8c68-11f6aecfcf9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:08.857072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04f528a2-25e2-43ee-8c68-11f6aecfcf9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:08.857514 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-04f528a2-25e2-43ee-8c68-11f6aecfcf9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:08.997125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-04f528a2-25e2-43ee-8c68-11f6aecfcf9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:08.999466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:09.006768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-04f528a2-25e2-43ee-8c68-11f6aecfcf9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162198 Jul 26 18:52:09.007366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1779/3581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:09.539217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b5c6bda2-4d8f-49fc-98f7-6b225de6ea2b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:09.539923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b5c6bda2-4d8f-49fc-98f7-6b225de6ea2b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:09.548624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5c6bda2-4d8f-49fc-98f7-6b225de6ea2b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:09.549175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5c6bda2-4d8f-49fc-98f7-6b225de6ea2b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:09.550204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5c6bda2-4d8f-49fc-98f7-6b225de6ea2b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:09.550637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5c6bda2-4d8f-49fc-98f7-6b225de6ea2b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:09.568352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-36887c3c-7abd-40ea-b49d-2a534e1d001b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:09.568980 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-36887c3c-7abd-40ea-b49d-2a534e1d001b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:09.575678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-36887c3c-7abd-40ea-b49d-2a534e1d001b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:09.576100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-36887c3c-7abd-40ea-b49d-2a534e1d001b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:09.576934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-36887c3c-7abd-40ea-b49d-2a534e1d001b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:09.577361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-36887c3c-7abd-40ea-b49d-2a534e1d001b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:09.687909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b5c6bda2-4d8f-49fc-98f7-6b225de6ea2b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:09.696422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b5c6bda2-4d8f-49fc-98f7-6b225de6ea2b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:09.697895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b5c6bda2-4d8f-49fc-98f7-6b225de6ea2b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:09.699235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b5c6bda2-4d8f-49fc-98f7-6b225de6ea2b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.165229 Jul 26 18:52:09.711047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1803/3582] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:09 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:09.711047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8e3afbee-7e9e-4752-91c4-9bafb00574db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:09.711047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8e3afbee-7e9e-4752-91c4-9bafb00574db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:09.711047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e3afbee-7e9e-4752-91c4-9bafb00574db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:09.711598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e3afbee-7e9e-4752-91c4-9bafb00574db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:09.715391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e3afbee-7e9e-4752-91c4-9bafb00574db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:09.715391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e3afbee-7e9e-4752-91c4-9bafb00574db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:09.716241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-36887c3c-7abd-40ea-b49d-2a534e1d001b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:09.724502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-36887c3c-7abd-40ea-b49d-2a534e1d001b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160760 Jul 26 18:52:09.725084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1780/3583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:09 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:09.832117 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-334e866b-9486-43ab-b246-6848499ce49d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:09.832738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-334e866b-9486-43ab-b246-6848499ce49d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:09.839239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-334e866b-9486-43ab-b246-6848499ce49d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:09.839693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-334e866b-9486-43ab-b246-6848499ce49d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:09.840289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8e3afbee-7e9e-4752-91c4-9bafb00574db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:09.840441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-334e866b-9486-43ab-b246-6848499ce49d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:09.840878 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-334e866b-9486-43ab-b246-6848499ce49d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:09.848569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8e3afbee-7e9e-4752-91c4-9bafb00574db tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.147808 Jul 26 18:52:09.852345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1804/3584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:09 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:09.976095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-334e866b-9486-43ab-b246-6848499ce49d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:09.987200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-334e866b-9486-43ab-b246-6848499ce49d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158824 Jul 26 18:52:09.988083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1781/3585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:09 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:10.028339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e0967e4d-e23f-4082-8a56-cf765c82d891 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:10.028951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e0967e4d-e23f-4082-8a56-cf765c82d891 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:10.035447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0967e4d-e23f-4082-8a56-cf765c82d891 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:10.035900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0967e4d-e23f-4082-8a56-cf765c82d891 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:10.036685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0967e4d-e23f-4082-8a56-cf765c82d891 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:10.037136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0967e4d-e23f-4082-8a56-cf765c82d891 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:10.178618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e0967e4d-e23f-4082-8a56-cf765c82d891 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:10.180901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:10.187957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e0967e4d-e23f-4082-8a56-cf765c82d891 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163575 Jul 26 18:52:10.188575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1805/3586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:10 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:10.723502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fe7fba27-6d9f-4f96-b6ae-8c32a3259d66 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:10.724122 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fe7fba27-6d9f-4f96-b6ae-8c32a3259d66 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:10.730919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe7fba27-6d9f-4f96-b6ae-8c32a3259d66 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:10.731413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe7fba27-6d9f-4f96-b6ae-8c32a3259d66 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:10.732149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe7fba27-6d9f-4f96-b6ae-8c32a3259d66 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:10.732576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fe7fba27-6d9f-4f96-b6ae-8c32a3259d66 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:10.746193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f3a51dcb-1d0c-40b3-93c6-b860c609fff2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:10.746817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f3a51dcb-1d0c-40b3-93c6-b860c609fff2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:10.753831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3a51dcb-1d0c-40b3-93c6-b860c609fff2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:10.754287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3a51dcb-1d0c-40b3-93c6-b860c609fff2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:10.755053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3a51dcb-1d0c-40b3-93c6-b860c609fff2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:10.755574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f3a51dcb-1d0c-40b3-93c6-b860c609fff2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:10.865227 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fe7fba27-6d9f-4f96-b6ae-8c32a3259d66 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:10.873954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fe7fba27-6d9f-4f96-b6ae-8c32a3259d66 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:10.875486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fe7fba27-6d9f-4f96-b6ae-8c32a3259d66 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:10.876674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fe7fba27-6d9f-4f96-b6ae-8c32a3259d66 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157446 Jul 26 18:52:10.877232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1782/3587] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:10 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:10.890326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f3a51dcb-1d0c-40b3-93c6-b860c609fff2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:10.891502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-123f5c7a-2fc4-4cd0-8776-0f97ae3763e2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:10.892105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-123f5c7a-2fc4-4cd0-8776-0f97ae3763e2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:10.898632 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-123f5c7a-2fc4-4cd0-8776-0f97ae3763e2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:10.899076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-123f5c7a-2fc4-4cd0-8776-0f97ae3763e2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:10.899325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f3a51dcb-1d0c-40b3-93c6-b860c609fff2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.157371 Jul 26 18:52:10.899828 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-123f5c7a-2fc4-4cd0-8776-0f97ae3763e2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:10.899948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1806/3588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:10.900254 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-123f5c7a-2fc4-4cd0-8776-0f97ae3763e2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:11.015139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3b8ae5c8-a4bf-4d09-86e7-2fc60c16dcac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:11.015907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3b8ae5c8-a4bf-4d09-86e7-2fc60c16dcac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:11.022691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b8ae5c8-a4bf-4d09-86e7-2fc60c16dcac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:11.023168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b8ae5c8-a4bf-4d09-86e7-2fc60c16dcac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:11.023940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b8ae5c8-a4bf-4d09-86e7-2fc60c16dcac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:11.024393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b8ae5c8-a4bf-4d09-86e7-2fc60c16dcac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:11.039236 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-123f5c7a-2fc4-4cd0-8776-0f97ae3763e2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:11.047657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-123f5c7a-2fc4-4cd0-8776-0f97ae3763e2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.163545 Jul 26 18:52:11.048218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1783/3589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:10 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:11.154560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3b8ae5c8-a4bf-4d09-86e7-2fc60c16dcac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:11.162684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3b8ae5c8-a4bf-4d09-86e7-2fc60c16dcac tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151549 Jul 26 18:52:11.163250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1807/3590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:11 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:11.210310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7e594176-913a-46bf-b05e-088fb59c714a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:11.210912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7e594176-913a-46bf-b05e-088fb59c714a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:11.217273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e594176-913a-46bf-b05e-088fb59c714a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:11.217713 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e594176-913a-46bf-b05e-088fb59c714a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:11.218456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e594176-913a-46bf-b05e-088fb59c714a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:11.218915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e594176-913a-46bf-b05e-088fb59c714a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:11.349625 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7e594176-913a-46bf-b05e-088fb59c714a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:11.358037 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7e594176-913a-46bf-b05e-088fb59c714a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.151868 Jul 26 18:52:11.358611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1784/3591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:11.904501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-091d2ff7-a844-4ef1-b397-4b3ee35faa21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:11.905355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-091d2ff7-a844-4ef1-b397-4b3ee35faa21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:11.916652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-091d2ff7-a844-4ef1-b397-4b3ee35faa21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:11.917394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-091d2ff7-a844-4ef1-b397-4b3ee35faa21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:11.918628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-091d2ff7-a844-4ef1-b397-4b3ee35faa21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:11.919393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-091d2ff7-a844-4ef1-b397-4b3ee35faa21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:11.924628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-15d22595-9b6b-4881-a6c9-e306978629a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:11.925545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-15d22595-9b6b-4881-a6c9-e306978629a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:11.932690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-15d22595-9b6b-4881-a6c9-e306978629a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:11.933140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-15d22595-9b6b-4881-a6c9-e306978629a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:11.933940 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-15d22595-9b6b-4881-a6c9-e306978629a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:11.934376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-15d22595-9b6b-4881-a6c9-e306978629a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:12.070866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-15d22595-9b6b-4881-a6c9-e306978629a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:12.073099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-091d2ff7-a844-4ef1-b397-4b3ee35faa21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:12.079201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-15d22595-9b6b-4881-a6c9-e306978629a5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161237 Jul 26 18:52:12.079779 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1785/3592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:11 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:12.082109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-091d2ff7-a844-4ef1-b397-4b3ee35faa21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:12.083692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-091d2ff7-a844-4ef1-b397-4b3ee35faa21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:12.084885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-091d2ff7-a844-4ef1-b397-4b3ee35faa21 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.187295 Jul 26 18:52:12.085416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1808/3593] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:12.090026 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dd3e3b34-81ce-4484-8543-3afa6242ef4a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:12.090732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dd3e3b34-81ce-4484-8543-3afa6242ef4a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:12.096804 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd3e3b34-81ce-4484-8543-3afa6242ef4a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:12.097258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd3e3b34-81ce-4484-8543-3afa6242ef4a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:12.098009 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd3e3b34-81ce-4484-8543-3afa6242ef4a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:12.098442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd3e3b34-81ce-4484-8543-3afa6242ef4a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:12.189844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-21fe6bec-0dda-4ec3-b75d-73f2caa2de17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:12.190486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-21fe6bec-0dda-4ec3-b75d-73f2caa2de17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:12.197145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21fe6bec-0dda-4ec3-b75d-73f2caa2de17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:12.197586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21fe6bec-0dda-4ec3-b75d-73f2caa2de17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:12.198337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21fe6bec-0dda-4ec3-b75d-73f2caa2de17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:12.198767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21fe6bec-0dda-4ec3-b75d-73f2caa2de17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:12.239375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dd3e3b34-81ce-4484-8543-3afa6242ef4a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:12.248274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dd3e3b34-81ce-4484-8543-3afa6242ef4a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161956 Jul 26 18:52:12.248858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1786/3594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:12 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:12.330204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-21fe6bec-0dda-4ec3-b75d-73f2caa2de17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:12.338330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-21fe6bec-0dda-4ec3-b75d-73f2caa2de17 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152434 Jul 26 18:52:12.338905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1809/3595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:12 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:12.381025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-20c216bf-5b44-488e-a4c3-bea4207d3185 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:12.381633 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-20c216bf-5b44-488e-a4c3-bea4207d3185 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:12.388144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20c216bf-5b44-488e-a4c3-bea4207d3185 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:12.388592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20c216bf-5b44-488e-a4c3-bea4207d3185 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:12.389336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20c216bf-5b44-488e-a4c3-bea4207d3185 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:12.389769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20c216bf-5b44-488e-a4c3-bea4207d3185 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:12.519407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-20c216bf-5b44-488e-a4c3-bea4207d3185 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:12.528209 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-20c216bf-5b44-488e-a4c3-bea4207d3185 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152032 Jul 26 18:52:12.528784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1787/3596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:12 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:13.104900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-87e8db0c-608d-4230-81bc-9f00a7ecfd99 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:13.105845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-87e8db0c-608d-4230-81bc-9f00a7ecfd99 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:13.112213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-26fb6bb3-ae86-4ed6-8fac-4314433e26fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:13.113212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-26fb6bb3-ae86-4ed6-8fac-4314433e26fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:13.116886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87e8db0c-608d-4230-81bc-9f00a7ecfd99 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:13.117666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87e8db0c-608d-4230-81bc-9f00a7ecfd99 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:13.118888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87e8db0c-608d-4230-81bc-9f00a7ecfd99 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:13.119678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87e8db0c-608d-4230-81bc-9f00a7ecfd99 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:13.124319 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26fb6bb3-ae86-4ed6-8fac-4314433e26fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:13.125073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26fb6bb3-ae86-4ed6-8fac-4314433e26fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:13.126329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26fb6bb3-ae86-4ed6-8fac-4314433e26fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:13.127103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26fb6bb3-ae86-4ed6-8fac-4314433e26fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:13.259237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-87e8db0c-608d-4230-81bc-9f00a7ecfd99 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:13.261640 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-26fb6bb3-ae86-4ed6-8fac-4314433e26fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:13.267493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-87e8db0c-608d-4230-81bc-9f00a7ecfd99 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.169335 Jul 26 18:52:13.268078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1810/3597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:13.270594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-26fb6bb3-ae86-4ed6-8fac-4314433e26fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:13.272480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-26fb6bb3-ae86-4ed6-8fac-4314433e26fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:13.273209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d33c78e0-1b31-4f7d-a9b3-6529a5a2860f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:13.273626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-26fb6bb3-ae86-4ed6-8fac-4314433e26fc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.168006 Jul 26 18:52:13.273830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d33c78e0-1b31-4f7d-a9b3-6529a5a2860f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:13.274313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1788/3598] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:13.279823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d33c78e0-1b31-4f7d-a9b3-6529a5a2860f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:13.280284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d33c78e0-1b31-4f7d-a9b3-6529a5a2860f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:13.281059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d33c78e0-1b31-4f7d-a9b3-6529a5a2860f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:13.281501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d33c78e0-1b31-4f7d-a9b3-6529a5a2860f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:13.360668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4ba00de0-6f1e-4165-84da-5ff239cd33c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:13.361273 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4ba00de0-6f1e-4165-84da-5ff239cd33c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:13.368093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ba00de0-6f1e-4165-84da-5ff239cd33c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:13.368543 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ba00de0-6f1e-4165-84da-5ff239cd33c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:13.369315 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ba00de0-6f1e-4165-84da-5ff239cd33c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:13.369749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4ba00de0-6f1e-4165-84da-5ff239cd33c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:13.417918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d33c78e0-1b31-4f7d-a9b3-6529a5a2860f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:13.426244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d33c78e0-1b31-4f7d-a9b3-6529a5a2860f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157196 Jul 26 18:52:13.426882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1811/3599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:13 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:13.499941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4ba00de0-6f1e-4165-84da-5ff239cd33c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:13.508293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4ba00de0-6f1e-4165-84da-5ff239cd33c8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151920 Jul 26 18:52:13.508864 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1789/3600] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:13 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:13.549738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-50080bf8-40af-450c-8eb8-61098b54872e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:13.550376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-50080bf8-40af-450c-8eb8-61098b54872e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:13.556793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50080bf8-40af-450c-8eb8-61098b54872e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:13.557241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50080bf8-40af-450c-8eb8-61098b54872e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:13.558017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50080bf8-40af-450c-8eb8-61098b54872e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:13.558444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50080bf8-40af-450c-8eb8-61098b54872e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:13.705666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-50080bf8-40af-450c-8eb8-61098b54872e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:13.718285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-50080bf8-40af-450c-8eb8-61098b54872e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.172121 Jul 26 18:52:13.719061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1812/3601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:13 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:14.293329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ef8ef02c-b848-4307-add9-c354a7beb52b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:14.294256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ef8ef02c-b848-4307-add9-c354a7beb52b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:14.299919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1755425d-d247-4d3d-98a1-452271ff0c05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:14.300803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1755425d-d247-4d3d-98a1-452271ff0c05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:14.303544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef8ef02c-b848-4307-add9-c354a7beb52b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:14.304022 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef8ef02c-b848-4307-add9-c354a7beb52b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:14.304830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef8ef02c-b848-4307-add9-c354a7beb52b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:14.305241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ef8ef02c-b848-4307-add9-c354a7beb52b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:14.307564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1755425d-d247-4d3d-98a1-452271ff0c05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:14.308010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1755425d-d247-4d3d-98a1-452271ff0c05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:14.308747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1755425d-d247-4d3d-98a1-452271ff0c05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:14.309246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1755425d-d247-4d3d-98a1-452271ff0c05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:14.441434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1755425d-d247-4d3d-98a1-452271ff0c05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:14.453033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1755425d-d247-4d3d-98a1-452271ff0c05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:14.454535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1755425d-d247-4d3d-98a1-452271ff0c05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:14.455728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1755425d-d247-4d3d-98a1-452271ff0c05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162160 Jul 26 18:52:14.456253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1813/3602] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:14 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:14.460623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-73ae9201-0de2-43e8-994c-d4f77f731404 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:14.461219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-73ae9201-0de2-43e8-994c-d4f77f731404 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:14.467132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73ae9201-0de2-43e8-994c-d4f77f731404 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:14.467579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73ae9201-0de2-43e8-994c-d4f77f731404 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:14.468327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73ae9201-0de2-43e8-994c-d4f77f731404 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:14.468757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73ae9201-0de2-43e8-994c-d4f77f731404 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:14.501124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ef8ef02c-b848-4307-add9-c354a7beb52b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:14.509528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ef8ef02c-b848-4307-add9-c354a7beb52b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.222979 Jul 26 18:52:14.510111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1790/3603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:14 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:14.530024 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8bbd74ab-028f-433b-b2f8-f6591ea2a79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:14.530730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8bbd74ab-028f-433b-b2f8-f6591ea2a79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:14.537198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8bbd74ab-028f-433b-b2f8-f6591ea2a79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:14.537757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8bbd74ab-028f-433b-b2f8-f6591ea2a79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:14.538601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8bbd74ab-028f-433b-b2f8-f6591ea2a79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:14.539139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8bbd74ab-028f-433b-b2f8-f6591ea2a79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:14.601444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-73ae9201-0de2-43e8-994c-d4f77f731404 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:14.609568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-73ae9201-0de2-43e8-994c-d4f77f731404 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152341 Jul 26 18:52:14.610142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1814/3604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:14 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:14.671332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8bbd74ab-028f-433b-b2f8-f6591ea2a79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:14.679671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8bbd74ab-028f-433b-b2f8-f6591ea2a79e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153718 Jul 26 18:52:14.680211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1791/3605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:14 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:14.741170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b4c3c7a5-3a6b-4bcb-965d-dfba2cce1426 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:14.741843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b4c3c7a5-3a6b-4bcb-965d-dfba2cce1426 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:14.748722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4c3c7a5-3a6b-4bcb-965d-dfba2cce1426 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:14.749175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4c3c7a5-3a6b-4bcb-965d-dfba2cce1426 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:14.749959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4c3c7a5-3a6b-4bcb-965d-dfba2cce1426 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:14.750401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4c3c7a5-3a6b-4bcb-965d-dfba2cce1426 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:14.887441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b4c3c7a5-3a6b-4bcb-965d-dfba2cce1426 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:14.895569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b4c3c7a5-3a6b-4bcb-965d-dfba2cce1426 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158560 Jul 26 18:52:14.896152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1815/3606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:14 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:15.482975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-618e4193-5947-4453-8690-e4a260b5f522 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:15.484021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-618e4193-5947-4453-8690-e4a260b5f522 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:15.495204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-618e4193-5947-4453-8690-e4a260b5f522 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:15.495946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-618e4193-5947-4453-8690-e4a260b5f522 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:15.497252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-618e4193-5947-4453-8690-e4a260b5f522 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:15.497987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-618e4193-5947-4453-8690-e4a260b5f522 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:15.531452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bbbbe607-cb35-44ae-b0df-e43c498dfc31 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:15.532894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bbbbe607-cb35-44ae-b0df-e43c498dfc31 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:15.540476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bbbbe607-cb35-44ae-b0df-e43c498dfc31 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:15.540918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bbbbe607-cb35-44ae-b0df-e43c498dfc31 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:15.541676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bbbbe607-cb35-44ae-b0df-e43c498dfc31 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:15.542108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bbbbe607-cb35-44ae-b0df-e43c498dfc31 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:15.634560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-618e4193-5947-4453-8690-e4a260b5f522 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:15.643191 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-618e4193-5947-4453-8690-e4a260b5f522 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:15.644803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-618e4193-5947-4453-8690-e4a260b5f522 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:15.645965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-618e4193-5947-4453-8690-e4a260b5f522 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.169461 Jul 26 18:52:15.646832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1792/3607] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:15 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:15.651178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0d492cb4-1356-4d45-96e0-47fcf04e2025 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:15.651773 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0d492cb4-1356-4d45-96e0-47fcf04e2025 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:15.657568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d492cb4-1356-4d45-96e0-47fcf04e2025 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:15.658027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d492cb4-1356-4d45-96e0-47fcf04e2025 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:15.658759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d492cb4-1356-4d45-96e0-47fcf04e2025 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:15.659207 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d492cb4-1356-4d45-96e0-47fcf04e2025 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:15.672918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bbbbe607-cb35-44ae-b0df-e43c498dfc31 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:15.681297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bbbbe607-cb35-44ae-b0df-e43c498dfc31 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154079 Jul 26 18:52:15.681879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1816/3608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:15 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:15.700719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5ff65c38-aa4b-4557-9eb8-c4376c1942e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:15.701424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5ff65c38-aa4b-4557-9eb8-c4376c1942e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:15.707858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ff65c38-aa4b-4557-9eb8-c4376c1942e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:15.708391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ff65c38-aa4b-4557-9eb8-c4376c1942e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:15.709231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ff65c38-aa4b-4557-9eb8-c4376c1942e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:15.709777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ff65c38-aa4b-4557-9eb8-c4376c1942e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:15.797637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0d492cb4-1356-4d45-96e0-47fcf04e2025 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:15.805903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0d492cb4-1356-4d45-96e0-47fcf04e2025 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.158045 Jul 26 18:52:15.806466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1793/3609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:15 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:15.891059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5ff65c38-aa4b-4557-9eb8-c4376c1942e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:15.900174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5ff65c38-aa4b-4557-9eb8-c4376c1942e6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.203431 Jul 26 18:52:15.900751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1817/3610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:15 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:15.917522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-29261461-ad59-46a0-8652-e2d8b3970794 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:15.918142 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-29261461-ad59-46a0-8652-e2d8b3970794 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:15.924594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29261461-ad59-46a0-8652-e2d8b3970794 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:15.925054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29261461-ad59-46a0-8652-e2d8b3970794 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:15.925841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29261461-ad59-46a0-8652-e2d8b3970794 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:15.926252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29261461-ad59-46a0-8652-e2d8b3970794 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:16.059552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-29261461-ad59-46a0-8652-e2d8b3970794 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:16.068349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-29261461-ad59-46a0-8652-e2d8b3970794 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154773 Jul 26 18:52:16.068927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1794/3611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:16.674392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-71720770-7ce5-4e41-82a2-fa1e92161a9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:16.675449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-71720770-7ce5-4e41-82a2-fa1e92161a9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:16.686623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71720770-7ce5-4e41-82a2-fa1e92161a9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:16.687433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71720770-7ce5-4e41-82a2-fa1e92161a9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:16.688669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71720770-7ce5-4e41-82a2-fa1e92161a9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:16.689423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71720770-7ce5-4e41-82a2-fa1e92161a9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:16.703011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8b83e3e0-a704-497a-9430-4d4cc38a361d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:16.703662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8b83e3e0-a704-497a-9430-4d4cc38a361d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:16.710528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8b83e3e0-a704-497a-9430-4d4cc38a361d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:16.710965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8b83e3e0-a704-497a-9430-4d4cc38a361d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:16.711756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8b83e3e0-a704-497a-9430-4d4cc38a361d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:16.712175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8b83e3e0-a704-497a-9430-4d4cc38a361d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:16.829749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-71720770-7ce5-4e41-82a2-fa1e92161a9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:16.839064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-71720770-7ce5-4e41-82a2-fa1e92161a9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:16.840577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-71720770-7ce5-4e41-82a2-fa1e92161a9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:16.841762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-71720770-7ce5-4e41-82a2-fa1e92161a9c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.174338 Jul 26 18:52:16.842327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1818/3612] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:16 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:16.847178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0ad40a93-2a39-4447-a22c-e87512b9bd08 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:16.847945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0ad40a93-2a39-4447-a22c-e87512b9bd08 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:16.854113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ad40a93-2a39-4447-a22c-e87512b9bd08 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:16.854647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ad40a93-2a39-4447-a22c-e87512b9bd08 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:16.855517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ad40a93-2a39-4447-a22c-e87512b9bd08 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:16.855723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8b83e3e0-a704-497a-9430-4d4cc38a361d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:16.856068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0ad40a93-2a39-4447-a22c-e87512b9bd08 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:16.863830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8b83e3e0-a704-497a-9430-4d4cc38a361d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164690 Jul 26 18:52:16.864597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1795/3613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:16 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:16.925484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-847433ea-ac1a-4206-8e3a-7d6fe8aec4e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:16.926044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-847433ea-ac1a-4206-8e3a-7d6fe8aec4e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:16.932455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-847433ea-ac1a-4206-8e3a-7d6fe8aec4e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:16.932904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-847433ea-ac1a-4206-8e3a-7d6fe8aec4e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:16.933705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-847433ea-ac1a-4206-8e3a-7d6fe8aec4e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:16.934134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-847433ea-ac1a-4206-8e3a-7d6fe8aec4e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:16.950475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:16.998075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0ad40a93-2a39-4447-a22c-e87512b9bd08 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:17.011763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0ad40a93-2a39-4447-a22c-e87512b9bd08 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.167229 Jul 26 18:52:17.016024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1819/3614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:16 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:17.077319 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-847433ea-ac1a-4206-8e3a-7d6fe8aec4e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:17.085495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-847433ea-ac1a-4206-8e3a-7d6fe8aec4e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.164109 Jul 26 18:52:17.086059 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1796/3615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:16 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:17.090323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5fef40bc-e4e2-47aa-9f44-0b397fa3debc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:17.091012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5fef40bc-e4e2-47aa-9f44-0b397fa3debc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:17.097876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fef40bc-e4e2-47aa-9f44-0b397fa3debc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:17.098318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fef40bc-e4e2-47aa-9f44-0b397fa3debc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:17.099096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fef40bc-e4e2-47aa-9f44-0b397fa3debc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:17.099524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fef40bc-e4e2-47aa-9f44-0b397fa3debc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:17.232894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5fef40bc-e4e2-47aa-9f44-0b397fa3debc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:17.241160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5fef40bc-e4e2-47aa-9f44-0b397fa3debc tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155320 Jul 26 18:52:17.241730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1820/3616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:17 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:17.327524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:52:17.327861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 18:52:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:52:17.869197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d96b862f-1c4c-4e83-aa1c-031c3e7c17d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:17.870128 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d96b862f-1c4c-4e83-aa1c-031c3e7c17d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:17.881212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d96b862f-1c4c-4e83-aa1c-031c3e7c17d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:17.881957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d96b862f-1c4c-4e83-aa1c-031c3e7c17d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:17.883225 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d96b862f-1c4c-4e83-aa1c-031c3e7c17d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:17.883933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d96b862f-1c4c-4e83-aa1c-031c3e7c17d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:17.889004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-97b90845-cfed-4f71-ad57-909ddc846bcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:17.890005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-97b90845-cfed-4f71-ad57-909ddc846bcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:17.898566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97b90845-cfed-4f71-ad57-909ddc846bcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:17.899008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97b90845-cfed-4f71-ad57-909ddc846bcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:17.899784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97b90845-cfed-4f71-ad57-909ddc846bcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:17.900210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97b90845-cfed-4f71-ad57-909ddc846bcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:18.017388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d96b862f-1c4c-4e83-aa1c-031c3e7c17d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:18.026560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d96b862f-1c4c-4e83-aa1c-031c3e7c17d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:18.028513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d96b862f-1c4c-4e83-aa1c-031c3e7c17d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:18.029701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d96b862f-1c4c-4e83-aa1c-031c3e7c17d3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.167242 Jul 26 18:52:18.030307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1797/3617] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:18.030829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-97b90845-cfed-4f71-ad57-909ddc846bcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:18.034650 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e934b1d9-a79e-4ace-855b-f12861ac5975 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:18.035386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e934b1d9-a79e-4ace-855b-f12861ac5975 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:18.045428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-97b90845-cfed-4f71-ad57-909ddc846bcd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156780 Jul 26 18:52:18.045428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1821/3618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:17 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:18.046184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e934b1d9-a79e-4ace-855b-f12861ac5975 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:18.046184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e934b1d9-a79e-4ace-855b-f12861ac5975 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:18.046184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e934b1d9-a79e-4ace-855b-f12861ac5975 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:18.046184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e934b1d9-a79e-4ace-855b-f12861ac5975 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:18.107005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e67795c8-2fee-4062-a2ea-29506e10968f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:18.107765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e67795c8-2fee-4062-a2ea-29506e10968f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:18.114025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e67795c8-2fee-4062-a2ea-29506e10968f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:18.114545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e67795c8-2fee-4062-a2ea-29506e10968f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:18.115406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e67795c8-2fee-4062-a2ea-29506e10968f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:18.115840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e67795c8-2fee-4062-a2ea-29506e10968f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:18.130901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:18.172935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e934b1d9-a79e-4ace-855b-f12861ac5975 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:18.181187 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e934b1d9-a79e-4ace-855b-f12861ac5975 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.149976 Jul 26 18:52:18.181987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1798/3619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:18 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:18.247301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e67795c8-2fee-4062-a2ea-29506e10968f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:18.255580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e67795c8-2fee-4062-a2ea-29506e10968f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152529 Jul 26 18:52:18.256181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1822/3620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:18 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:18.262220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-37c49e09-da80-4a9b-b02d-367929042031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:18.262819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-37c49e09-da80-4a9b-b02d-367929042031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:18.269017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-37c49e09-da80-4a9b-b02d-367929042031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:18.269427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-37c49e09-da80-4a9b-b02d-367929042031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:18.270166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-37c49e09-da80-4a9b-b02d-367929042031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:18.270590 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-37c49e09-da80-4a9b-b02d-367929042031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:18.406620 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-37c49e09-da80-4a9b-b02d-367929042031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:18.416578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-37c49e09-da80-4a9b-b02d-367929042031 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158193 Jul 26 18:52:18.417166 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1799/3621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:19.053471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0f672f3a-329e-40f4-8c50-5adfaf7b3bdb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:19.054068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f672f3a-329e-40f4-8c50-5adfaf7b3bdb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:19.061228 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f672f3a-329e-40f4-8c50-5adfaf7b3bdb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:19.061680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b2c612af-d0d6-4ffc-b7e8-bcb6b8b0572d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:19.062168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f672f3a-329e-40f4-8c50-5adfaf7b3bdb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:19.062296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b2c612af-d0d6-4ffc-b7e8-bcb6b8b0572d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:19.062415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f672f3a-329e-40f4-8c50-5adfaf7b3bdb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:19.062885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f672f3a-329e-40f4-8c50-5adfaf7b3bdb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:19.069226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2c612af-d0d6-4ffc-b7e8-bcb6b8b0572d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:19.069670 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2c612af-d0d6-4ffc-b7e8-bcb6b8b0572d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:19.070427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2c612af-d0d6-4ffc-b7e8-bcb6b8b0572d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:19.070850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b2c612af-d0d6-4ffc-b7e8-bcb6b8b0572d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:19.204460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0f672f3a-329e-40f4-8c50-5adfaf7b3bdb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:19.206077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b2c612af-d0d6-4ffc-b7e8-bcb6b8b0572d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:19.213506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0f672f3a-329e-40f4-8c50-5adfaf7b3bdb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:19.214054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b2c612af-d0d6-4ffc-b7e8-bcb6b8b0572d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156291 Jul 26 18:52:19.214630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1800/3622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:19 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:19.215058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0f672f3a-329e-40f4-8c50-5adfaf7b3bdb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:19.216281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0f672f3a-329e-40f4-8c50-5adfaf7b3bdb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.166983 Jul 26 18:52:19.217012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1823/3623] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:19 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:19.219072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c05e7133-1847-46dc-a91b-e912bc285ebb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:19.219646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c05e7133-1847-46dc-a91b-e912bc285ebb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:19.225458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c05e7133-1847-46dc-a91b-e912bc285ebb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:19.225902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c05e7133-1847-46dc-a91b-e912bc285ebb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:19.226641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c05e7133-1847-46dc-a91b-e912bc285ebb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:19.227090 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c05e7133-1847-46dc-a91b-e912bc285ebb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:19.277227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-af0cb474-039f-4943-a937-495769a1a428 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:19.277831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-af0cb474-039f-4943-a937-495769a1a428 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:19.284066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af0cb474-039f-4943-a937-495769a1a428 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:19.284501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af0cb474-039f-4943-a937-495769a1a428 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:19.285283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af0cb474-039f-4943-a937-495769a1a428 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:19.285709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-af0cb474-039f-4943-a937-495769a1a428 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:19.354911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c05e7133-1847-46dc-a91b-e912bc285ebb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:19.363136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c05e7133-1847-46dc-a91b-e912bc285ebb tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.147479 Jul 26 18:52:19.363721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1801/3624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:19 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:19.413649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-af0cb474-039f-4943-a937-495769a1a428 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:19.421782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-af0cb474-039f-4943-a937-495769a1a428 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.148481 Jul 26 18:52:19.422352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1824/3625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:19 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:19.440389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f42f19c7-bc54-47ef-9715-3e072544696c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:19.441242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f42f19c7-bc54-47ef-9715-3e072544696c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:19.451296 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f42f19c7-bc54-47ef-9715-3e072544696c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:19.451934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f42f19c7-bc54-47ef-9715-3e072544696c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:19.453138 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f42f19c7-bc54-47ef-9715-3e072544696c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:19.453768 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f42f19c7-bc54-47ef-9715-3e072544696c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:19.602965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f42f19c7-bc54-47ef-9715-3e072544696c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:19.611177 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f42f19c7-bc54-47ef-9715-3e072544696c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.176825 Jul 26 18:52:19.611749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1802/3626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:19 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:20.236743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-47014f9a-4418-4f8c-9b4e-e00429f12275 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:20.237826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-47014f9a-4418-4f8c-9b4e-e00429f12275 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:20.238592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7865cb89-8a36-492e-b1ad-958c226758a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:20.239235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7865cb89-8a36-492e-b1ad-958c226758a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:20.245972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47014f9a-4418-4f8c-9b4e-e00429f12275 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:20.246210 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7865cb89-8a36-492e-b1ad-958c226758a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:20.246400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47014f9a-4418-4f8c-9b4e-e00429f12275 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:20.246552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7865cb89-8a36-492e-b1ad-958c226758a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:20.247211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47014f9a-4418-4f8c-9b4e-e00429f12275 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:20.247359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7865cb89-8a36-492e-b1ad-958c226758a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:20.247681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47014f9a-4418-4f8c-9b4e-e00429f12275 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:20.247855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7865cb89-8a36-492e-b1ad-958c226758a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:20.381763 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7865cb89-8a36-492e-b1ad-958c226758a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:20.383004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-47014f9a-4418-4f8c-9b4e-e00429f12275 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:20.390602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7865cb89-8a36-492e-b1ad-958c226758a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:20.391107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-47014f9a-4418-4f8c-9b4e-e00429f12275 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158574 Jul 26 18:52:20.391698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1825/3627] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:20.392418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7865cb89-8a36-492e-b1ad-958c226758a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:20.393699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7865cb89-8a36-492e-b1ad-958c226758a4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159584 Jul 26 18:52:20.404135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1803/3628] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:20.404330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-84cec657-a944-47e5-9e19-3a66a7ee3781 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:20.404330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-84cec657-a944-47e5-9e19-3a66a7ee3781 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:20.404330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-84cec657-a944-47e5-9e19-3a66a7ee3781 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:20.404330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-84cec657-a944-47e5-9e19-3a66a7ee3781 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:20.404708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-84cec657-a944-47e5-9e19-3a66a7ee3781 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:20.404708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-84cec657-a944-47e5-9e19-3a66a7ee3781 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:20.444269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9ea13bf9-77c7-4966-9b6b-b139faec42c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:20.444987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9ea13bf9-77c7-4966-9b6b-b139faec42c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:20.451840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ea13bf9-77c7-4966-9b6b-b139faec42c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:20.452599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ea13bf9-77c7-4966-9b6b-b139faec42c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:20.453558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ea13bf9-77c7-4966-9b6b-b139faec42c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:20.454066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9ea13bf9-77c7-4966-9b6b-b139faec42c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:20.541971 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-84cec657-a944-47e5-9e19-3a66a7ee3781 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:20.550172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-84cec657-a944-47e5-9e19-3a66a7ee3781 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157490 Jul 26 18:52:20.550807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1826/3629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:20 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:20.592781 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9ea13bf9-77c7-4966-9b6b-b139faec42c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:20.601027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9ea13bf9-77c7-4966-9b6b-b139faec42c5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161642 Jul 26 18:52:20.601592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1804/3630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:20 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:20.633253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-512de128-ed1b-4814-a42a-3b96cc18b75b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:20.633978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-512de128-ed1b-4814-a42a-3b96cc18b75b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:20.640425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-512de128-ed1b-4814-a42a-3b96cc18b75b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:20.640863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-512de128-ed1b-4814-a42a-3b96cc18b75b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:20.641628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-512de128-ed1b-4814-a42a-3b96cc18b75b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:20.642060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-512de128-ed1b-4814-a42a-3b96cc18b75b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:20.780970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-512de128-ed1b-4814-a42a-3b96cc18b75b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:20.789456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-512de128-ed1b-4814-a42a-3b96cc18b75b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160104 Jul 26 18:52:20.790042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1827/3631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:20 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:21.417186 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8b90961f-fd53-4c6d-9f3b-63b043482400 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:21.419044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8b90961f-fd53-4c6d-9f3b-63b043482400 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:21.419560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8afaa28a-32b0-411d-ae36-95b806f469f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:21.420477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8afaa28a-32b0-411d-ae36-95b806f469f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:21.429364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8afaa28a-32b0-411d-ae36-95b806f469f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:21.429654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8b90961f-fd53-4c6d-9f3b-63b043482400 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:21.429906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8afaa28a-32b0-411d-ae36-95b806f469f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:21.430045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8b90961f-fd53-4c6d-9f3b-63b043482400 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:21.430768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8afaa28a-32b0-411d-ae36-95b806f469f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:21.430957 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8b90961f-fd53-4c6d-9f3b-63b043482400 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:21.431420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8b90961f-fd53-4c6d-9f3b-63b043482400 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:21.431683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8afaa28a-32b0-411d-ae36-95b806f469f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:21.572888 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8b90961f-fd53-4c6d-9f3b-63b043482400 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:21.573255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8afaa28a-32b0-411d-ae36-95b806f469f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:21.583325 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8b90961f-fd53-4c6d-9f3b-63b043482400 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.172161 Jul 26 18:52:21.583818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8afaa28a-32b0-411d-ae36-95b806f469f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:21.583969 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1805/3632] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:21 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:21.585368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8afaa28a-32b0-411d-ae36-95b806f469f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:21.586720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8afaa28a-32b0-411d-ae36-95b806f469f5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.172822 Jul 26 18:52:21.587305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1828/3633] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:21 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:21.597529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ab461878-748e-48da-91ec-5a063a41c2df tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:21.597529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ab461878-748e-48da-91ec-5a063a41c2df tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:21.597529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab461878-748e-48da-91ec-5a063a41c2df tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:21.597529 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab461878-748e-48da-91ec-5a063a41c2df tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:21.598021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab461878-748e-48da-91ec-5a063a41c2df tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:21.598021 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ab461878-748e-48da-91ec-5a063a41c2df tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:21.624061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-09b05733-b644-4490-a89f-c82fac352d05 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:21.624886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-09b05733-b644-4490-a89f-c82fac352d05 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:21.632538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09b05733-b644-4490-a89f-c82fac352d05 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:21.632992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09b05733-b644-4490-a89f-c82fac352d05 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:21.633794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09b05733-b644-4490-a89f-c82fac352d05 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:21.634237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09b05733-b644-4490-a89f-c82fac352d05 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:21.731950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ab461878-748e-48da-91ec-5a063a41c2df tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:21.740475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ab461878-748e-48da-91ec-5a063a41c2df tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155587 Jul 26 18:52:21.741429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1806/3634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:21 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:21.769254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-09b05733-b644-4490-a89f-c82fac352d05 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:21.777660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-09b05733-b644-4490-a89f-c82fac352d05 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157896 Jul 26 18:52:21.778227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1829/3635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:21 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:21.811112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6df91d30-28bc-4080-b413-bbed2bc9b510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:21.811722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6df91d30-28bc-4080-b413-bbed2bc9b510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:21.819965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6df91d30-28bc-4080-b413-bbed2bc9b510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:21.820560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6df91d30-28bc-4080-b413-bbed2bc9b510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:21.821659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6df91d30-28bc-4080-b413-bbed2bc9b510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:21.822269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6df91d30-28bc-4080-b413-bbed2bc9b510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:21.973392 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6df91d30-28bc-4080-b413-bbed2bc9b510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:21.981776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6df91d30-28bc-4080-b413-bbed2bc9b510 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.174572 Jul 26 18:52:21.982342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1807/3636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:22.608916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5cac5551-758b-476f-8f1b-e9ed0f418d77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:22.609809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5cac5551-758b-476f-8f1b-e9ed0f418d77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:22.618033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cac5551-758b-476f-8f1b-e9ed0f418d77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:22.618484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cac5551-758b-476f-8f1b-e9ed0f418d77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:22.619465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cac5551-758b-476f-8f1b-e9ed0f418d77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:22.619906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cac5551-758b-476f-8f1b-e9ed0f418d77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:22.671123 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f7f09f37-1846-4e5c-85ac-895a09e72dbe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:22.671729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f7f09f37-1846-4e5c-85ac-895a09e72dbe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:22.678693 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7f09f37-1846-4e5c-85ac-895a09e72dbe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:22.679172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7f09f37-1846-4e5c-85ac-895a09e72dbe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:22.679904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7f09f37-1846-4e5c-85ac-895a09e72dbe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:22.680341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7f09f37-1846-4e5c-85ac-895a09e72dbe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:22.751711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5cac5551-758b-476f-8f1b-e9ed0f418d77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:22.760473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5cac5551-758b-476f-8f1b-e9ed0f418d77 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158082 Jul 26 18:52:22.761397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1830/3637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:22 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:22.765808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-abf4961d-48eb-4b57-9fa8-6777497cb11a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:22.766399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-abf4961d-48eb-4b57-9fa8-6777497cb11a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:22.773187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-abf4961d-48eb-4b57-9fa8-6777497cb11a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:22.773629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-abf4961d-48eb-4b57-9fa8-6777497cb11a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:22.774350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-abf4961d-48eb-4b57-9fa8-6777497cb11a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:22.774999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-abf4961d-48eb-4b57-9fa8-6777497cb11a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:22.813085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f7f09f37-1846-4e5c-85ac-895a09e72dbe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:22.821950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f7f09f37-1846-4e5c-85ac-895a09e72dbe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:22.823602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f7f09f37-1846-4e5c-85ac-895a09e72dbe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:22.824874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f7f09f37-1846-4e5c-85ac-895a09e72dbe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157779 Jul 26 18:52:22.825436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1808/3638] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:22 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:22.829827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-58dc708a-f17e-4d2f-a52a-dcfcacf49dec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:22.830432 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-58dc708a-f17e-4d2f-a52a-dcfcacf49dec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:22.836459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58dc708a-f17e-4d2f-a52a-dcfcacf49dec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:22.837151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58dc708a-f17e-4d2f-a52a-dcfcacf49dec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:22.837915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58dc708a-f17e-4d2f-a52a-dcfcacf49dec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:22.838357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58dc708a-f17e-4d2f-a52a-dcfcacf49dec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:22.904844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-abf4961d-48eb-4b57-9fa8-6777497cb11a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:22.912987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-abf4961d-48eb-4b57-9fa8-6777497cb11a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.150642 Jul 26 18:52:22.913601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1831/3639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:22 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:22.966710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-58dc708a-f17e-4d2f-a52a-dcfcacf49dec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:22.974946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-58dc708a-f17e-4d2f-a52a-dcfcacf49dec tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.148541 Jul 26 18:52:22.975518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1809/3640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:22 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:23.002970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6cbd7baf-ea74-44db-ad3b-b624cfee3a1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:23.003794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6cbd7baf-ea74-44db-ad3b-b624cfee3a1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:23.010134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6cbd7baf-ea74-44db-ad3b-b624cfee3a1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:23.010582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6cbd7baf-ea74-44db-ad3b-b624cfee3a1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:23.011379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6cbd7baf-ea74-44db-ad3b-b624cfee3a1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:23.011816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6cbd7baf-ea74-44db-ad3b-b624cfee3a1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:23.147768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6cbd7baf-ea74-44db-ad3b-b624cfee3a1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:23.160195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6cbd7baf-ea74-44db-ad3b-b624cfee3a1d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160664 Jul 26 18:52:23.160848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1832/3641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:23.786134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bb76ee1f-4bfb-4db2-8a14-861585b3747b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:23.787386 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bb76ee1f-4bfb-4db2-8a14-861585b3747b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:23.798572 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb76ee1f-4bfb-4db2-8a14-861585b3747b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:23.799418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb76ee1f-4bfb-4db2-8a14-861585b3747b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:23.800782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb76ee1f-4bfb-4db2-8a14-861585b3747b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:23.801223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb76ee1f-4bfb-4db2-8a14-861585b3747b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:23.847544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b0291fc3-2225-4ccd-be45-1250b9a33d3c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:23.848148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b0291fc3-2225-4ccd-be45-1250b9a33d3c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:23.854827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0291fc3-2225-4ccd-be45-1250b9a33d3c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:23.855319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0291fc3-2225-4ccd-be45-1250b9a33d3c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:23.856075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0291fc3-2225-4ccd-be45-1250b9a33d3c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:23.856494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b0291fc3-2225-4ccd-be45-1250b9a33d3c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:23.934387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bb76ee1f-4bfb-4db2-8a14-861585b3747b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:23.942688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bb76ee1f-4bfb-4db2-8a14-861585b3747b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.163015 Jul 26 18:52:23.943505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1810/3642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:23 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:23.947722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-805cc6f2-3fe0-466b-83cf-3a3462866d17 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:23.948369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-805cc6f2-3fe0-466b-83cf-3a3462866d17 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:23.954313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-805cc6f2-3fe0-466b-83cf-3a3462866d17 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:23.954767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-805cc6f2-3fe0-466b-83cf-3a3462866d17 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:23.955599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-805cc6f2-3fe0-466b-83cf-3a3462866d17 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:23.956033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-805cc6f2-3fe0-466b-83cf-3a3462866d17 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:23.988487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b0291fc3-2225-4ccd-be45-1250b9a33d3c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:23.998002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b0291fc3-2225-4ccd-be45-1250b9a33d3c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:23.999532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b0291fc3-2225-4ccd-be45-1250b9a33d3c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:24.000714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b0291fc3-2225-4ccd-be45-1250b9a33d3c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157155 Jul 26 18:52:24.001275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1833/3643] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:23 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:24.005711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-475f5b38-6e81-48e5-9338-bb018e464087 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:24.006284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-475f5b38-6e81-48e5-9338-bb018e464087 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:24.012631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-475f5b38-6e81-48e5-9338-bb018e464087 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:24.012980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-475f5b38-6e81-48e5-9338-bb018e464087 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:24.014429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-475f5b38-6e81-48e5-9338-bb018e464087 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:24.014661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-475f5b38-6e81-48e5-9338-bb018e464087 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:24.086248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-805cc6f2-3fe0-466b-83cf-3a3462866d17 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:24.094756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-805cc6f2-3fe0-466b-83cf-3a3462866d17 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.150473 Jul 26 18:52:24.095436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1811/3644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:23 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:24.146038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-475f5b38-6e81-48e5-9338-bb018e464087 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:24.154566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-475f5b38-6e81-48e5-9338-bb018e464087 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152326 Jul 26 18:52:24.155137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1834/3645] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:24 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:24.189588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e3ff58b7-bfdb-4354-8f35-48e46d22077a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:24.190224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e3ff58b7-bfdb-4354-8f35-48e46d22077a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:24.197923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3ff58b7-bfdb-4354-8f35-48e46d22077a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:24.198379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3ff58b7-bfdb-4354-8f35-48e46d22077a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:24.199179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3ff58b7-bfdb-4354-8f35-48e46d22077a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:24.199607 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3ff58b7-bfdb-4354-8f35-48e46d22077a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:24.334339 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e3ff58b7-bfdb-4354-8f35-48e46d22077a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:24.342353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e3ff58b7-bfdb-4354-8f35-48e46d22077a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158894 Jul 26 18:52:24.342924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1812/3646] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:24 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:24.968222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-21a83ccd-712a-4934-9f44-589d783c2083 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:24.969280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-21a83ccd-712a-4934-9f44-589d783c2083 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:24.977537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21a83ccd-712a-4934-9f44-589d783c2083 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:24.977984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21a83ccd-712a-4934-9f44-589d783c2083 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:24.978748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21a83ccd-712a-4934-9f44-589d783c2083 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:24.979223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21a83ccd-712a-4934-9f44-589d783c2083 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:25.023772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-72411785-f2fc-4206-851b-79b9cdb42026 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:25.024332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-72411785-f2fc-4206-851b-79b9cdb42026 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:25.031226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-72411785-f2fc-4206-851b-79b9cdb42026 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:25.031757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-72411785-f2fc-4206-851b-79b9cdb42026 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:25.032507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-72411785-f2fc-4206-851b-79b9cdb42026 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:25.032936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-72411785-f2fc-4206-851b-79b9cdb42026 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:25.035799 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:25.109350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-21a83ccd-712a-4934-9f44-589d783c2083 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:25.117831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-21a83ccd-712a-4934-9f44-589d783c2083 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156118 Jul 26 18:52:25.118363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1835/3647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:24 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:25.123153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-61055984-bf17-4df9-be8e-50a243ac515c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:25.123728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-61055984-bf17-4df9-be8e-50a243ac515c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:25.129918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61055984-bf17-4df9-be8e-50a243ac515c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:25.130368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61055984-bf17-4df9-be8e-50a243ac515c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:25.131142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61055984-bf17-4df9-be8e-50a243ac515c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:25.131579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61055984-bf17-4df9-be8e-50a243ac515c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:25.163300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-72411785-f2fc-4206-851b-79b9cdb42026 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:25.172060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-72411785-f2fc-4206-851b-79b9cdb42026 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:25.173692 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-72411785-f2fc-4206-851b-79b9cdb42026 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:25.174933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-72411785-f2fc-4206-851b-79b9cdb42026 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155633 Jul 26 18:52:25.175576 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1813/3648] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:25.179985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-120b7931-be91-40cb-983f-c9a003b5d3fd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:25.180639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-120b7931-be91-40cb-983f-c9a003b5d3fd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:25.186537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-120b7931-be91-40cb-983f-c9a003b5d3fd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:25.187592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-120b7931-be91-40cb-983f-c9a003b5d3fd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:25.188405 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-120b7931-be91-40cb-983f-c9a003b5d3fd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:25.189389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-120b7931-be91-40cb-983f-c9a003b5d3fd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:25.259233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-61055984-bf17-4df9-be8e-50a243ac515c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:25.267357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-61055984-bf17-4df9-be8e-50a243ac515c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.147669 Jul 26 18:52:25.267920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1836/3649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:25 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:25.315375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-120b7931-be91-40cb-983f-c9a003b5d3fd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:25.327581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-120b7931-be91-40cb-983f-c9a003b5d3fd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150477 Jul 26 18:52:25.328376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1814/3650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:25 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:25.365401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-74d7dab3-5ab1-42cd-8a41-08e1193fa746 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:25.365996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-74d7dab3-5ab1-42cd-8a41-08e1193fa746 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:25.372498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74d7dab3-5ab1-42cd-8a41-08e1193fa746 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:25.372969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74d7dab3-5ab1-42cd-8a41-08e1193fa746 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:25.373715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74d7dab3-5ab1-42cd-8a41-08e1193fa746 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:25.374144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74d7dab3-5ab1-42cd-8a41-08e1193fa746 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:25.517367 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-74d7dab3-5ab1-42cd-8a41-08e1193fa746 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:25.525854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-74d7dab3-5ab1-42cd-8a41-08e1193fa746 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.165416 Jul 26 18:52:25.526442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1837/3651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:25 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:26.142988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-73743170-e678-4066-b607-a2d250de4a8e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:26.143897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-73743170-e678-4066-b607-a2d250de4a8e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:26.146789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:26.152271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73743170-e678-4066-b607-a2d250de4a8e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:26.152714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73743170-e678-4066-b607-a2d250de4a8e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:26.153465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73743170-e678-4066-b607-a2d250de4a8e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:26.153888 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73743170-e678-4066-b607-a2d250de4a8e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:26.198450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-24412da1-e142-4182-9eaa-21ebec8935cb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:26.199061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-24412da1-e142-4182-9eaa-21ebec8935cb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:26.201598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:26.206949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24412da1-e142-4182-9eaa-21ebec8935cb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:26.207553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24412da1-e142-4182-9eaa-21ebec8935cb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:26.208313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24412da1-e142-4182-9eaa-21ebec8935cb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:26.208740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24412da1-e142-4182-9eaa-21ebec8935cb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:26.296736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-73743170-e678-4066-b607-a2d250de4a8e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:26.305538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-73743170-e678-4066-b607-a2d250de4a8e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.169017 Jul 26 18:52:26.306145 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1815/3652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:26 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:26.310553 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a4943947-234f-4148-9d36-cc1f670bbeaa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:26.311180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a4943947-234f-4148-9d36-cc1f670bbeaa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:26.317271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4943947-234f-4148-9d36-cc1f670bbeaa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:26.317736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4943947-234f-4148-9d36-cc1f670bbeaa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:26.318496 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4943947-234f-4148-9d36-cc1f670bbeaa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:26.318927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a4943947-234f-4148-9d36-cc1f670bbeaa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:26.346302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-24412da1-e142-4182-9eaa-21ebec8935cb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:26.354854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-24412da1-e142-4182-9eaa-21ebec8935cb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:26.356378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-24412da1-e142-4182-9eaa-21ebec8935cb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:26.357537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-24412da1-e142-4182-9eaa-21ebec8935cb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.163547 Jul 26 18:52:26.358096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1838/3653] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:52:26.362498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-157e101b-2485-49d8-b5b4-2b969abf896b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:26.363251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-157e101b-2485-49d8-b5b4-2b969abf896b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:26.369196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-157e101b-2485-49d8-b5b4-2b969abf896b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:26.369640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-157e101b-2485-49d8-b5b4-2b969abf896b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:26.370390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-157e101b-2485-49d8-b5b4-2b969abf896b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:26.371005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-157e101b-2485-49d8-b5b4-2b969abf896b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:26.374863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:26.447414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a4943947-234f-4148-9d36-cc1f670bbeaa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:26.455626 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a4943947-234f-4148-9d36-cc1f670bbeaa tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.148555 Jul 26 18:52:26.456197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1816/3654] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:26 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:26.501012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-157e101b-2485-49d8-b5b4-2b969abf896b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:26.509215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-157e101b-2485-49d8-b5b4-2b969abf896b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150113 Jul 26 18:52:26.509778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1839/3655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:26 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:26.549903 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5a2013d9-8e74-48b8-b3b6-6a3acde3ce17 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:26.550714 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5a2013d9-8e74-48b8-b3b6-6a3acde3ce17 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:26.560814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a2013d9-8e74-48b8-b3b6-6a3acde3ce17 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:26.561304 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a2013d9-8e74-48b8-b3b6-6a3acde3ce17 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:26.562199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a2013d9-8e74-48b8-b3b6-6a3acde3ce17 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:26.562631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5a2013d9-8e74-48b8-b3b6-6a3acde3ce17 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:26.694313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5a2013d9-8e74-48b8-b3b6-6a3acde3ce17 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:26.702851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5a2013d9-8e74-48b8-b3b6-6a3acde3ce17 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.159254 Jul 26 18:52:26.703446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1817/3656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:26 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:27.331784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cccdc1c2-6d29-4343-9bd7-d5016c19841f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:27.332845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cccdc1c2-6d29-4343-9bd7-d5016c19841f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:27.343864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cccdc1c2-6d29-4343-9bd7-d5016c19841f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:27.344486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cccdc1c2-6d29-4343-9bd7-d5016c19841f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:27.345727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cccdc1c2-6d29-4343-9bd7-d5016c19841f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:27.346444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cccdc1c2-6d29-4343-9bd7-d5016c19841f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:27.380788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4d5135cd-46bc-43a8-b203-3827ef379608 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:27.381389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4d5135cd-46bc-43a8-b203-3827ef379608 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:27.387585 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d5135cd-46bc-43a8-b203-3827ef379608 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:27.388000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d5135cd-46bc-43a8-b203-3827ef379608 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:27.388782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d5135cd-46bc-43a8-b203-3827ef379608 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:27.389206 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d5135cd-46bc-43a8-b203-3827ef379608 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:27.475506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cccdc1c2-6d29-4343-9bd7-d5016c19841f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:27.483866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cccdc1c2-6d29-4343-9bd7-d5016c19841f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158555 Jul 26 18:52:27.484445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1840/3657] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:27.497640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cb5e41b3-ae7c-4364-b65f-a5479f011387 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:27.497640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cb5e41b3-ae7c-4364-b65f-a5479f011387 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:27.497640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb5e41b3-ae7c-4364-b65f-a5479f011387 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:27.497640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb5e41b3-ae7c-4364-b65f-a5479f011387 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:27.498129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb5e41b3-ae7c-4364-b65f-a5479f011387 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:27.498129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb5e41b3-ae7c-4364-b65f-a5479f011387 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:27.520507 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4d5135cd-46bc-43a8-b203-3827ef379608 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:27.529483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4d5135cd-46bc-43a8-b203-3827ef379608 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:27.530983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4d5135cd-46bc-43a8-b203-3827ef379608 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:27.532156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4d5135cd-46bc-43a8-b203-3827ef379608 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155248 Jul 26 18:52:27.532710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1818/3658] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:27 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:52:27.537081 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-84ba87d0-55af-4b87-927a-d7d175bc26a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:27.537680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-84ba87d0-55af-4b87-927a-d7d175bc26a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:27.543711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84ba87d0-55af-4b87-927a-d7d175bc26a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:27.544156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84ba87d0-55af-4b87-927a-d7d175bc26a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:27.544907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84ba87d0-55af-4b87-927a-d7d175bc26a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:27.545335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-84ba87d0-55af-4b87-927a-d7d175bc26a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:27.632149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cb5e41b3-ae7c-4364-b65f-a5479f011387 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:27.643422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cb5e41b3-ae7c-4364-b65f-a5479f011387 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.157914 Jul 26 18:52:27.645107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1841/3659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:27 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:27.678417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-84ba87d0-55af-4b87-927a-d7d175bc26a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:27.686675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-84ba87d0-55af-4b87-927a-d7d175bc26a5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153018 Jul 26 18:52:27.687274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1819/3660] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:27 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:27.724798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a09263cf-8425-4d3c-8a64-79784d464e6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:27.725526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a09263cf-8425-4d3c-8a64-79784d464e6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:27.732974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a09263cf-8425-4d3c-8a64-79784d464e6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:27.733437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a09263cf-8425-4d3c-8a64-79784d464e6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:27.734235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a09263cf-8425-4d3c-8a64-79784d464e6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:27.734671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a09263cf-8425-4d3c-8a64-79784d464e6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:27.870649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a09263cf-8425-4d3c-8a64-79784d464e6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:27.882837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a09263cf-8425-4d3c-8a64-79784d464e6d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.161518 Jul 26 18:52:27.883551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1842/3661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:27 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:28.509885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e7dbccb6-1c02-46fb-adbc-6a28b615e9dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:28.510865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e7dbccb6-1c02-46fb-adbc-6a28b615e9dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:28.520860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7dbccb6-1c02-46fb-adbc-6a28b615e9dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:28.521644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7dbccb6-1c02-46fb-adbc-6a28b615e9dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:28.522406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7dbccb6-1c02-46fb-adbc-6a28b615e9dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:28.522850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7dbccb6-1c02-46fb-adbc-6a28b615e9dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:28.555343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-98141fb4-aca0-48b5-bae5-b98763d23dd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:28.555927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-98141fb4-aca0-48b5-bae5-b98763d23dd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:28.562897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98141fb4-aca0-48b5-bae5-b98763d23dd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:28.563402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98141fb4-aca0-48b5-bae5-b98763d23dd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:28.564572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98141fb4-aca0-48b5-bae5-b98763d23dd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:28.565159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98141fb4-aca0-48b5-bae5-b98763d23dd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:28.654883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e7dbccb6-1c02-46fb-adbc-6a28b615e9dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:28.663848 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e7dbccb6-1c02-46fb-adbc-6a28b615e9dd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160863 Jul 26 18:52:28.664432 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1820/3662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:28 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:28.700041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-98141fb4-aca0-48b5-bae5-b98763d23dd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:28.709254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-98141fb4-aca0-48b5-bae5-b98763d23dd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:28.710786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-98141fb4-aca0-48b5-bae5-b98763d23dd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:28.711934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-98141fb4-aca0-48b5-bae5-b98763d23dd9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160611 Jul 26 18:52:28.727056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1843/3663] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:28.727509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0d73c135-250b-4d12-943b-79fa3f01f22d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:28.727509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0d73c135-250b-4d12-943b-79fa3f01f22d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:28.727721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-45c4cf6a-755e-46ed-94a4-2ea3d267fada tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:28.727721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-45c4cf6a-755e-46ed-94a4-2ea3d267fada tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:28.728018 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d73c135-250b-4d12-943b-79fa3f01f22d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:28.728115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45c4cf6a-755e-46ed-94a4-2ea3d267fada tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:28.728224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d73c135-250b-4d12-943b-79fa3f01f22d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:28.728327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45c4cf6a-755e-46ed-94a4-2ea3d267fada tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:28.728429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d73c135-250b-4d12-943b-79fa3f01f22d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:28.728520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45c4cf6a-755e-46ed-94a4-2ea3d267fada tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:28.728609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0d73c135-250b-4d12-943b-79fa3f01f22d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:28.728711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-45c4cf6a-755e-46ed-94a4-2ea3d267fada tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:28.861568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-45c4cf6a-755e-46ed-94a4-2ea3d267fada tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:28.861794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0d73c135-250b-4d12-943b-79fa3f01f22d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:28.869870 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0d73c135-250b-4d12-943b-79fa3f01f22d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.204485 Jul 26 18:52:28.870060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-45c4cf6a-755e-46ed-94a4-2ea3d267fada tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156006 Jul 26 18:52:28.870603 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1844/3664] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:28 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:28.871095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1821/3665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:28 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:28.908187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bd286af6-64f8-4e36-8948-17230a12ccab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:28.908788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bd286af6-64f8-4e36-8948-17230a12ccab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:28.914947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd286af6-64f8-4e36-8948-17230a12ccab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:28.915433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd286af6-64f8-4e36-8948-17230a12ccab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:28.916184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd286af6-64f8-4e36-8948-17230a12ccab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:28.916617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bd286af6-64f8-4e36-8948-17230a12ccab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:29.062059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bd286af6-64f8-4e36-8948-17230a12ccab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:29.072446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bd286af6-64f8-4e36-8948-17230a12ccab tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167630 Jul 26 18:52:29.073058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1845/3666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:28 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:29.685867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a03f577b-76fa-4a22-a5aa-47cd080101e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:29.686496 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a03f577b-76fa-4a22-a5aa-47cd080101e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:29.693677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a03f577b-76fa-4a22-a5aa-47cd080101e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:29.694115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a03f577b-76fa-4a22-a5aa-47cd080101e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:29.694859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a03f577b-76fa-4a22-a5aa-47cd080101e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:29.695338 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a03f577b-76fa-4a22-a5aa-47cd080101e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:29.736916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5b7fe22e-0158-4868-b4e8-5d0c3e0e4a15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:29.737579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5b7fe22e-0158-4868-b4e8-5d0c3e0e4a15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:29.745905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b7fe22e-0158-4868-b4e8-5d0c3e0e4a15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:29.746413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b7fe22e-0158-4868-b4e8-5d0c3e0e4a15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:29.747228 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b7fe22e-0158-4868-b4e8-5d0c3e0e4a15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:29.747654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5b7fe22e-0158-4868-b4e8-5d0c3e0e4a15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:29.833438 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a03f577b-76fa-4a22-a5aa-47cd080101e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:29.841647 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a03f577b-76fa-4a22-a5aa-47cd080101e5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159681 Jul 26 18:52:29.842199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1822/3667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:29 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:29.891838 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-11cd93d9-255a-4e48-abac-fdd37066e702 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:29.892450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-11cd93d9-255a-4e48-abac-fdd37066e702 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:29.894020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5b7fe22e-0158-4868-b4e8-5d0c3e0e4a15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:29.898840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11cd93d9-255a-4e48-abac-fdd37066e702 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:29.899309 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11cd93d9-255a-4e48-abac-fdd37066e702 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:29.900079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11cd93d9-255a-4e48-abac-fdd37066e702 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:29.900508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-11cd93d9-255a-4e48-abac-fdd37066e702 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:29.902904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5b7fe22e-0158-4868-b4e8-5d0c3e0e4a15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:29.904461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5b7fe22e-0158-4868-b4e8-5d0c3e0e4a15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:29.905630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5b7fe22e-0158-4868-b4e8-5d0c3e0e4a15 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.172712 Jul 26 18:52:29.906193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1846/3668] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:29.910572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1efc078c-6224-4cb0-ad45-b9384b675ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:29.911254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1efc078c-6224-4cb0-ad45-b9384b675ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:29.917057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1efc078c-6224-4cb0-ad45-b9384b675ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:29.917503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1efc078c-6224-4cb0-ad45-b9384b675ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:29.918263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1efc078c-6224-4cb0-ad45-b9384b675ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:29.918695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1efc078c-6224-4cb0-ad45-b9384b675ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:30.028655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-11cd93d9-255a-4e48-abac-fdd37066e702 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:30.037243 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-11cd93d9-255a-4e48-abac-fdd37066e702 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.149638 Jul 26 18:52:30.038002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1823/3669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:29 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:30.046667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1efc078c-6224-4cb0-ad45-b9384b675ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:30.055057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1efc078c-6224-4cb0-ad45-b9384b675ca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.147903 Jul 26 18:52:30.055630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1847/3670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:29 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:30.093727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3dcc94a1-3dad-4c66-a04e-bbbeb7dd9c15 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:30.094420 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3dcc94a1-3dad-4c66-a04e-bbbeb7dd9c15 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:30.101027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dcc94a1-3dad-4c66-a04e-bbbeb7dd9c15 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:30.101467 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dcc94a1-3dad-4c66-a04e-bbbeb7dd9c15 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:30.102213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dcc94a1-3dad-4c66-a04e-bbbeb7dd9c15 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:30.102641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3dcc94a1-3dad-4c66-a04e-bbbeb7dd9c15 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:30.242151 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3dcc94a1-3dad-4c66-a04e-bbbeb7dd9c15 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:30.250440 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3dcc94a1-3dad-4c66-a04e-bbbeb7dd9c15 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160512 Jul 26 18:52:30.251042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1824/3671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:30 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:30.861696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c42d708d-8909-4ab0-b5b7-e1f047c3fd05 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:30.862303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c42d708d-8909-4ab0-b5b7-e1f047c3fd05 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:30.869302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c42d708d-8909-4ab0-b5b7-e1f047c3fd05 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:30.869747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c42d708d-8909-4ab0-b5b7-e1f047c3fd05 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:30.870496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c42d708d-8909-4ab0-b5b7-e1f047c3fd05 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:30.870921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c42d708d-8909-4ab0-b5b7-e1f047c3fd05 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:30.929146 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-80f97764-96df-48f3-825a-abbd1722a254 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:30.929725 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-80f97764-96df-48f3-825a-abbd1722a254 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:30.936453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80f97764-96df-48f3-825a-abbd1722a254 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:30.936889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80f97764-96df-48f3-825a-abbd1722a254 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:30.937628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80f97764-96df-48f3-825a-abbd1722a254 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:30.938053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-80f97764-96df-48f3-825a-abbd1722a254 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:31.003464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c42d708d-8909-4ab0-b5b7-e1f047c3fd05 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:31.013183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c42d708d-8909-4ab0-b5b7-e1f047c3fd05 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155303 Jul 26 18:52:31.013757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1848/3672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:30 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:31.057762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-30f45057-f562-4ef9-b411-bb0640e748a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:31.058397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-30f45057-f562-4ef9-b411-bb0640e748a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:31.064575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30f45057-f562-4ef9-b411-bb0640e748a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:31.065019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30f45057-f562-4ef9-b411-bb0640e748a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:31.065791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30f45057-f562-4ef9-b411-bb0640e748a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:31.066323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30f45057-f562-4ef9-b411-bb0640e748a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:31.070508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80f97764-96df-48f3-825a-abbd1722a254 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:31.080015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80f97764-96df-48f3-825a-abbd1722a254 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:31.081654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-80f97764-96df-48f3-825a-abbd1722a254 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:31.082850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-80f97764-96df-48f3-825a-abbd1722a254 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157657 Jul 26 18:52:31.083497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1825/3673] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:31.087844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eb96a1b0-9b83-4611-829a-3e1904ecfd11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:31.088433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eb96a1b0-9b83-4611-829a-3e1904ecfd11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:31.094985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb96a1b0-9b83-4611-829a-3e1904ecfd11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:31.095538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb96a1b0-9b83-4611-829a-3e1904ecfd11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:31.096356 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb96a1b0-9b83-4611-829a-3e1904ecfd11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:31.096850 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eb96a1b0-9b83-4611-829a-3e1904ecfd11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:31.195776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-30f45057-f562-4ef9-b411-bb0640e748a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:31.203781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-30f45057-f562-4ef9-b411-bb0640e748a9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.149920 Jul 26 18:52:31.204356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1849/3674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:31 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:31.224591 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eb96a1b0-9b83-4611-829a-3e1904ecfd11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:31.232597 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eb96a1b0-9b83-4611-829a-3e1904ecfd11 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.148174 Jul 26 18:52:31.233156 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1826/3675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:31 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:31.273449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bb6578a0-3574-4270-b96b-69305f7579d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:31.274044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bb6578a0-3574-4270-b96b-69305f7579d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:31.280453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb6578a0-3574-4270-b96b-69305f7579d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:31.280908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb6578a0-3574-4270-b96b-69305f7579d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:31.281661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb6578a0-3574-4270-b96b-69305f7579d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:31.282093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb6578a0-3574-4270-b96b-69305f7579d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:31.410744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bb6578a0-3574-4270-b96b-69305f7579d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:31.419763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bb6578a0-3574-4270-b96b-69305f7579d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.150647 Jul 26 18:52:31.420372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1850/3676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:31 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:32.039381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e7042daa-661e-41ac-a0e0-c308fdfa2a5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:32.040422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e7042daa-661e-41ac-a0e0-c308fdfa2a5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:32.051338 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7042daa-661e-41ac-a0e0-c308fdfa2a5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:32.051825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7042daa-661e-41ac-a0e0-c308fdfa2a5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:32.052602 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7042daa-661e-41ac-a0e0-c308fdfa2a5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:32.053324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7042daa-661e-41ac-a0e0-c308fdfa2a5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:32.106723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dfc4354a-5b0a-44e0-8668-7eef14615726 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:32.107320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dfc4354a-5b0a-44e0-8668-7eef14615726 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:32.114341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfc4354a-5b0a-44e0-8668-7eef14615726 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:32.114788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfc4354a-5b0a-44e0-8668-7eef14615726 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:32.115570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfc4354a-5b0a-44e0-8668-7eef14615726 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:32.116003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dfc4354a-5b0a-44e0-8668-7eef14615726 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:32.191958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e7042daa-661e-41ac-a0e0-c308fdfa2a5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:32.200241 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e7042daa-661e-41ac-a0e0-c308fdfa2a5c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.167470 Jul 26 18:52:32.200810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1827/3677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:32 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:32.225026 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5adb99ce-c715-4b38-a982-1df291244086 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:32.225743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5adb99ce-c715-4b38-a982-1df291244086 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:32.232366 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5adb99ce-c715-4b38-a982-1df291244086 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:32.232822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5adb99ce-c715-4b38-a982-1df291244086 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:32.233588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5adb99ce-c715-4b38-a982-1df291244086 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:32.234018 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5adb99ce-c715-4b38-a982-1df291244086 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:32.374162 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5adb99ce-c715-4b38-a982-1df291244086 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:32.382884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5adb99ce-c715-4b38-a982-1df291244086 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161722 Jul 26 18:52:32.383487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1828/3678] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:32 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:32.402378 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6457054b-423f-4ea6-be0a-ad74ae3bfc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:32.402988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6457054b-423f-4ea6-be0a-ad74ae3bfc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:32.410314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6457054b-423f-4ea6-be0a-ad74ae3bfc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:32.410756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6457054b-423f-4ea6-be0a-ad74ae3bfc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:32.411557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6457054b-423f-4ea6-be0a-ad74ae3bfc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:32.411991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6457054b-423f-4ea6-be0a-ad74ae3bfc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:32.486074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dfc4354a-5b0a-44e0-8668-7eef14615726 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:32.494662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dfc4354a-5b0a-44e0-8668-7eef14615726 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:32.496198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dfc4354a-5b0a-44e0-8668-7eef14615726 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:32.497377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dfc4354a-5b0a-44e0-8668-7eef14615726 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.395168 Jul 26 18:52:32.497935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1851/3679] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:32 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:32.502293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-15d260d3-130e-48f3-b241-2f5618e8b241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:32.502923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-15d260d3-130e-48f3-b241-2f5618e8b241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:32.508956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15d260d3-130e-48f3-b241-2f5618e8b241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:32.509404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15d260d3-130e-48f3-b241-2f5618e8b241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:32.510161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15d260d3-130e-48f3-b241-2f5618e8b241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:32.510592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15d260d3-130e-48f3-b241-2f5618e8b241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:32.548499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6457054b-423f-4ea6-be0a-ad74ae3bfc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:32.550716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:32.558646 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6457054b-423f-4ea6-be0a-ad74ae3bfc18 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.160115 Jul 26 18:52:32.559317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1829/3680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:32 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:32.642594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15d260d3-130e-48f3-b241-2f5618e8b241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:32.655825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-15d260d3-130e-48f3-b241-2f5618e8b241 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156552 Jul 26 18:52:32.656742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1852/3681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:32 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:33.225107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2ede595c-c30d-473a-8623-558dec39848c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:33.225927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2ede595c-c30d-473a-8623-558dec39848c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:33.235244 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2ede595c-c30d-473a-8623-558dec39848c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:33.235843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2ede595c-c30d-473a-8623-558dec39848c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:33.236865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2ede595c-c30d-473a-8623-558dec39848c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:33.237439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2ede595c-c30d-473a-8623-558dec39848c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:33.371702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2ede595c-c30d-473a-8623-558dec39848c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:33.380271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2ede595c-c30d-473a-8623-558dec39848c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161866 Jul 26 18:52:33.380845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1830/3682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:33 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:33.408766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-969b60e8-3f9f-4500-948c-c1c12acf8eec tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:33.409344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-969b60e8-3f9f-4500-948c-c1c12acf8eec tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:33.416313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-969b60e8-3f9f-4500-948c-c1c12acf8eec tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:33.416758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-969b60e8-3f9f-4500-948c-c1c12acf8eec tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:33.417502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-969b60e8-3f9f-4500-948c-c1c12acf8eec tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:33.417929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-969b60e8-3f9f-4500-948c-c1c12acf8eec tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:33.519917 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8da5313d-5bb4-44d6-90fe-63a9d5e13898 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:33.520641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8da5313d-5bb4-44d6-90fe-63a9d5e13898 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:33.527308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8da5313d-5bb4-44d6-90fe-63a9d5e13898 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:33.527754 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8da5313d-5bb4-44d6-90fe-63a9d5e13898 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:33.528500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8da5313d-5bb4-44d6-90fe-63a9d5e13898 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:33.528926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8da5313d-5bb4-44d6-90fe-63a9d5e13898 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:33.557146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-969b60e8-3f9f-4500-948c-c1c12acf8eec tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:33.565541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-969b60e8-3f9f-4500-948c-c1c12acf8eec tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.163069 Jul 26 18:52:33.566121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1853/3683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:33 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:33.584627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-645b5bd4-8289-49c1-af1f-8525ba64b112 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:33.585240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-645b5bd4-8289-49c1-af1f-8525ba64b112 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:33.591638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-645b5bd4-8289-49c1-af1f-8525ba64b112 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:33.592087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-645b5bd4-8289-49c1-af1f-8525ba64b112 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:33.592856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-645b5bd4-8289-49c1-af1f-8525ba64b112 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:33.593288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-645b5bd4-8289-49c1-af1f-8525ba64b112 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:33.663930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8da5313d-5bb4-44d6-90fe-63a9d5e13898 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:33.673137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8da5313d-5bb4-44d6-90fe-63a9d5e13898 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:33.674666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8da5313d-5bb4-44d6-90fe-63a9d5e13898 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:33.675893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8da5313d-5bb4-44d6-90fe-63a9d5e13898 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160010 Jul 26 18:52:33.686561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1831/3684] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:33.686561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-43ae5a52-9fae-412e-90df-ccbd29dcabe2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:33.686561 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-43ae5a52-9fae-412e-90df-ccbd29dcabe2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:33.690599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43ae5a52-9fae-412e-90df-ccbd29dcabe2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:33.691350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43ae5a52-9fae-412e-90df-ccbd29dcabe2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:33.691835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43ae5a52-9fae-412e-90df-ccbd29dcabe2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:33.692290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-43ae5a52-9fae-412e-90df-ccbd29dcabe2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:33.722090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-645b5bd4-8289-49c1-af1f-8525ba64b112 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:33.730287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-645b5bd4-8289-49c1-af1f-8525ba64b112 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.149777 Jul 26 18:52:33.731054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1854/3685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:33 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:33.818846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-43ae5a52-9fae-412e-90df-ccbd29dcabe2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:33.826913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-43ae5a52-9fae-412e-90df-ccbd29dcabe2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.147326 Jul 26 18:52:33.827476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1832/3686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:33 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:34.406038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-41e076c2-5262-4e7d-91a9-91ffef72c75a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:34.406916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-41e076c2-5262-4e7d-91a9-91ffef72c75a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:34.418923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41e076c2-5262-4e7d-91a9-91ffef72c75a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:34.420078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41e076c2-5262-4e7d-91a9-91ffef72c75a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:34.420922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41e076c2-5262-4e7d-91a9-91ffef72c75a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:34.421781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-41e076c2-5262-4e7d-91a9-91ffef72c75a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:34.554474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-41e076c2-5262-4e7d-91a9-91ffef72c75a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:34.556790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:34.564168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-41e076c2-5262-4e7d-91a9-91ffef72c75a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164580 Jul 26 18:52:34.564736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1855/3687] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:34 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:34.589953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-22048a90-1af0-4e99-8745-bc1e9ca81815 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:34.590883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-22048a90-1af0-4e99-8745-bc1e9ca81815 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:34.593052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:52:34.593222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 18:52:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:52:34.601575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22048a90-1af0-4e99-8745-bc1e9ca81815 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:34.602181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22048a90-1af0-4e99-8745-bc1e9ca81815 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:34.603271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22048a90-1af0-4e99-8745-bc1e9ca81815 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:34.603798 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-22048a90-1af0-4e99-8745-bc1e9ca81815 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:34.699278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d51851af-43cd-4890-9558-6fef3ec2d689 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:34.699987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d51851af-43cd-4890-9558-6fef3ec2d689 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:34.706415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d51851af-43cd-4890-9558-6fef3ec2d689 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:34.706876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d51851af-43cd-4890-9558-6fef3ec2d689 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:34.707751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d51851af-43cd-4890-9558-6fef3ec2d689 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:34.708291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d51851af-43cd-4890-9558-6fef3ec2d689 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:34.743629 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-22048a90-1af0-4e99-8745-bc1e9ca81815 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:34.752242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-22048a90-1af0-4e99-8745-bc1e9ca81815 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.168183 Jul 26 18:52:34.752835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1833/3688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:34 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:34.757457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-09c3ad4d-1991-4701-8e05-0258e090e1df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:34.758340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-09c3ad4d-1991-4701-8e05-0258e090e1df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:34.764724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09c3ad4d-1991-4701-8e05-0258e090e1df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:34.765173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09c3ad4d-1991-4701-8e05-0258e090e1df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:34.765927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09c3ad4d-1991-4701-8e05-0258e090e1df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:34.766357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-09c3ad4d-1991-4701-8e05-0258e090e1df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:34.842694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d51851af-43cd-4890-9558-6fef3ec2d689 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:34.851695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d51851af-43cd-4890-9558-6fef3ec2d689 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:34.853553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d51851af-43cd-4890-9558-6fef3ec2d689 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:34.854708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d51851af-43cd-4890-9558-6fef3ec2d689 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159740 Jul 26 18:52:34.855327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1856/3689] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:34 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:34.859823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-75797798-a353-4929-a27c-a943e71240f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:34.860416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-75797798-a353-4929-a27c-a943e71240f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:34.866350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75797798-a353-4929-a27c-a943e71240f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:34.866795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75797798-a353-4929-a27c-a943e71240f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:34.867742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75797798-a353-4929-a27c-a943e71240f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:34.868165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75797798-a353-4929-a27c-a943e71240f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:34.897900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-09c3ad4d-1991-4701-8e05-0258e090e1df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:34.905882 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-09c3ad4d-1991-4701-8e05-0258e090e1df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152101 Jul 26 18:52:34.906555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1834/3690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:34 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:34.999736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-75797798-a353-4929-a27c-a943e71240f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:35.013593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-75797798-a353-4929-a27c-a943e71240f3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156868 Jul 26 18:52:35.014371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1857/3691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:34 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:35.590108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8d02d20e-8119-4b30-ae20-eacf278665a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:35.591089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8d02d20e-8119-4b30-ae20-eacf278665a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:35.600656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d02d20e-8119-4b30-ae20-eacf278665a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:35.601092 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d02d20e-8119-4b30-ae20-eacf278665a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:35.601839 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d02d20e-8119-4b30-ae20-eacf278665a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:35.602441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8d02d20e-8119-4b30-ae20-eacf278665a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:35.747103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8d02d20e-8119-4b30-ae20-eacf278665a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:35.759280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8d02d20e-8119-4b30-ae20-eacf278665a7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.175655 Jul 26 18:52:35.760153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1835/3692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:35 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:35.774124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0a05842a-66b2-449a-8580-fec63a0fc2ad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:35.774656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0a05842a-66b2-449a-8580-fec63a0fc2ad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:35.781372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a05842a-66b2-449a-8580-fec63a0fc2ad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:35.781849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a05842a-66b2-449a-8580-fec63a0fc2ad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:35.782539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a05842a-66b2-449a-8580-fec63a0fc2ad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:35.782988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a05842a-66b2-449a-8580-fec63a0fc2ad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:35.877737 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5e4a9558-812e-4a15-b175-16c8f7a7e48f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:35.878358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5e4a9558-812e-4a15-b175-16c8f7a7e48f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:35.884821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e4a9558-812e-4a15-b175-16c8f7a7e48f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:35.885274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e4a9558-812e-4a15-b175-16c8f7a7e48f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:35.886034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e4a9558-812e-4a15-b175-16c8f7a7e48f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:35.886471 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e4a9558-812e-4a15-b175-16c8f7a7e48f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:35.922530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0a05842a-66b2-449a-8580-fec63a0fc2ad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:35.929608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0a05842a-66b2-449a-8580-fec63a0fc2ad tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.159763 Jul 26 18:52:35.930182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1858/3693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:35 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:35.934552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6e26507f-6547-46d9-8db8-f36a3712a85e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:35.935170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6e26507f-6547-46d9-8db8-f36a3712a85e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:35.940930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6e26507f-6547-46d9-8db8-f36a3712a85e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:35.941369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6e26507f-6547-46d9-8db8-f36a3712a85e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:35.942112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6e26507f-6547-46d9-8db8-f36a3712a85e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:35.942541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6e26507f-6547-46d9-8db8-f36a3712a85e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:36.017822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5e4a9558-812e-4a15-b175-16c8f7a7e48f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:36.027387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5e4a9558-812e-4a15-b175-16c8f7a7e48f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:36.028927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5e4a9558-812e-4a15-b175-16c8f7a7e48f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:36.030197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5e4a9558-812e-4a15-b175-16c8f7a7e48f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156462 Jul 26 18:52:36.030832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1836/3694] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:35 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:36.038056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3cadc358-481d-43c4-84f3-66b185d189a0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:36.038790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3cadc358-481d-43c4-84f3-66b185d189a0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:36.046403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cadc358-481d-43c4-84f3-66b185d189a0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:36.046979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cadc358-481d-43c4-84f3-66b185d189a0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:36.047852 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cadc358-481d-43c4-84f3-66b185d189a0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:36.048416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3cadc358-481d-43c4-84f3-66b185d189a0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:36.071879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6e26507f-6547-46d9-8db8-f36a3712a85e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:36.080018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6e26507f-6547-46d9-8db8-f36a3712a85e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.148871 Jul 26 18:52:36.088667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1859/3695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:35 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:36.186687 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3cadc358-481d-43c4-84f3-66b185d189a0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:36.196068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3cadc358-481d-43c4-84f3-66b185d189a0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.161984 Jul 26 18:52:36.197006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1837/3696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:36 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:36.784998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cbcffc47-4eee-4cec-b4d9-472d12a19d0f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:36.785706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cbcffc47-4eee-4cec-b4d9-472d12a19d0f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:36.794004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbcffc47-4eee-4cec-b4d9-472d12a19d0f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:36.794539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbcffc47-4eee-4cec-b4d9-472d12a19d0f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:36.795478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbcffc47-4eee-4cec-b4d9-472d12a19d0f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:36.795988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbcffc47-4eee-4cec-b4d9-472d12a19d0f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:36.930800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cbcffc47-4eee-4cec-b4d9-472d12a19d0f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:36.939270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cbcffc47-4eee-4cec-b4d9-472d12a19d0f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158902 Jul 26 18:52:36.939840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1860/3697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:36 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:36.950857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b3b20d06-d5a8-4b33-8cad-eda216dfc36b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:36.951585 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b3b20d06-d5a8-4b33-8cad-eda216dfc36b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:36.958560 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3b20d06-d5a8-4b33-8cad-eda216dfc36b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:36.958981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3b20d06-d5a8-4b33-8cad-eda216dfc36b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:36.959765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3b20d06-d5a8-4b33-8cad-eda216dfc36b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:36.960201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3b20d06-d5a8-4b33-8cad-eda216dfc36b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:37.053556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4ae6dfe7-f63e-47b0-976c-73fb7e9dffc9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:37.054181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4ae6dfe7-f63e-47b0-976c-73fb7e9dffc9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:37.061145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ae6dfe7-f63e-47b0-976c-73fb7e9dffc9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:37.061589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ae6dfe7-f63e-47b0-976c-73fb7e9dffc9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:37.062342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ae6dfe7-f63e-47b0-976c-73fb7e9dffc9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:37.062769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4ae6dfe7-f63e-47b0-976c-73fb7e9dffc9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:37.090235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b3b20d06-d5a8-4b33-8cad-eda216dfc36b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:37.099230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b3b20d06-d5a8-4b33-8cad-eda216dfc36b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152188 Jul 26 18:52:37.099807 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1838/3698] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:36 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:37.104297 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-29e0facf-817c-4fa3-b8ce-7ceca1659d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:37.104889 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-29e0facf-817c-4fa3-b8ce-7ceca1659d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:37.110752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29e0facf-817c-4fa3-b8ce-7ceca1659d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:37.111235 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29e0facf-817c-4fa3-b8ce-7ceca1659d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:37.111996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29e0facf-817c-4fa3-b8ce-7ceca1659d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:37.112417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-29e0facf-817c-4fa3-b8ce-7ceca1659d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:37.195678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4ae6dfe7-f63e-47b0-976c-73fb7e9dffc9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:37.204337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4ae6dfe7-f63e-47b0-976c-73fb7e9dffc9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:37.205835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4ae6dfe7-f63e-47b0-976c-73fb7e9dffc9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:37.206991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4ae6dfe7-f63e-47b0-976c-73fb7e9dffc9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157442 Jul 26 18:52:37.211068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1861/3699] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:37.221919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7b819ee3-2bcc-499e-b25a-c25e08d59427 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:37.222627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7b819ee3-2bcc-499e-b25a-c25e08d59427 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:37.229010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b819ee3-2bcc-499e-b25a-c25e08d59427 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:37.229588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b819ee3-2bcc-499e-b25a-c25e08d59427 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:37.230595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b819ee3-2bcc-499e-b25a-c25e08d59427 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:37.231037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b819ee3-2bcc-499e-b25a-c25e08d59427 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:37.251578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-29e0facf-817c-4fa3-b8ce-7ceca1659d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:37.259528 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-29e0facf-817c-4fa3-b8ce-7ceca1659d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158760 Jul 26 18:52:37.260093 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1839/3700] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:37 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:37.365469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7b819ee3-2bcc-499e-b25a-c25e08d59427 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:37.373715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7b819ee3-2bcc-499e-b25a-c25e08d59427 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158581 Jul 26 18:52:37.374250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1862/3701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:37 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:37.751783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:52:37.752191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 18:52:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:52:37.964833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e5127929-fe1b-45b4-9dae-21295ac457e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:37.965761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e5127929-fe1b-45b4-9dae-21295ac457e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:37.975613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e5127929-fe1b-45b4-9dae-21295ac457e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:37.976052 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e5127929-fe1b-45b4-9dae-21295ac457e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:37.976800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e5127929-fe1b-45b4-9dae-21295ac457e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:37.977219 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e5127929-fe1b-45b4-9dae-21295ac457e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:38.104694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e5127929-fe1b-45b4-9dae-21295ac457e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:38.113542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e5127929-fe1b-45b4-9dae-21295ac457e8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154956 Jul 26 18:52:38.114691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1840/3702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:37 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:38.120265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a760b5c5-65ed-4235-8b99-a68055f06dde tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:38.120862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a760b5c5-65ed-4235-8b99-a68055f06dde tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:38.129840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a760b5c5-65ed-4235-8b99-a68055f06dde tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:38.130284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a760b5c5-65ed-4235-8b99-a68055f06dde tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:38.131047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a760b5c5-65ed-4235-8b99-a68055f06dde tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:38.131506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a760b5c5-65ed-4235-8b99-a68055f06dde tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:38.232287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1d0808c2-c4d9-4c12-953c-36ab4c8253ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:38.233329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1d0808c2-c4d9-4c12-953c-36ab4c8253ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:38.239935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d0808c2-c4d9-4c12-953c-36ab4c8253ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:38.240377 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d0808c2-c4d9-4c12-953c-36ab4c8253ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:38.241120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d0808c2-c4d9-4c12-953c-36ab4c8253ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:38.241552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1d0808c2-c4d9-4c12-953c-36ab4c8253ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:38.268239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a760b5c5-65ed-4235-8b99-a68055f06dde tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:38.278098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a760b5c5-65ed-4235-8b99-a68055f06dde tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161577 Jul 26 18:52:38.290791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1863/3703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:38 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:38.296822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6059ec16-e154-45d2-b76c-a3f605084a47 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:38.297588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6059ec16-e154-45d2-b76c-a3f605084a47 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:38.304157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6059ec16-e154-45d2-b76c-a3f605084a47 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:38.304611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6059ec16-e154-45d2-b76c-a3f605084a47 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:38.305377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6059ec16-e154-45d2-b76c-a3f605084a47 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:38.305814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6059ec16-e154-45d2-b76c-a3f605084a47 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:38.377222 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d0808c2-c4d9-4c12-953c-36ab4c8253ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:38.386411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d0808c2-c4d9-4c12-953c-36ab4c8253ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:38.387967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1d0808c2-c4d9-4c12-953c-36ab4c8253ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:38.389231 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1d0808c2-c4d9-4c12-953c-36ab4c8253ba tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162643 Jul 26 18:52:38.389800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1841/3704] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:38.394510 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f6fd09f5-63a6-4352-9a6c-04e8b2f530d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:38.395148 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f6fd09f5-63a6-4352-9a6c-04e8b2f530d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:38.401524 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f6fd09f5-63a6-4352-9a6c-04e8b2f530d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:38.401975 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f6fd09f5-63a6-4352-9a6c-04e8b2f530d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:38.402736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f6fd09f5-63a6-4352-9a6c-04e8b2f530d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:38.403201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f6fd09f5-63a6-4352-9a6c-04e8b2f530d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:38.435663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6059ec16-e154-45d2-b76c-a3f605084a47 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:38.443992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6059ec16-e154-45d2-b76c-a3f605084a47 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152157 Jul 26 18:52:38.444553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1864/3705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:38 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:38.532067 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f6fd09f5-63a6-4352-9a6c-04e8b2f530d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:38.540568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f6fd09f5-63a6-4352-9a6c-04e8b2f530d0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.149801 Jul 26 18:52:38.541141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1842/3706] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:38 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:39.143589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2645d8dd-ad06-42fa-95fc-dd9a991940bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:39.144545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2645d8dd-ad06-42fa-95fc-dd9a991940bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:39.155831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2645d8dd-ad06-42fa-95fc-dd9a991940bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:39.156572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2645d8dd-ad06-42fa-95fc-dd9a991940bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:39.157820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2645d8dd-ad06-42fa-95fc-dd9a991940bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:39.158543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2645d8dd-ad06-42fa-95fc-dd9a991940bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:39.297184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2645d8dd-ad06-42fa-95fc-dd9a991940bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:39.303865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e55c5786-d9e5-4093-bd53-e509d56eb870 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:39.304470 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e55c5786-d9e5-4093-bd53-e509d56eb870 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:39.305763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2645d8dd-ad06-42fa-95fc-dd9a991940bd tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.168706 Jul 26 18:52:39.306314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1865/3707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:39 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:39.311115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e55c5786-d9e5-4093-bd53-e509d56eb870 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:39.311557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e55c5786-d9e5-4093-bd53-e509d56eb870 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:39.312305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e55c5786-d9e5-4093-bd53-e509d56eb870 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:39.312736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e55c5786-d9e5-4093-bd53-e509d56eb870 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:39.412370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-64e0882b-fe59-41c4-bd5c-6f339a74b4b2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:39.412894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-64e0882b-fe59-41c4-bd5c-6f339a74b4b2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:39.419249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-64e0882b-fe59-41c4-bd5c-6f339a74b4b2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:39.419676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-64e0882b-fe59-41c4-bd5c-6f339a74b4b2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:39.420512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-64e0882b-fe59-41c4-bd5c-6f339a74b4b2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:39.420871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-64e0882b-fe59-41c4-bd5c-6f339a74b4b2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:39.447490 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e55c5786-d9e5-4093-bd53-e509d56eb870 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:39.455642 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e55c5786-d9e5-4093-bd53-e509d56eb870 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155630 Jul 26 18:52:39.456239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1843/3708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:39 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:39.465121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-53a1ca05-57ab-4048-a166-831e1ceecf29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:39.465826 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-53a1ca05-57ab-4048-a166-831e1ceecf29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:39.471790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53a1ca05-57ab-4048-a166-831e1ceecf29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:39.472230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53a1ca05-57ab-4048-a166-831e1ceecf29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:39.473155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53a1ca05-57ab-4048-a166-831e1ceecf29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:39.473630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-53a1ca05-57ab-4048-a166-831e1ceecf29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:39.551747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-64e0882b-fe59-41c4-bd5c-6f339a74b4b2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:39.560456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-64e0882b-fe59-41c4-bd5c-6f339a74b4b2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:39.561957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-64e0882b-fe59-41c4-bd5c-6f339a74b4b2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:39.563170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-64e0882b-fe59-41c4-bd5c-6f339a74b4b2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.154866 Jul 26 18:52:39.563897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1866/3709] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:39.571630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-909947d8-e758-452a-9896-057bc1c006ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:39.572226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-909947d8-e758-452a-9896-057bc1c006ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:39.578582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-909947d8-e758-452a-9896-057bc1c006ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:39.579047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-909947d8-e758-452a-9896-057bc1c006ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:39.579786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-909947d8-e758-452a-9896-057bc1c006ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:39.580211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-909947d8-e758-452a-9896-057bc1c006ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:39.600534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-53a1ca05-57ab-4048-a166-831e1ceecf29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:39.608628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-53a1ca05-57ab-4048-a166-831e1ceecf29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.147358 Jul 26 18:52:39.609186 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1844/3710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:39 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:39.706576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-909947d8-e758-452a-9896-057bc1c006ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:39.715044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-909947d8-e758-452a-9896-057bc1c006ac tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.150343 Jul 26 18:52:39.715644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1867/3711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:39 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:40.332303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8cc0793e-9269-4101-966e-8d4e25648fa4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:40.333223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8cc0793e-9269-4101-966e-8d4e25648fa4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:40.341612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8cc0793e-9269-4101-966e-8d4e25648fa4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:40.342161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8cc0793e-9269-4101-966e-8d4e25648fa4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:40.343112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8cc0793e-9269-4101-966e-8d4e25648fa4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:40.343671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8cc0793e-9269-4101-966e-8d4e25648fa4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:40.476925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9aa4a8cd-eb08-4280-993a-9e5bab7af462 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:40.477538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9aa4a8cd-eb08-4280-993a-9e5bab7af462 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:40.479147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8cc0793e-9269-4101-966e-8d4e25648fa4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:40.484737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9aa4a8cd-eb08-4280-993a-9e5bab7af462 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:40.485161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9aa4a8cd-eb08-4280-993a-9e5bab7af462 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:40.485983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9aa4a8cd-eb08-4280-993a-9e5bab7af462 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:40.486460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9aa4a8cd-eb08-4280-993a-9e5bab7af462 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:40.487500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8cc0793e-9269-4101-966e-8d4e25648fa4 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161888 Jul 26 18:52:40.488066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1845/3712] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:40 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:40.586172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c7c423ad-8202-478a-98c9-cbf5eb2e4cc5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:40.586700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c7c423ad-8202-478a-98c9-cbf5eb2e4cc5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:40.593167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c7c423ad-8202-478a-98c9-cbf5eb2e4cc5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:40.593613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c7c423ad-8202-478a-98c9-cbf5eb2e4cc5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:40.594372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c7c423ad-8202-478a-98c9-cbf5eb2e4cc5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:40.594952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c7c423ad-8202-478a-98c9-cbf5eb2e4cc5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:40.610028 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:40.619169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9aa4a8cd-eb08-4280-993a-9e5bab7af462 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:40.627552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9aa4a8cd-eb08-4280-993a-9e5bab7af462 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154606 Jul 26 18:52:40.628116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1868/3713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:40 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:40.632674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b91fc297-bf3b-46e4-a4d3-f7668d05b990 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:40.633278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b91fc297-bf3b-46e4-a4d3-f7668d05b990 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:40.639376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b91fc297-bf3b-46e4-a4d3-f7668d05b990 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:40.639834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b91fc297-bf3b-46e4-a4d3-f7668d05b990 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:40.640618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b91fc297-bf3b-46e4-a4d3-f7668d05b990 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:40.641076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b91fc297-bf3b-46e4-a4d3-f7668d05b990 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:40.732183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c7c423ad-8202-478a-98c9-cbf5eb2e4cc5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:40.740861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c7c423ad-8202-478a-98c9-cbf5eb2e4cc5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:40.742388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c7c423ad-8202-478a-98c9-cbf5eb2e4cc5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:40.743601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c7c423ad-8202-478a-98c9-cbf5eb2e4cc5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161566 Jul 26 18:52:40.744384 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1846/3714] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:40 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:40.750814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9a43065c-565f-487b-8bbb-edc183eb4d99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:40.751477 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9a43065c-565f-487b-8bbb-edc183eb4d99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:40.757590 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a43065c-565f-487b-8bbb-edc183eb4d99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:40.758027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a43065c-565f-487b-8bbb-edc183eb4d99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:40.758779 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a43065c-565f-487b-8bbb-edc183eb4d99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:40.759257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9a43065c-565f-487b-8bbb-edc183eb4d99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:40.776863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b91fc297-bf3b-46e4-a4d3-f7668d05b990 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:40.784977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b91fc297-bf3b-46e4-a4d3-f7668d05b990 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155777 Jul 26 18:52:40.785553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1869/3715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:40 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:40.888696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9a43065c-565f-487b-8bbb-edc183eb4d99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:40.897523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9a43065c-565f-487b-8bbb-edc183eb4d99 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.150656 Jul 26 18:52:40.898094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1847/3716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:40 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:41.508908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e8d132ab-4d4e-417d-a08f-995085bb279a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:41.509538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e8d132ab-4d4e-417d-a08f-995085bb279a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:41.516349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8d132ab-4d4e-417d-a08f-995085bb279a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:41.516797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8d132ab-4d4e-417d-a08f-995085bb279a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:41.517549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8d132ab-4d4e-417d-a08f-995085bb279a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:41.517982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8d132ab-4d4e-417d-a08f-995085bb279a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:41.649070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-92b86345-5741-4b25-9cef-3a0712125060 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:41.649771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-92b86345-5741-4b25-9cef-3a0712125060 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:41.656556 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92b86345-5741-4b25-9cef-3a0712125060 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:41.657084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92b86345-5741-4b25-9cef-3a0712125060 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:41.657902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92b86345-5741-4b25-9cef-3a0712125060 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:41.658418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-92b86345-5741-4b25-9cef-3a0712125060 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:41.680054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e8d132ab-4d4e-417d-a08f-995085bb279a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:41.688166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e8d132ab-4d4e-417d-a08f-995085bb279a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.183175 Jul 26 18:52:41.688705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1870/3717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:41 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:41.767174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ef4fd547-71f9-4c3f-996a-0871e9f3ca53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:41.767779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ef4fd547-71f9-4c3f-996a-0871e9f3ca53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:41.774287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef4fd547-71f9-4c3f-996a-0871e9f3ca53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:41.774730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef4fd547-71f9-4c3f-996a-0871e9f3ca53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:41.775503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef4fd547-71f9-4c3f-996a-0871e9f3ca53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:41.775926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef4fd547-71f9-4c3f-996a-0871e9f3ca53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:41.794823 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-92b86345-5741-4b25-9cef-3a0712125060 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:41.805165 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-92b86345-5741-4b25-9cef-3a0712125060 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.160188 Jul 26 18:52:41.805746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1848/3718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:41 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:41.810218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e09d4f14-4298-4fc4-b26b-02e98ce0f98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:41.810817 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e09d4f14-4298-4fc4-b26b-02e98ce0f98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:41.817002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e09d4f14-4298-4fc4-b26b-02e98ce0f98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:41.817469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e09d4f14-4298-4fc4-b26b-02e98ce0f98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:41.818264 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e09d4f14-4298-4fc4-b26b-02e98ce0f98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:41.818694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e09d4f14-4298-4fc4-b26b-02e98ce0f98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:41.919658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ef4fd547-71f9-4c3f-996a-0871e9f3ca53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:41.928388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ef4fd547-71f9-4c3f-996a-0871e9f3ca53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:41.929858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ef4fd547-71f9-4c3f-996a-0871e9f3ca53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:41.931009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ef4fd547-71f9-4c3f-996a-0871e9f3ca53 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.167882 Jul 26 18:52:41.931963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1871/3719] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:41 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:52:41.936333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-700e7b1b-eec9-46ec-9655-9e56b104aa76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:41.936934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-700e7b1b-eec9-46ec-9655-9e56b104aa76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:41.942745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-700e7b1b-eec9-46ec-9655-9e56b104aa76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:41.943224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-700e7b1b-eec9-46ec-9655-9e56b104aa76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:41.943985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-700e7b1b-eec9-46ec-9655-9e56b104aa76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:41.944420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-700e7b1b-eec9-46ec-9655-9e56b104aa76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:41.952182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e09d4f14-4298-4fc4-b26b-02e98ce0f98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:41.959642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:41.960441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e09d4f14-4298-4fc4-b26b-02e98ce0f98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153776 Jul 26 18:52:41.961134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1849/3720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:41 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:42.076884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-700e7b1b-eec9-46ec-9655-9e56b104aa76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:42.084988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-700e7b1b-eec9-46ec-9655-9e56b104aa76 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152109 Jul 26 18:52:42.085578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1872/3721] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:41 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:42.713372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c2b0a884-649d-40aa-9915-37c91d48d79b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:42.714414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c2b0a884-649d-40aa-9915-37c91d48d79b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:42.725349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2b0a884-649d-40aa-9915-37c91d48d79b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:42.726089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2b0a884-649d-40aa-9915-37c91d48d79b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:42.727403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2b0a884-649d-40aa-9915-37c91d48d79b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:42.728126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c2b0a884-649d-40aa-9915-37c91d48d79b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:42.825911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8c9f670f-db68-4575-a724-6b37bdaf3afd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:42.826487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8c9f670f-db68-4575-a724-6b37bdaf3afd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:42.833122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c9f670f-db68-4575-a724-6b37bdaf3afd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:42.833563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c9f670f-db68-4575-a724-6b37bdaf3afd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:42.834318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c9f670f-db68-4575-a724-6b37bdaf3afd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:42.834742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8c9f670f-db68-4575-a724-6b37bdaf3afd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:42.866333 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c2b0a884-649d-40aa-9915-37c91d48d79b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:42.874895 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c2b0a884-649d-40aa-9915-37c91d48d79b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.168224 Jul 26 18:52:42.875520 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1850/3722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:42 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:42.954312 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4068a378-4bc3-469f-9e18-6b7ca8aa6393 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:42.954923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4068a378-4bc3-469f-9e18-6b7ca8aa6393 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:42.961221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4068a378-4bc3-469f-9e18-6b7ca8aa6393 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:42.961669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4068a378-4bc3-469f-9e18-6b7ca8aa6393 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:42.962418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4068a378-4bc3-469f-9e18-6b7ca8aa6393 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:42.962846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4068a378-4bc3-469f-9e18-6b7ca8aa6393 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:42.970553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8c9f670f-db68-4575-a724-6b37bdaf3afd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:42.978987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8c9f670f-db68-4575-a724-6b37bdaf3afd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156874 Jul 26 18:52:42.979585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1873/3723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:42 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:42.983957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-18ae39db-e233-4c75-880f-bbb4c7d627ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:42.984534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-18ae39db-e233-4c75-880f-bbb4c7d627ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:42.990899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18ae39db-e233-4c75-880f-bbb4c7d627ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:42.991375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18ae39db-e233-4c75-880f-bbb4c7d627ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:42.992136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18ae39db-e233-4c75-880f-bbb4c7d627ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:42.992569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18ae39db-e233-4c75-880f-bbb4c7d627ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:43.107463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4068a378-4bc3-469f-9e18-6b7ca8aa6393 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:43.115994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4068a378-4bc3-469f-9e18-6b7ca8aa6393 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:43.117619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4068a378-4bc3-469f-9e18-6b7ca8aa6393 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:43.118965 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4068a378-4bc3-469f-9e18-6b7ca8aa6393 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.168631 Jul 26 18:52:43.126311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1851/3724] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:52:43.126311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ad4922f2-9821-40fa-aa86-d6b5375b0967 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:43.126311 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ad4922f2-9821-40fa-aa86-d6b5375b0967 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:43.126871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-18ae39db-e233-4c75-880f-bbb4c7d627ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:43.131284 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad4922f2-9821-40fa-aa86-d6b5375b0967 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:43.131801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad4922f2-9821-40fa-aa86-d6b5375b0967 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:43.132615 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad4922f2-9821-40fa-aa86-d6b5375b0967 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:43.133126 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad4922f2-9821-40fa-aa86-d6b5375b0967 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:43.135907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-18ae39db-e233-4c75-880f-bbb4c7d627ff tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155270 Jul 26 18:52:43.136550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1874/3725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:42 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:43.261672 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ad4922f2-9821-40fa-aa86-d6b5375b0967 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:43.273155 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ad4922f2-9821-40fa-aa86-d6b5375b0967 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152411 Jul 26 18:52:43.273722 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1852/3726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:43 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:43.900729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a96b5d82-4aa0-419b-a2a4-e0c5b17ebba2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:43.901598 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a96b5d82-4aa0-419b-a2a4-e0c5b17ebba2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:43.912282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a96b5d82-4aa0-419b-a2a4-e0c5b17ebba2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:43.912734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a96b5d82-4aa0-419b-a2a4-e0c5b17ebba2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:43.913489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a96b5d82-4aa0-419b-a2a4-e0c5b17ebba2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:43.913920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a96b5d82-4aa0-419b-a2a4-e0c5b17ebba2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:44.000905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9776b8eb-cfaa-4de3-ae97-1e7c66778bd9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:44.001513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9776b8eb-cfaa-4de3-ae97-1e7c66778bd9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:44.008385 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9776b8eb-cfaa-4de3-ae97-1e7c66778bd9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:44.008832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9776b8eb-cfaa-4de3-ae97-1e7c66778bd9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:44.009592 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9776b8eb-cfaa-4de3-ae97-1e7c66778bd9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:44.010023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9776b8eb-cfaa-4de3-ae97-1e7c66778bd9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:44.050069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a96b5d82-4aa0-419b-a2a4-e0c5b17ebba2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:44.058491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a96b5d82-4aa0-419b-a2a4-e0c5b17ebba2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164723 Jul 26 18:52:44.059178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1875/3727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:43 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:44.142097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a43e3db3-70d9-4f87-b429-58638433cebc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:44.142699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a43e3db3-70d9-4f87-b429-58638433cebc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:44.149788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a43e3db3-70d9-4f87-b429-58638433cebc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:44.150238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a43e3db3-70d9-4f87-b429-58638433cebc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:44.151095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a43e3db3-70d9-4f87-b429-58638433cebc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:44.152517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a43e3db3-70d9-4f87-b429-58638433cebc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:44.290729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a43e3db3-70d9-4f87-b429-58638433cebc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:44.300078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a43e3db3-70d9-4f87-b429-58638433cebc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:44.301611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a43e3db3-70d9-4f87-b429-58638433cebc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:44.303212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a43e3db3-70d9-4f87-b429-58638433cebc tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.165058 Jul 26 18:52:44.303776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1876/3728] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:44 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:44.308231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e04980b8-f167-4057-b8a7-ac972e296fbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:44.309115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e04980b8-f167-4057-b8a7-ac972e296fbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:44.315337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e04980b8-f167-4057-b8a7-ac972e296fbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:44.315780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e04980b8-f167-4057-b8a7-ac972e296fbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:44.316540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e04980b8-f167-4057-b8a7-ac972e296fbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:44.317003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e04980b8-f167-4057-b8a7-ac972e296fbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:44.382691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9776b8eb-cfaa-4de3-ae97-1e7c66778bd9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:44.390867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9776b8eb-cfaa-4de3-ae97-1e7c66778bd9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.393932 Jul 26 18:52:44.391485 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1853/3729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:43 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:44.395944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-af10792d-62ae-492d-9dda-d08d672b880c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:44.396831 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-af10792d-62ae-492d-9dda-d08d672b880c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:44.402792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af10792d-62ae-492d-9dda-d08d672b880c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:44.403555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af10792d-62ae-492d-9dda-d08d672b880c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:44.404307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af10792d-62ae-492d-9dda-d08d672b880c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:44.404730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-af10792d-62ae-492d-9dda-d08d672b880c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:44.454153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e04980b8-f167-4057-b8a7-ac972e296fbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:44.462440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e04980b8-f167-4057-b8a7-ac972e296fbb tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157712 Jul 26 18:52:44.463045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1877/3730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:44 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:44.532812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-af10792d-62ae-492d-9dda-d08d672b880c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:44.540872 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-af10792d-62ae-492d-9dda-d08d672b880c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.148441 Jul 26 18:52:44.541410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1854/3731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:44 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:45.084041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-47951faa-42df-4ed7-add5-0bde137e608e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:45.084977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-47951faa-42df-4ed7-add5-0bde137e608e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:45.096076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47951faa-42df-4ed7-add5-0bde137e608e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:45.096811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47951faa-42df-4ed7-add5-0bde137e608e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:45.098046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47951faa-42df-4ed7-add5-0bde137e608e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:45.098800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-47951faa-42df-4ed7-add5-0bde137e608e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:45.236524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-47951faa-42df-4ed7-add5-0bde137e608e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:45.248169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-47951faa-42df-4ed7-add5-0bde137e608e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.170435 Jul 26 18:52:45.249009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1878/3732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:45 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:45.330175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0b3c15d6-d9af-4bb3-b743-d86b87a0ae7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:45.331218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0b3c15d6-d9af-4bb3-b743-d86b87a0ae7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:45.342389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b3c15d6-d9af-4bb3-b743-d86b87a0ae7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:45.343074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b3c15d6-d9af-4bb3-b743-d86b87a0ae7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:45.344360 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b3c15d6-d9af-4bb3-b743-d86b87a0ae7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:45.345079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0b3c15d6-d9af-4bb3-b743-d86b87a0ae7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:45.412718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e44a17b5-6590-474e-9a54-f5d30b6254dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:45.413348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e44a17b5-6590-474e-9a54-f5d30b6254dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:45.419599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e44a17b5-6590-474e-9a54-f5d30b6254dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:45.420048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e44a17b5-6590-474e-9a54-f5d30b6254dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:45.420832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e44a17b5-6590-474e-9a54-f5d30b6254dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:45.421246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e44a17b5-6590-474e-9a54-f5d30b6254dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:45.481396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0b3c15d6-d9af-4bb3-b743-d86b87a0ae7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:45.490056 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0b3c15d6-d9af-4bb3-b743-d86b87a0ae7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:45.491605 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0b3c15d6-d9af-4bb3-b743-d86b87a0ae7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:45.492757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0b3c15d6-d9af-4bb3-b743-d86b87a0ae7f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.169113 Jul 26 18:52:45.493327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1855/3733] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:45.497649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6eafe0a2-e401-45b7-b739-68a7bacd7356 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:45.498251 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6eafe0a2-e401-45b7-b739-68a7bacd7356 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:45.504073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6eafe0a2-e401-45b7-b739-68a7bacd7356 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:45.505054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6eafe0a2-e401-45b7-b739-68a7bacd7356 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:45.506038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6eafe0a2-e401-45b7-b739-68a7bacd7356 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:45.506685 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6eafe0a2-e401-45b7-b739-68a7bacd7356 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:45.562119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e44a17b5-6590-474e-9a54-f5d30b6254dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:45.570206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e44a17b5-6590-474e-9a54-f5d30b6254dc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161453 Jul 26 18:52:45.570775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1879/3734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:45 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:45.575219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2b609098-0ed7-4ce7-b368-d5014568233d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:45.575768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2b609098-0ed7-4ce7-b368-d5014568233d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:45.581444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b609098-0ed7-4ce7-b368-d5014568233d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:45.581898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b609098-0ed7-4ce7-b368-d5014568233d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:45.582709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b609098-0ed7-4ce7-b368-d5014568233d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:45.583351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b609098-0ed7-4ce7-b368-d5014568233d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:45.641631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6eafe0a2-e401-45b7-b739-68a7bacd7356 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:45.650074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6eafe0a2-e401-45b7-b739-68a7bacd7356 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155823 Jul 26 18:52:45.650644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1856/3735] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:45 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:45.718254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2b609098-0ed7-4ce7-b368-d5014568233d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:45.727194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2b609098-0ed7-4ce7-b368-d5014568233d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155293 Jul 26 18:52:45.727883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1880/3736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:45 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:46.277867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-41f7633d-9925-4e6e-9247-f3b1e1b0412c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:46.279173 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-41f7633d-9925-4e6e-9247-f3b1e1b0412c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:46.289262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41f7633d-9925-4e6e-9247-f3b1e1b0412c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:46.290006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41f7633d-9925-4e6e-9247-f3b1e1b0412c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:46.291310 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41f7633d-9925-4e6e-9247-f3b1e1b0412c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:46.292267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-41f7633d-9925-4e6e-9247-f3b1e1b0412c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:46.436952 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-41f7633d-9925-4e6e-9247-f3b1e1b0412c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:46.449394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-41f7633d-9925-4e6e-9247-f3b1e1b0412c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.178115 Jul 26 18:52:46.450198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1857/3737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:46 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:46.516368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-eab408a5-b82d-4cff-b37c-3e5be5a8eec2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:46.516946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-eab408a5-b82d-4cff-b37c-3e5be5a8eec2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:46.524354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eab408a5-b82d-4cff-b37c-3e5be5a8eec2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:46.524800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eab408a5-b82d-4cff-b37c-3e5be5a8eec2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:46.525553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eab408a5-b82d-4cff-b37c-3e5be5a8eec2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:46.525982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eab408a5-b82d-4cff-b37c-3e5be5a8eec2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:46.591700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d8cb4027-536e-448c-aeac-7ef2f2a554d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:46.592226 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d8cb4027-536e-448c-aeac-7ef2f2a554d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:46.598954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8cb4027-536e-448c-aeac-7ef2f2a554d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:46.599387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8cb4027-536e-448c-aeac-7ef2f2a554d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:46.600170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8cb4027-536e-448c-aeac-7ef2f2a554d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:46.600637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d8cb4027-536e-448c-aeac-7ef2f2a554d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:46.666499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-eab408a5-b82d-4cff-b37c-3e5be5a8eec2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:46.675545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-eab408a5-b82d-4cff-b37c-3e5be5a8eec2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:46.677071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-eab408a5-b82d-4cff-b37c-3e5be5a8eec2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:46.678260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-eab408a5-b82d-4cff-b37c-3e5be5a8eec2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.165821 Jul 26 18:52:46.678827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1881/3738] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:46.683328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b3a5a913-7cb9-4b46-aa33-2132b7286619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:46.683935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b3a5a913-7cb9-4b46-aa33-2132b7286619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:46.691066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3a5a913-7cb9-4b46-aa33-2132b7286619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:46.691499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3a5a913-7cb9-4b46-aa33-2132b7286619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:46.692336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3a5a913-7cb9-4b46-aa33-2132b7286619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:46.692767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3a5a913-7cb9-4b46-aa33-2132b7286619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:46.733322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d8cb4027-536e-448c-aeac-7ef2f2a554d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:46.741483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d8cb4027-536e-448c-aeac-7ef2f2a554d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153792 Jul 26 18:52:46.747090 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1858/3739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:46 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:46.748435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9e0154dd-907c-4009-875b-f7a4ac68e63d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:46.749041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9e0154dd-907c-4009-875b-f7a4ac68e63d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:46.756474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e0154dd-907c-4009-875b-f7a4ac68e63d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:46.756953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e0154dd-907c-4009-875b-f7a4ac68e63d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:46.757710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e0154dd-907c-4009-875b-f7a4ac68e63d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:46.758141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9e0154dd-907c-4009-875b-f7a4ac68e63d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:46.834773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b3a5a913-7cb9-4b46-aa33-2132b7286619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:46.842826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b3a5a913-7cb9-4b46-aa33-2132b7286619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.162956 Jul 26 18:52:46.843364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1882/3740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:46 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:46.897657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9e0154dd-907c-4009-875b-f7a4ac68e63d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:46.905825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9e0154dd-907c-4009-875b-f7a4ac68e63d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.161147 Jul 26 18:52:46.906364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1859/3741] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:46 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:47.478155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5e3445b4-9aee-4b29-82ea-4fe46e5b4a83 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:47.479188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5e3445b4-9aee-4b29-82ea-4fe46e5b4a83 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:47.489544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e3445b4-9aee-4b29-82ea-4fe46e5b4a83 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:47.490279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e3445b4-9aee-4b29-82ea-4fe46e5b4a83 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:47.491561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e3445b4-9aee-4b29-82ea-4fe46e5b4a83 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:47.492271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e3445b4-9aee-4b29-82ea-4fe46e5b4a83 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:47.630737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5e3445b4-9aee-4b29-82ea-4fe46e5b4a83 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:47.639590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5e3445b4-9aee-4b29-82ea-4fe46e5b4a83 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.168299 Jul 26 18:52:47.640161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1883/3742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:47 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:47.705897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-135ef9a9-8b2b-4ba4-ba6c-7d7b93315df5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:47.706891 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-135ef9a9-8b2b-4ba4-ba6c-7d7b93315df5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:47.717843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-135ef9a9-8b2b-4ba4-ba6c-7d7b93315df5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:47.718617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-135ef9a9-8b2b-4ba4-ba6c-7d7b93315df5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:47.719919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-135ef9a9-8b2b-4ba4-ba6c-7d7b93315df5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:47.720628 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-135ef9a9-8b2b-4ba4-ba6c-7d7b93315df5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:47.766052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c396094a-8586-46ee-bf75-e631999f1932 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:47.766765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c396094a-8586-46ee-bf75-e631999f1932 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:47.774009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c396094a-8586-46ee-bf75-e631999f1932 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:47.774470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c396094a-8586-46ee-bf75-e631999f1932 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:47.775269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c396094a-8586-46ee-bf75-e631999f1932 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:47.775707 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c396094a-8586-46ee-bf75-e631999f1932 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:47.862275 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-135ef9a9-8b2b-4ba4-ba6c-7d7b93315df5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:47.872075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-135ef9a9-8b2b-4ba4-ba6c-7d7b93315df5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:47.873663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-135ef9a9-8b2b-4ba4-ba6c-7d7b93315df5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:47.874953 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-135ef9a9-8b2b-4ba4-ba6c-7d7b93315df5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.175730 Jul 26 18:52:47.876097 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1860/3743] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:47 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:47.880787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3ec2c341-cb9a-4093-a8df-dfc386b2060f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:47.881491 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3ec2c341-cb9a-4093-a8df-dfc386b2060f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:47.888483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ec2c341-cb9a-4093-a8df-dfc386b2060f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:47.889029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ec2c341-cb9a-4093-a8df-dfc386b2060f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:47.889876 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ec2c341-cb9a-4093-a8df-dfc386b2060f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:47.890416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3ec2c341-cb9a-4093-a8df-dfc386b2060f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:47.919439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c396094a-8586-46ee-bf75-e631999f1932 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:47.927701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c396094a-8586-46ee-bf75-e631999f1932 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.167539 Jul 26 18:52:47.928279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1884/3744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:47 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:47.935072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d6fc0232-4b5c-43e7-9595-6fb62d2e3760 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:47.935072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d6fc0232-4b5c-43e7-9595-6fb62d2e3760 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:47.939255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d6fc0232-4b5c-43e7-9595-6fb62d2e3760 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:47.939701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d6fc0232-4b5c-43e7-9595-6fb62d2e3760 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:47.940457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d6fc0232-4b5c-43e7-9595-6fb62d2e3760 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:47.940884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d6fc0232-4b5c-43e7-9595-6fb62d2e3760 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:48.019466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3ec2c341-cb9a-4093-a8df-dfc386b2060f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:48.028396 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3ec2c341-cb9a-4093-a8df-dfc386b2060f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151218 Jul 26 18:52:48.028962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1861/3745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:47 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:48.076743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d6fc0232-4b5c-43e7-9595-6fb62d2e3760 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:48.085009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d6fc0232-4b5c-43e7-9595-6fb62d2e3760 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155764 Jul 26 18:52:48.085574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1885/3746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:47 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:48.666017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-56b56714-9377-43a3-9c7b-e751d81d9d7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:48.667064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-56b56714-9377-43a3-9c7b-e751d81d9d7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:48.677260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56b56714-9377-43a3-9c7b-e751d81d9d7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:48.677707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56b56714-9377-43a3-9c7b-e751d81d9d7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:48.678458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56b56714-9377-43a3-9c7b-e751d81d9d7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:48.678892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56b56714-9377-43a3-9c7b-e751d81d9d7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:48.823762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-56b56714-9377-43a3-9c7b-e751d81d9d7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:48.832217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-56b56714-9377-43a3-9c7b-e751d81d9d7e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.172984 Jul 26 18:52:48.832829 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1862/3747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:48 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:48.901304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9d6d38d2-b8bc-4118-b417-8d231f2cc28f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:48.902212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9d6d38d2-b8bc-4118-b417-8d231f2cc28f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:48.913016 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d6d38d2-b8bc-4118-b417-8d231f2cc28f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:48.913641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d6d38d2-b8bc-4118-b417-8d231f2cc28f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:48.914412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d6d38d2-b8bc-4118-b417-8d231f2cc28f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:48.914843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d6d38d2-b8bc-4118-b417-8d231f2cc28f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:48.948934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-20546605-3af3-4036-b1b3-aea27a545a77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:48.949849 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-20546605-3af3-4036-b1b3-aea27a545a77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:48.956223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20546605-3af3-4036-b1b3-aea27a545a77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:48.956683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20546605-3af3-4036-b1b3-aea27a545a77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:48.957466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20546605-3af3-4036-b1b3-aea27a545a77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:48.957866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-20546605-3af3-4036-b1b3-aea27a545a77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:48.960540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:49.053080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9d6d38d2-b8bc-4118-b417-8d231f2cc28f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:49.061985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9d6d38d2-b8bc-4118-b417-8d231f2cc28f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:49.063517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9d6d38d2-b8bc-4118-b417-8d231f2cc28f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:49.064674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9d6d38d2-b8bc-4118-b417-8d231f2cc28f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.169835 Jul 26 18:52:49.065449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1886/3748] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:49.069678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-36223a36-1fdf-4c3a-9ca1-fdb4cfef2b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:49.070270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-36223a36-1fdf-4c3a-9ca1-fdb4cfef2b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:49.076526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36223a36-1fdf-4c3a-9ca1-fdb4cfef2b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:49.076967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36223a36-1fdf-4c3a-9ca1-fdb4cfef2b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:49.077712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36223a36-1fdf-4c3a-9ca1-fdb4cfef2b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:49.078140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36223a36-1fdf-4c3a-9ca1-fdb4cfef2b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:49.089495 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-20546605-3af3-4036-b1b3-aea27a545a77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:49.097610 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-20546605-3af3-4036-b1b3-aea27a545a77 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.152640 Jul 26 18:52:49.098301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1863/3749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:48 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:49.106774 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0f7f27d9-17b0-49c2-aaef-bb610c0234e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:49.107570 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0f7f27d9-17b0-49c2-aaef-bb610c0234e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:49.114004 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f7f27d9-17b0-49c2-aaef-bb610c0234e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:49.114521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f7f27d9-17b0-49c2-aaef-bb610c0234e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:49.115374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f7f27d9-17b0-49c2-aaef-bb610c0234e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:49.115873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0f7f27d9-17b0-49c2-aaef-bb610c0234e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:49.211256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-36223a36-1fdf-4c3a-9ca1-fdb4cfef2b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:49.219420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-36223a36-1fdf-4c3a-9ca1-fdb4cfef2b0d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153160 Jul 26 18:52:49.220148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1887/3750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:49 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:49.250000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0f7f27d9-17b0-49c2-aaef-bb610c0234e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:49.262320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0f7f27d9-17b0-49c2-aaef-bb610c0234e9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158886 Jul 26 18:52:49.263133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1864/3751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:49 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:49.858082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7b753819-7765-48f6-a521-91635870026d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:49.859061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7b753819-7765-48f6-a521-91635870026d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:49.862281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:49.871494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b753819-7765-48f6-a521-91635870026d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:49.872402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b753819-7765-48f6-a521-91635870026d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:49.873653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b753819-7765-48f6-a521-91635870026d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:49.874376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b753819-7765-48f6-a521-91635870026d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:50.013908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7b753819-7765-48f6-a521-91635870026d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:50.022934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7b753819-7765-48f6-a521-91635870026d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.171621 Jul 26 18:52:50.023696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1888/3752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:49 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:50.089435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-afdb5d68-5efd-41ea-b4de-bd0356095035 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:50.090045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-afdb5d68-5efd-41ea-b4de-bd0356095035 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:50.093307 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:50.099053 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afdb5d68-5efd-41ea-b4de-bd0356095035 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:50.099739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afdb5d68-5efd-41ea-b4de-bd0356095035 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:50.100844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afdb5d68-5efd-41ea-b4de-bd0356095035 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:50.101500 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-afdb5d68-5efd-41ea-b4de-bd0356095035 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:50.119165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7f39a516-65cb-4761-9439-a03d64a4b7cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:50.119816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7f39a516-65cb-4761-9439-a03d64a4b7cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:50.126284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f39a516-65cb-4761-9439-a03d64a4b7cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:50.126730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f39a516-65cb-4761-9439-a03d64a4b7cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:50.127521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f39a516-65cb-4761-9439-a03d64a4b7cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:50.127949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f39a516-65cb-4761-9439-a03d64a4b7cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:50.130515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:50.238130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-afdb5d68-5efd-41ea-b4de-bd0356095035 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:50.247205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-afdb5d68-5efd-41ea-b4de-bd0356095035 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:50.248764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-afdb5d68-5efd-41ea-b4de-bd0356095035 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:50.249977 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-afdb5d68-5efd-41ea-b4de-bd0356095035 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.165309 Jul 26 18:52:50.250506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1865/3753] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:50 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:50.255520 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-87fa8371-0dc5-42ed-a6e2-f942cafea692 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:50.256150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-87fa8371-0dc5-42ed-a6e2-f942cafea692 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:50.262449 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-87fa8371-0dc5-42ed-a6e2-f942cafea692 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:50.262968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-87fa8371-0dc5-42ed-a6e2-f942cafea692 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:50.263750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-87fa8371-0dc5-42ed-a6e2-f942cafea692 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:50.264197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-87fa8371-0dc5-42ed-a6e2-f942cafea692 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:50.268141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7f39a516-65cb-4761-9439-a03d64a4b7cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:50.277009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7f39a516-65cb-4761-9439-a03d64a4b7cd tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161716 Jul 26 18:52:50.277758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1889/3754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:50 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:50.285623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c3696348-333a-41c1-9db2-89821ee0d76b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:50.286356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c3696348-333a-41c1-9db2-89821ee0d76b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:50.292571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3696348-333a-41c1-9db2-89821ee0d76b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:50.293019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3696348-333a-41c1-9db2-89821ee0d76b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:50.293777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3696348-333a-41c1-9db2-89821ee0d76b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:50.294341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3696348-333a-41c1-9db2-89821ee0d76b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:50.395000 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-87fa8371-0dc5-42ed-a6e2-f942cafea692 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:50.403536 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-87fa8371-0dc5-42ed-a6e2-f942cafea692 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151910 Jul 26 18:52:50.404115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1866/3755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:50 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:50.427806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c3696348-333a-41c1-9db2-89821ee0d76b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:50.439847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c3696348-333a-41c1-9db2-89821ee0d76b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157860 Jul 26 18:52:50.440604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1890/3756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:50 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:51.048858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4433a77a-a765-4ded-b4c4-37de0fc03e9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:51.049859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4433a77a-a765-4ded-b4c4-37de0fc03e9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:51.057064 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4433a77a-a765-4ded-b4c4-37de0fc03e9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:51.057515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4433a77a-a765-4ded-b4c4-37de0fc03e9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:51.058278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4433a77a-a765-4ded-b4c4-37de0fc03e9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:51.058753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4433a77a-a765-4ded-b4c4-37de0fc03e9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:51.196839 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4433a77a-a765-4ded-b4c4-37de0fc03e9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:51.209438 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4433a77a-a765-4ded-b4c4-37de0fc03e9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.166950 Jul 26 18:52:51.210082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1867/3757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:51 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:51.277144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ae3529ce-1dc8-4256-82f9-d8f42c42936c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:51.278046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ae3529ce-1dc8-4256-82f9-d8f42c42936c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:51.287322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae3529ce-1dc8-4256-82f9-d8f42c42936c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:51.287705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae3529ce-1dc8-4256-82f9-d8f42c42936c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:51.288461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae3529ce-1dc8-4256-82f9-d8f42c42936c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:51.288895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae3529ce-1dc8-4256-82f9-d8f42c42936c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:51.299060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ec8a1ea6-e0c6-476d-807c-f9a87e3569d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:51.299724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ec8a1ea6-e0c6-476d-807c-f9a87e3569d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:51.306196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec8a1ea6-e0c6-476d-807c-f9a87e3569d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:51.306651 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec8a1ea6-e0c6-476d-807c-f9a87e3569d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:51.307475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec8a1ea6-e0c6-476d-807c-f9a87e3569d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:51.307915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ec8a1ea6-e0c6-476d-807c-f9a87e3569d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:51.427889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ae3529ce-1dc8-4256-82f9-d8f42c42936c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:51.438662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ae3529ce-1dc8-4256-82f9-d8f42c42936c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:51.440233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ae3529ce-1dc8-4256-82f9-d8f42c42936c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:51.441414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ae3529ce-1dc8-4256-82f9-d8f42c42936c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.170259 Jul 26 18:52:51.442022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1891/3758] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:51.446465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1b83a60e-fa75-4655-b7fa-cd3624c7d924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:51.447093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1b83a60e-fa75-4655-b7fa-cd3624c7d924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:51.448216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ec8a1ea6-e0c6-476d-807c-f9a87e3569d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:51.453473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b83a60e-fa75-4655-b7fa-cd3624c7d924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:51.453926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b83a60e-fa75-4655-b7fa-cd3624c7d924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:51.456370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b83a60e-fa75-4655-b7fa-cd3624c7d924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:51.456370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b83a60e-fa75-4655-b7fa-cd3624c7d924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:51.457066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ec8a1ea6-e0c6-476d-807c-f9a87e3569d4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.162132 Jul 26 18:52:51.457721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1868/3759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:51 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:51.462362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4a51b885-bde1-4588-ae5a-838fe6c183e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:51.463061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4a51b885-bde1-4588-ae5a-838fe6c183e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:51.469005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a51b885-bde1-4588-ae5a-838fe6c183e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:51.469518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a51b885-bde1-4588-ae5a-838fe6c183e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:51.470346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a51b885-bde1-4588-ae5a-838fe6c183e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:51.470865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4a51b885-bde1-4588-ae5a-838fe6c183e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:51.592685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1b83a60e-fa75-4655-b7fa-cd3624c7d924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:51.601256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1b83a60e-fa75-4655-b7fa-cd3624c7d924 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158253 Jul 26 18:52:51.601832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1892/3760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:51 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:51.605399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4a51b885-bde1-4588-ae5a-838fe6c183e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:51.613299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4a51b885-bde1-4588-ae5a-838fe6c183e7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154616 Jul 26 18:52:51.613923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1869/3761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:51 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:52.239334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e12d440c-5d13-4f26-a51a-903f651ac3dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:52.239936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e12d440c-5d13-4f26-a51a-903f651ac3dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:52.246314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e12d440c-5d13-4f26-a51a-903f651ac3dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:52.246752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e12d440c-5d13-4f26-a51a-903f651ac3dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:52.247540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e12d440c-5d13-4f26-a51a-903f651ac3dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:52.247964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e12d440c-5d13-4f26-a51a-903f651ac3dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:52.378513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e12d440c-5d13-4f26-a51a-903f651ac3dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:52.387135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e12d440c-5d13-4f26-a51a-903f651ac3dc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.153638 Jul 26 18:52:52.387718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1893/3762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:52 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:52.468407 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-12bb71ef-23c3-4ba8-8b48-06e03181f38b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:52.469474 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-12bb71ef-23c3-4ba8-8b48-06e03181f38b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:52.480688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12bb71ef-23c3-4ba8-8b48-06e03181f38b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:52.481423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12bb71ef-23c3-4ba8-8b48-06e03181f38b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:52.481682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9817c55c-53db-4f7a-933c-d3415297582e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:52.482442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9817c55c-53db-4f7a-933c-d3415297582e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:52.482723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12bb71ef-23c3-4ba8-8b48-06e03181f38b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:52.483412 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12bb71ef-23c3-4ba8-8b48-06e03181f38b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:52.491304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9817c55c-53db-4f7a-933c-d3415297582e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:52.491754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9817c55c-53db-4f7a-933c-d3415297582e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:52.492511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9817c55c-53db-4f7a-933c-d3415297582e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:52.492938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9817c55c-53db-4f7a-933c-d3415297582e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:52.616961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-12bb71ef-23c3-4ba8-8b48-06e03181f38b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:52.625744 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-12bb71ef-23c3-4ba8-8b48-06e03181f38b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:52.627573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-12bb71ef-23c3-4ba8-8b48-06e03181f38b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:52.628735 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-12bb71ef-23c3-4ba8-8b48-06e03181f38b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.166886 Jul 26 18:52:52.628871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9817c55c-53db-4f7a-933c-d3415297582e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:52.629387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1870/3763] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:52.633790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9b2e3543-54b9-49c2-a228-4f28b8402e8d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:52.634352 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9b2e3543-54b9-49c2-a228-4f28b8402e8d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:52.637832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9817c55c-53db-4f7a-933c-d3415297582e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.162709 Jul 26 18:52:52.638406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1894/3764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:52 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:52.640959 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b2e3543-54b9-49c2-a228-4f28b8402e8d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:52.641594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b2e3543-54b9-49c2-a228-4f28b8402e8d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:52.642501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b2e3543-54b9-49c2-a228-4f28b8402e8d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:52.642903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c3671e8c-38e5-4acd-ab23-34560e0c5e9d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:52.643272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b2e3543-54b9-49c2-a228-4f28b8402e8d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:52.643535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c3671e8c-38e5-4acd-ab23-34560e0c5e9d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:52.649743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3671e8c-38e5-4acd-ab23-34560e0c5e9d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:52.650313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3671e8c-38e5-4acd-ab23-34560e0c5e9d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:52.651090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3671e8c-38e5-4acd-ab23-34560e0c5e9d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:52.651524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c3671e8c-38e5-4acd-ab23-34560e0c5e9d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:52.774801 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9b2e3543-54b9-49c2-a228-4f28b8402e8d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:52.780411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c3671e8c-38e5-4acd-ab23-34560e0c5e9d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:52.786443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9b2e3543-54b9-49c2-a228-4f28b8402e8d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156047 Jul 26 18:52:52.787283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1871/3765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:52 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:52.789396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c3671e8c-38e5-4acd-ab23-34560e0c5e9d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.149980 Jul 26 18:52:52.789957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1895/3766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:52 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:53.414125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1414f617-f77b-43c2-8a61-a1d447955fcc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:53.414644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1414f617-f77b-43c2-8a61-a1d447955fcc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:53.421267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1414f617-f77b-43c2-8a61-a1d447955fcc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:53.421747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1414f617-f77b-43c2-8a61-a1d447955fcc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:53.422504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1414f617-f77b-43c2-8a61-a1d447955fcc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:53.423784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1414f617-f77b-43c2-8a61-a1d447955fcc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:53.577601 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1414f617-f77b-43c2-8a61-a1d447955fcc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:53.590497 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1414f617-f77b-43c2-8a61-a1d447955fcc tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.182773 Jul 26 18:52:53.591293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1872/3767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:53 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:53.652736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3e7c2a74-8895-4778-aeac-579c10b05488 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:53.653374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3e7c2a74-8895-4778-aeac-579c10b05488 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:53.658921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9c4688e7-48ba-45cd-9378-d1595fbd285f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:53.659566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9c4688e7-48ba-45cd-9378-d1595fbd285f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:53.660695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e7c2a74-8895-4778-aeac-579c10b05488 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:53.661120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e7c2a74-8895-4778-aeac-579c10b05488 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:53.662165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e7c2a74-8895-4778-aeac-579c10b05488 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:53.662605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3e7c2a74-8895-4778-aeac-579c10b05488 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:53.665987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9c4688e7-48ba-45cd-9378-d1595fbd285f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:53.666373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9c4688e7-48ba-45cd-9378-d1595fbd285f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:53.667150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9c4688e7-48ba-45cd-9378-d1595fbd285f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:53.667582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9c4688e7-48ba-45cd-9378-d1595fbd285f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:53.799645 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9c4688e7-48ba-45cd-9378-d1595fbd285f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:53.800140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3e7c2a74-8895-4778-aeac-579c10b05488 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:53.808281 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9c4688e7-48ba-45cd-9378-d1595fbd285f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.153046 Jul 26 18:52:53.808819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1873/3768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:53 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:53.809555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3e7c2a74-8895-4778-aeac-579c10b05488 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:53.811483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3e7c2a74-8895-4778-aeac-579c10b05488 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:53.812659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3e7c2a74-8895-4778-aeac-579c10b05488 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.163885 Jul 26 18:52:53.813205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1896/3769] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:53.813463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2320e4b7-7406-44fc-84a5-5a109809f70a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:53.814180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2320e4b7-7406-44fc-84a5-5a109809f70a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:53.818054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ffd9b769-9e3f-41c6-ba55-76052bd41a74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:53.818855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ffd9b769-9e3f-41c6-ba55-76052bd41a74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:53.820169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2320e4b7-7406-44fc-84a5-5a109809f70a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:53.820611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2320e4b7-7406-44fc-84a5-5a109809f70a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:53.821532 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2320e4b7-7406-44fc-84a5-5a109809f70a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:53.822108 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2320e4b7-7406-44fc-84a5-5a109809f70a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:53.825151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ffd9b769-9e3f-41c6-ba55-76052bd41a74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:53.825608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ffd9b769-9e3f-41c6-ba55-76052bd41a74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:53.826334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ffd9b769-9e3f-41c6-ba55-76052bd41a74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:53.826958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ffd9b769-9e3f-41c6-ba55-76052bd41a74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:53.955863 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2320e4b7-7406-44fc-84a5-5a109809f70a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:53.958576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ffd9b769-9e3f-41c6-ba55-76052bd41a74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:53.964335 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2320e4b7-7406-44fc-84a5-5a109809f70a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154383 Jul 26 18:52:53.964905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1874/3770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:53 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:53.966692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ffd9b769-9e3f-41c6-ba55-76052bd41a74 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152200 Jul 26 18:52:53.967328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1897/3771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:53 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:54.618484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ff433b23-9a4a-4976-87ed-ba1a5a366975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:54.619374 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ff433b23-9a4a-4976-87ed-ba1a5a366975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:54.631403 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff433b23-9a4a-4976-87ed-ba1a5a366975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:54.632283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff433b23-9a4a-4976-87ed-ba1a5a366975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:54.633537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff433b23-9a4a-4976-87ed-ba1a5a366975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:54.634276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff433b23-9a4a-4976-87ed-ba1a5a366975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:54.777840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ff433b23-9a4a-4976-87ed-ba1a5a366975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:54.790012 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ff433b23-9a4a-4976-87ed-ba1a5a366975 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.178607 Jul 26 18:52:54.790586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1875/3772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:54 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:54.829728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4176995a-7e8f-4daa-977e-1d6e8a992cd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:54.830348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4176995a-7e8f-4daa-977e-1d6e8a992cd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:54.835198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cf0f8caf-61ae-4813-a8fe-19538d0c69f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:54.835933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cf0f8caf-61ae-4813-a8fe-19538d0c69f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:54.837289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4176995a-7e8f-4daa-977e-1d6e8a992cd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:54.837731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4176995a-7e8f-4daa-977e-1d6e8a992cd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:54.838483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4176995a-7e8f-4daa-977e-1d6e8a992cd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:54.838902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4176995a-7e8f-4daa-977e-1d6e8a992cd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:54.841950 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf0f8caf-61ae-4813-a8fe-19538d0c69f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:54.842404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf0f8caf-61ae-4813-a8fe-19538d0c69f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:54.843172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf0f8caf-61ae-4813-a8fe-19538d0c69f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:54.843604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cf0f8caf-61ae-4813-a8fe-19538d0c69f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:54.970265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cf0f8caf-61ae-4813-a8fe-19538d0c69f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:54.972132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4176995a-7e8f-4daa-977e-1d6e8a992cd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:54.979115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cf0f8caf-61ae-4813-a8fe-19538d0c69f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:54.980798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4176995a-7e8f-4daa-977e-1d6e8a992cd7 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154874 Jul 26 18:52:54.980941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cf0f8caf-61ae-4813-a8fe-19538d0c69f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:54.981385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1898/3773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:54 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:54.982055 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cf0f8caf-61ae-4813-a8fe-19538d0c69f4 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.150696 Jul 26 18:52:54.994966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1876/3774] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:54 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:54.995241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4c6c0b46-eb70-4ca4-835d-f58deafa579d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:54.995241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4c6c0b46-eb70-4ca4-835d-f58deafa579d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:54.995466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3a3215cb-9938-44bf-b8bc-206bd62526f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:54.995466 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3a3215cb-9938-44bf-b8bc-206bd62526f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:54.995666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c6c0b46-eb70-4ca4-835d-f58deafa579d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:54.995666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c6c0b46-eb70-4ca4-835d-f58deafa579d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:54.995666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c6c0b46-eb70-4ca4-835d-f58deafa579d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:54.995666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c6c0b46-eb70-4ca4-835d-f58deafa579d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:54.996619 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a3215cb-9938-44bf-b8bc-206bd62526f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:54.997124 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a3215cb-9938-44bf-b8bc-206bd62526f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:54.997943 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a3215cb-9938-44bf-b8bc-206bd62526f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:54.999080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3a3215cb-9938-44bf-b8bc-206bd62526f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:55.129003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4c6c0b46-eb70-4ca4-835d-f58deafa579d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:55.132278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3a3215cb-9938-44bf-b8bc-206bd62526f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:55.137564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4c6c0b46-eb70-4ca4-835d-f58deafa579d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155178 Jul 26 18:52:55.138112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1899/3775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:54 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:55.140218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3a3215cb-9938-44bf-b8bc-206bd62526f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154376 Jul 26 18:52:55.140771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1877/3776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:54 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:55.815533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2712a5f9-88cb-44b7-8c2a-6beac82373fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:55.816129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2712a5f9-88cb-44b7-8c2a-6beac82373fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:55.823613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2712a5f9-88cb-44b7-8c2a-6beac82373fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:55.824052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2712a5f9-88cb-44b7-8c2a-6beac82373fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:55.824911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2712a5f9-88cb-44b7-8c2a-6beac82373fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:55.825424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2712a5f9-88cb-44b7-8c2a-6beac82373fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:55.974210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2712a5f9-88cb-44b7-8c2a-6beac82373fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:55.982794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2712a5f9-88cb-44b7-8c2a-6beac82373fe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.171312 Jul 26 18:52:55.983484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1900/3777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:55 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:56.001865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-945bddfc-c7cc-4599-af7a-79db64440de4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:56.002423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-945bddfc-c7cc-4599-af7a-79db64440de4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:56.005790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bb6ae505-81ce-4f27-b9ad-0f2a4f0f7f93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:56.006401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bb6ae505-81ce-4f27-b9ad-0f2a4f0f7f93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:56.010048 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-945bddfc-c7cc-4599-af7a-79db64440de4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:56.010198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-945bddfc-c7cc-4599-af7a-79db64440de4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:56.010869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-945bddfc-c7cc-4599-af7a-79db64440de4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:56.011353 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-945bddfc-c7cc-4599-af7a-79db64440de4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:56.014294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb6ae505-81ce-4f27-b9ad-0f2a4f0f7f93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:56.014752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb6ae505-81ce-4f27-b9ad-0f2a4f0f7f93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:56.015587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb6ae505-81ce-4f27-b9ad-0f2a4f0f7f93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:56.016023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb6ae505-81ce-4f27-b9ad-0f2a4f0f7f93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:56.148690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-945bddfc-c7cc-4599-af7a-79db64440de4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:56.159869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-945bddfc-c7cc-4599-af7a-79db64440de4 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161550 Jul 26 18:52:56.160504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1878/3778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:55 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:56.164202 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bb6ae505-81ce-4f27-b9ad-0f2a4f0f7f93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:56.165552 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-58ed1f0e-1a14-4267-ac5e-f58a058fc1d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:56.166140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-58ed1f0e-1a14-4267-ac5e-f58a058fc1d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:56.172543 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58ed1f0e-1a14-4267-ac5e-f58a058fc1d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:56.172970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58ed1f0e-1a14-4267-ac5e-f58a058fc1d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:56.173756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58ed1f0e-1a14-4267-ac5e-f58a058fc1d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:56.174127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bb6ae505-81ce-4f27-b9ad-0f2a4f0f7f93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:56.174331 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-58ed1f0e-1a14-4267-ac5e-f58a058fc1d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:56.175830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bb6ae505-81ce-4f27-b9ad-0f2a4f0f7f93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:56.177212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bb6ae505-81ce-4f27-b9ad-0f2a4f0f7f93 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.175306 Jul 26 18:52:56.177883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1901/3779] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:56 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:56.182548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-74a1ee89-51f6-4b81-b1ed-00b34730d359 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:56.183280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-74a1ee89-51f6-4b81-b1ed-00b34730d359 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:56.189694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74a1ee89-51f6-4b81-b1ed-00b34730d359 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:56.189877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74a1ee89-51f6-4b81-b1ed-00b34730d359 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:56.190644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74a1ee89-51f6-4b81-b1ed-00b34730d359 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:56.191151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-74a1ee89-51f6-4b81-b1ed-00b34730d359 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:56.310843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-58ed1f0e-1a14-4267-ac5e-f58a058fc1d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:56.313087 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:56.320106 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-58ed1f0e-1a14-4267-ac5e-f58a058fc1d4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158249 Jul 26 18:52:56.320680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1879/3780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:56 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:56.330386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-74a1ee89-51f6-4b81-b1ed-00b34730d359 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:56.338997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-74a1ee89-51f6-4b81-b1ed-00b34730d359 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160110 Jul 26 18:52:56.339586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1902/3781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:56 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:57.006318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5d4b9d6c-2ab9-4734-9f54-f56077dc6985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:57.006892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5d4b9d6c-2ab9-4734-9f54-f56077dc6985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:57.014508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5d4b9d6c-2ab9-4734-9f54-f56077dc6985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:57.014949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5d4b9d6c-2ab9-4734-9f54-f56077dc6985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:57.015734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5d4b9d6c-2ab9-4734-9f54-f56077dc6985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:57.016263 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5d4b9d6c-2ab9-4734-9f54-f56077dc6985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:57.162067 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5d4b9d6c-2ab9-4734-9f54-f56077dc6985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:57.170487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5d4b9d6c-2ab9-4734-9f54-f56077dc6985 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.168416 Jul 26 18:52:57.171085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1880/3782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:57 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:57.180976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-744a8b35-1617-44bd-ad16-c3557d48470e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:57.181650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-744a8b35-1617-44bd-ad16-c3557d48470e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:57.188123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-744a8b35-1617-44bd-ad16-c3557d48470e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:57.188562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-744a8b35-1617-44bd-ad16-c3557d48470e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:57.189304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-744a8b35-1617-44bd-ad16-c3557d48470e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:57.189728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-744a8b35-1617-44bd-ad16-c3557d48470e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:57.204913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-97f8f8d3-d135-4790-8843-fa71e29976af tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:57.205139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-97f8f8d3-d135-4790-8843-fa71e29976af tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:57.211654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97f8f8d3-d135-4790-8843-fa71e29976af tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:57.212094 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97f8f8d3-d135-4790-8843-fa71e29976af tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:57.212843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97f8f8d3-d135-4790-8843-fa71e29976af tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:57.213270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-97f8f8d3-d135-4790-8843-fa71e29976af tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:57.323288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-744a8b35-1617-44bd-ad16-c3557d48470e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:57.332143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-744a8b35-1617-44bd-ad16-c3557d48470e tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154951 Jul 26 18:52:57.332685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1903/3783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:57 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:57.346596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-97f8f8d3-d135-4790-8843-fa71e29976af tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:57.349160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-955a3e82-ed31-40d8-8e7b-a2e8264bedd4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:57.349766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-955a3e82-ed31-40d8-8e7b-a2e8264bedd4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:57.355621 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-97f8f8d3-d135-4790-8843-fa71e29976af tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:57.355842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-955a3e82-ed31-40d8-8e7b-a2e8264bedd4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:57.356285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-955a3e82-ed31-40d8-8e7b-a2e8264bedd4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:57.357038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-955a3e82-ed31-40d8-8e7b-a2e8264bedd4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:57.357150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-97f8f8d3-d135-4790-8843-fa71e29976af tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:57.357470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-955a3e82-ed31-40d8-8e7b-a2e8264bedd4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:57.358257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-97f8f8d3-d135-4790-8843-fa71e29976af tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157687 Jul 26 18:52:57.358845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1881/3784] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:57 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:57.363349 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-195b4b47-967a-4022-87c7-e96f4e6ad90f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:57.363981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-195b4b47-967a-4022-87c7-e96f4e6ad90f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:57.370011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-195b4b47-967a-4022-87c7-e96f4e6ad90f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:57.370453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-195b4b47-967a-4022-87c7-e96f4e6ad90f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:57.371210 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-195b4b47-967a-4022-87c7-e96f4e6ad90f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:57.371658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-195b4b47-967a-4022-87c7-e96f4e6ad90f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:57.507718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-195b4b47-967a-4022-87c7-e96f4e6ad90f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:57.507886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-955a3e82-ed31-40d8-8e7b-a2e8264bedd4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:57.515702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-195b4b47-967a-4022-87c7-e96f4e6ad90f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155902 Jul 26 18:52:57.516060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-955a3e82-ed31-40d8-8e7b-a2e8264bedd4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.170844 Jul 26 18:52:57.516269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1882/3785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:57 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:57.516751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1904/3786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:57 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:52:58.196180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1bd4db95-7ee2-4a12-a482-7a4729177ec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:58.197161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1bd4db95-7ee2-4a12-a482-7a4729177ec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:58.208212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1bd4db95-7ee2-4a12-a482-7a4729177ec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:58.208947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1bd4db95-7ee2-4a12-a482-7a4729177ec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:58.210184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1bd4db95-7ee2-4a12-a482-7a4729177ec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:58.210894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1bd4db95-7ee2-4a12-a482-7a4729177ec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:58.353036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1bd4db95-7ee2-4a12-a482-7a4729177ec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:58.353338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-73173e9a-ecc5-476d-9555-9fc6b09e173d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:58.353938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-73173e9a-ecc5-476d-9555-9fc6b09e173d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:58.360625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73173e9a-ecc5-476d-9555-9fc6b09e173d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:58.361069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73173e9a-ecc5-476d-9555-9fc6b09e173d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:58.361234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1bd4db95-7ee2-4a12-a482-7a4729177ec2 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.171741 Jul 26 18:52:58.361752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1883/3787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:58 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:58.361950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73173e9a-ecc5-476d-9555-9fc6b09e173d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:58.362199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-73173e9a-ecc5-476d-9555-9fc6b09e173d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:58.380393 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9b2deacd-c0f2-403c-8570-87a8e27bc541 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:58.381022 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9b2deacd-c0f2-403c-8570-87a8e27bc541 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:58.387293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b2deacd-c0f2-403c-8570-87a8e27bc541 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:58.387846 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b2deacd-c0f2-403c-8570-87a8e27bc541 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:58.388608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b2deacd-c0f2-403c-8570-87a8e27bc541 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:58.389031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9b2deacd-c0f2-403c-8570-87a8e27bc541 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:58.495779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-73173e9a-ecc5-476d-9555-9fc6b09e173d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:58.498025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:52:58.506078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-73173e9a-ecc5-476d-9555-9fc6b09e173d tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156575 Jul 26 18:52:58.519617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1905/3788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:58 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:58.528649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9b2deacd-c0f2-403c-8570-87a8e27bc541 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:58.538330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9b2deacd-c0f2-403c-8570-87a8e27bc541 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:58.538541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-59934e77-6fdc-4fc3-aa5c-b57a7a678951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:58.539082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-59934e77-6fdc-4fc3-aa5c-b57a7a678951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:58.539893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9b2deacd-c0f2-403c-8570-87a8e27bc541 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:58.541082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9b2deacd-c0f2-403c-8570-87a8e27bc541 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.164619 Jul 26 18:52:58.541664 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1884/3789] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:58 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:52:58.545514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59934e77-6fdc-4fc3-aa5c-b57a7a678951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:58.545956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59934e77-6fdc-4fc3-aa5c-b57a7a678951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:58.546213 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8e7730ad-c6eb-49e9-b19e-ca4cedb676eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:58.546703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59934e77-6fdc-4fc3-aa5c-b57a7a678951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:58.546825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8e7730ad-c6eb-49e9-b19e-ca4cedb676eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:58.547152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-59934e77-6fdc-4fc3-aa5c-b57a7a678951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:58.552941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e7730ad-c6eb-49e9-b19e-ca4cedb676eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:58.553402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e7730ad-c6eb-49e9-b19e-ca4cedb676eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:58.554179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e7730ad-c6eb-49e9-b19e-ca4cedb676eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:58.554611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8e7730ad-c6eb-49e9-b19e-ca4cedb676eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:58.679740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-59934e77-6fdc-4fc3-aa5c-b57a7a678951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:58.680778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8e7730ad-c6eb-49e9-b19e-ca4cedb676eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:58.691278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-59934e77-6fdc-4fc3-aa5c-b57a7a678951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156497 Jul 26 18:52:58.691955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8e7730ad-c6eb-49e9-b19e-ca4cedb676eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.149077 Jul 26 18:52:58.692096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1906/3790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:58 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:58.692525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1885/3791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:58 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:59.387473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5fd65881-5420-491b-9650-493408980d9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:59.388395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5fd65881-5420-491b-9650-493408980d9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:59.399676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fd65881-5420-491b-9650-493408980d9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:59.400429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fd65881-5420-491b-9650-493408980d9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:59.401665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fd65881-5420-491b-9650-493408980d9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:59.402393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fd65881-5420-491b-9650-493408980d9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:59.528230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-fd58f6a2-7d3f-4bd2-ba63-c0c424661aed tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:59.528826 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-fd58f6a2-7d3f-4bd2-ba63-c0c424661aed tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:59.534142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5fd65881-5420-491b-9650-493408980d9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:59.535898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd58f6a2-7d3f-4bd2-ba63-c0c424661aed tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:59.536348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd58f6a2-7d3f-4bd2-ba63-c0c424661aed tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:59.537140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd58f6a2-7d3f-4bd2-ba63-c0c424661aed tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:59.537579 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-fd58f6a2-7d3f-4bd2-ba63-c0c424661aed tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:59.542662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5fd65881-5420-491b-9650-493408980d9a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161809 Jul 26 18:52:59.552025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1907/3792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:59 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:59.563881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a40048ec-af79-48d5-9199-97723d3b3d51 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:59.564862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a40048ec-af79-48d5-9199-97723d3b3d51 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:59.571491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a40048ec-af79-48d5-9199-97723d3b3d51 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:59.572104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a40048ec-af79-48d5-9199-97723d3b3d51 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:59.572874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a40048ec-af79-48d5-9199-97723d3b3d51 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:59.573312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a40048ec-af79-48d5-9199-97723d3b3d51 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:59.672217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-fd58f6a2-7d3f-4bd2-ba63-c0c424661aed tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:59.680568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-fd58f6a2-7d3f-4bd2-ba63-c0c424661aed tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156314 Jul 26 18:52:59.681107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1886/3793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:59 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:59.702741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a40048ec-af79-48d5-9199-97723d3b3d51 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:59.711742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a40048ec-af79-48d5-9199-97723d3b3d51 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:59.713208 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e3ddb680-14d9-45bb-a536-fc647451db8a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:59.713364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a40048ec-af79-48d5-9199-97723d3b3d51 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:59.713810 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e3ddb680-14d9-45bb-a536-fc647451db8a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:59.714385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a40048ec-af79-48d5-9199-97723d3b3d51 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.154398 Jul 26 18:52:59.714936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1908/3794] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:52:59 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:52:59.719270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0c63b8a9-3d88-43d0-a96f-45e4ceffff35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:52:59.719811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3ddb680-14d9-45bb-a536-fc647451db8a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:59.719951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0c63b8a9-3d88-43d0-a96f-45e4ceffff35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:52:59.720250 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3ddb680-14d9-45bb-a536-fc647451db8a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:59.720994 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3ddb680-14d9-45bb-a536-fc647451db8a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:59.721476 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3ddb680-14d9-45bb-a536-fc647451db8a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:59.726017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c63b8a9-3d88-43d0-a96f-45e4ceffff35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:59.726471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c63b8a9-3d88-43d0-a96f-45e4ceffff35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:59.727249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c63b8a9-3d88-43d0-a96f-45e4ceffff35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:52:59.727680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c63b8a9-3d88-43d0-a96f-45e4ceffff35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:52:59.858380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0c63b8a9-3d88-43d0-a96f-45e4ceffff35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:59.861475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e3ddb680-14d9-45bb-a536-fc647451db8a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:52:59.867298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0c63b8a9-3d88-43d0-a96f-45e4ceffff35 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151274 Jul 26 18:52:59.868176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1909/3795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:59 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:52:59.872357 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e3ddb680-14d9-45bb-a536-fc647451db8a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162718 Jul 26 18:52:59.872967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1887/3796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:52:59 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:00.568308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3220064c-ea96-4d36-a827-494c8e1565ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:00.569418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3220064c-ea96-4d36-a827-494c8e1565ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:00.580493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3220064c-ea96-4d36-a827-494c8e1565ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:00.581234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3220064c-ea96-4d36-a827-494c8e1565ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:00.582532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3220064c-ea96-4d36-a827-494c8e1565ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:00.582966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3220064c-ea96-4d36-a827-494c8e1565ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:00.701575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e719b76a-07d6-46d9-8293-b25062830a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:00.702176 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e719b76a-07d6-46d9-8293-b25062830a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:00.709274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e719b76a-07d6-46d9-8293-b25062830a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:00.709711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e719b76a-07d6-46d9-8293-b25062830a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:00.710441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e719b76a-07d6-46d9-8293-b25062830a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:00.710866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e719b76a-07d6-46d9-8293-b25062830a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:00.713253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3220064c-ea96-4d36-a827-494c8e1565ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:00.721624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3220064c-ea96-4d36-a827-494c8e1565ed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159774 Jul 26 18:53:00.722237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1910/3797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:00 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:00.737715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1f705e88-bd3f-4838-a74f-b49b4190f554 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:00.738317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1f705e88-bd3f-4838-a74f-b49b4190f554 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:00.744531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f705e88-bd3f-4838-a74f-b49b4190f554 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:00.744974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f705e88-bd3f-4838-a74f-b49b4190f554 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:00.745756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f705e88-bd3f-4838-a74f-b49b4190f554 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:00.746183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f705e88-bd3f-4838-a74f-b49b4190f554 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:00.846522 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e719b76a-07d6-46d9-8293-b25062830a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:00.854641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e719b76a-07d6-46d9-8293-b25062830a9c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156943 Jul 26 18:53:00.855291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1888/3798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:00 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:00.884098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1f705e88-bd3f-4838-a74f-b49b4190f554 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:00.888726 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5fd39c64-e78f-4842-8622-09e3ae17050f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:00.889337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5fd39c64-e78f-4842-8622-09e3ae17050f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:00.892700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1f705e88-bd3f-4838-a74f-b49b4190f554 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:00.894199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1f705e88-bd3f-4838-a74f-b49b4190f554 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:00.895381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1f705e88-bd3f-4838-a74f-b49b4190f554 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161530 Jul 26 18:53:00.895517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5fd39c64-e78f-4842-8622-09e3ae17050f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:00.895859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5fd39c64-e78f-4842-8622-09e3ae17050f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:00.896310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1911/3799] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:00 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:00.896958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5fd39c64-e78f-4842-8622-09e3ae17050f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:00.897391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5fd39c64-e78f-4842-8622-09e3ae17050f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:00.900525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4c77c6e6-e4fc-4fd3-8dbd-4391e5c14ef3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:00.902314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4c77c6e6-e4fc-4fd3-8dbd-4391e5c14ef3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:00.906752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c77c6e6-e4fc-4fd3-8dbd-4391e5c14ef3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:00.907229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c77c6e6-e4fc-4fd3-8dbd-4391e5c14ef3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:00.907993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c77c6e6-e4fc-4fd3-8dbd-4391e5c14ef3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:00.908406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c77c6e6-e4fc-4fd3-8dbd-4391e5c14ef3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:01.038898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5fd39c64-e78f-4842-8622-09e3ae17050f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:01.039772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4c77c6e6-e4fc-4fd3-8dbd-4391e5c14ef3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:01.047245 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5fd39c64-e78f-4842-8622-09e3ae17050f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.162231 Jul 26 18:53:01.047853 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1889/3800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:00 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:01.052303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4c77c6e6-e4fc-4fd3-8dbd-4391e5c14ef3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154782 Jul 26 18:53:01.053205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1912/3801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:00 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:01.745910 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-eaa068f2-b9b3-48be-83a7-5ead2326dab8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:01.746653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-eaa068f2-b9b3-48be-83a7-5ead2326dab8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:01.756338 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eaa068f2-b9b3-48be-83a7-5ead2326dab8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:01.756787 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eaa068f2-b9b3-48be-83a7-5ead2326dab8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:01.757538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eaa068f2-b9b3-48be-83a7-5ead2326dab8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:01.757945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-eaa068f2-b9b3-48be-83a7-5ead2326dab8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:01.876235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-81e66671-d357-4fc7-9cb0-2865252337b8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:01.877032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-81e66671-d357-4fc7-9cb0-2865252337b8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:01.884847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81e66671-d357-4fc7-9cb0-2865252337b8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:01.885305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81e66671-d357-4fc7-9cb0-2865252337b8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:01.886072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81e66671-d357-4fc7-9cb0-2865252337b8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:01.886505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81e66671-d357-4fc7-9cb0-2865252337b8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:01.889916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-eaa068f2-b9b3-48be-83a7-5ead2326dab8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:01.898656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-eaa068f2-b9b3-48be-83a7-5ead2326dab8 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158929 Jul 26 18:53:01.899317 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1890/3802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:01 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:01.918680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dfd74a6c-2cd0-47d3-b652-40c2cc3685a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:01.919237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dfd74a6c-2cd0-47d3-b652-40c2cc3685a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:01.925513 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dfd74a6c-2cd0-47d3-b652-40c2cc3685a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:01.925961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dfd74a6c-2cd0-47d3-b652-40c2cc3685a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:01.926718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dfd74a6c-2cd0-47d3-b652-40c2cc3685a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:01.927183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dfd74a6c-2cd0-47d3-b652-40c2cc3685a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:02.022326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-81e66671-d357-4fc7-9cb0-2865252337b8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:02.031129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-81e66671-d357-4fc7-9cb0-2865252337b8 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.159060 Jul 26 18:53:02.031751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1913/3803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:01 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:02.061995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dfd74a6c-2cd0-47d3-b652-40c2cc3685a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:02.067796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-612c184a-0512-4851-9a14-ed4ef612a87f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:02.068404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-612c184a-0512-4851-9a14-ed4ef612a87f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:02.071327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dfd74a6c-2cd0-47d3-b652-40c2cc3685a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:02.072604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dfd74a6c-2cd0-47d3-b652-40c2cc3685a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:02.073771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dfd74a6c-2cd0-47d3-b652-40c2cc3685a6 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158894 Jul 26 18:53:02.084147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1891/3804] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:01 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:02.084705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-612c184a-0512-4851-9a14-ed4ef612a87f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:02.084705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-612c184a-0512-4851-9a14-ed4ef612a87f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:02.084705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-612c184a-0512-4851-9a14-ed4ef612a87f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:02.084705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-612c184a-0512-4851-9a14-ed4ef612a87f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:02.085183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b5a01ce3-bf9f-443d-9f05-6c481c3438ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:02.085183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b5a01ce3-bf9f-443d-9f05-6c481c3438ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:02.089181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5a01ce3-bf9f-443d-9f05-6c481c3438ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:02.089181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5a01ce3-bf9f-443d-9f05-6c481c3438ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:02.089181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5a01ce3-bf9f-443d-9f05-6c481c3438ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:02.089181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b5a01ce3-bf9f-443d-9f05-6c481c3438ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:02.208060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-612c184a-0512-4851-9a14-ed4ef612a87f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:02.216267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-612c184a-0512-4851-9a14-ed4ef612a87f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152247 Jul 26 18:53:02.216841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1914/3805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:02 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:02.218569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b5a01ce3-bf9f-443d-9f05-6c481c3438ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:02.226803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b5a01ce3-bf9f-443d-9f05-6c481c3438ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.151505 Jul 26 18:53:02.227413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1892/3806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:02.924298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e48828ab-9bed-4865-bf4b-30279e1bfa86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:02.925241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e48828ab-9bed-4865-bf4b-30279e1bfa86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:02.933431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e48828ab-9bed-4865-bf4b-30279e1bfa86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:02.933928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e48828ab-9bed-4865-bf4b-30279e1bfa86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:02.934763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e48828ab-9bed-4865-bf4b-30279e1bfa86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:02.935286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e48828ab-9bed-4865-bf4b-30279e1bfa86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:03.052492 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-44e9af7d-ca7f-4b68-9727-3521f37fa681 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:03.053104 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-44e9af7d-ca7f-4b68-9727-3521f37fa681 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:03.059944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44e9af7d-ca7f-4b68-9727-3521f37fa681 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:03.060385 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44e9af7d-ca7f-4b68-9727-3521f37fa681 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:03.061139 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44e9af7d-ca7f-4b68-9727-3521f37fa681 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:03.061586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44e9af7d-ca7f-4b68-9727-3521f37fa681 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:03.067257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e48828ab-9bed-4865-bf4b-30279e1bfa86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:03.075492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e48828ab-9bed-4865-bf4b-30279e1bfa86 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.157642 Jul 26 18:53:03.076070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1915/3807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:02 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:03.101374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5237f96a-af59-4939-9a7f-dfce7cdcbf23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:03.102001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5237f96a-af59-4939-9a7f-dfce7cdcbf23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:03.108042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5237f96a-af59-4939-9a7f-dfce7cdcbf23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:03.108481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5237f96a-af59-4939-9a7f-dfce7cdcbf23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:03.109235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5237f96a-af59-4939-9a7f-dfce7cdcbf23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:03.109673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5237f96a-af59-4939-9a7f-dfce7cdcbf23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:03.196783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-44e9af7d-ca7f-4b68-9727-3521f37fa681 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:03.204780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-44e9af7d-ca7f-4b68-9727-3521f37fa681 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156483 Jul 26 18:53:03.205350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1893/3808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:03 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:03.238411 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0ff93161-40be-4b69-b6bf-fe21134ad374 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:03.239274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0ff93161-40be-4b69-b6bf-fe21134ad374 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:03.242950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5237f96a-af59-4939-9a7f-dfce7cdcbf23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:03.245292 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ff93161-40be-4b69-b6bf-fe21134ad374 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:03.245733 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ff93161-40be-4b69-b6bf-fe21134ad374 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:03.246484 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ff93161-40be-4b69-b6bf-fe21134ad374 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:03.246913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ff93161-40be-4b69-b6bf-fe21134ad374 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:03.251659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5237f96a-af59-4939-9a7f-dfce7cdcbf23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:03.253148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5237f96a-af59-4939-9a7f-dfce7cdcbf23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:03.254298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5237f96a-af59-4939-9a7f-dfce7cdcbf23 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156802 Jul 26 18:53:03.254949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1916/3809] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:03 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:53:03.259536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5d51902c-9743-4ddf-8e08-727d60d650d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:03.260124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5d51902c-9743-4ddf-8e08-727d60d650d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:03.268038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d51902c-9743-4ddf-8e08-727d60d650d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:03.268410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d51902c-9743-4ddf-8e08-727d60d650d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:03.269149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d51902c-9743-4ddf-8e08-727d60d650d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:03.269577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d51902c-9743-4ddf-8e08-727d60d650d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:03.376599 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0ff93161-40be-4b69-b6bf-fe21134ad374 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:03.384749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0ff93161-40be-4b69-b6bf-fe21134ad374 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.150409 Jul 26 18:53:03.385318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1894/3810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:03 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:03.399094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5d51902c-9743-4ddf-8e08-727d60d650d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:03.407266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5d51902c-9743-4ddf-8e08-727d60d650d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.151267 Jul 26 18:53:03.407801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1917/3811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:03 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:04.100197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0e6e312b-657f-41bb-bcad-37a2bfcbfbce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:04.100973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0e6e312b-657f-41bb-bcad-37a2bfcbfbce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:04.110178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e6e312b-657f-41bb-bcad-37a2bfcbfbce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:04.110736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e6e312b-657f-41bb-bcad-37a2bfcbfbce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:04.111731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e6e312b-657f-41bb-bcad-37a2bfcbfbce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:04.112267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0e6e312b-657f-41bb-bcad-37a2bfcbfbce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:04.226343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-db98c2ea-ac8b-4121-9a4f-780af20bab74 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:04.226902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-db98c2ea-ac8b-4121-9a4f-780af20bab74 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:04.233893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db98c2ea-ac8b-4121-9a4f-780af20bab74 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:04.234338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db98c2ea-ac8b-4121-9a4f-780af20bab74 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:04.235131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db98c2ea-ac8b-4121-9a4f-780af20bab74 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:04.235563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db98c2ea-ac8b-4121-9a4f-780af20bab74 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:04.261581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0e6e312b-657f-41bb-bcad-37a2bfcbfbce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:04.270589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0e6e312b-657f-41bb-bcad-37a2bfcbfbce tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.176632 Jul 26 18:53:04.272496 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1895/3812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:04 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:04.279342 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a89dbe54-23b6-4f91-8614-6dcd304fbfe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:04.279970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a89dbe54-23b6-4f91-8614-6dcd304fbfe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:04.286268 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a89dbe54-23b6-4f91-8614-6dcd304fbfe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:04.286711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a89dbe54-23b6-4f91-8614-6dcd304fbfe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:04.287574 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a89dbe54-23b6-4f91-8614-6dcd304fbfe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:04.288008 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a89dbe54-23b6-4f91-8614-6dcd304fbfe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:04.303336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:04.373537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-db98c2ea-ac8b-4121-9a4f-780af20bab74 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:04.382421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-db98c2ea-ac8b-4121-9a4f-780af20bab74 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.160203 Jul 26 18:53:04.383272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1918/3813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:04 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:04.405706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e188190f-1c35-4075-9bd1-de222e917f74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:04.406332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e188190f-1c35-4075-9bd1-de222e917f74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:04.412662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e188190f-1c35-4075-9bd1-de222e917f74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:04.413118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e188190f-1c35-4075-9bd1-de222e917f74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:04.413883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e188190f-1c35-4075-9bd1-de222e917f74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:04.414348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e188190f-1c35-4075-9bd1-de222e917f74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:04.423887 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a89dbe54-23b6-4f91-8614-6dcd304fbfe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:04.433045 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a89dbe54-23b6-4f91-8614-6dcd304fbfe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:04.434563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a89dbe54-23b6-4f91-8614-6dcd304fbfe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:04.435794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a89dbe54-23b6-4f91-8614-6dcd304fbfe1 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160280 Jul 26 18:53:04.436369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1896/3814] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:04 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:53:04.440920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-889f0a4d-3a16-43c6-a91c-9a455655557a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:04.441534 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-889f0a4d-3a16-43c6-a91c-9a455655557a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:04.447924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-889f0a4d-3a16-43c6-a91c-9a455655557a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:04.448382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-889f0a4d-3a16-43c6-a91c-9a455655557a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:04.449149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-889f0a4d-3a16-43c6-a91c-9a455655557a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:04.449586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-889f0a4d-3a16-43c6-a91c-9a455655557a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:04.550535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e188190f-1c35-4075-9bd1-de222e917f74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:04.559299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e188190f-1c35-4075-9bd1-de222e917f74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157385 Jul 26 18:53:04.559906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1919/3815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:04 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:04.581256 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-889f0a4d-3a16-43c6-a91c-9a455655557a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:04.589684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-889f0a4d-3a16-43c6-a91c-9a455655557a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152324 Jul 26 18:53:04.590272 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1897/3816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:04 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:05.292741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ba82f6a7-f389-4b23-81b8-c447e80b2518 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:05.293336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ba82f6a7-f389-4b23-81b8-c447e80b2518 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:05.300715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba82f6a7-f389-4b23-81b8-c447e80b2518 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:05.301164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba82f6a7-f389-4b23-81b8-c447e80b2518 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:05.301913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba82f6a7-f389-4b23-81b8-c447e80b2518 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:05.302340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba82f6a7-f389-4b23-81b8-c447e80b2518 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:05.404458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5f4e1d25-56c3-4109-9e74-02469fcefd6a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:05.405170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5f4e1d25-56c3-4109-9e74-02469fcefd6a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:05.412389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f4e1d25-56c3-4109-9e74-02469fcefd6a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:05.413095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f4e1d25-56c3-4109-9e74-02469fcefd6a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:05.413936 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f4e1d25-56c3-4109-9e74-02469fcefd6a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:05.414415 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f4e1d25-56c3-4109-9e74-02469fcefd6a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:05.478571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ba82f6a7-f389-4b23-81b8-c447e80b2518 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:05.487063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ba82f6a7-f389-4b23-81b8-c447e80b2518 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.198478 Jul 26 18:53:05.487658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1920/3817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:05 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:05.505522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ebd89d7e-1a63-4999-8066-814e55712aae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:05.506208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ebd89d7e-1a63-4999-8066-814e55712aae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:05.512750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ebd89d7e-1a63-4999-8066-814e55712aae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:05.513238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ebd89d7e-1a63-4999-8066-814e55712aae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:05.514021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ebd89d7e-1a63-4999-8066-814e55712aae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:05.514419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ebd89d7e-1a63-4999-8066-814e55712aae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:05.554131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5f4e1d25-56c3-4109-9e74-02469fcefd6a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:05.562780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5f4e1d25-56c3-4109-9e74-02469fcefd6a tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.162297 Jul 26 18:53:05.563867 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1898/3818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:05 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:05.581649 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-186124b6-8e4b-45e6-9925-bf92412db13f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:05.582341 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-186124b6-8e4b-45e6-9925-bf92412db13f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:05.589555 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-186124b6-8e4b-45e6-9925-bf92412db13f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:05.590161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-186124b6-8e4b-45e6-9925-bf92412db13f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:05.590939 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-186124b6-8e4b-45e6-9925-bf92412db13f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:05.591417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-186124b6-8e4b-45e6-9925-bf92412db13f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:05.726803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-186124b6-8e4b-45e6-9925-bf92412db13f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:05.735379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-186124b6-8e4b-45e6-9925-bf92412db13f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158444 Jul 26 18:53:05.735991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1899/3819] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:05 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:05.739787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ebd89d7e-1a63-4999-8066-814e55712aae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:05.740566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b3f55f8c-5213-4308-aaf5-6282b404cc34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:05.741351 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b3f55f8c-5213-4308-aaf5-6282b404cc34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:05.747898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3f55f8c-5213-4308-aaf5-6282b404cc34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:05.748355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3f55f8c-5213-4308-aaf5-6282b404cc34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:05.749198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3f55f8c-5213-4308-aaf5-6282b404cc34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:05.749631 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3f55f8c-5213-4308-aaf5-6282b404cc34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:05.758622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ebd89d7e-1a63-4999-8066-814e55712aae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:05.760278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ebd89d7e-1a63-4999-8066-814e55712aae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:05.761505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ebd89d7e-1a63-4999-8066-814e55712aae tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.259979 Jul 26 18:53:05.762301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1921/3820] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:05 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:05.900288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b3f55f8c-5213-4308-aaf5-6282b404cc34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:05.908858 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b3f55f8c-5213-4308-aaf5-6282b404cc34 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.171868 Jul 26 18:53:05.909458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1900/3821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:05 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:06.513239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f01098aa-6311-4fbe-803d-8b069093dd6f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:06.514241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f01098aa-6311-4fbe-803d-8b069093dd6f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:06.525035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f01098aa-6311-4fbe-803d-8b069093dd6f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:06.525649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f01098aa-6311-4fbe-803d-8b069093dd6f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:06.526962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f01098aa-6311-4fbe-803d-8b069093dd6f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:06.527516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f01098aa-6311-4fbe-803d-8b069093dd6f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:06.545232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:06.592958 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f2f70649-7cdb-48d3-81df-2646a8620dc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:06.593668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f2f70649-7cdb-48d3-81df-2646a8620dc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:06.600976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2f70649-7cdb-48d3-81df-2646a8620dc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:06.601419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2f70649-7cdb-48d3-81df-2646a8620dc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:06.602198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2f70649-7cdb-48d3-81df-2646a8620dc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:06.602622 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f2f70649-7cdb-48d3-81df-2646a8620dc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:06.674503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f01098aa-6311-4fbe-803d-8b069093dd6f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:06.683311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f01098aa-6311-4fbe-803d-8b069093dd6f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.176885 Jul 26 18:53:06.683980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1922/3822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:06 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:06.741907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f2f70649-7cdb-48d3-81df-2646a8620dc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:06.750641 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f2f70649-7cdb-48d3-81df-2646a8620dc2 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.161548 Jul 26 18:53:06.751261 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1901/3823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:06 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:06.786404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-91d55b68-f2a0-49e2-b183-5fd7914a64d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:06.786983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-91d55b68-f2a0-49e2-b183-5fd7914a64d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:06.793854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91d55b68-f2a0-49e2-b183-5fd7914a64d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:06.794300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91d55b68-f2a0-49e2-b183-5fd7914a64d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:06.795050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91d55b68-f2a0-49e2-b183-5fd7914a64d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:06.795515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91d55b68-f2a0-49e2-b183-5fd7914a64d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:06.820842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-56cbf846-d7ee-4eab-906f-33c2148f433b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:06.821630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-56cbf846-d7ee-4eab-906f-33c2148f433b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:06.827921 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56cbf846-d7ee-4eab-906f-33c2148f433b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:06.828372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56cbf846-d7ee-4eab-906f-33c2148f433b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:06.829140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56cbf846-d7ee-4eab-906f-33c2148f433b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:06.829573 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56cbf846-d7ee-4eab-906f-33c2148f433b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:06.931945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-91d55b68-f2a0-49e2-b183-5fd7914a64d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:06.940419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-91d55b68-f2a0-49e2-b183-5fd7914a64d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:06.941961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-91d55b68-f2a0-49e2-b183-5fd7914a64d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:06.943298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-91d55b68-f2a0-49e2-b183-5fd7914a64d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161035 Jul 26 18:53:06.943828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1923/3824] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:06 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:06.948607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dd5960d2-63f9-40f4-9ecb-09f231e7de16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:06.948903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dd5960d2-63f9-40f4-9ecb-09f231e7de16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:06.956859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd5960d2-63f9-40f4-9ecb-09f231e7de16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:06.958766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd5960d2-63f9-40f4-9ecb-09f231e7de16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:06.959618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd5960d2-63f9-40f4-9ecb-09f231e7de16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:06.960040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd5960d2-63f9-40f4-9ecb-09f231e7de16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:06.964442 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-56cbf846-d7ee-4eab-906f-33c2148f433b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:06.974402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-56cbf846-d7ee-4eab-906f-33c2148f433b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.157564 Jul 26 18:53:06.974982 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1902/3825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:06 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:07.090354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dd5960d2-63f9-40f4-9ecb-09f231e7de16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:07.098698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dd5960d2-63f9-40f4-9ecb-09f231e7de16 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.153912 Jul 26 18:53:07.099316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1924/3826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:06 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:07.709701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-daea678c-88a2-43b0-99a5-1fd75f0f373c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:07.710729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-daea678c-88a2-43b0-99a5-1fd75f0f373c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:07.721857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-daea678c-88a2-43b0-99a5-1fd75f0f373c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:07.722588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-daea678c-88a2-43b0-99a5-1fd75f0f373c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:07.723873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-daea678c-88a2-43b0-99a5-1fd75f0f373c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:07.724580 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-daea678c-88a2-43b0-99a5-1fd75f0f373c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:07.771699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b7d2c6df-81e5-4a62-8c91-a3d754df734b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:07.772343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b7d2c6df-81e5-4a62-8c91-a3d754df734b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:07.779590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7d2c6df-81e5-4a62-8c91-a3d754df734b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:07.780048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7d2c6df-81e5-4a62-8c91-a3d754df734b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:07.780820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7d2c6df-81e5-4a62-8c91-a3d754df734b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:07.781247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b7d2c6df-81e5-4a62-8c91-a3d754df734b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:07.862816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-daea678c-88a2-43b0-99a5-1fd75f0f373c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:07.871291 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-daea678c-88a2-43b0-99a5-1fd75f0f373c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.168098 Jul 26 18:53:07.871869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1903/3827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:07 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:07.913266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b7d2c6df-81e5-4a62-8c91-a3d754df734b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:07.921893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b7d2c6df-81e5-4a62-8c91-a3d754df734b tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.154470 Jul 26 18:53:07.922461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1925/3828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:07 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:07.970505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4c588bff-7d08-4dcc-8417-e7e3fde38857 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:07.971141 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4c588bff-7d08-4dcc-8417-e7e3fde38857 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:07.977822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c588bff-7d08-4dcc-8417-e7e3fde38857 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:07.978276 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c588bff-7d08-4dcc-8417-e7e3fde38857 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:07.979061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c588bff-7d08-4dcc-8417-e7e3fde38857 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:07.979504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c588bff-7d08-4dcc-8417-e7e3fde38857 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:07.995156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4a40dc5f-d87e-4917-9593-0ef6b4c15b21 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:07.995760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4a40dc5f-d87e-4917-9593-0ef6b4c15b21 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:08.002171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a40dc5f-d87e-4917-9593-0ef6b4c15b21 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:08.002648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a40dc5f-d87e-4917-9593-0ef6b4c15b21 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:08.003454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a40dc5f-d87e-4917-9593-0ef6b4c15b21 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:08.003888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a40dc5f-d87e-4917-9593-0ef6b4c15b21 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:08.114509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4c588bff-7d08-4dcc-8417-e7e3fde38857 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:08.123486 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4c588bff-7d08-4dcc-8417-e7e3fde38857 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:08.125017 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4c588bff-7d08-4dcc-8417-e7e3fde38857 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:08.126193 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4c588bff-7d08-4dcc-8417-e7e3fde38857 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159647 Jul 26 18:53:08.127248 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1904/3829] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:07 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:08.131278 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ad51813f-12ea-4be1-bb77-b69428e6da98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:08.131880 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ad51813f-12ea-4be1-bb77-b69428e6da98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:08.137946 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad51813f-12ea-4be1-bb77-b69428e6da98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:08.138391 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad51813f-12ea-4be1-bb77-b69428e6da98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:08.139230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad51813f-12ea-4be1-bb77-b69428e6da98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:08.139667 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ad51813f-12ea-4be1-bb77-b69428e6da98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:08.145023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4a40dc5f-d87e-4917-9593-0ef6b4c15b21 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:08.153815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4a40dc5f-d87e-4917-9593-0ef6b4c15b21 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.162590 Jul 26 18:53:08.154412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1926/3830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:07 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:08.274216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ad51813f-12ea-4be1-bb77-b69428e6da98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:08.286319 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ad51813f-12ea-4be1-bb77-b69428e6da98 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158151 Jul 26 18:53:08.287224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1905/3831] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:08.898349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-487bd5b6-e4d0-4bbf-9c17-296e916fb81f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:08.899357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-487bd5b6-e4d0-4bbf-9c17-296e916fb81f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:08.906545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-487bd5b6-e4d0-4bbf-9c17-296e916fb81f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:08.906987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-487bd5b6-e4d0-4bbf-9c17-296e916fb81f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:08.907770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-487bd5b6-e4d0-4bbf-9c17-296e916fb81f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:08.908193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-487bd5b6-e4d0-4bbf-9c17-296e916fb81f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:08.942998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5d27eda3-b66f-4f64-a25f-c8f9b4870d16 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:08.943697 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5d27eda3-b66f-4f64-a25f-c8f9b4870d16 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:08.952780 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5d27eda3-b66f-4f64-a25f-c8f9b4870d16 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:08.953230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5d27eda3-b66f-4f64-a25f-c8f9b4870d16 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:08.954001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5d27eda3-b66f-4f64-a25f-c8f9b4870d16 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:08.954425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5d27eda3-b66f-4f64-a25f-c8f9b4870d16 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:09.046727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-487bd5b6-e4d0-4bbf-9c17-296e916fb81f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:09.054899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-487bd5b6-e4d0-4bbf-9c17-296e916fb81f tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164118 Jul 26 18:53:09.055611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1927/3832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:08 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:09.090136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5d27eda3-b66f-4f64-a25f-c8f9b4870d16 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:09.098884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5d27eda3-b66f-4f64-a25f-c8f9b4870d16 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.159790 Jul 26 18:53:09.099530 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1906/3833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:08 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:09.149908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f29ac475-fc4e-4133-92c1-77e86affceda tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:09.150516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f29ac475-fc4e-4133-92c1-77e86affceda tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:09.156728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f29ac475-fc4e-4133-92c1-77e86affceda tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:09.157178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f29ac475-fc4e-4133-92c1-77e86affceda tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:09.157941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f29ac475-fc4e-4133-92c1-77e86affceda tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:09.158361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f29ac475-fc4e-4133-92c1-77e86affceda tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:09.175979 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-83681e4b-4174-42fa-b209-b164483d4a39 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:09.176581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-83681e4b-4174-42fa-b209-b164483d4a39 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:09.182694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83681e4b-4174-42fa-b209-b164483d4a39 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:09.183198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83681e4b-4174-42fa-b209-b164483d4a39 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:09.183992 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83681e4b-4174-42fa-b209-b164483d4a39 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:09.184435 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-83681e4b-4174-42fa-b209-b164483d4a39 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:09.293198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f29ac475-fc4e-4133-92c1-77e86affceda tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:09.301742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f29ac475-fc4e-4133-92c1-77e86affceda tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:09.303349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f29ac475-fc4e-4133-92c1-77e86affceda tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:09.304510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f29ac475-fc4e-4133-92c1-77e86affceda tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159041 Jul 26 18:53:09.305099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1928/3834] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:09 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:09.309593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-df035841-9521-4f01-9eb1-400f027e461f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:09.310186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-df035841-9521-4f01-9eb1-400f027e461f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:09.317810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df035841-9521-4f01-9eb1-400f027e461f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:09.318996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df035841-9521-4f01-9eb1-400f027e461f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:09.320122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df035841-9521-4f01-9eb1-400f027e461f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:09.320742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-df035841-9521-4f01-9eb1-400f027e461f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:09.325036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-83681e4b-4174-42fa-b209-b164483d4a39 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:09.333364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-83681e4b-4174-42fa-b209-b164483d4a39 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161170 Jul 26 18:53:09.334153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1907/3835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:09 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:09.454775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-df035841-9521-4f01-9eb1-400f027e461f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:09.463725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-df035841-9521-4f01-9eb1-400f027e461f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157697 Jul 26 18:53:09.464291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1929/3836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:09 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:10.080129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2e1d97be-cf57-4ddf-86a0-29ff1762fb95 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:10.081119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2e1d97be-cf57-4ddf-86a0-29ff1762fb95 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:10.092745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e1d97be-cf57-4ddf-86a0-29ff1762fb95 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:10.093518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e1d97be-cf57-4ddf-86a0-29ff1762fb95 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:10.094756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e1d97be-cf57-4ddf-86a0-29ff1762fb95 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:10.095502 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2e1d97be-cf57-4ddf-86a0-29ff1762fb95 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:10.119934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-211a8dbc-88e8-46e6-bc47-d35d4407a5d9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:10.120520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-211a8dbc-88e8-46e6-bc47-d35d4407a5d9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:10.127415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-211a8dbc-88e8-46e6-bc47-d35d4407a5d9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:10.127861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-211a8dbc-88e8-46e6-bc47-d35d4407a5d9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:10.128604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-211a8dbc-88e8-46e6-bc47-d35d4407a5d9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:10.129036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-211a8dbc-88e8-46e6-bc47-d35d4407a5d9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:10.241088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2e1d97be-cf57-4ddf-86a0-29ff1762fb95 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:10.249387 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2e1d97be-cf57-4ddf-86a0-29ff1762fb95 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.176094 Jul 26 18:53:10.249962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1908/3837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:10 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:10.269679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-211a8dbc-88e8-46e6-bc47-d35d4407a5d9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:10.278133 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-211a8dbc-88e8-46e6-bc47-d35d4407a5d9 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.162330 Jul 26 18:53:10.278700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1930/3838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:10 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:10.327188 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c19dc2b4-1940-459c-a65a-90d6f8f5ddaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:10.327794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c19dc2b4-1940-459c-a65a-90d6f8f5ddaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:10.334096 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c19dc2b4-1940-459c-a65a-90d6f8f5ddaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:10.334547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c19dc2b4-1940-459c-a65a-90d6f8f5ddaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:10.335327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c19dc2b4-1940-459c-a65a-90d6f8f5ddaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:10.335757 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c19dc2b4-1940-459c-a65a-90d6f8f5ddaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:10.355375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-776be784-7da8-4681-a7f0-068e7d1400d0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:10.355988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-776be784-7da8-4681-a7f0-068e7d1400d0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:10.362527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-776be784-7da8-4681-a7f0-068e7d1400d0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:10.362949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-776be784-7da8-4681-a7f0-068e7d1400d0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:10.363756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-776be784-7da8-4681-a7f0-068e7d1400d0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:10.364190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-776be784-7da8-4681-a7f0-068e7d1400d0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:10.468350 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c19dc2b4-1940-459c-a65a-90d6f8f5ddaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:10.476955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c19dc2b4-1940-459c-a65a-90d6f8f5ddaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:10.478570 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c19dc2b4-1940-459c-a65a-90d6f8f5ddaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:10.479845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c19dc2b4-1940-459c-a65a-90d6f8f5ddaf tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156594 Jul 26 18:53:10.480409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1909/3839] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:10 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:10.484835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0ddc35a1-f021-47b5-b140-1258a8a8c1e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:10.485432 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0ddc35a1-f021-47b5-b140-1258a8a8c1e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:10.491211 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ddc35a1-f021-47b5-b140-1258a8a8c1e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:10.491676 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ddc35a1-f021-47b5-b140-1258a8a8c1e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:10.492423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ddc35a1-f021-47b5-b140-1258a8a8c1e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:10.492851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0ddc35a1-f021-47b5-b140-1258a8a8c1e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:10.500378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-776be784-7da8-4681-a7f0-068e7d1400d0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:10.508255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-776be784-7da8-4681-a7f0-068e7d1400d0 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156974 Jul 26 18:53:10.508821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1931/3840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:10 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:10.629503 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0ddc35a1-f021-47b5-b140-1258a8a8c1e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:10.637654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0ddc35a1-f021-47b5-b140-1258a8a8c1e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156288 Jul 26 18:53:10.638212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1910/3841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:10 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:11.270482 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-32814320-eb00-4493-aa72-c867413d8596 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:11.271564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-32814320-eb00-4493-aa72-c867413d8596 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:11.278429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32814320-eb00-4493-aa72-c867413d8596 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:11.278875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32814320-eb00-4493-aa72-c867413d8596 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:11.279655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32814320-eb00-4493-aa72-c867413d8596 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:11.280083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32814320-eb00-4493-aa72-c867413d8596 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:11.298361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-151b3cd7-e5c5-443f-bd52-2ea31f6e3cea tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:11.298967 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-151b3cd7-e5c5-443f-bd52-2ea31f6e3cea tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:11.305710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-151b3cd7-e5c5-443f-bd52-2ea31f6e3cea tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:11.306157 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-151b3cd7-e5c5-443f-bd52-2ea31f6e3cea tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:11.306912 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-151b3cd7-e5c5-443f-bd52-2ea31f6e3cea tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:11.307372 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-151b3cd7-e5c5-443f-bd52-2ea31f6e3cea tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:11.413957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-32814320-eb00-4493-aa72-c867413d8596 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:11.422785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-32814320-eb00-4493-aa72-c867413d8596 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156013 Jul 26 18:53:11.423447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1932/3842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:11 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:11.455856 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-151b3cd7-e5c5-443f-bd52-2ea31f6e3cea tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:11.464070 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-151b3cd7-e5c5-443f-bd52-2ea31f6e3cea tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.169652 Jul 26 18:53:11.464652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1911/3843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:11 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:11.502608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4d4b3ecb-3ccd-4327-a80e-319f9918aff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:11.503176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4d4b3ecb-3ccd-4327-a80e-319f9918aff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:11.509494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d4b3ecb-3ccd-4327-a80e-319f9918aff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:11.509941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d4b3ecb-3ccd-4327-a80e-319f9918aff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:11.510686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d4b3ecb-3ccd-4327-a80e-319f9918aff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:11.511151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d4b3ecb-3ccd-4327-a80e-319f9918aff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:11.530161 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a77cbd62-9986-423a-9426-584df9cd1c96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:11.530797 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a77cbd62-9986-423a-9426-584df9cd1c96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:11.537022 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a77cbd62-9986-423a-9426-584df9cd1c96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:11.537465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a77cbd62-9986-423a-9426-584df9cd1c96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:11.538216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a77cbd62-9986-423a-9426-584df9cd1c96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:11.538638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a77cbd62-9986-423a-9426-584df9cd1c96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:11.644162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4d4b3ecb-3ccd-4327-a80e-319f9918aff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:11.654140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4d4b3ecb-3ccd-4327-a80e-319f9918aff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:11.655725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4d4b3ecb-3ccd-4327-a80e-319f9918aff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:11.658091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4d4b3ecb-3ccd-4327-a80e-319f9918aff5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159476 Jul 26 18:53:11.658659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1933/3844] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:11 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:11.665785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d5430f6e-1550-4385-9c97-7814a674b73a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:11.666399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d5430f6e-1550-4385-9c97-7814a674b73a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:11.674885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5430f6e-1550-4385-9c97-7814a674b73a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:11.675379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5430f6e-1550-4385-9c97-7814a674b73a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:11.676180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5430f6e-1550-4385-9c97-7814a674b73a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:11.676621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5430f6e-1550-4385-9c97-7814a674b73a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:11.684652 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a77cbd62-9986-423a-9426-584df9cd1c96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:11.694661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a77cbd62-9986-423a-9426-584df9cd1c96 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.168508 Jul 26 18:53:11.706791 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1912/3845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:11 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:11.808326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d5430f6e-1550-4385-9c97-7814a674b73a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:11.816827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d5430f6e-1550-4385-9c97-7814a674b73a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156541 Jul 26 18:53:11.817406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1934/3846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:12.448987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5e495ad1-b968-4929-b5af-f5d888517abe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:12.450001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5e495ad1-b968-4929-b5af-f5d888517abe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:12.460976 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e495ad1-b968-4929-b5af-f5d888517abe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:12.461705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e495ad1-b968-4929-b5af-f5d888517abe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:12.462860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e495ad1-b968-4929-b5af-f5d888517abe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:12.463318 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5e495ad1-b968-4929-b5af-f5d888517abe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:12.465830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:12.485673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f9935c3b-f6c8-4b86-9fe6-f0f5da853f09 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:12.486271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f9935c3b-f6c8-4b86-9fe6-f0f5da853f09 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:12.495268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9935c3b-f6c8-4b86-9fe6-f0f5da853f09 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:12.495715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9935c3b-f6c8-4b86-9fe6-f0f5da853f09 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:12.496475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9935c3b-f6c8-4b86-9fe6-f0f5da853f09 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:12.496904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9935c3b-f6c8-4b86-9fe6-f0f5da853f09 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:12.602238 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5e495ad1-b968-4929-b5af-f5d888517abe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:12.610759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5e495ad1-b968-4929-b5af-f5d888517abe tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.168503 Jul 26 18:53:12.611401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1913/3847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:12 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:12.629694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f9935c3b-f6c8-4b86-9fe6-f0f5da853f09 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:12.637871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f9935c3b-f6c8-4b86-9fe6-f0f5da853f09 tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.156192 Jul 26 18:53:12.638448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1935/3848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:12 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:12.683724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e3b7c29e-0728-4daf-9d34-03c678685cff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:12.684332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e3b7c29e-0728-4daf-9d34-03c678685cff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:12.690821 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3b7c29e-0728-4daf-9d34-03c678685cff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:12.691293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3b7c29e-0728-4daf-9d34-03c678685cff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:12.692079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3b7c29e-0728-4daf-9d34-03c678685cff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:12.692512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e3b7c29e-0728-4daf-9d34-03c678685cff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:12.717486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dcf660ee-4690-4d8f-8fef-cb201c3db660 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:12.718093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dcf660ee-4690-4d8f-8fef-cb201c3db660 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:12.724524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dcf660ee-4690-4d8f-8fef-cb201c3db660 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:12.724979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dcf660ee-4690-4d8f-8fef-cb201c3db660 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:12.725717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dcf660ee-4690-4d8f-8fef-cb201c3db660 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:12.726150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dcf660ee-4690-4d8f-8fef-cb201c3db660 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:12.824194 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e3b7c29e-0728-4daf-9d34-03c678685cff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:12.832683 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e3b7c29e-0728-4daf-9d34-03c678685cff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:12.834183 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e3b7c29e-0728-4daf-9d34-03c678685cff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:12.835376 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e3b7c29e-0728-4daf-9d34-03c678685cff tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155842 Jul 26 18:53:12.835937 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1914/3849] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:12 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:12.840358 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6d651fe6-14ce-4202-ba9d-17b4e298b45d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:12.841461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6d651fe6-14ce-4202-ba9d-17b4e298b45d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:12.842718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:12.848095 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d651fe6-14ce-4202-ba9d-17b4e298b45d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:12.848916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d651fe6-14ce-4202-ba9d-17b4e298b45d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:12.849568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d651fe6-14ce-4202-ba9d-17b4e298b45d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:12.850230 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6d651fe6-14ce-4202-ba9d-17b4e298b45d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:12.858599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dcf660ee-4690-4d8f-8fef-cb201c3db660 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:12.867421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dcf660ee-4690-4d8f-8fef-cb201c3db660 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153716 Jul 26 18:53:12.868082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1936/3850] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:12 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:12.989518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6d651fe6-14ce-4202-ba9d-17b4e298b45d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:12.999515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6d651fe6-14ce-4202-ba9d-17b4e298b45d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162554 Jul 26 18:53:13.000125 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1915/3851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:12 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:13.636264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1984ac31-3209-40c2-b87a-c0f23be3393e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:13.636963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1984ac31-3209-40c2-b87a-c0f23be3393e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:13.646370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1984ac31-3209-40c2-b87a-c0f23be3393e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:13.646957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1984ac31-3209-40c2-b87a-c0f23be3393e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:13.647987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1984ac31-3209-40c2-b87a-c0f23be3393e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:13.648555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1984ac31-3209-40c2-b87a-c0f23be3393e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:13.661361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-55f19855-be86-4e71-b027-2ed855a7b03c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:13.662260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-55f19855-be86-4e71-b027-2ed855a7b03c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:13.670233 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55f19855-be86-4e71-b027-2ed855a7b03c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:13.670684 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55f19855-be86-4e71-b027-2ed855a7b03c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:13.671479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55f19855-be86-4e71-b027-2ed855a7b03c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:13.671909 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-55f19855-be86-4e71-b027-2ed855a7b03c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:13.789031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1984ac31-3209-40c2-b87a-c0f23be3393e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:13.798107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1984ac31-3209-40c2-b87a-c0f23be3393e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.168052 Jul 26 18:53:13.798759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1937/3852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:13 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:13.803689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-55f19855-be86-4e71-b027-2ed855a7b03c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:13.812023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-55f19855-be86-4e71-b027-2ed855a7b03c tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.155837 Jul 26 18:53:13.812603 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1916/3853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:13 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:13.862617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1f573037-fb19-46f5-bed3-623555c46e99 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:13.863657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1f573037-fb19-46f5-bed3-623555c46e99 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:13.866468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:13.872992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f573037-fb19-46f5-bed3-623555c46e99 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:13.873455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f573037-fb19-46f5-bed3-623555c46e99 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:13.874204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f573037-fb19-46f5-bed3-623555c46e99 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:13.874635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1f573037-fb19-46f5-bed3-623555c46e99 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:13.889201 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bfdbd921-72ee-4182-a072-4d0f0980a9e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:13.890383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bfdbd921-72ee-4182-a072-4d0f0980a9e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:13.896934 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfdbd921-72ee-4182-a072-4d0f0980a9e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:13.897381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfdbd921-72ee-4182-a072-4d0f0980a9e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:13.898153 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfdbd921-72ee-4182-a072-4d0f0980a9e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:13.898581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bfdbd921-72ee-4182-a072-4d0f0980a9e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:14.005469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1f573037-fb19-46f5-bed3-623555c46e99 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:14.014037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1f573037-fb19-46f5-bed3-623555c46e99 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:14.015654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1f573037-fb19-46f5-bed3-623555c46e99 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:14.016816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1f573037-fb19-46f5-bed3-623555c46e99 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160627 Jul 26 18:53:14.017345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1938/3854] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:14.022297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-324dd015-4ed6-4c25-943d-4c8cd040d7e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:14.023086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-324dd015-4ed6-4c25-943d-4c8cd040d7e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:14.029378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-324dd015-4ed6-4c25-943d-4c8cd040d7e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:14.029824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-324dd015-4ed6-4c25-943d-4c8cd040d7e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:14.030586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-324dd015-4ed6-4c25-943d-4c8cd040d7e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:14.031035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-324dd015-4ed6-4c25-943d-4c8cd040d7e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:14.035071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:14.042322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bfdbd921-72ee-4182-a072-4d0f0980a9e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:14.050595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bfdbd921-72ee-4182-a072-4d0f0980a9e7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.165440 Jul 26 18:53:14.051551 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1917/3855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:13 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:14.160799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-324dd015-4ed6-4c25-943d-4c8cd040d7e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:14.173100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-324dd015-4ed6-4c25-943d-4c8cd040d7e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154367 Jul 26 18:53:14.173995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1939/3856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:14 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:14.469749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-59917018-1395-4404-805e-77113f9a0ced tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:14.470262 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-59917018-1395-4404-805e-77113f9a0ced tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:14.477170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59917018-1395-4404-805e-77113f9a0ced tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:14.477624 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59917018-1395-4404-805e-77113f9a0ced tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:14.478473 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59917018-1395-4404-805e-77113f9a0ced tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:14.478915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59917018-1395-4404-805e-77113f9a0ced tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:14.505216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-59917018-1395-4404-805e-77113f9a0ced tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Going to try to terminate instance {{(pid=117997) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 18:53:14.602851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-59917018-1395-4404-805e-77113f9a0ced tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "DELETE /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 204 len: 0 microversion: 2.1 time: 0.136981 Jul 26 18:53:14.603590 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1918/3857] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 18:53:14 2022] DELETE /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:53:14.612829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-87f14a41-7fb5-4f98-b99d-e3c844a7e7d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:14.613531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-87f14a41-7fb5-4f98-b99d-e3c844a7e7d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:14.620109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87f14a41-7fb5-4f98-b99d-e3c844a7e7d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:14.620555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87f14a41-7fb5-4f98-b99d-e3c844a7e7d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:14.621308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87f14a41-7fb5-4f98-b99d-e3c844a7e7d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:14.621720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87f14a41-7fb5-4f98-b99d-e3c844a7e7d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:14.767441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-87f14a41-7fb5-4f98-b99d-e3c844a7e7d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:14.778165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-87f14a41-7fb5-4f98-b99d-e3c844a7e7d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1715 microversion: 2.1 time: 0.169455 Jul 26 18:53:14.778746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1940/3858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:14 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1715 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:14.821682 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-9cc125f5-030b-4211-a251-5f67a5c88020 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:14.822389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-9cc125f5-030b-4211-a251-5f67a5c88020 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:14.829764 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9cc125f5-030b-4211-a251-5f67a5c88020 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:14.830239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9cc125f5-030b-4211-a251-5f67a5c88020 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:14.831036 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9cc125f5-030b-4211-a251-5f67a5c88020 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:14.831511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-9cc125f5-030b-4211-a251-5f67a5c88020 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:14.833474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2d73bd39-771e-4ad9-a20d-74940c92c8fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:14.834057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2d73bd39-771e-4ad9-a20d-74940c92c8fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:14.840816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d73bd39-771e-4ad9-a20d-74940c92c8fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:14.841244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d73bd39-771e-4ad9-a20d-74940c92c8fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:14.842004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d73bd39-771e-4ad9-a20d-74940c92c8fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:14.842435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2d73bd39-771e-4ad9-a20d-74940c92c8fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:14.962038 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-9cc125f5-030b-4211-a251-5f67a5c88020 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:14.970314 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-9cc125f5-030b-4211-a251-5f67a5c88020 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.153334 Jul 26 18:53:14.970864 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1919/3859] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:14 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:14.972631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2d73bd39-771e-4ad9-a20d-74940c92c8fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:14.980944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2d73bd39-771e-4ad9-a20d-74940c92c8fc tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.151500 Jul 26 18:53:14.981506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1941/3860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:14 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:15.042506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ffbf8eea-e47d-46a2-937e-5d9226929367 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:15.043127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ffbf8eea-e47d-46a2-937e-5d9226929367 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:15.049543 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffbf8eea-e47d-46a2-937e-5d9226929367 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:15.049985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffbf8eea-e47d-46a2-937e-5d9226929367 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:15.050731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffbf8eea-e47d-46a2-937e-5d9226929367 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:15.051196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ffbf8eea-e47d-46a2-937e-5d9226929367 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:15.072290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-012fc3f2-5357-4595-8e04-4dbebe87e85c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:15.072899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-012fc3f2-5357-4595-8e04-4dbebe87e85c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:15.079468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-012fc3f2-5357-4595-8e04-4dbebe87e85c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:15.079934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-012fc3f2-5357-4595-8e04-4dbebe87e85c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:15.080725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-012fc3f2-5357-4595-8e04-4dbebe87e85c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:15.081160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-012fc3f2-5357-4595-8e04-4dbebe87e85c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:15.183465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ffbf8eea-e47d-46a2-937e-5d9226929367 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:15.192666 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ffbf8eea-e47d-46a2-937e-5d9226929367 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:15.194179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ffbf8eea-e47d-46a2-937e-5d9226929367 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:15.195379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ffbf8eea-e47d-46a2-937e-5d9226929367 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156965 Jul 26 18:53:15.195971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1920/3861] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:15 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:15.200589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-30710d41-ec45-44bc-a9c8-98f07ab92fd6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:15.201198 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-30710d41-ec45-44bc-a9c8-98f07ab92fd6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:15.207327 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30710d41-ec45-44bc-a9c8-98f07ab92fd6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:15.207778 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30710d41-ec45-44bc-a9c8-98f07ab92fd6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:15.208541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30710d41-ec45-44bc-a9c8-98f07ab92fd6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:15.208970 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-30710d41-ec45-44bc-a9c8-98f07ab92fd6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:15.214518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-012fc3f2-5357-4595-8e04-4dbebe87e85c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:15.222526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-012fc3f2-5357-4595-8e04-4dbebe87e85c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154193 Jul 26 18:53:15.223109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1942/3862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:15 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:15.350323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-30710d41-ec45-44bc-a9c8-98f07ab92fd6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:15.361541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-30710d41-ec45-44bc-a9c8-98f07ab92fd6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.164568 Jul 26 18:53:15.362115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1921/3863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:15.799779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cdc64e21-2448-49c1-b4a4-208ca1fccf22 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:15.800398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cdc64e21-2448-49c1-b4a4-208ca1fccf22 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:15.807561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cdc64e21-2448-49c1-b4a4-208ca1fccf22 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:15.808009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cdc64e21-2448-49c1-b4a4-208ca1fccf22 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:15.808763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cdc64e21-2448-49c1-b4a4-208ca1fccf22 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:15.809192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cdc64e21-2448-49c1-b4a4-208ca1fccf22 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:15.991931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-069e200e-ea85-4e51-ad29-04a0407e4791 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:15.993003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-069e200e-ea85-4e51-ad29-04a0407e4791 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:15.999885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-069e200e-ea85-4e51-ad29-04a0407e4791 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:16.000364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-069e200e-ea85-4e51-ad29-04a0407e4791 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:16.001169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-069e200e-ea85-4e51-ad29-04a0407e4791 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:16.001606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-069e200e-ea85-4e51-ad29-04a0407e4791 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:16.017064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cdc64e21-2448-49c1-b4a4-208ca1fccf22 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:16.027115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cdc64e21-2448-49c1-b4a4-208ca1fccf22 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1715 microversion: 2.1 time: 0.231390 Jul 26 18:53:16.027700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1943/3864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:15 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1715 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:16.044086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7719dd94-6c3c-4dae-be4a-3f5661223e1f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:16.044755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7719dd94-6c3c-4dae-be4a-3f5661223e1f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] [instance: fc78286d-d3af-46ed-bc61-506e92fe4a32] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:16.054439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7719dd94-6c3c-4dae-be4a-3f5661223e1f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:16.055210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7719dd94-6c3c-4dae-be4a-3f5661223e1f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:16.056290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7719dd94-6c3c-4dae-be4a-3f5661223e1f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:16.056935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7719dd94-6c3c-4dae-be4a-3f5661223e1f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:16.144849 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-069e200e-ea85-4e51-ad29-04a0407e4791 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:16.154034 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-069e200e-ea85-4e51-ad29-04a0407e4791 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.166244 Jul 26 18:53:16.154721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1922/3865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:15 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:16.218288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ae5b7268-68e6-4a59-8c5f-2157055b0fb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:16.219083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ae5b7268-68e6-4a59-8c5f-2157055b0fb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:16.225443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae5b7268-68e6-4a59-8c5f-2157055b0fb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:16.225908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae5b7268-68e6-4a59-8c5f-2157055b0fb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:16.226678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae5b7268-68e6-4a59-8c5f-2157055b0fb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:16.227143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ae5b7268-68e6-4a59-8c5f-2157055b0fb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:16.367487 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ae5b7268-68e6-4a59-8c5f-2157055b0fb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:16.376925 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ae5b7268-68e6-4a59-8c5f-2157055b0fb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:16.378419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ae5b7268-68e6-4a59-8c5f-2157055b0fb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:16.379655 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ae5b7268-68e6-4a59-8c5f-2157055b0fb9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.165609 Jul 26 18:53:16.389793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1923/3866] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:16 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:16.389793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b0e202f3-9f6b-4ffc-8bf5-f23b317055d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:16.389793 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b0e202f3-9f6b-4ffc-8bf5-f23b317055d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:16.392731 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0e202f3-9f6b-4ffc-8bf5-f23b317055d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:16.393133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0e202f3-9f6b-4ffc-8bf5-f23b317055d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:16.393899 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0e202f3-9f6b-4ffc-8bf5-f23b317055d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:16.394347 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0e202f3-9f6b-4ffc-8bf5-f23b317055d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:16.532730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b0e202f3-9f6b-4ffc-8bf5-f23b317055d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:16.541457 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b0e202f3-9f6b-4ffc-8bf5-f23b317055d9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.159850 Jul 26 18:53:16.555678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1924/3867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:16 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:16.555678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4065a932-d682-4afb-8ca5-e62302b1dfb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:16.555678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4065a932-d682-4afb-8ca5-e62302b1dfb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:16.555678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4065a932-d682-4afb-8ca5-e62302b1dfb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:16.556285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4065a932-d682-4afb-8ca5-e62302b1dfb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:16.556285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4065a932-d682-4afb-8ca5-e62302b1dfb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:16.556285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4065a932-d682-4afb-8ca5-e62302b1dfb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:16.568224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7719dd94-6c3c-4dae-be4a-3f5661223e1f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b9730f230249638cfc64f7b0ae9014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a3a3d4e1a54483ebf824780b87b97e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:16.577077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7719dd94-6c3c-4dae-be4a-3f5661223e1f tempest-VolumesSnapshotTestJSON-1183204950 tempest-VolumesSnapshotTestJSON-1183204950-project] 10.222.0.27 "GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32" status: 200 len: 1560 microversion: 2.1 time: 0.537213 Jul 26 18:53:16.578090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1944/3868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:16 2022] GET /compute/v2.1/servers/fc78286d-d3af-46ed-bc61-506e92fe4a32 => generated 1560 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:16.699859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4065a932-d682-4afb-8ca5-e62302b1dfb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:16.709464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4065a932-d682-4afb-8ca5-e62302b1dfb2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.166401 Jul 26 18:53:16.710329 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1925/3869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:17.048970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-82e720e1-1f0d-44b2-afd9-cc4604722ca6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:17.050493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-82e720e1-1f0d-44b2-afd9-cc4604722ca6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:17.060706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82e720e1-1f0d-44b2-afd9-cc4604722ca6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:17.062579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82e720e1-1f0d-44b2-afd9-cc4604722ca6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:17.063475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82e720e1-1f0d-44b2-afd9-cc4604722ca6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:17.064288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82e720e1-1f0d-44b2-afd9-cc4604722ca6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:17.145054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-82e720e1-1f0d-44b2-afd9-cc4604722ca6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:17.153903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-82e720e1-1f0d-44b2-afd9-cc4604722ca6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1649 microversion: 2.1 time: 0.108742 Jul 26 18:53:17.155072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1945/3870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:17 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1649 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:17.175319 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7e9ed1c0-6fb1-44d2-a21a-f0afd372c50c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:17.176681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7e9ed1c0-6fb1-44d2-a21a-f0afd372c50c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:17.183423 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e9ed1c0-6fb1-44d2-a21a-f0afd372c50c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:17.183873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e9ed1c0-6fb1-44d2-a21a-f0afd372c50c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:17.184639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e9ed1c0-6fb1-44d2-a21a-f0afd372c50c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:17.185066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7e9ed1c0-6fb1-44d2-a21a-f0afd372c50c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:17.295762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-4859e4c9-8146-4505-b40d-ae9cd0ba2412 req-b2da3466-f354-4a76-8367-2b6e6f921339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99df3fd1-46e9-4842-9e60-b69d557d60c2", "name": "network-vif-deleted", "tag": "53af1993-485e-4c66-b4ad-cc0182bef59d"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:53:17.306103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-4859e4c9-8146-4505-b40d-ae9cd0ba2412 req-b2da3466-f354-4a76-8367-2b6e6f921339 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:17.306954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-4859e4c9-8146-4505-b40d-ae9cd0ba2412 req-b2da3466-f354-4a76-8367-2b6e6f921339 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:17.320921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-4859e4c9-8146-4505-b40d-ae9cd0ba2412 req-b2da3466-f354-4a76-8367-2b6e6f921339 service nova] Creating event network-vif-deleted:53af1993-485e-4c66-b4ad-cc0182bef59d for instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 on hv-cinder-82549 Jul 26 18:53:17.329507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-4859e4c9-8146-4505-b40d-ae9cd0ba2412 req-b2da3466-f354-4a76-8367-2b6e6f921339 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119837 Jul 26 18:53:17.339189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1946/3871] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:53:17.384388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7e9ed1c0-6fb1-44d2-a21a-f0afd372c50c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:17.394832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7e9ed1c0-6fb1-44d2-a21a-f0afd372c50c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.223259 Jul 26 18:53:17.395656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1926/3872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:17 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:17.409935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2ef722a1-f9c9-4040-a849-28b4aa75fe49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:17.411224 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2ef722a1-f9c9-4040-a849-28b4aa75fe49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:17.417825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ef722a1-f9c9-4040-a849-28b4aa75fe49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:17.418270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ef722a1-f9c9-4040-a849-28b4aa75fe49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:17.419063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ef722a1-f9c9-4040-a849-28b4aa75fe49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:17.419494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ef722a1-f9c9-4040-a849-28b4aa75fe49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:17.550977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2ef722a1-f9c9-4040-a849-28b4aa75fe49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:17.560524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2ef722a1-f9c9-4040-a849-28b4aa75fe49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:17.562023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2ef722a1-f9c9-4040-a849-28b4aa75fe49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:17.563232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2ef722a1-f9c9-4040-a849-28b4aa75fe49 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.163831 Jul 26 18:53:17.563537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6765791f-6f5e-434c-b652-84d3042a18c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:17.572700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1947/3873] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:17 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:53:17.572907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6765791f-6f5e-434c-b652-84d3042a18c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:17.572907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6765791f-6f5e-434c-b652-84d3042a18c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:17.572907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6765791f-6f5e-434c-b652-84d3042a18c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:17.572907 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6765791f-6f5e-434c-b652-84d3042a18c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:17.573270 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6765791f-6f5e-434c-b652-84d3042a18c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:17.707871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-6765791f-6f5e-434c-b652-84d3042a18c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:17.716221 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-6765791f-6f5e-434c-b652-84d3042a18c6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156515 Jul 26 18:53:17.716796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1927/3874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:17 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:17.732235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4d0a66d3-076b-4162-8f80-87e90f6fb81f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:17.733286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4d0a66d3-076b-4162-8f80-87e90f6fb81f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:17.739634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d0a66d3-076b-4162-8f80-87e90f6fb81f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:17.740063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d0a66d3-076b-4162-8f80-87e90f6fb81f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:17.740816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d0a66d3-076b-4162-8f80-87e90f6fb81f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:17.741245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4d0a66d3-076b-4162-8f80-87e90f6fb81f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:17.871118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4d0a66d3-076b-4162-8f80-87e90f6fb81f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:17.879705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4d0a66d3-076b-4162-8f80-87e90f6fb81f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.151845 Jul 26 18:53:17.880298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1948/3875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:17 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:18.175419 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e7a671b5-38e4-42aa-a566-0317d7bd4936 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:18.176002 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e7a671b5-38e4-42aa-a566-0317d7bd4936 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:18.182404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7a671b5-38e4-42aa-a566-0317d7bd4936 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:18.182902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7a671b5-38e4-42aa-a566-0317d7bd4936 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:18.183671 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7a671b5-38e4-42aa-a566-0317d7bd4936 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:18.184099 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e7a671b5-38e4-42aa-a566-0317d7bd4936 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:18.186723 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:18.256908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e7a671b5-38e4-42aa-a566-0317d7bd4936 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:18.265184 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e7a671b5-38e4-42aa-a566-0317d7bd4936 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093813 Jul 26 18:53:18.265740 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1928/3876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:18 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:18.421689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fefe70b3-57eb-4aaa-87be-d04f48da6d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:18.422697 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fefe70b3-57eb-4aaa-87be-d04f48da6d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:18.433687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fefe70b3-57eb-4aaa-87be-d04f48da6d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:18.434068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fefe70b3-57eb-4aaa-87be-d04f48da6d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:18.434832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fefe70b3-57eb-4aaa-87be-d04f48da6d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:18.435300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fefe70b3-57eb-4aaa-87be-d04f48da6d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:18.575182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fefe70b3-57eb-4aaa-87be-d04f48da6d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:18.587355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fefe70b3-57eb-4aaa-87be-d04f48da6d8d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.171921 Jul 26 18:53:18.588108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1949/3877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:18 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:18.588588 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-8a0ed4bb-8a5b-48d1-9d9e-56dff4ad16be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:18.589433 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-8a0ed4bb-8a5b-48d1-9d9e-56dff4ad16be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:18.595926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a0ed4bb-8a5b-48d1-9d9e-56dff4ad16be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:18.596371 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a0ed4bb-8a5b-48d1-9d9e-56dff4ad16be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:18.597131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a0ed4bb-8a5b-48d1-9d9e-56dff4ad16be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:18.597565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-8a0ed4bb-8a5b-48d1-9d9e-56dff4ad16be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:18.738065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8a0ed4bb-8a5b-48d1-9d9e-56dff4ad16be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:18.738262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6c018480-3b71-4016-baf3-817135cd4d0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:18.738680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6c018480-3b71-4016-baf3-817135cd4d0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:18.744892 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c018480-3b71-4016-baf3-817135cd4d0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:18.745379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c018480-3b71-4016-baf3-817135cd4d0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:18.746146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c018480-3b71-4016-baf3-817135cd4d0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:18.746577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6c018480-3b71-4016-baf3-817135cd4d0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:18.747884 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8a0ed4bb-8a5b-48d1-9d9e-56dff4ad16be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:18.749788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-8a0ed4bb-8a5b-48d1-9d9e-56dff4ad16be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:18.751091 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-8a0ed4bb-8a5b-48d1-9d9e-56dff4ad16be tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.168337 Jul 26 18:53:18.751635 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1929/3878] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:18 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:18.880084 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6c018480-3b71-4016-baf3-817135cd4d0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:18.888548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6c018480-3b71-4016-baf3-817135cd4d0c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154361 Jul 26 18:53:18.889122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1950/3879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:18 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:18.901578 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5470a980-865f-421f-ba04-8633e617d1b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:18.902164 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5470a980-865f-421f-ba04-8633e617d1b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:18.908379 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5470a980-865f-421f-ba04-8633e617d1b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:18.908827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5470a980-865f-421f-ba04-8633e617d1b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:18.909565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5470a980-865f-421f-ba04-8633e617d1b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:18.909990 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5470a980-865f-421f-ba04-8633e617d1b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:19.038346 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5470a980-865f-421f-ba04-8633e617d1b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:19.049216 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5470a980-865f-421f-ba04-8633e617d1b3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.151342 Jul 26 18:53:19.049988 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1930/3880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:19.290146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e723d9a6-4fc4-40d3-8ad7-ee453b1e659b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:19.291003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e723d9a6-4fc4-40d3-8ad7-ee453b1e659b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:19.301511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e723d9a6-4fc4-40d3-8ad7-ee453b1e659b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:19.302238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e723d9a6-4fc4-40d3-8ad7-ee453b1e659b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:19.303532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e723d9a6-4fc4-40d3-8ad7-ee453b1e659b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:19.304243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e723d9a6-4fc4-40d3-8ad7-ee453b1e659b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:19.369169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e723d9a6-4fc4-40d3-8ad7-ee453b1e659b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:19.378373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e723d9a6-4fc4-40d3-8ad7-ee453b1e659b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095006 Jul 26 18:53:19.378957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1951/3881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:19 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:19.612734 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2445405e-1c16-4684-8d44-3c216776bb1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:19.613681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2445405e-1c16-4684-8d44-3c216776bb1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:19.624902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2445405e-1c16-4684-8d44-3c216776bb1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:19.625658 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2445405e-1c16-4684-8d44-3c216776bb1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:19.626919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2445405e-1c16-4684-8d44-3c216776bb1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:19.627700 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2445405e-1c16-4684-8d44-3c216776bb1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:19.762409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2445405e-1c16-4684-8d44-3c216776bb1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:19.775267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2445405e-1c16-4684-8d44-3c216776bb1e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.168846 Jul 26 18:53:19.775699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e8e2a905-7a59-434d-8042-c1b0d60796d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:19.776315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e8e2a905-7a59-434d-8042-c1b0d60796d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:19.776659 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1931/3882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:19 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:19.786408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8e2a905-7a59-434d-8042-c1b0d60796d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:19.786983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8e2a905-7a59-434d-8042-c1b0d60796d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:19.787878 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8e2a905-7a59-434d-8042-c1b0d60796d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:19.788411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8e2a905-7a59-434d-8042-c1b0d60796d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:19.910926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-12ef3b6e-9150-4b08-98f6-21377557f861 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:19.911679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-12ef3b6e-9150-4b08-98f6-21377557f861 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:19.918042 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12ef3b6e-9150-4b08-98f6-21377557f861 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:19.918493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12ef3b6e-9150-4b08-98f6-21377557f861 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:19.919293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12ef3b6e-9150-4b08-98f6-21377557f861 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:19.919730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-12ef3b6e-9150-4b08-98f6-21377557f861 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:19.929978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e8e2a905-7a59-434d-8042-c1b0d60796d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:19.938740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e8e2a905-7a59-434d-8042-c1b0d60796d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:19.940288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e8e2a905-7a59-434d-8042-c1b0d60796d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:19.941445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e8e2a905-7a59-434d-8042-c1b0d60796d9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.171033 Jul 26 18:53:19.942026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1952/3883] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:19 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:20.048041 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-12ef3b6e-9150-4b08-98f6-21377557f861 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:20.056163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-12ef3b6e-9150-4b08-98f6-21377557f861 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.149114 Jul 26 18:53:20.056705 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1932/3884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:19 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:20.073334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7cef1ac2-9398-4358-b0a7-3b997c66d04b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:20.073953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7cef1ac2-9398-4358-b0a7-3b997c66d04b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:20.080227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cef1ac2-9398-4358-b0a7-3b997c66d04b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:20.080668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cef1ac2-9398-4358-b0a7-3b997c66d04b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:20.081421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cef1ac2-9398-4358-b0a7-3b997c66d04b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:20.081857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cef1ac2-9398-4358-b0a7-3b997c66d04b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:20.213866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7cef1ac2-9398-4358-b0a7-3b997c66d04b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:20.222038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7cef1ac2-9398-4358-b0a7-3b997c66d04b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152624 Jul 26 18:53:20.222601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1953/3885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:20 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:20.404710 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5495639f-4dc7-4618-b983-fa8500733692 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:20.405721 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5495639f-4dc7-4618-b983-fa8500733692 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:20.416432 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5495639f-4dc7-4618-b983-fa8500733692 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:20.417080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5495639f-4dc7-4618-b983-fa8500733692 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:20.418029 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5495639f-4dc7-4618-b983-fa8500733692 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:20.418458 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5495639f-4dc7-4618-b983-fa8500733692 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:20.479874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5495639f-4dc7-4618-b983-fa8500733692 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:20.488451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5495639f-4dc7-4618-b983-fa8500733692 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090352 Jul 26 18:53:20.489033 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1933/3886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:20 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:20.803284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4f10eed5-d623-4ae2-a0e3-b6fef086353d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:20.804318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4f10eed5-d623-4ae2-a0e3-b6fef086353d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:20.813633 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f10eed5-d623-4ae2-a0e3-b6fef086353d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:20.814167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f10eed5-d623-4ae2-a0e3-b6fef086353d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:20.814965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f10eed5-d623-4ae2-a0e3-b6fef086353d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:20.815726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f10eed5-d623-4ae2-a0e3-b6fef086353d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:20.955951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4f10eed5-d623-4ae2-a0e3-b6fef086353d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:20.967477 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-7f0ad0a0-1155-46b3-b5df-58fb873fb357 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:20.968038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4f10eed5-d623-4ae2-a0e3-b6fef086353d tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.172794 Jul 26 18:53:20.968154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-7f0ad0a0-1155-46b3-b5df-58fb873fb357 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:20.968447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1954/3887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:20 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:20.977370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f0ad0a0-1155-46b3-b5df-58fb873fb357 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:20.977989 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f0ad0a0-1155-46b3-b5df-58fb873fb357 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:20.979083 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f0ad0a0-1155-46b3-b5df-58fb873fb357 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:20.979812 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-7f0ad0a0-1155-46b3-b5df-58fb873fb357 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:21.078047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-644b66f3-c64f-4330-adf7-1c5593decc38 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:21.078647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-644b66f3-c64f-4330-adf7-1c5593decc38 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:21.085002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-644b66f3-c64f-4330-adf7-1c5593decc38 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:21.085455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-644b66f3-c64f-4330-adf7-1c5593decc38 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:21.086209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-644b66f3-c64f-4330-adf7-1c5593decc38 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:21.086636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-644b66f3-c64f-4330-adf7-1c5593decc38 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:21.116016 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7f0ad0a0-1155-46b3-b5df-58fb873fb357 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:21.124955 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7f0ad0a0-1155-46b3-b5df-58fb873fb357 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:21.126453 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-7f0ad0a0-1155-46b3-b5df-58fb873fb357 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:21.127636 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-7f0ad0a0-1155-46b3-b5df-58fb873fb357 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.166374 Jul 26 18:53:21.128199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1934/3888] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:20 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:21.235351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-644b66f3-c64f-4330-adf7-1c5593decc38 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:21.243794 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-916ce127-fcbd-4acc-8bb4-67d831cd353d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:21.244401 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-916ce127-fcbd-4acc-8bb4-67d831cd353d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:21.244897 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-644b66f3-c64f-4330-adf7-1c5593decc38 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.170743 Jul 26 18:53:21.245485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1955/3889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:21 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:21.250594 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-916ce127-fcbd-4acc-8bb4-67d831cd353d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:21.251057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-916ce127-fcbd-4acc-8bb4-67d831cd353d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:21.251809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-916ce127-fcbd-4acc-8bb4-67d831cd353d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:21.252234 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-916ce127-fcbd-4acc-8bb4-67d831cd353d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:21.384941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-916ce127-fcbd-4acc-8bb4-67d831cd353d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:21.394811 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-916ce127-fcbd-4acc-8bb4-67d831cd353d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154763 Jul 26 18:53:21.395425 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1935/3890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:21.512956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-478fa69c-597b-43ad-b960-fc2c7bcefbb4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:21.513954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-478fa69c-597b-43ad-b960-fc2c7bcefbb4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:21.524937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-478fa69c-597b-43ad-b960-fc2c7bcefbb4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:21.525686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-478fa69c-597b-43ad-b960-fc2c7bcefbb4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:21.526928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-478fa69c-597b-43ad-b960-fc2c7bcefbb4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:21.527392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-478fa69c-597b-43ad-b960-fc2c7bcefbb4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:21.542826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:21.589316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-478fa69c-597b-43ad-b960-fc2c7bcefbb4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:21.597348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-478fa69c-597b-43ad-b960-fc2c7bcefbb4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091005 Jul 26 18:53:21.597943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1956/3891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:21 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:21.996540 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3275a456-ceaa-40a9-95f1-e65a7dae02ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:21.997518 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3275a456-ceaa-40a9-95f1-e65a7dae02ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:22.008525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3275a456-ceaa-40a9-95f1-e65a7dae02ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:22.009264 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3275a456-ceaa-40a9-95f1-e65a7dae02ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:22.010506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3275a456-ceaa-40a9-95f1-e65a7dae02ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:22.011223 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3275a456-ceaa-40a9-95f1-e65a7dae02ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:22.147300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3275a456-ceaa-40a9-95f1-e65a7dae02ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:22.150188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c92da018-e7d3-4a80-ace3-876cb917ae2d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:22.150786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c92da018-e7d3-4a80-ace3-876cb917ae2d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:22.155809 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3275a456-ceaa-40a9-95f1-e65a7dae02ec tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165919 Jul 26 18:53:22.156397 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1936/3892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:21 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:22.157655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c92da018-e7d3-4a80-ace3-876cb917ae2d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:22.158100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c92da018-e7d3-4a80-ace3-876cb917ae2d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:22.158862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c92da018-e7d3-4a80-ace3-876cb917ae2d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:22.159323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c92da018-e7d3-4a80-ace3-876cb917ae2d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:22.266118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bee144aa-b58e-4888-9084-4bce591efca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:22.266760 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bee144aa-b58e-4888-9084-4bce591efca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:22.273456 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bee144aa-b58e-4888-9084-4bce591efca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:22.273902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bee144aa-b58e-4888-9084-4bce591efca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:22.274674 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bee144aa-b58e-4888-9084-4bce591efca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:22.275143 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bee144aa-b58e-4888-9084-4bce591efca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:22.294806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c92da018-e7d3-4a80-ace3-876cb917ae2d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:22.303799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c92da018-e7d3-4a80-ace3-876cb917ae2d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:22.305328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c92da018-e7d3-4a80-ace3-876cb917ae2d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:22.306513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c92da018-e7d3-4a80-ace3-876cb917ae2d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160604 Jul 26 18:53:22.307045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1957/3893] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:22 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:22.408932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bee144aa-b58e-4888-9084-4bce591efca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:22.416876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2ed560af-dca3-45e8-93fd-68ba8d8413b0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:22.417280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bee144aa-b58e-4888-9084-4bce591efca7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155147 Jul 26 18:53:22.417456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2ed560af-dca3-45e8-93fd-68ba8d8413b0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:22.417974 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1937/3894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:22 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:22.426184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ed560af-dca3-45e8-93fd-68ba8d8413b0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:22.426630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ed560af-dca3-45e8-93fd-68ba8d8413b0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:22.427424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ed560af-dca3-45e8-93fd-68ba8d8413b0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:22.427849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ed560af-dca3-45e8-93fd-68ba8d8413b0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:22.567830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2ed560af-dca3-45e8-93fd-68ba8d8413b0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:22.576404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2ed560af-dca3-45e8-93fd-68ba8d8413b0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163310 Jul 26 18:53:22.576977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1958/3895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:22.621585 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e8e3d849-4289-4740-a595-1b51c7b67539 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:22.622517 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e8e3d849-4289-4740-a595-1b51c7b67539 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:22.632600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8e3d849-4289-4740-a595-1b51c7b67539 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:22.633280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8e3d849-4289-4740-a595-1b51c7b67539 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:22.634521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8e3d849-4289-4740-a595-1b51c7b67539 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:22.635290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e8e3d849-4289-4740-a595-1b51c7b67539 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:22.698361 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e8e3d849-4289-4740-a595-1b51c7b67539 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:22.707113 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e8e3d849-4289-4740-a595-1b51c7b67539 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091973 Jul 26 18:53:22.707681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1938/3896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:22 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:23.180916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fca780ba-d718-4f27-9fcd-96db2b7d77e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:23.181880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fca780ba-d718-4f27-9fcd-96db2b7d77e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:23.193036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fca780ba-d718-4f27-9fcd-96db2b7d77e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:23.193823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fca780ba-d718-4f27-9fcd-96db2b7d77e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:23.195051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fca780ba-d718-4f27-9fcd-96db2b7d77e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:23.195797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fca780ba-d718-4f27-9fcd-96db2b7d77e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:23.329948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d2dad3ec-0e4f-47e8-af45-df44ad3b20db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:23.330543 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d2dad3ec-0e4f-47e8-af45-df44ad3b20db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:23.332920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fca780ba-d718-4f27-9fcd-96db2b7d77e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:23.337923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2dad3ec-0e4f-47e8-af45-df44ad3b20db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:23.338378 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2dad3ec-0e4f-47e8-af45-df44ad3b20db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:23.339149 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2dad3ec-0e4f-47e8-af45-df44ad3b20db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:23.339582 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d2dad3ec-0e4f-47e8-af45-df44ad3b20db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:23.341230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fca780ba-d718-4f27-9fcd-96db2b7d77e7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.166979 Jul 26 18:53:23.342016 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1959/3897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:23 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:23.439538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5c9dda4f-b021-46c3-b2eb-f5093f108283 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:23.440095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5c9dda4f-b021-46c3-b2eb-f5093f108283 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:23.446717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c9dda4f-b021-46c3-b2eb-f5093f108283 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:23.447193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c9dda4f-b021-46c3-b2eb-f5093f108283 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:23.447948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c9dda4f-b021-46c3-b2eb-f5093f108283 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:23.448381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c9dda4f-b021-46c3-b2eb-f5093f108283 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:23.481785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d2dad3ec-0e4f-47e8-af45-df44ad3b20db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:23.490454 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d2dad3ec-0e4f-47e8-af45-df44ad3b20db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:23.492103 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d2dad3ec-0e4f-47e8-af45-df44ad3b20db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:23.493274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d2dad3ec-0e4f-47e8-af45-df44ad3b20db tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.167455 Jul 26 18:53:23.493833 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1939/3898] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:23 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:23.585171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5c9dda4f-b021-46c3-b2eb-f5093f108283 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:23.596938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5c9dda4f-b021-46c3-b2eb-f5093f108283 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.161177 Jul 26 18:53:23.597734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1960/3899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:23 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:23.600290 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3898f7fc-1be8-4ca0-bb9b-693baeefa304 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:23.601179 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3898f7fc-1be8-4ca0-bb9b-693baeefa304 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:23.608730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3898f7fc-1be8-4ca0-bb9b-693baeefa304 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:23.609181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3898f7fc-1be8-4ca0-bb9b-693baeefa304 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:23.609935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3898f7fc-1be8-4ca0-bb9b-693baeefa304 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:23.610367 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3898f7fc-1be8-4ca0-bb9b-693baeefa304 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:23.728011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-465b3fce-e60b-4b20-a3ee-e07ccc718167 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:23.728706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-465b3fce-e60b-4b20-a3ee-e07ccc718167 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:23.735169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-465b3fce-e60b-4b20-a3ee-e07ccc718167 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:23.735702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-465b3fce-e60b-4b20-a3ee-e07ccc718167 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:23.736540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-465b3fce-e60b-4b20-a3ee-e07ccc718167 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:23.737026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-465b3fce-e60b-4b20-a3ee-e07ccc718167 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:23.737359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3898f7fc-1be8-4ca0-bb9b-693baeefa304 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:23.745746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3898f7fc-1be8-4ca0-bb9b-693baeefa304 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.151373 Jul 26 18:53:23.746399 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1940/3900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:23 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:23.799264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-465b3fce-e60b-4b20-a3ee-e07ccc718167 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:23.807530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-465b3fce-e60b-4b20-a3ee-e07ccc718167 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083404 Jul 26 18:53:23.808086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1961/3901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:23 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:24.366643 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cab8f8ba-fb22-4220-80b7-680b594ac616 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:24.367557 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cab8f8ba-fb22-4220-80b7-680b594ac616 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:24.378750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cab8f8ba-fb22-4220-80b7-680b594ac616 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:24.379541 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cab8f8ba-fb22-4220-80b7-680b594ac616 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:24.380832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cab8f8ba-fb22-4220-80b7-680b594ac616 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:24.381547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cab8f8ba-fb22-4220-80b7-680b594ac616 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:24.516661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9979b623-05c7-44e0-9c06-a72a52aa1e65 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:24.517889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9979b623-05c7-44e0-9c06-a72a52aa1e65 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:24.524570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9979b623-05c7-44e0-9c06-a72a52aa1e65 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:24.525047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9979b623-05c7-44e0-9c06-a72a52aa1e65 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:24.525549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cab8f8ba-fb22-4220-80b7-680b594ac616 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:24.525807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9979b623-05c7-44e0-9c06-a72a52aa1e65 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:24.526237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9979b623-05c7-44e0-9c06-a72a52aa1e65 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:24.535566 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cab8f8ba-fb22-4220-80b7-680b594ac616 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.175452 Jul 26 18:53:24.549926 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1941/3902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:24 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:24.621324 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b0bae490-30f9-4f3c-8eea-71b0af37e99e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:24.621964 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b0bae490-30f9-4f3c-8eea-71b0af37e99e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:24.628336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0bae490-30f9-4f3c-8eea-71b0af37e99e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:24.628894 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0bae490-30f9-4f3c-8eea-71b0af37e99e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:24.629752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0bae490-30f9-4f3c-8eea-71b0af37e99e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:24.630240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b0bae490-30f9-4f3c-8eea-71b0af37e99e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:24.670371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9979b623-05c7-44e0-9c06-a72a52aa1e65 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:24.679926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9979b623-05c7-44e0-9c06-a72a52aa1e65 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:24.681416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9979b623-05c7-44e0-9c06-a72a52aa1e65 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:24.682578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9979b623-05c7-44e0-9c06-a72a52aa1e65 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.169875 Jul 26 18:53:24.683441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1962/3903] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:24 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:53:24.766308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0482ada0-bf40-43ba-ac81-1d55bc53f784 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:24.766925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0482ada0-bf40-43ba-ac81-1d55bc53f784 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:24.772199 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b0bae490-30f9-4f3c-8eea-71b0af37e99e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:24.773470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0482ada0-bf40-43ba-ac81-1d55bc53f784 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:24.773912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0482ada0-bf40-43ba-ac81-1d55bc53f784 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:24.774693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0482ada0-bf40-43ba-ac81-1d55bc53f784 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:24.775140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0482ada0-bf40-43ba-ac81-1d55bc53f784 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:24.780775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b0bae490-30f9-4f3c-8eea-71b0af37e99e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.163438 Jul 26 18:53:24.781326 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1942/3904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:24 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:24.828163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-72aa4c07-73d0-4ac5-938c-741b868370ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:24.828762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-72aa4c07-73d0-4ac5-938c-741b868370ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:24.834954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-72aa4c07-73d0-4ac5-938c-741b868370ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:24.835430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-72aa4c07-73d0-4ac5-938c-741b868370ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:24.836164 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-72aa4c07-73d0-4ac5-938c-741b868370ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:24.836563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-72aa4c07-73d0-4ac5-938c-741b868370ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:24.898860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-72aa4c07-73d0-4ac5-938c-741b868370ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:24.907255 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-72aa4c07-73d0-4ac5-938c-741b868370ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083019 Jul 26 18:53:24.907841 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1943/3905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:24 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:24.909050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0482ada0-bf40-43ba-ac81-1d55bc53f784 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:24.919533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0482ada0-bf40-43ba-ac81-1d55bc53f784 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156986 Jul 26 18:53:24.920106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1963/3906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:24 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:25.557135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-99b65f39-95cc-4d81-9c35-bcdd8ca2efac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:25.557743 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-99b65f39-95cc-4d81-9c35-bcdd8ca2efac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:25.564521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99b65f39-95cc-4d81-9c35-bcdd8ca2efac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:25.564948 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99b65f39-95cc-4d81-9c35-bcdd8ca2efac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:25.565855 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99b65f39-95cc-4d81-9c35-bcdd8ca2efac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:25.566286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-99b65f39-95cc-4d81-9c35-bcdd8ca2efac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:25.700421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-99b65f39-95cc-4d81-9c35-bcdd8ca2efac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:25.702618 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:25.706457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-09a5ad43-420d-4889-987e-f74a8ede72d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:25.707162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-09a5ad43-420d-4889-987e-f74a8ede72d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:25.709827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-99b65f39-95cc-4d81-9c35-bcdd8ca2efac tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.156627 Jul 26 18:53:25.710381 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1944/3907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:25 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:25.714833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09a5ad43-420d-4889-987e-f74a8ede72d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:25.715304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09a5ad43-420d-4889-987e-f74a8ede72d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:25.716246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09a5ad43-420d-4889-987e-f74a8ede72d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:25.716676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-09a5ad43-420d-4889-987e-f74a8ede72d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:25.802047 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-824ccd98-cbff-4076-a405-67af487108b5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:25.802657 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-824ccd98-cbff-4076-a405-67af487108b5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:25.809336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-824ccd98-cbff-4076-a405-67af487108b5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:25.809795 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-824ccd98-cbff-4076-a405-67af487108b5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:25.810535 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-824ccd98-cbff-4076-a405-67af487108b5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:25.810968 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-824ccd98-cbff-4076-a405-67af487108b5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:25.848085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-09a5ad43-420d-4889-987e-f74a8ede72d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:25.856975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-09a5ad43-420d-4889-987e-f74a8ede72d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:25.858514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-09a5ad43-420d-4889-987e-f74a8ede72d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:25.859738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-09a5ad43-420d-4889-987e-f74a8ede72d2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157790 Jul 26 18:53:25.860296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1964/3908] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:25 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:25.931691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2e21a368-a5ee-4d8b-a012-c04eb76e529c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:25.932317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2e21a368-a5ee-4d8b-a012-c04eb76e529c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:25.938980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e21a368-a5ee-4d8b-a012-c04eb76e529c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:25.939345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e21a368-a5ee-4d8b-a012-c04eb76e529c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:25.940097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e21a368-a5ee-4d8b-a012-c04eb76e529c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:25.940524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e21a368-a5ee-4d8b-a012-c04eb76e529c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:25.941947 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-824ccd98-cbff-4076-a405-67af487108b5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:25.950240 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-824ccd98-cbff-4076-a405-67af487108b5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152097 Jul 26 18:53:25.950973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1945/3909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:25 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:25.956532 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d3cbe067-7f27-428b-b49d-e87a5c859e65 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:25.957189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d3cbe067-7f27-428b-b49d-e87a5c859e65 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:25.964271 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3cbe067-7f27-428b-b49d-e87a5c859e65 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:25.964796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3cbe067-7f27-428b-b49d-e87a5c859e65 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:25.965558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3cbe067-7f27-428b-b49d-e87a5c859e65 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:25.966006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d3cbe067-7f27-428b-b49d-e87a5c859e65 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:26.005640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2e21a368-a5ee-4d8b-a012-c04eb76e529c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:26.013756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2e21a368-a5ee-4d8b-a012-c04eb76e529c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086005 Jul 26 18:53:26.014544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1965/3910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:25 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:26.102016 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d3cbe067-7f27-428b-b49d-e87a5c859e65 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:26.110288 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d3cbe067-7f27-428b-b49d-e87a5c859e65 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158176 Jul 26 18:53:26.110840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1946/3911] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:25 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:26.734307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-737c2040-1555-4b48-9e76-acbbaf646c92 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:26.734913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-737c2040-1555-4b48-9e76-acbbaf646c92 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:26.742040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-737c2040-1555-4b48-9e76-acbbaf646c92 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:26.742464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-737c2040-1555-4b48-9e76-acbbaf646c92 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:26.743282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-737c2040-1555-4b48-9e76-acbbaf646c92 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:26.743714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-737c2040-1555-4b48-9e76-acbbaf646c92 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:26.875051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-737c2040-1555-4b48-9e76-acbbaf646c92 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:26.881788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-85cc2bd9-6c97-4c5e-b8a9-cd63a2bd2aee tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:26.882369 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-85cc2bd9-6c97-4c5e-b8a9-cd63a2bd2aee tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:26.883602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-737c2040-1555-4b48-9e76-acbbaf646c92 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.154585 Jul 26 18:53:26.884180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1966/3912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:26 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:26.889144 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85cc2bd9-6c97-4c5e-b8a9-cd63a2bd2aee tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:26.889585 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85cc2bd9-6c97-4c5e-b8a9-cd63a2bd2aee tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:26.890355 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85cc2bd9-6c97-4c5e-b8a9-cd63a2bd2aee tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:26.890782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-85cc2bd9-6c97-4c5e-b8a9-cd63a2bd2aee tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:26.972300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dcc8bd4a-62b2-4c28-8984-e0f844303489 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:26.972906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dcc8bd4a-62b2-4c28-8984-e0f844303489 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:26.979324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dcc8bd4a-62b2-4c28-8984-e0f844303489 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:26.979771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dcc8bd4a-62b2-4c28-8984-e0f844303489 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:26.980746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dcc8bd4a-62b2-4c28-8984-e0f844303489 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:26.980953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dcc8bd4a-62b2-4c28-8984-e0f844303489 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:27.033547 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-85cc2bd9-6c97-4c5e-b8a9-cd63a2bd2aee tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:27.042072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-85cc2bd9-6c97-4c5e-b8a9-cd63a2bd2aee tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:27.043616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-85cc2bd9-6c97-4c5e-b8a9-cd63a2bd2aee tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:27.044835 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-85cc2bd9-6c97-4c5e-b8a9-cd63a2bd2aee tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.167009 Jul 26 18:53:27.045402 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1947/3913] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:26 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:53:27.049770 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-75c21f6a-9c42-4013-8861-63e636824311 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:27.050367 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-75c21f6a-9c42-4013-8861-63e636824311 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:27.056316 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-75c21f6a-9c42-4013-8861-63e636824311 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:27.056759 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-75c21f6a-9c42-4013-8861-63e636824311 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:27.057511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-75c21f6a-9c42-4013-8861-63e636824311 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:27.057942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-75c21f6a-9c42-4013-8861-63e636824311 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:27.114709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dcc8bd4a-62b2-4c28-8984-e0f844303489 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:27.123134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dcc8bd4a-62b2-4c28-8984-e0f844303489 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154852 Jul 26 18:53:27.123733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1967/3914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:26 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:27.127525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-75c21f6a-9c42-4013-8861-63e636824311 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:27.132383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e7bdf8d1-e3d8-4aee-b055-ad2f3d3237e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:27.132983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e7bdf8d1-e3d8-4aee-b055-ad2f3d3237e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:27.136120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-75c21f6a-9c42-4013-8861-63e636824311 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089708 Jul 26 18:53:27.138992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7bdf8d1-e3d8-4aee-b055-ad2f3d3237e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:27.139461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7bdf8d1-e3d8-4aee-b055-ad2f3d3237e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:27.140235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7bdf8d1-e3d8-4aee-b055-ad2f3d3237e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:27.140684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7bdf8d1-e3d8-4aee-b055-ad2f3d3237e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:27.143898 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1948/3915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:27 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:27.288339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e7bdf8d1-e3d8-4aee-b055-ad2f3d3237e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:27.296855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e7bdf8d1-e3d8-4aee-b055-ad2f3d3237e4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.168434 Jul 26 18:53:27.297419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1968/3916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:27 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:27.909782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d0b763d3-68fd-4858-b264-a7d9213a89ef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:27.910783 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d0b763d3-68fd-4858-b264-a7d9213a89ef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:27.921011 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0b763d3-68fd-4858-b264-a7d9213a89ef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:27.921761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0b763d3-68fd-4858-b264-a7d9213a89ef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:27.923007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0b763d3-68fd-4858-b264-a7d9213a89ef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:27.923765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d0b763d3-68fd-4858-b264-a7d9213a89ef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:28.064422 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d0b763d3-68fd-4858-b264-a7d9213a89ef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:28.069173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-835beb2b-29a0-4b3b-89ac-021ae3f3275d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:28.069771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-835beb2b-29a0-4b3b-89ac-021ae3f3275d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:28.072724 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d0b763d3-68fd-4858-b264-a7d9213a89ef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.169628 Jul 26 18:53:28.073303 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1949/3917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:27 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:28.076819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-835beb2b-29a0-4b3b-89ac-021ae3f3275d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:28.077270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-835beb2b-29a0-4b3b-89ac-021ae3f3275d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:28.078062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-835beb2b-29a0-4b3b-89ac-021ae3f3275d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:28.078494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-835beb2b-29a0-4b3b-89ac-021ae3f3275d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:28.145025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4086e074-b3bd-468e-9cb0-78abc2806a3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:28.145729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4086e074-b3bd-468e-9cb0-78abc2806a3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:28.152336 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4086e074-b3bd-468e-9cb0-78abc2806a3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:28.152716 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4086e074-b3bd-468e-9cb0-78abc2806a3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:28.153489 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4086e074-b3bd-468e-9cb0-78abc2806a3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:28.153929 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4086e074-b3bd-468e-9cb0-78abc2806a3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:28.214816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-835beb2b-29a0-4b3b-89ac-021ae3f3275d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:28.224130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-835beb2b-29a0-4b3b-89ac-021ae3f3275d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:28.225639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-835beb2b-29a0-4b3b-89ac-021ae3f3275d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:28.226808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-835beb2b-29a0-4b3b-89ac-021ae3f3275d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161578 Jul 26 18:53:28.227410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1969/3918] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:28 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:28.232016 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1b9cc7fa-ffbc-4f21-9e9c-bf39f8d4ec94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:28.232615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1b9cc7fa-ffbc-4f21-9e9c-bf39f8d4ec94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:28.238667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b9cc7fa-ffbc-4f21-9e9c-bf39f8d4ec94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:28.239137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b9cc7fa-ffbc-4f21-9e9c-bf39f8d4ec94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:28.239896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b9cc7fa-ffbc-4f21-9e9c-bf39f8d4ec94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:28.240327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1b9cc7fa-ffbc-4f21-9e9c-bf39f8d4ec94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:28.285217 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4086e074-b3bd-468e-9cb0-78abc2806a3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:28.293439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4086e074-b3bd-468e-9cb0-78abc2806a3b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152366 Jul 26 18:53:28.294003 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1950/3919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:28 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:28.302480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1b9cc7fa-ffbc-4f21-9e9c-bf39f8d4ec94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:28.310793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1b9cc7fa-ffbc-4f21-9e9c-bf39f8d4ec94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.082412 Jul 26 18:53:28.311353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1970/3920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:28 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:28.317501 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c4d110fc-5fd2-4b10-84e6-bdd517fcbffa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:28.318105 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c4d110fc-5fd2-4b10-84e6-bdd517fcbffa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:28.324131 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4d110fc-5fd2-4b10-84e6-bdd517fcbffa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:28.324569 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4d110fc-5fd2-4b10-84e6-bdd517fcbffa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:28.325434 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4d110fc-5fd2-4b10-84e6-bdd517fcbffa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:28.325869 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4d110fc-5fd2-4b10-84e6-bdd517fcbffa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:28.458822 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c4d110fc-5fd2-4b10-84e6-bdd517fcbffa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:28.469563 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c4d110fc-5fd2-4b10-84e6-bdd517fcbffa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155820 Jul 26 18:53:28.470134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1951/3921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:28 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:29.093796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-576c6622-d50f-45d5-987d-b4c2fa6eadb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:29.094413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-576c6622-d50f-45d5-987d-b4c2fa6eadb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:29.101330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-576c6622-d50f-45d5-987d-b4c2fa6eadb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:29.101776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-576c6622-d50f-45d5-987d-b4c2fa6eadb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:29.102532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-576c6622-d50f-45d5-987d-b4c2fa6eadb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:29.102969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-576c6622-d50f-45d5-987d-b4c2fa6eadb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:29.246856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-576c6622-d50f-45d5-987d-b4c2fa6eadb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:29.249983 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d24352b2-0724-49ac-af96-3783eb3e3d96 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:29.250595 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d24352b2-0724-49ac-af96-3783eb3e3d96 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:29.255566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-576c6622-d50f-45d5-987d-b4c2fa6eadb7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165754 Jul 26 18:53:29.256146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1971/3922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:29 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:29.257321 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d24352b2-0724-49ac-af96-3783eb3e3d96 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:29.257771 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d24352b2-0724-49ac-af96-3783eb3e3d96 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:29.258525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d24352b2-0724-49ac-af96-3783eb3e3d96 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:29.258954 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d24352b2-0724-49ac-af96-3783eb3e3d96 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:29.315171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ce3b7bfb-8ae8-406a-acbc-277d4e4134e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:29.315899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ce3b7bfb-8ae8-406a-acbc-277d4e4134e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:29.322688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce3b7bfb-8ae8-406a-acbc-277d4e4134e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:29.323189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce3b7bfb-8ae8-406a-acbc-277d4e4134e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:29.323978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce3b7bfb-8ae8-406a-acbc-277d4e4134e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:29.324634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ce3b7bfb-8ae8-406a-acbc-277d4e4134e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:29.396133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d24352b2-0724-49ac-af96-3783eb3e3d96 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:29.405178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d24352b2-0724-49ac-af96-3783eb3e3d96 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:29.406699 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d24352b2-0724-49ac-af96-3783eb3e3d96 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:29.407892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d24352b2-0724-49ac-af96-3783eb3e3d96 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.161867 Jul 26 18:53:29.408437 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1952/3923] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:29 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:53:29.412847 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a2e88223-be48-4949-bf3a-1a169122332d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:29.413448 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a2e88223-be48-4949-bf3a-1a169122332d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:29.419461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2e88223-be48-4949-bf3a-1a169122332d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:29.419908 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2e88223-be48-4949-bf3a-1a169122332d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:29.420673 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2e88223-be48-4949-bf3a-1a169122332d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:29.421114 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a2e88223-be48-4949-bf3a-1a169122332d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:29.461659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ce3b7bfb-8ae8-406a-acbc-277d4e4134e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:29.470272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ce3b7bfb-8ae8-406a-acbc-277d4e4134e8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.159034 Jul 26 18:53:29.470881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1972/3924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:29 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:29.484637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a2e88223-be48-4949-bf3a-1a169122332d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:29.490768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-15442b1d-257a-4f75-b67d-0251d519547c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:29.491474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-15442b1d-257a-4f75-b67d-0251d519547c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:29.493089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a2e88223-be48-4949-bf3a-1a169122332d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083659 Jul 26 18:53:29.493851 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1953/3925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:29 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:29.497778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15442b1d-257a-4f75-b67d-0251d519547c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:29.498313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15442b1d-257a-4f75-b67d-0251d519547c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:29.499178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15442b1d-257a-4f75-b67d-0251d519547c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:29.499680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15442b1d-257a-4f75-b67d-0251d519547c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:29.503661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:29.641731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15442b1d-257a-4f75-b67d-0251d519547c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:29.654641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-15442b1d-257a-4f75-b67d-0251d519547c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167195 Jul 26 18:53:29.655348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1973/3926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:29 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:30.281849 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c05126d5-fe8d-4518-82d0-5965e085e8a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:30.282727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c05126d5-fe8d-4518-82d0-5965e085e8a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:30.293893 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c05126d5-fe8d-4518-82d0-5965e085e8a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:30.294640 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c05126d5-fe8d-4518-82d0-5965e085e8a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:30.295653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c05126d5-fe8d-4518-82d0-5965e085e8a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:30.296084 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c05126d5-fe8d-4518-82d0-5965e085e8a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:30.431554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6aab91c9-7076-484e-bd65-60843cb0b3c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:30.432200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6aab91c9-7076-484e-bd65-60843cb0b3c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:30.439417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6aab91c9-7076-484e-bd65-60843cb0b3c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:30.439911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6aab91c9-7076-484e-bd65-60843cb0b3c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:30.440715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6aab91c9-7076-484e-bd65-60843cb0b3c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:30.441169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6aab91c9-7076-484e-bd65-60843cb0b3c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:30.447885 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c05126d5-fe8d-4518-82d0-5965e085e8a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:30.457066 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c05126d5-fe8d-4518-82d0-5965e085e8a9 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.181955 Jul 26 18:53:30.457843 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1954/3927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:30 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:30.492252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f7b0bbd1-0fed-47be-a6f8-f0124821631d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:30.492854 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f7b0bbd1-0fed-47be-a6f8-f0124821631d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:30.499190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7b0bbd1-0fed-47be-a6f8-f0124821631d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:30.499634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7b0bbd1-0fed-47be-a6f8-f0124821631d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:30.500383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7b0bbd1-0fed-47be-a6f8-f0124821631d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:30.500814 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f7b0bbd1-0fed-47be-a6f8-f0124821631d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:30.575952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6aab91c9-7076-484e-bd65-60843cb0b3c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:30.584831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6aab91c9-7076-484e-bd65-60843cb0b3c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:30.586319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6aab91c9-7076-484e-bd65-60843cb0b3c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:30.587494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6aab91c9-7076-484e-bd65-60843cb0b3c5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160165 Jul 26 18:53:30.588021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1974/3928] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:30 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:30.592419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-de882463-4e02-463e-a495-285d7d9820b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:30.593000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-de882463-4e02-463e-a495-285d7d9820b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:30.598892 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de882463-4e02-463e-a495-285d7d9820b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:30.599355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de882463-4e02-463e-a495-285d7d9820b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:30.600114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de882463-4e02-463e-a495-285d7d9820b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:30.600918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-de882463-4e02-463e-a495-285d7d9820b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:30.630916 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f7b0bbd1-0fed-47be-a6f8-f0124821631d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:30.639730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f7b0bbd1-0fed-47be-a6f8-f0124821631d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151357 Jul 26 18:53:30.640312 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1955/3929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:30 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:30.661898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-de882463-4e02-463e-a495-285d7d9820b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:30.670146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-de882463-4e02-463e-a495-285d7d9820b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.081170 Jul 26 18:53:30.670708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1975/3930] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:30 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:30.680436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b3582236-5314-44b8-b614-2192e50af6f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:30.681185 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b3582236-5314-44b8-b614-2192e50af6f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:30.687581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3582236-5314-44b8-b614-2192e50af6f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:30.688023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3582236-5314-44b8-b614-2192e50af6f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:30.688769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3582236-5314-44b8-b614-2192e50af6f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:30.689168 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b3582236-5314-44b8-b614-2192e50af6f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:30.837512 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b3582236-5314-44b8-b614-2192e50af6f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:30.845802 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b3582236-5314-44b8-b614-2192e50af6f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.169174 Jul 26 18:53:30.846345 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1956/3931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:30 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:31.483072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-419cb811-96b7-4169-a38a-ad1cc574d150 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:31.484130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-419cb811-96b7-4169-a38a-ad1cc574d150 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:31.498470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-419cb811-96b7-4169-a38a-ad1cc574d150 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:31.499368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-419cb811-96b7-4169-a38a-ad1cc574d150 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:31.500125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-419cb811-96b7-4169-a38a-ad1cc574d150 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:31.500562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-419cb811-96b7-4169-a38a-ad1cc574d150 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:31.609944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e666163a-5a89-4c6a-b4bb-caf754ffc8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:31.610533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e666163a-5a89-4c6a-b4bb-caf754ffc8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:31.617430 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e666163a-5a89-4c6a-b4bb-caf754ffc8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:31.617874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e666163a-5a89-4c6a-b4bb-caf754ffc8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:31.618639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e666163a-5a89-4c6a-b4bb-caf754ffc8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:31.619065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e666163a-5a89-4c6a-b4bb-caf754ffc8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:31.636226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-419cb811-96b7-4169-a38a-ad1cc574d150 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:31.644829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-419cb811-96b7-4169-a38a-ad1cc574d150 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.168308 Jul 26 18:53:31.645415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1976/3932] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:31 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:31.661206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5fae4eaf-c9c8-4dc0-a0c6-d4135df0a18d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:31.661808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5fae4eaf-c9c8-4dc0-a0c6-d4135df0a18d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:31.667963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fae4eaf-c9c8-4dc0-a0c6-d4135df0a18d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:31.668414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fae4eaf-c9c8-4dc0-a0c6-d4135df0a18d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:31.669173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fae4eaf-c9c8-4dc0-a0c6-d4135df0a18d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:31.669602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fae4eaf-c9c8-4dc0-a0c6-d4135df0a18d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:31.759438 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e666163a-5a89-4c6a-b4bb-caf754ffc8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:31.768119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e666163a-5a89-4c6a-b4bb-caf754ffc8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:31.769630 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e666163a-5a89-4c6a-b4bb-caf754ffc8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:31.771133 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e666163a-5a89-4c6a-b4bb-caf754ffc8ef tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.164823 Jul 26 18:53:31.771712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1957/3933] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:31 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:31.790902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-dd80989c-ef23-4700-b41d-7e0375bac507 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:31.791549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-dd80989c-ef23-4700-b41d-7e0375bac507 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:31.797681 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd80989c-ef23-4700-b41d-7e0375bac507 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:31.798140 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd80989c-ef23-4700-b41d-7e0375bac507 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:31.798900 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd80989c-ef23-4700-b41d-7e0375bac507 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:31.799359 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-dd80989c-ef23-4700-b41d-7e0375bac507 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:31.801318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5fae4eaf-c9c8-4dc0-a0c6-d4135df0a18d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:31.809263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5fae4eaf-c9c8-4dc0-a0c6-d4135df0a18d tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151821 Jul 26 18:53:31.810024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1977/3934] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:31 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:31.859608 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-dd80989c-ef23-4700-b41d-7e0375bac507 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:31.867156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-21cfb9ae-a6be-4573-b025-60f58b9f74f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:31.867764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-21cfb9ae-a6be-4573-b025-60f58b9f74f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:31.867933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-dd80989c-ef23-4700-b41d-7e0375bac507 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.080829 Jul 26 18:53:31.868505 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1958/3935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:31 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:31.873769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21cfb9ae-a6be-4573-b025-60f58b9f74f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:31.874294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21cfb9ae-a6be-4573-b025-60f58b9f74f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:31.875053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21cfb9ae-a6be-4573-b025-60f58b9f74f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:31.875509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21cfb9ae-a6be-4573-b025-60f58b9f74f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:32.010914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-21cfb9ae-a6be-4573-b025-60f58b9f74f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:32.019477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-21cfb9ae-a6be-4573-b025-60f58b9f74f1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156178 Jul 26 18:53:32.020060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1978/3936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:31 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:32.670679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cffdb21e-0dde-4643-94de-286d82ffd8db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:32.671669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cffdb21e-0dde-4643-94de-286d82ffd8db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:32.680282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cffdb21e-0dde-4643-94de-286d82ffd8db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:32.680842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cffdb21e-0dde-4643-94de-286d82ffd8db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:32.681784 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cffdb21e-0dde-4643-94de-286d82ffd8db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:32.682322 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cffdb21e-0dde-4643-94de-286d82ffd8db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:32.793943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ef503ec5-b660-486a-b37c-5b934f772213 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:32.794537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ef503ec5-b660-486a-b37c-5b934f772213 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:32.801726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef503ec5-b660-486a-b37c-5b934f772213 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:32.802184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef503ec5-b660-486a-b37c-5b934f772213 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:32.802943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef503ec5-b660-486a-b37c-5b934f772213 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:32.803408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef503ec5-b660-486a-b37c-5b934f772213 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:32.831375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cffdb21e-0dde-4643-94de-286d82ffd8db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:32.839730 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cffdb21e-0dde-4643-94de-286d82ffd8db tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.175574 Jul 26 18:53:32.840306 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1959/3937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:32 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:32.844941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-91780f27-33d9-4bda-a083-4bb16ccebefd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:32.845537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-91780f27-33d9-4bda-a083-4bb16ccebefd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:32.851745 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91780f27-33d9-4bda-a083-4bb16ccebefd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:32.852189 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91780f27-33d9-4bda-a083-4bb16ccebefd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:32.852945 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91780f27-33d9-4bda-a083-4bb16ccebefd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:32.853370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-91780f27-33d9-4bda-a083-4bb16ccebefd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:32.933201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ef503ec5-b660-486a-b37c-5b934f772213 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:32.942292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ef503ec5-b660-486a-b37c-5b934f772213 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:32.943933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ef503ec5-b660-486a-b37c-5b934f772213 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:32.945105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ef503ec5-b660-486a-b37c-5b934f772213 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155133 Jul 26 18:53:32.945867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1979/3938] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:32 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:32.959979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9213b439-96ca-43cf-bd22-52f77b456332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:32.961215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9213b439-96ca-43cf-bd22-52f77b456332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:32.968100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9213b439-96ca-43cf-bd22-52f77b456332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:32.968534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9213b439-96ca-43cf-bd22-52f77b456332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:32.969285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9213b439-96ca-43cf-bd22-52f77b456332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:32.969711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9213b439-96ca-43cf-bd22-52f77b456332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:32.985388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-91780f27-33d9-4bda-a083-4bb16ccebefd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:32.993575 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-91780f27-33d9-4bda-a083-4bb16ccebefd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152322 Jul 26 18:53:32.994147 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1960/3939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:32 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:33.030912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9213b439-96ca-43cf-bd22-52f77b456332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:33.039074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9213b439-96ca-43cf-bd22-52f77b456332 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083130 Jul 26 18:53:33.039642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1980/3940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:33.041280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5c4c8b43-0f4d-4697-a4c0-71725bb736e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:33.041887 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5c4c8b43-0f4d-4697-a4c0-71725bb736e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:33.048013 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c4c8b43-0f4d-4697-a4c0-71725bb736e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:33.048464 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c4c8b43-0f4d-4697-a4c0-71725bb736e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:33.049224 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c4c8b43-0f4d-4697-a4c0-71725bb736e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:33.049656 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5c4c8b43-0f4d-4697-a4c0-71725bb736e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:33.064498 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:33.179394 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5c4c8b43-0f4d-4697-a4c0-71725bb736e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:33.188337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5c4c8b43-0f4d-4697-a4c0-71725bb736e6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.150898 Jul 26 18:53:33.188836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1961/3941] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:33 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:33.864652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-01778828-7584-48bd-9fe8-8f33625484eb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:33.865646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-01778828-7584-48bd-9fe8-8f33625484eb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:33.875497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01778828-7584-48bd-9fe8-8f33625484eb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:33.875947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01778828-7584-48bd-9fe8-8f33625484eb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:33.876706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01778828-7584-48bd-9fe8-8f33625484eb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:33.877142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-01778828-7584-48bd-9fe8-8f33625484eb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:33.968460 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f8c04837-c381-47e6-bb6c-2f88416ccf1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:33.969330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f8c04837-c381-47e6-bb6c-2f88416ccf1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:33.971769 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:33.976949 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8c04837-c381-47e6-bb6c-2f88416ccf1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:33.977398 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8c04837-c381-47e6-bb6c-2f88416ccf1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:33.978160 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8c04837-c381-47e6-bb6c-2f88416ccf1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:33.978586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f8c04837-c381-47e6-bb6c-2f88416ccf1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:34.009684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-01778828-7584-48bd-9fe8-8f33625484eb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:34.018293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-01778828-7584-48bd-9fe8-8f33625484eb tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160174 Jul 26 18:53:34.018835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1981/3942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:33 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:34.024010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2a29917d-58ac-4efe-9e63-d828fc482d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:34.024629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2a29917d-58ac-4efe-9e63-d828fc482d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:34.030593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a29917d-58ac-4efe-9e63-d828fc482d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:34.031507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a29917d-58ac-4efe-9e63-d828fc482d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:34.031813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a29917d-58ac-4efe-9e63-d828fc482d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:34.032244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2a29917d-58ac-4efe-9e63-d828fc482d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:34.115805 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f8c04837-c381-47e6-bb6c-2f88416ccf1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:34.124562 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f8c04837-c381-47e6-bb6c-2f88416ccf1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:34.126062 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f8c04837-c381-47e6-bb6c-2f88416ccf1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:34.127239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f8c04837-c381-47e6-bb6c-2f88416ccf1f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162876 Jul 26 18:53:34.127800 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1962/3943] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:33 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:34.132130 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c4c3f8bf-cb99-4da0-9d86-f1de324717e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:34.132729 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c4c3f8bf-cb99-4da0-9d86-f1de324717e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:34.138691 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4c3f8bf-cb99-4da0-9d86-f1de324717e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:34.139204 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4c3f8bf-cb99-4da0-9d86-f1de324717e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:34.140044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4c3f8bf-cb99-4da0-9d86-f1de324717e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:34.140469 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4c3f8bf-cb99-4da0-9d86-f1de324717e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:34.164644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2a29917d-58ac-4efe-9e63-d828fc482d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:34.172907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2a29917d-58ac-4efe-9e63-d828fc482d95 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153097 Jul 26 18:53:34.173481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1982/3944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:34 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:34.201612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c4c3f8bf-cb99-4da0-9d86-f1de324717e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:34.208784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c6d9ab30-8604-4e6c-82cb-bc77e27115e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:34.209407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c6d9ab30-8604-4e6c-82cb-bc77e27115e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:34.210073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c4c3f8bf-cb99-4da0-9d86-f1de324717e1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.081321 Jul 26 18:53:34.210668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1963/3945] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:34 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:34.216083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6d9ab30-8604-4e6c-82cb-bc77e27115e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:34.216531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6d9ab30-8604-4e6c-82cb-bc77e27115e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:34.217268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6d9ab30-8604-4e6c-82cb-bc77e27115e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:34.217748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6d9ab30-8604-4e6c-82cb-bc77e27115e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:34.351722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c6d9ab30-8604-4e6c-82cb-bc77e27115e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:34.362891 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c6d9ab30-8604-4e6c-82cb-bc77e27115e1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157598 Jul 26 18:53:34.363691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1983/3946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:34 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:35.044533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a5e3b203-ae33-4abc-8704-24ff2166bcef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:35.045596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a5e3b203-ae33-4abc-8704-24ff2166bcef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:35.052963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5e3b203-ae33-4abc-8704-24ff2166bcef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:35.053413 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5e3b203-ae33-4abc-8704-24ff2166bcef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:35.054171 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5e3b203-ae33-4abc-8704-24ff2166bcef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:35.054604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a5e3b203-ae33-4abc-8704-24ff2166bcef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:35.150166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fe9e9252-1e8e-465b-9f39-0fc0a81b66e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:35.150841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fe9e9252-1e8e-465b-9f39-0fc0a81b66e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:35.157870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe9e9252-1e8e-465b-9f39-0fc0a81b66e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:35.158329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe9e9252-1e8e-465b-9f39-0fc0a81b66e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:35.159100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe9e9252-1e8e-465b-9f39-0fc0a81b66e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:35.159561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fe9e9252-1e8e-465b-9f39-0fc0a81b66e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:35.188175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a5e3b203-ae33-4abc-8704-24ff2166bcef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:35.196749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a5e3b203-ae33-4abc-8704-24ff2166bcef tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.158872 Jul 26 18:53:35.197330 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1964/3947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:35 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:35.201874 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4c54da90-0714-4601-a5ae-cf1b58522c23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:35.202579 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4c54da90-0714-4601-a5ae-cf1b58522c23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:35.208584 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c54da90-0714-4601-a5ae-cf1b58522c23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:35.209031 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c54da90-0714-4601-a5ae-cf1b58522c23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:35.209785 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c54da90-0714-4601-a5ae-cf1b58522c23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:35.210218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4c54da90-0714-4601-a5ae-cf1b58522c23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:35.292749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fe9e9252-1e8e-465b-9f39-0fc0a81b66e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:35.301556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fe9e9252-1e8e-465b-9f39-0fc0a81b66e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:35.302989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fe9e9252-1e8e-465b-9f39-0fc0a81b66e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:35.304193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fe9e9252-1e8e-465b-9f39-0fc0a81b66e7 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158345 Jul 26 18:53:35.304764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1984/3948] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:35 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:35.311366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f39ea21c-9f2e-4cd9-b33e-828e05a3d60a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:35.311366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f39ea21c-9f2e-4cd9-b33e-828e05a3d60a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:35.317035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f39ea21c-9f2e-4cd9-b33e-828e05a3d60a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:35.317488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f39ea21c-9f2e-4cd9-b33e-828e05a3d60a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:35.318228 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f39ea21c-9f2e-4cd9-b33e-828e05a3d60a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:35.318653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f39ea21c-9f2e-4cd9-b33e-828e05a3d60a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:35.344701 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4c54da90-0714-4601-a5ae-cf1b58522c23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:35.352689 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4c54da90-0714-4601-a5ae-cf1b58522c23 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154404 Jul 26 18:53:35.353274 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1965/3949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:35 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:35.384426 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-ff59b957-13ce-4209-9adb-cb2d5c25376d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:35.385032 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-ff59b957-13ce-4209-9adb-cb2d5c25376d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:35.385817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f39ea21c-9f2e-4cd9-b33e-828e05a3d60a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:35.391752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff59b957-13ce-4209-9adb-cb2d5c25376d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:35.392269 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff59b957-13ce-4209-9adb-cb2d5c25376d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:35.393023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff59b957-13ce-4209-9adb-cb2d5c25376d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:35.393417 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-ff59b957-13ce-4209-9adb-cb2d5c25376d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:35.394339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f39ea21c-9f2e-4cd9-b33e-828e05a3d60a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.088622 Jul 26 18:53:35.394905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1985/3950] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:35.529006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-ff59b957-13ce-4209-9adb-cb2d5c25376d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:35.537337 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-ff59b957-13ce-4209-9adb-cb2d5c25376d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156875 Jul 26 18:53:35.537919 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1966/3951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:35 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:36.221322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d1706b41-48d6-47b7-ae32-33660d84c60e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:36.222282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d1706b41-48d6-47b7-ae32-33660d84c60e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:36.233620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1706b41-48d6-47b7-ae32-33660d84c60e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:36.234237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1706b41-48d6-47b7-ae32-33660d84c60e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:36.234986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1706b41-48d6-47b7-ae32-33660d84c60e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:36.235440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1706b41-48d6-47b7-ae32-33660d84c60e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:36.327538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-996a8b81-f5b4-4cea-a1dd-bf9b59bf9226 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:36.328158 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-996a8b81-f5b4-4cea-a1dd-bf9b59bf9226 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:36.335762 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-996a8b81-f5b4-4cea-a1dd-bf9b59bf9226 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:36.336220 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-996a8b81-f5b4-4cea-a1dd-bf9b59bf9226 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:36.336985 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-996a8b81-f5b4-4cea-a1dd-bf9b59bf9226 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:36.337389 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-996a8b81-f5b4-4cea-a1dd-bf9b59bf9226 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:36.380257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d1706b41-48d6-47b7-ae32-33660d84c60e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:36.388316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d1706b41-48d6-47b7-ae32-33660d84c60e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.173639 Jul 26 18:53:36.388864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1986/3952] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:36 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:36.393465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0edb4a91-185e-404e-a6a8-b040c6ca935f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:36.394095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0edb4a91-185e-404e-a6a8-b040c6ca935f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:36.400301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0edb4a91-185e-404e-a6a8-b040c6ca935f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:36.400757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0edb4a91-185e-404e-a6a8-b040c6ca935f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:36.401672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0edb4a91-185e-404e-a6a8-b040c6ca935f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:36.402271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0edb4a91-185e-404e-a6a8-b040c6ca935f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:36.470446 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-996a8b81-f5b4-4cea-a1dd-bf9b59bf9226 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:36.478998 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-996a8b81-f5b4-4cea-a1dd-bf9b59bf9226 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:36.480544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-996a8b81-f5b4-4cea-a1dd-bf9b59bf9226 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:36.481776 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-996a8b81-f5b4-4cea-a1dd-bf9b59bf9226 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158184 Jul 26 18:53:36.482285 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1967/3953] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:36 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:36.486679 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-de5b0fe3-5744-4785-981f-2b8bb4bea286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:36.487300 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-de5b0fe3-5744-4785-981f-2b8bb4bea286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:36.493388 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de5b0fe3-5744-4785-981f-2b8bb4bea286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:36.493844 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de5b0fe3-5744-4785-981f-2b8bb4bea286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:36.494677 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de5b0fe3-5744-4785-981f-2b8bb4bea286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:36.495035 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-de5b0fe3-5744-4785-981f-2b8bb4bea286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:36.537502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0edb4a91-185e-404e-a6a8-b040c6ca935f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:36.545643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0edb4a91-185e-404e-a6a8-b040c6ca935f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155800 Jul 26 18:53:36.546264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1987/3954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:36 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:36.556480 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-de5b0fe3-5744-4785-981f-2b8bb4bea286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:36.558733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-02201e2c-b2b0-4245-9ba5-51a058636d04 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:36.559373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-02201e2c-b2b0-4245-9ba5-51a058636d04 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:36.561205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:36.565137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-de5b0fe3-5744-4785-981f-2b8bb4bea286 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.081893 Jul 26 18:53:36.565694 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1968/3955] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:36 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:36.566906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-02201e2c-b2b0-4245-9ba5-51a058636d04 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:36.567380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-02201e2c-b2b0-4245-9ba5-51a058636d04 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:36.568150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-02201e2c-b2b0-4245-9ba5-51a058636d04 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:36.568582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-02201e2c-b2b0-4245-9ba5-51a058636d04 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:36.700528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-02201e2c-b2b0-4245-9ba5-51a058636d04 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:36.709125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-02201e2c-b2b0-4245-9ba5-51a058636d04 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154059 Jul 26 18:53:36.709722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1988/3956] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:36 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:37.413879 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-820c5fc3-67bc-4c64-9fe0-0c2f7542bbe1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:37.414861 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-820c5fc3-67bc-4c64-9fe0-0c2f7542bbe1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:37.425798 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-820c5fc3-67bc-4c64-9fe0-0c2f7542bbe1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:37.426538 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-820c5fc3-67bc-4c64-9fe0-0c2f7542bbe1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:37.427830 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-820c5fc3-67bc-4c64-9fe0-0c2f7542bbe1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:37.428545 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-820c5fc3-67bc-4c64-9fe0-0c2f7542bbe1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:37.504746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7852107b-61f2-4513-93cd-6651cb863292 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:37.505413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7852107b-61f2-4513-93cd-6651cb863292 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:37.512039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7852107b-61f2-4513-93cd-6651cb863292 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:37.512646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7852107b-61f2-4513-93cd-6651cb863292 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:37.513249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7852107b-61f2-4513-93cd-6651cb863292 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:37.513758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7852107b-61f2-4513-93cd-6651cb863292 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:37.565075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-820c5fc3-67bc-4c64-9fe0-0c2f7542bbe1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:37.573162 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-820c5fc3-67bc-4c64-9fe0-0c2f7542bbe1 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165771 Jul 26 18:53:37.573707 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1969/3957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:37 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:37.578037 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-1bf37a25-236d-40c9-98fa-319ca16c0619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:37.578820 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-1bf37a25-236d-40c9-98fa-319ca16c0619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:37.584416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1bf37a25-236d-40c9-98fa-319ca16c0619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:37.585099 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1bf37a25-236d-40c9-98fa-319ca16c0619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:37.585606 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1bf37a25-236d-40c9-98fa-319ca16c0619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:37.586061 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-1bf37a25-236d-40c9-98fa-319ca16c0619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:37.649845 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7852107b-61f2-4513-93cd-6651cb863292 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:37.652063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:37.660715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7852107b-61f2-4513-93cd-6651cb863292 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:37.662208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7852107b-61f2-4513-93cd-6651cb863292 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:37.663420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7852107b-61f2-4513-93cd-6651cb863292 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162621 Jul 26 18:53:37.664034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1989/3958] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:37 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:37.668349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0a6beea0-4167-4b0f-9fc6-404546c3c7bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:37.668940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0a6beea0-4167-4b0f-9fc6-404546c3c7bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:37.675230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a6beea0-4167-4b0f-9fc6-404546c3c7bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:37.675675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a6beea0-4167-4b0f-9fc6-404546c3c7bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:37.676419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a6beea0-4167-4b0f-9fc6-404546c3c7bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:37.676854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a6beea0-4167-4b0f-9fc6-404546c3c7bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:37.718089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-1bf37a25-236d-40c9-98fa-319ca16c0619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:37.726258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-1bf37a25-236d-40c9-98fa-319ca16c0619 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151595 Jul 26 18:53:37.726824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1970/3959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:37 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:37.731196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5491979a-bdb5-4fa0-ba1c-a0f31d322977 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:37.731788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5491979a-bdb5-4fa0-ba1c-a0f31d322977 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:37.737498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0a6beea0-4167-4b0f-9fc6-404546c3c7bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:37.738488 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5491979a-bdb5-4fa0-ba1c-a0f31d322977 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:37.739008 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5491979a-bdb5-4fa0-ba1c-a0f31d322977 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:37.739902 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5491979a-bdb5-4fa0-ba1c-a0f31d322977 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:37.740404 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5491979a-bdb5-4fa0-ba1c-a0f31d322977 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:37.745655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0a6beea0-4167-4b0f-9fc6-404546c3c7bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.080686 Jul 26 18:53:37.746418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1990/3960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:37 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:37.869040 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5491979a-bdb5-4fa0-ba1c-a0f31d322977 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:37.877088 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5491979a-bdb5-4fa0-ba1c-a0f31d322977 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.149282 Jul 26 18:53:37.877662 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1971/3961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:37 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:38.596342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5f139511-cd05-47af-ba17-759948bba1b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:38.597295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5f139511-cd05-47af-ba17-759948bba1b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:38.608528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f139511-cd05-47af-ba17-759948bba1b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:38.609172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f139511-cd05-47af-ba17-759948bba1b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:38.609925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f139511-cd05-47af-ba17-759948bba1b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:38.610352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5f139511-cd05-47af-ba17-759948bba1b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:38.686025 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-26d385b6-3c08-4361-9880-d91b2a786ab8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:38.686727 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-26d385b6-3c08-4361-9880-d91b2a786ab8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:38.693796 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26d385b6-3c08-4361-9880-d91b2a786ab8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:38.694237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26d385b6-3c08-4361-9880-d91b2a786ab8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:38.694991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26d385b6-3c08-4361-9880-d91b2a786ab8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:38.695450 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-26d385b6-3c08-4361-9880-d91b2a786ab8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:38.757972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5f139511-cd05-47af-ba17-759948bba1b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:38.766604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5f139511-cd05-47af-ba17-759948bba1b3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.174363 Jul 26 18:53:38.767215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1991/3962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:38 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:38.772144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bca88eaf-7804-42c4-a3c9-6270700a0582 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:38.772745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bca88eaf-7804-42c4-a3c9-6270700a0582 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:38.779405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bca88eaf-7804-42c4-a3c9-6270700a0582 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:38.779887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bca88eaf-7804-42c4-a3c9-6270700a0582 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:38.780755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bca88eaf-7804-42c4-a3c9-6270700a0582 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:38.781189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bca88eaf-7804-42c4-a3c9-6270700a0582 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:38.829718 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-26d385b6-3c08-4361-9880-d91b2a786ab8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:38.838568 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-26d385b6-3c08-4361-9880-d91b2a786ab8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:38.840129 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-26d385b6-3c08-4361-9880-d91b2a786ab8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:38.841313 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-26d385b6-3c08-4361-9880-d91b2a786ab8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159325 Jul 26 18:53:38.841871 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1972/3963] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:38 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:38.846572 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e0b165df-6eed-411b-85c2-f421eecc3cd6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:38.847205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e0b165df-6eed-411b-85c2-f421eecc3cd6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:38.853944 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e0b165df-6eed-411b-85c2-f421eecc3cd6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:38.854416 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e0b165df-6eed-411b-85c2-f421eecc3cd6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:38.855255 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e0b165df-6eed-411b-85c2-f421eecc3cd6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:38.855702 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e0b165df-6eed-411b-85c2-f421eecc3cd6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:38.917425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bca88eaf-7804-42c4-a3c9-6270700a0582 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:38.926447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bca88eaf-7804-42c4-a3c9-6270700a0582 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158214 Jul 26 18:53:38.927061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1992/3964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:38 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:38.931658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-33ad38a8-cd39-44cd-ad95-7534c1be24b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:38.932258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-33ad38a8-cd39-44cd-ad95-7534c1be24b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:38.939086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33ad38a8-cd39-44cd-ad95-7534c1be24b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:38.939534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33ad38a8-cd39-44cd-ad95-7534c1be24b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:38.940364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33ad38a8-cd39-44cd-ad95-7534c1be24b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:38.940792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33ad38a8-cd39-44cd-ad95-7534c1be24b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:39.075960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-33ad38a8-cd39-44cd-ad95-7534c1be24b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:39.084752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-33ad38a8-cd39-44cd-ad95-7534c1be24b4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156621 Jul 26 18:53:39.085302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1993/3965] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:38 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:39.165712 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e0b165df-6eed-411b-85c2-f421eecc3cd6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:39.179565 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e0b165df-6eed-411b-85c2-f421eecc3cd6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.336381 Jul 26 18:53:39.180549 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1973/3966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:38 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:39.789685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-97a92d1e-5bd7-4102-8acf-54c214accb3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:39.790376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-97a92d1e-5bd7-4102-8acf-54c214accb3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:39.797170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97a92d1e-5bd7-4102-8acf-54c214accb3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:39.797623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97a92d1e-5bd7-4102-8acf-54c214accb3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:39.798379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97a92d1e-5bd7-4102-8acf-54c214accb3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:39.798810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97a92d1e-5bd7-4102-8acf-54c214accb3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:39.864686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4e522396-aeb5-4fc8-819e-c23515b74704 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:39.866287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4e522396-aeb5-4fc8-819e-c23515b74704 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:39.873756 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e522396-aeb5-4fc8-819e-c23515b74704 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:39.874178 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e522396-aeb5-4fc8-819e-c23515b74704 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:39.875082 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e522396-aeb5-4fc8-819e-c23515b74704 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:39.875533 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4e522396-aeb5-4fc8-819e-c23515b74704 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:39.933567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-97a92d1e-5bd7-4102-8acf-54c214accb3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:39.941784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-97a92d1e-5bd7-4102-8acf-54c214accb3b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.157256 Jul 26 18:53:39.942362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1994/3967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:39 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:39.948864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-709e99c9-43bd-4393-a978-d5b936183d9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:39.949497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-709e99c9-43bd-4393-a978-d5b936183d9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:39.956005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-709e99c9-43bd-4393-a978-d5b936183d9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:39.956517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-709e99c9-43bd-4393-a978-d5b936183d9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:39.957350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-709e99c9-43bd-4393-a978-d5b936183d9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:39.957859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-709e99c9-43bd-4393-a978-d5b936183d9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:40.004772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4e522396-aeb5-4fc8-819e-c23515b74704 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:40.013421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4e522396-aeb5-4fc8-819e-c23515b74704 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:40.015112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4e522396-aeb5-4fc8-819e-c23515b74704 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:40.016320 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4e522396-aeb5-4fc8-819e-c23515b74704 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155560 Jul 26 18:53:40.017115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1974/3968] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:39 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:40.088719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-709e99c9-43bd-4393-a978-d5b936183d9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:40.097416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-709e99c9-43bd-4393-a978-d5b936183d9f tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152154 Jul 26 18:53:40.097997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1995/3969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:39 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:40.106237 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-046d2e72-d154-4524-afcf-453ee655a94d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:40.106845 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-046d2e72-d154-4524-afcf-453ee655a94d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:40.113499 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-046d2e72-d154-4524-afcf-453ee655a94d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:40.113941 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-046d2e72-d154-4524-afcf-453ee655a94d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:40.114704 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-046d2e72-d154-4524-afcf-453ee655a94d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:40.115174 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-046d2e72-d154-4524-afcf-453ee655a94d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:40.201301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5bbe4e59-11ac-4480-82ad-1fad4abff63d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:40.201961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5bbe4e59-11ac-4480-82ad-1fad4abff63d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:40.208396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5bbe4e59-11ac-4480-82ad-1fad4abff63d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:40.208833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5bbe4e59-11ac-4480-82ad-1fad4abff63d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:40.209590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5bbe4e59-11ac-4480-82ad-1fad4abff63d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:40.210021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5bbe4e59-11ac-4480-82ad-1fad4abff63d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:40.255782 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-046d2e72-d154-4524-afcf-453ee655a94d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:40.264006 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-046d2e72-d154-4524-afcf-453ee655a94d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.161699 Jul 26 18:53:40.264612 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1975/3970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:40 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:40.273462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5bbe4e59-11ac-4480-82ad-1fad4abff63d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:40.281461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5bbe4e59-11ac-4480-82ad-1fad4abff63d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.084050 Jul 26 18:53:40.282027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1996/3971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:40 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:40.968181 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-bb6878a3-7035-47db-9d6e-42b55057f90c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:40.969167 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-bb6878a3-7035-47db-9d6e-42b55057f90c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:40.980468 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb6878a3-7035-47db-9d6e-42b55057f90c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:40.981218 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb6878a3-7035-47db-9d6e-42b55057f90c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:40.982493 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb6878a3-7035-47db-9d6e-42b55057f90c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:40.983265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-bb6878a3-7035-47db-9d6e-42b55057f90c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:41.040426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7302d5db-69da-4e00-9d83-4c11569231b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:41.041048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7302d5db-69da-4e00-9d83-4c11569231b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:41.048048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7302d5db-69da-4e00-9d83-4c11569231b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:41.048498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7302d5db-69da-4e00-9d83-4c11569231b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:41.049296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7302d5db-69da-4e00-9d83-4c11569231b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:41.049727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7302d5db-69da-4e00-9d83-4c11569231b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:41.113258 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-bb6878a3-7035-47db-9d6e-42b55057f90c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:41.121506 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-bb6878a3-7035-47db-9d6e-42b55057f90c tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159906 Jul 26 18:53:41.122080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1976/3972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:40 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:41.126583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-0a4e07c7-965e-4340-8a84-3567e53d7663 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:41.127203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-0a4e07c7-965e-4340-8a84-3567e53d7663 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:41.134312 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a4e07c7-965e-4340-8a84-3567e53d7663 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:41.134827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a4e07c7-965e-4340-8a84-3567e53d7663 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:41.135688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a4e07c7-965e-4340-8a84-3567e53d7663 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:41.136118 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-0a4e07c7-965e-4340-8a84-3567e53d7663 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:41.185310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7302d5db-69da-4e00-9d83-4c11569231b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:41.194354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7302d5db-69da-4e00-9d83-4c11569231b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:41.195908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7302d5db-69da-4e00-9d83-4c11569231b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:41.197111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7302d5db-69da-4e00-9d83-4c11569231b3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.160656 Jul 26 18:53:41.197680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1997/3973] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:41 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:41.265736 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-0a4e07c7-965e-4340-8a84-3567e53d7663 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:41.274293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-0a4e07c7-965e-4340-8a84-3567e53d7663 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151249 Jul 26 18:53:41.274857 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1977/3974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:41 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:41.286000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e24d83c9-8243-4b6e-ae09-a4eb69a9963a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:41.286630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e24d83c9-8243-4b6e-ae09-a4eb69a9963a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:41.293033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e24d83c9-8243-4b6e-ae09-a4eb69a9963a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:41.293486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e24d83c9-8243-4b6e-ae09-a4eb69a9963a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:41.294247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e24d83c9-8243-4b6e-ae09-a4eb69a9963a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:41.294684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e24d83c9-8243-4b6e-ae09-a4eb69a9963a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:41.303509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d74e941f-01ec-4619-a816-168b8dedaf1b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:41.304115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d74e941f-01ec-4619-a816-168b8dedaf1b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:41.310923 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d74e941f-01ec-4619-a816-168b8dedaf1b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:41.311479 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d74e941f-01ec-4619-a816-168b8dedaf1b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:41.312332 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d74e941f-01ec-4619-a816-168b8dedaf1b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:41.313205 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d74e941f-01ec-4619-a816-168b8dedaf1b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:41.316678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:41.373648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d74e941f-01ec-4619-a816-168b8dedaf1b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:41.381834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d74e941f-01ec-4619-a816-168b8dedaf1b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.084089 Jul 26 18:53:41.382410 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1978/3975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:41 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:41.425490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e24d83c9-8243-4b6e-ae09-a4eb69a9963a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:41.433884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e24d83c9-8243-4b6e-ae09-a4eb69a9963a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.151783 Jul 26 18:53:41.434471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1998/3976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:41 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:42.147790 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f177e021-aac3-44b0-961d-5044be0b4472 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:42.148813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f177e021-aac3-44b0-961d-5044be0b4472 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:42.158452 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f177e021-aac3-44b0-961d-5044be0b4472 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:42.158897 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f177e021-aac3-44b0-961d-5044be0b4472 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:42.159696 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f177e021-aac3-44b0-961d-5044be0b4472 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:42.160123 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f177e021-aac3-44b0-961d-5044be0b4472 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:42.220051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3b223db6-e0be-412f-8fdc-3caefc8033bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:42.220674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3b223db6-e0be-412f-8fdc-3caefc8033bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:42.227792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b223db6-e0be-412f-8fdc-3caefc8033bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:42.228215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b223db6-e0be-412f-8fdc-3caefc8033bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:42.229018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b223db6-e0be-412f-8fdc-3caefc8033bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:42.229451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3b223db6-e0be-412f-8fdc-3caefc8033bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:42.306746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f177e021-aac3-44b0-961d-5044be0b4472 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:42.314961 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f177e021-aac3-44b0-961d-5044be0b4472 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.174180 Jul 26 18:53:42.315548 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1979/3977] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:42 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:42.319966 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-90b3bc73-72ed-482d-bd05-d87581ddd5df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:42.320586 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-90b3bc73-72ed-482d-bd05-d87581ddd5df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:42.326418 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-90b3bc73-72ed-482d-bd05-d87581ddd5df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:42.326860 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-90b3bc73-72ed-482d-bd05-d87581ddd5df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:42.327709 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-90b3bc73-72ed-482d-bd05-d87581ddd5df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:42.328135 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-90b3bc73-72ed-482d-bd05-d87581ddd5df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:42.369164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3b223db6-e0be-412f-8fdc-3caefc8033bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:42.377812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3b223db6-e0be-412f-8fdc-3caefc8033bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:42.379330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3b223db6-e0be-412f-8fdc-3caefc8033bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:42.380485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3b223db6-e0be-412f-8fdc-3caefc8033bd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.164432 Jul 26 18:53:42.381057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 1999/3978] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:42 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:42.401827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-478bc69f-7d4d-4a94-b560-b1f77413402b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:42.402419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-478bc69f-7d4d-4a94-b560-b1f77413402b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:42.408705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-478bc69f-7d4d-4a94-b560-b1f77413402b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:42.409172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-478bc69f-7d4d-4a94-b560-b1f77413402b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:42.409956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-478bc69f-7d4d-4a94-b560-b1f77413402b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:42.410412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-478bc69f-7d4d-4a94-b560-b1f77413402b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:42.459904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-90b3bc73-72ed-482d-bd05-d87581ddd5df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:42.468120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-90b3bc73-72ed-482d-bd05-d87581ddd5df tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151567 Jul 26 18:53:42.468883 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1980/3979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:42 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:42.471919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-478bc69f-7d4d-4a94-b560-b1f77413402b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:42.480634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-478bc69f-7d4d-4a94-b560-b1f77413402b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.082369 Jul 26 18:53:42.481447 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d85e0a59-ed2f-4d25-8969-ff2522d2b576 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:42.481583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2000/3980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:42 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:42.481816 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d85e0a59-ed2f-4d25-8969-ff2522d2b576 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:42.487930 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d85e0a59-ed2f-4d25-8969-ff2522d2b576 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:42.488370 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d85e0a59-ed2f-4d25-8969-ff2522d2b576 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:42.489120 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d85e0a59-ed2f-4d25-8969-ff2522d2b576 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:42.489558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d85e0a59-ed2f-4d25-8969-ff2522d2b576 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:42.620375 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d85e0a59-ed2f-4d25-8969-ff2522d2b576 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:42.630163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d85e0a59-ed2f-4d25-8969-ff2522d2b576 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.153812 Jul 26 18:53:42.630753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1981/3981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:42 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:43.340664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8d375b62-f450-4b3d-a744-f5cf814919c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:43.341592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8d375b62-f450-4b3d-a744-f5cf814919c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:43.349607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d375b62-f450-4b3d-a744-f5cf814919c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:43.350064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d375b62-f450-4b3d-a744-f5cf814919c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:43.350827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d375b62-f450-4b3d-a744-f5cf814919c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:43.351295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d375b62-f450-4b3d-a744-f5cf814919c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:43.404112 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e1449115-dc39-42e6-8628-c0c7021847ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:43.404711 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e1449115-dc39-42e6-8628-c0c7021847ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:43.412168 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1449115-dc39-42e6-8628-c0c7021847ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:43.412688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1449115-dc39-42e6-8628-c0c7021847ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:43.413527 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1449115-dc39-42e6-8628-c0c7021847ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:43.413963 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e1449115-dc39-42e6-8628-c0c7021847ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:43.484344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8d375b62-f450-4b3d-a744-f5cf814919c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:43.492032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8d375b62-f450-4b3d-a744-f5cf814919c7 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.157454 Jul 26 18:53:43.492344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2001/3982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:43 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:43.496828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-373ae251-4c8b-4256-8dac-978e70ffeb27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:43.497420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-373ae251-4c8b-4256-8dac-978e70ffeb27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:43.503481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-373ae251-4c8b-4256-8dac-978e70ffeb27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:43.503922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-373ae251-4c8b-4256-8dac-978e70ffeb27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:43.504677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-373ae251-4c8b-4256-8dac-978e70ffeb27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:43.505105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-373ae251-4c8b-4256-8dac-978e70ffeb27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:43.545913 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e1449115-dc39-42e6-8628-c0c7021847ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:43.554742 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e1449115-dc39-42e6-8628-c0c7021847ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:43.556383 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e1449115-dc39-42e6-8628-c0c7021847ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:43.557690 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e1449115-dc39-42e6-8628-c0c7021847ad tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157604 Jul 26 18:53:43.558572 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1982/3983] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:43 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:43.563074 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-f589e232-1ff5-4eb9-a684-59bbcee627a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:43.563765 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-f589e232-1ff5-4eb9-a684-59bbcee627a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:43.570182 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f589e232-1ff5-4eb9-a684-59bbcee627a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:43.570634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f589e232-1ff5-4eb9-a684-59bbcee627a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:43.571554 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f589e232-1ff5-4eb9-a684-59bbcee627a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:43.571996 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-f589e232-1ff5-4eb9-a684-59bbcee627a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:43.636277 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-f589e232-1ff5-4eb9-a684-59bbcee627a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:43.637635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-373ae251-4c8b-4256-8dac-978e70ffeb27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:43.644414 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-f589e232-1ff5-4eb9-a684-59bbcee627a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.084940 Jul 26 18:53:43.644986 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1983/3984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:43.646020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-373ae251-4c8b-4256-8dac-978e70ffeb27 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.152392 Jul 26 18:53:43.646569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2002/3985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:43 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:43.658577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-684b4a84-c77f-4ad2-84a8-1827a49b7883 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:43.659299 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-684b4a84-c77f-4ad2-84a8-1827a49b7883 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:43.665287 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-684b4a84-c77f-4ad2-84a8-1827a49b7883 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:43.665819 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-684b4a84-c77f-4ad2-84a8-1827a49b7883 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:43.666577 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-684b4a84-c77f-4ad2-84a8-1827a49b7883 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:43.667010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-684b4a84-c77f-4ad2-84a8-1827a49b7883 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:43.803981 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-684b4a84-c77f-4ad2-84a8-1827a49b7883 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:43.812170 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-684b4a84-c77f-4ad2-84a8-1827a49b7883 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.157387 Jul 26 18:53:43.812752 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1984/3986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:43 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:44.517143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1791d271-fda1-4744-8e16-ecff3b31f588 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:44.517851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1791d271-fda1-4744-8e16-ecff3b31f588 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:44.526521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1791d271-fda1-4744-8e16-ecff3b31f588 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:44.527062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1791d271-fda1-4744-8e16-ecff3b31f588 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:44.527953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1791d271-fda1-4744-8e16-ecff3b31f588 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:44.528456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1791d271-fda1-4744-8e16-ecff3b31f588 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:44.581121 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-59479d4f-7eec-4e67-9f37-efb6b5e392b9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:44.581839 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-59479d4f-7eec-4e67-9f37-efb6b5e392b9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:44.588589 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59479d4f-7eec-4e67-9f37-efb6b5e392b9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:44.589023 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59479d4f-7eec-4e67-9f37-efb6b5e392b9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:44.589770 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59479d4f-7eec-4e67-9f37-efb6b5e392b9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:44.590194 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-59479d4f-7eec-4e67-9f37-efb6b5e392b9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:44.661728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1791d271-fda1-4744-8e16-ecff3b31f588 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:44.670435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1791d271-fda1-4744-8e16-ecff3b31f588 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.159908 Jul 26 18:53:44.671084 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2003/3987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:44 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:44.675877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-147d9c6e-3df0-44e1-8df8-51dac2f26da0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:44.676466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-147d9c6e-3df0-44e1-8df8-51dac2f26da0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:44.682625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-147d9c6e-3df0-44e1-8df8-51dac2f26da0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:44.683185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-147d9c6e-3df0-44e1-8df8-51dac2f26da0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:44.684143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-147d9c6e-3df0-44e1-8df8-51dac2f26da0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:44.684606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-147d9c6e-3df0-44e1-8df8-51dac2f26da0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:44.723901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-59479d4f-7eec-4e67-9f37-efb6b5e392b9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:44.732509 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-59479d4f-7eec-4e67-9f37-efb6b5e392b9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:44.734010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-59479d4f-7eec-4e67-9f37-efb6b5e392b9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:44.735308 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-59479d4f-7eec-4e67-9f37-efb6b5e392b9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.158230 Jul 26 18:53:44.735875 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1985/3988] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:44 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:53:44.740163 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-3362a97c-2ad5-4234-8603-5bf199b20357 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:44.740767 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-3362a97c-2ad5-4234-8603-5bf199b20357 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:44.745867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-147d9c6e-3df0-44e1-8df8-51dac2f26da0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:44.749611 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3362a97c-2ad5-4234-8603-5bf199b20357 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:44.750054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3362a97c-2ad5-4234-8603-5bf199b20357 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:44.750859 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3362a97c-2ad5-4234-8603-5bf199b20357 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:44.751323 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-3362a97c-2ad5-4234-8603-5bf199b20357 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:44.755360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-147d9c6e-3df0-44e1-8df8-51dac2f26da0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083287 Jul 26 18:53:44.756016 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2004/3989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:44 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:44.834885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-500474de-db72-4699-b628-14b86bc1d378 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:44.835875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-500474de-db72-4699-b628-14b86bc1d378 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:44.843272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-500474de-db72-4699-b628-14b86bc1d378 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:44.843714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-500474de-db72-4699-b628-14b86bc1d378 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:44.844583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-500474de-db72-4699-b628-14b86bc1d378 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:44.845006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-500474de-db72-4699-b628-14b86bc1d378 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:44.886761 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-3362a97c-2ad5-4234-8603-5bf199b20357 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:44.895115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-3362a97c-2ad5-4234-8603-5bf199b20357 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.158150 Jul 26 18:53:44.895604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1986/3990] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:44 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:44.978160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-500474de-db72-4699-b628-14b86bc1d378 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:44.986556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-500474de-db72-4699-b628-14b86bc1d378 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156703 Jul 26 18:53:44.987154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2005/3991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:44 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:45.693100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-10d925c5-1994-4131-a906-43d3f1b133da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:45.693892 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-10d925c5-1994-4131-a906-43d3f1b133da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:45.703688 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10d925c5-1994-4131-a906-43d3f1b133da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:45.704340 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10d925c5-1994-4131-a906-43d3f1b133da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:45.705406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10d925c5-1994-4131-a906-43d3f1b133da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:45.705991 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-10d925c5-1994-4131-a906-43d3f1b133da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:45.757992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-234f838c-6936-43dd-993e-8ca166fe14d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:45.758617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-234f838c-6936-43dd-993e-8ca166fe14d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:45.765236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-234f838c-6936-43dd-993e-8ca166fe14d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:45.765678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-234f838c-6936-43dd-993e-8ca166fe14d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:45.766430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-234f838c-6936-43dd-993e-8ca166fe14d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:45.766855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-234f838c-6936-43dd-993e-8ca166fe14d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:45.783530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:45.843905 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-10d925c5-1994-4131-a906-43d3f1b133da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:45.852202 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-10d925c5-1994-4131-a906-43d3f1b133da tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.164631 Jul 26 18:53:45.852836 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1987/3992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:45 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:45.857293 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-968a6674-050f-447e-82ff-ab3ccb2c9518 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:45.857971 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-968a6674-050f-447e-82ff-ab3ccb2c9518 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:45.864076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-968a6674-050f-447e-82ff-ab3ccb2c9518 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:45.864596 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-968a6674-050f-447e-82ff-ab3ccb2c9518 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:45.865429 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-968a6674-050f-447e-82ff-ab3ccb2c9518 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:45.865924 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-968a6674-050f-447e-82ff-ab3ccb2c9518 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:45.901249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-234f838c-6936-43dd-993e-8ca166fe14d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:45.910193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-234f838c-6936-43dd-993e-8ca166fe14d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:45.911843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-234f838c-6936-43dd-993e-8ca166fe14d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:45.913326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-234f838c-6936-43dd-993e-8ca166fe14d5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159404 Jul 26 18:53:45.913900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2006/3993] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:45 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:45.918507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b2884912-69e9-485a-ba0f-5b791542da82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:45.919140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b2884912-69e9-485a-ba0f-5b791542da82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:45.925415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2884912-69e9-485a-ba0f-5b791542da82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:45.925839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2884912-69e9-485a-ba0f-5b791542da82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:45.926592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2884912-69e9-485a-ba0f-5b791542da82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:45.927048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b2884912-69e9-485a-ba0f-5b791542da82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:45.931196 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-968a6674-050f-447e-82ff-ab3ccb2c9518 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:45.939521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-968a6674-050f-447e-82ff-ab3ccb2c9518 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085675 Jul 26 18:53:45.940210 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1988/3994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:45 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:46.008373 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-b15a8cfd-2423-4d98-ace6-b86c545f7cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:46.009115 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-b15a8cfd-2423-4d98-ace6-b86c545f7cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:46.015137 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b15a8cfd-2423-4d98-ace6-b86c545f7cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:46.015583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b15a8cfd-2423-4d98-ace6-b86c545f7cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:46.016382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b15a8cfd-2423-4d98-ace6-b86c545f7cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:46.016813 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-b15a8cfd-2423-4d98-ace6-b86c545f7cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:46.062389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b2884912-69e9-485a-ba0f-5b791542da82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:46.070587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b2884912-69e9-485a-ba0f-5b791542da82 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.155737 Jul 26 18:53:46.071180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2007/3995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:45 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:46.145280 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-b15a8cfd-2423-4d98-ace6-b86c545f7cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:46.155461 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-b15a8cfd-2423-4d98-ace6-b86c545f7cf3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.150933 Jul 26 18:53:46.156039 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1989/3996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:46 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:46.874572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3bdeb709-22be-4f73-89ac-049e337b968e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:46.875244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3bdeb709-22be-4f73-89ac-049e337b968e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:46.882266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3bdeb709-22be-4f73-89ac-049e337b968e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:46.882705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3bdeb709-22be-4f73-89ac-049e337b968e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:46.883486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3bdeb709-22be-4f73-89ac-049e337b968e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:46.883907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3bdeb709-22be-4f73-89ac-049e337b968e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:46.936746 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-44438fd7-c7a2-42df-b7ec-791ee4506198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:46.937455 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-44438fd7-c7a2-42df-b7ec-791ee4506198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:46.944661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44438fd7-c7a2-42df-b7ec-791ee4506198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:46.945192 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44438fd7-c7a2-42df-b7ec-791ee4506198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:46.946001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44438fd7-c7a2-42df-b7ec-791ee4506198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:46.946441 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-44438fd7-c7a2-42df-b7ec-791ee4506198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:47.017314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3bdeb709-22be-4f73-89ac-049e337b968e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:47.025969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3bdeb709-22be-4f73-89ac-049e337b968e tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.155354 Jul 26 18:53:47.026556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2008/3997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:46 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:47.031092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4328ded6-a555-4fdc-a74f-96d13a5369de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:47.032431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4328ded6-a555-4fdc-a74f-96d13a5369de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:47.039825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4328ded6-a555-4fdc-a74f-96d13a5369de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:47.040270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4328ded6-a555-4fdc-a74f-96d13a5369de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:47.041037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4328ded6-a555-4fdc-a74f-96d13a5369de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:47.041511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4328ded6-a555-4fdc-a74f-96d13a5369de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:47.079604 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-44438fd7-c7a2-42df-b7ec-791ee4506198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:47.091439 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-44438fd7-c7a2-42df-b7ec-791ee4506198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:47.093523 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-44438fd7-c7a2-42df-b7ec-791ee4506198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:47.095200 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-44438fd7-c7a2-42df-b7ec-791ee4506198 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.162408 Jul 26 18:53:47.095842 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1990/3998] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:46 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:47.100210 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-5f48dae1-36da-4573-8403-59b75dcb6d2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:47.100877 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-5f48dae1-36da-4573-8403-59b75dcb6d2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:47.107054 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f48dae1-36da-4573-8403-59b75dcb6d2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:47.107583 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f48dae1-36da-4573-8403-59b75dcb6d2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:47.108409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f48dae1-36da-4573-8403-59b75dcb6d2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:47.108901 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-5f48dae1-36da-4573-8403-59b75dcb6d2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:47.109308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4328ded6-a555-4fdc-a74f-96d13a5369de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:47.117578 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4328ded6-a555-4fdc-a74f-96d13a5369de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090026 Jul 26 18:53:47.118150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2009/3999] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:47 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:47.176898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9342d426-e1d5-4573-a205-23c548d8c5f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:47.177499 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9342d426-e1d5-4573-a205-23c548d8c5f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:47.183610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9342d426-e1d5-4573-a205-23c548d8c5f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:47.184059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9342d426-e1d5-4573-a205-23c548d8c5f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:47.184812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9342d426-e1d5-4573-a205-23c548d8c5f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:47.185242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9342d426-e1d5-4573-a205-23c548d8c5f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:47.242362 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-5f48dae1-36da-4573-8403-59b75dcb6d2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:47.250962 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-5f48dae1-36da-4573-8403-59b75dcb6d2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154047 Jul 26 18:53:47.251834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1991/4000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:47 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:47.322409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9342d426-e1d5-4573-a205-23c548d8c5f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:47.335230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9342d426-e1d5-4573-a205-23c548d8c5f0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.161856 Jul 26 18:53:47.336041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2010/4001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:47 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:48.051600 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-616985b4-eb77-4423-8442-e8a9aebc32b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:48.052639 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-616985b4-eb77-4423-8442-e8a9aebc32b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:48.063616 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-616985b4-eb77-4423-8442-e8a9aebc32b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:48.064080 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-616985b4-eb77-4423-8442-e8a9aebc32b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:48.064827 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-616985b4-eb77-4423-8442-e8a9aebc32b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:48.065252 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-616985b4-eb77-4423-8442-e8a9aebc32b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:48.117947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a6f54cfd-ae77-4e05-a8f1-01a3a3cca4eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:48.118608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a6f54cfd-ae77-4e05-a8f1-01a3a3cca4eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:48.125915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a6f54cfd-ae77-4e05-a8f1-01a3a3cca4eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:48.126436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a6f54cfd-ae77-4e05-a8f1-01a3a3cca4eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:48.127371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a6f54cfd-ae77-4e05-a8f1-01a3a3cca4eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:48.127811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a6f54cfd-ae77-4e05-a8f1-01a3a3cca4eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:48.196881 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-616985b4-eb77-4423-8442-e8a9aebc32b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:48.205305 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-616985b4-eb77-4423-8442-e8a9aebc32b6 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.160193 Jul 26 18:53:48.206169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1992/4002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:48 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:48.210483 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-a8f41ab1-58f1-48dc-aff6-93a76f1c023c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:48.211110 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-a8f41ab1-58f1-48dc-aff6-93a76f1c023c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:48.217459 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a8f41ab1-58f1-48dc-aff6-93a76f1c023c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:48.217911 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a8f41ab1-58f1-48dc-aff6-93a76f1c023c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:48.218648 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a8f41ab1-58f1-48dc-aff6-93a76f1c023c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:48.219154 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-a8f41ab1-58f1-48dc-aff6-93a76f1c023c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:48.260796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a6f54cfd-ae77-4e05-a8f1-01a3a3cca4eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:48.270356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a6f54cfd-ae77-4e05-a8f1-01a3a3cca4eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:48.272336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a6f54cfd-ae77-4e05-a8f1-01a3a3cca4eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:48.273503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a6f54cfd-ae77-4e05-a8f1-01a3a3cca4eb tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159572 Jul 26 18:53:48.274065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2011/4003] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:48 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:48.278590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cec30d8e-dffa-4e34-9452-b6f243043355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:48.279210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cec30d8e-dffa-4e34-9452-b6f243043355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:48.281150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-a8f41ab1-58f1-48dc-aff6-93a76f1c023c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:48.285321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cec30d8e-dffa-4e34-9452-b6f243043355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:48.285896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cec30d8e-dffa-4e34-9452-b6f243043355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:48.286661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cec30d8e-dffa-4e34-9452-b6f243043355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:48.287267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cec30d8e-dffa-4e34-9452-b6f243043355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:48.289951 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-a8f41ab1-58f1-48dc-aff6-93a76f1c023c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083055 Jul 26 18:53:48.290475 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1993/4004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:48 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:48.357973 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-02419555-c2a0-4a79-8c18-383f64c425f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:48.358832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-02419555-c2a0-4a79-8c18-383f64c425f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:48.365382 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02419555-c2a0-4a79-8c18-383f64c425f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:48.365832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02419555-c2a0-4a79-8c18-383f64c425f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:48.366593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02419555-c2a0-4a79-8c18-383f64c425f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:48.367057 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-02419555-c2a0-4a79-8c18-383f64c425f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:48.417805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cec30d8e-dffa-4e34-9452-b6f243043355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:48.426195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cec30d8e-dffa-4e34-9452-b6f243043355 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.151167 Jul 26 18:53:48.426774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2012/4005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:48 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:48.499931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-02419555-c2a0-4a79-8c18-383f64c425f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:48.503265 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=100 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:48.512933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-02419555-c2a0-4a79-8c18-383f64c425f2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158653 Jul 26 18:53:48.513669 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1994/4006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:48 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:49.229996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c5d9b0df-6406-43dd-8e7f-630ef3b7447a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:49.230998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c5d9b0df-6406-43dd-8e7f-630ef3b7447a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:49.239623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5d9b0df-6406-43dd-8e7f-630ef3b7447a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:49.240068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5d9b0df-6406-43dd-8e7f-630ef3b7447a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:49.240813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5d9b0df-6406-43dd-8e7f-630ef3b7447a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:49.241238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5d9b0df-6406-43dd-8e7f-630ef3b7447a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:49.296302 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-e19ee49d-d165-405a-922e-be9ff451bd3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:49.296904 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-e19ee49d-d165-405a-922e-be9ff451bd3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:49.304136 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e19ee49d-d165-405a-922e-be9ff451bd3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:49.304609 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e19ee49d-d165-405a-922e-be9ff451bd3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:49.305634 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e19ee49d-d165-405a-922e-be9ff451bd3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:49.306069 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-e19ee49d-d165-405a-922e-be9ff451bd3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:49.374192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c5d9b0df-6406-43dd-8e7f-630ef3b7447a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:49.385019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c5d9b0df-6406-43dd-8e7f-630ef3b7447a tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.161381 Jul 26 18:53:49.385951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2013/4007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:49 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:49.390256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-26d32695-e181-42f8-b1eb-5c0f345544bc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:49.390851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-26d32695-e181-42f8-b1eb-5c0f345544bc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:49.397328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26d32695-e181-42f8-b1eb-5c0f345544bc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:49.397769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26d32695-e181-42f8-b1eb-5c0f345544bc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:49.398544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26d32695-e181-42f8-b1eb-5c0f345544bc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:49.398944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26d32695-e181-42f8-b1eb-5c0f345544bc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:49.437119 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e19ee49d-d165-405a-922e-be9ff451bd3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:49.446283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e19ee49d-d165-405a-922e-be9ff451bd3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:49.447832 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-e19ee49d-d165-405a-922e-be9ff451bd3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:49.449076 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-e19ee49d-d165-405a-922e-be9ff451bd3b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156902 Jul 26 18:53:49.449644 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1995/4008] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:49 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:49.454257 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-389846c7-4558-432b-b494-7b6651b7f1b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:49.454866 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-389846c7-4558-432b-b494-7b6651b7f1b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:49.460124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-26d32695-e181-42f8-b1eb-5c0f345544bc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:49.460972 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-389846c7-4558-432b-b494-7b6651b7f1b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:49.461436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-389846c7-4558-432b-b494-7b6651b7f1b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:49.462203 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-389846c7-4558-432b-b494-7b6651b7f1b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:49.462637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-389846c7-4558-432b-b494-7b6651b7f1b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:49.468388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-26d32695-e181-42f8-b1eb-5c0f345544bc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.081655 Jul 26 18:53:49.468955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2014/4009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:49 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:49.536206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9be1c0d9-afe8-46ac-b582-ce56216dabed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:49.536682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9be1c0d9-afe8-46ac-b582-ce56216dabed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:49.543061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9be1c0d9-afe8-46ac-b582-ce56216dabed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:49.543322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9be1c0d9-afe8-46ac-b582-ce56216dabed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:49.544122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9be1c0d9-afe8-46ac-b582-ce56216dabed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:49.544543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9be1c0d9-afe8-46ac-b582-ce56216dabed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:49.596032 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-389846c7-4558-432b-b494-7b6651b7f1b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:49.604242 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-389846c7-4558-432b-b494-7b6651b7f1b3 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153401 Jul 26 18:53:49.605132 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1996/4010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:49 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:49.676315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9be1c0d9-afe8-46ac-b582-ce56216dabed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:49.684651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9be1c0d9-afe8-46ac-b582-ce56216dabed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.152912 Jul 26 18:53:49.685230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2015/4011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:49 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:50.411077 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-2fc3a358-19b3-4581-90fc-7dd3bc58f3d5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:50.412010 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-2fc3a358-19b3-4581-90fc-7dd3bc58f3d5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:50.423044 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2fc3a358-19b3-4581-90fc-7dd3bc58f3d5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:50.423508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2fc3a358-19b3-4581-90fc-7dd3bc58f3d5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:50.424267 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2fc3a358-19b3-4581-90fc-7dd3bc58f3d5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:50.424703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-2fc3a358-19b3-4581-90fc-7dd3bc58f3d5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:50.473266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-90f0afde-933e-4952-b0d3-061020800707 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:50.473850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-90f0afde-933e-4952-b0d3-061020800707 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:50.483668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90f0afde-933e-4952-b0d3-061020800707 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:50.484082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90f0afde-933e-4952-b0d3-061020800707 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:50.485311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90f0afde-933e-4952-b0d3-061020800707 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:50.485749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90f0afde-933e-4952-b0d3-061020800707 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:50.563508 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-2fc3a358-19b3-4581-90fc-7dd3bc58f3d5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:50.572027 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-2fc3a358-19b3-4581-90fc-7dd3bc58f3d5 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.167678 Jul 26 18:53:50.572613 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1997/4012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:50 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:50.577197 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-c4fd5186-13a7-4ce9-baff-39723c931af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:50.577840 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-c4fd5186-13a7-4ce9-baff-39723c931af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:50.583992 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4fd5186-13a7-4ce9-baff-39723c931af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:50.584447 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4fd5186-13a7-4ce9-baff-39723c931af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:50.585212 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4fd5186-13a7-4ce9-baff-39723c931af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:50.585654 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-c4fd5186-13a7-4ce9-baff-39723c931af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:50.615905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-90f0afde-933e-4952-b0d3-061020800707 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:50.625210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-90f0afde-933e-4952-b0d3-061020800707 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:50.626770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-90f0afde-933e-4952-b0d3-061020800707 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:50.627995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-90f0afde-933e-4952-b0d3-061020800707 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.159640 Jul 26 18:53:50.628561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2016/4013] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:50 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:50.633634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b6be33dc-62c4-49ef-9b31-43463473b3e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:50.634222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b6be33dc-62c4-49ef-9b31-43463473b3e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:50.640332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6be33dc-62c4-49ef-9b31-43463473b3e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:50.640770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6be33dc-62c4-49ef-9b31-43463473b3e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:50.641640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6be33dc-62c4-49ef-9b31-43463473b3e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:50.642072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6be33dc-62c4-49ef-9b31-43463473b3e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:50.647772 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-c4fd5186-13a7-4ce9-baff-39723c931af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:50.656005 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-c4fd5186-13a7-4ce9-baff-39723c931af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.082472 Jul 26 18:53:50.656660 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1998/4014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:50 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:50.706001 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-73f9c1f8-241b-46ef-9005-39bf170d24a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:50.706511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-73f9c1f8-241b-46ef-9005-39bf170d24a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:50.712749 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73f9c1f8-241b-46ef-9005-39bf170d24a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:50.713169 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73f9c1f8-241b-46ef-9005-39bf170d24a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:50.713938 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73f9c1f8-241b-46ef-9005-39bf170d24a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:50.714364 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-73f9c1f8-241b-46ef-9005-39bf170d24a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:50.777823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b6be33dc-62c4-49ef-9b31-43463473b3e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:50.786411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b6be33dc-62c4-49ef-9b31-43463473b3e1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.156832 Jul 26 18:53:50.786965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2017/4015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:50 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:50.852542 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-73f9c1f8-241b-46ef-9005-39bf170d24a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:50.860849 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-73f9c1f8-241b-46ef-9005-39bf170d24a7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158908 Jul 26 18:53:50.861436 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 1999/4016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:50 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:51.592677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-10d1cda2-e4a1-43a3-97b8-9578b63b09f3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:51.593271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-10d1cda2-e4a1-43a3-97b8-9578b63b09f3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:51.602888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-10d1cda2-e4a1-43a3-97b8-9578b63b09f3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:51.603374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-10d1cda2-e4a1-43a3-97b8-9578b63b09f3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:51.604120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-10d1cda2-e4a1-43a3-97b8-9578b63b09f3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:51.604550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-10d1cda2-e4a1-43a3-97b8-9578b63b09f3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:51.652075 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-d9bc59f0-ee61-448d-b59d-4443a35365da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:51.652686 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-d9bc59f0-ee61-448d-b59d-4443a35365da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:51.659638 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9bc59f0-ee61-448d-b59d-4443a35365da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:51.660085 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9bc59f0-ee61-448d-b59d-4443a35365da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:51.660834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9bc59f0-ee61-448d-b59d-4443a35365da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:51.661282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-d9bc59f0-ee61-448d-b59d-4443a35365da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:51.737389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-10d1cda2-e4a1-43a3-97b8-9578b63b09f3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:51.746087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-10d1cda2-e4a1-43a3-97b8-9578b63b09f3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.157302 Jul 26 18:53:51.746644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2018/4017] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:51 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:51.752225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7f728c84-0b24-486b-8c8c-7d2546b67188 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:51.753049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7f728c84-0b24-486b-8c8c-7d2546b67188 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:51.759765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f728c84-0b24-486b-8c8c-7d2546b67188 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:51.760220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f728c84-0b24-486b-8c8c-7d2546b67188 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:51.760997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f728c84-0b24-486b-8c8c-7d2546b67188 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:51.761452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f728c84-0b24-486b-8c8c-7d2546b67188 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:51.791587 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d9bc59f0-ee61-448d-b59d-4443a35365da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:51.800232 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d9bc59f0-ee61-448d-b59d-4443a35365da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:51.801732 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-d9bc59f0-ee61-448d-b59d-4443a35365da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:51.803150 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-d9bc59f0-ee61-448d-b59d-4443a35365da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.155020 Jul 26 18:53:51.804068 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 2000/4018] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:51 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:51.808753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-33e98efd-69b7-4b77-b41b-785a10e50e71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:51.809348 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-33e98efd-69b7-4b77-b41b-785a10e50e71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:51.815443 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-33e98efd-69b7-4b77-b41b-785a10e50e71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:51.815888 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-33e98efd-69b7-4b77-b41b-785a10e50e71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:51.816637 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-33e98efd-69b7-4b77-b41b-785a10e50e71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:51.817065 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-33e98efd-69b7-4b77-b41b-785a10e50e71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:51.823374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7f728c84-0b24-486b-8c8c-7d2546b67188 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:51.831535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7f728c84-0b24-486b-8c8c-7d2546b67188 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083705 Jul 26 18:53:51.832110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2019/4019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:51.883134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cec646c0-dda3-47de-ad98-d630f2aeb3d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:51.883770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cec646c0-dda3-47de-ad98-d630f2aeb3d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:51.890282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cec646c0-dda3-47de-ad98-d630f2aeb3d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:51.890741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cec646c0-dda3-47de-ad98-d630f2aeb3d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:51.891549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cec646c0-dda3-47de-ad98-d630f2aeb3d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:51.891981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cec646c0-dda3-47de-ad98-d630f2aeb3d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:51.950537 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-33e98efd-69b7-4b77-b41b-785a10e50e71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:51.959007 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-33e98efd-69b7-4b77-b41b-785a10e50e71 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.153814 Jul 26 18:53:51.959617 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 2001/4020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:51 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:52.030190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cec646c0-dda3-47de-ad98-d630f2aeb3d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:52.042890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cec646c0-dda3-47de-ad98-d630f2aeb3d4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.164096 Jul 26 18:53:52.043681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2020/4021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:51 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:52.768282 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-4d573f6d-c1c0-4051-bd80-2932cd5bb617 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:52.768915 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-4d573f6d-c1c0-4051-bd80-2932cd5bb617 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:52.776260 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d573f6d-c1c0-4051-bd80-2932cd5bb617 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:52.776703 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d573f6d-c1c0-4051-bd80-2932cd5bb617 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:52.777451 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d573f6d-c1c0-4051-bd80-2932cd5bb617 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:52.777906 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-4d573f6d-c1c0-4051-bd80-2932cd5bb617 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:52.826202 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2e45b2c3-0ec3-47b3-9e2f-96932df37d5b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:52.826795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2e45b2c3-0ec3-47b3-9e2f-96932df37d5b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:52.833688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e45b2c3-0ec3-47b3-9e2f-96932df37d5b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:52.834140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e45b2c3-0ec3-47b3-9e2f-96932df37d5b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:52.834899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e45b2c3-0ec3-47b3-9e2f-96932df37d5b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:52.835333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e45b2c3-0ec3-47b3-9e2f-96932df37d5b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:52.908511 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-4d573f6d-c1c0-4051-bd80-2932cd5bb617 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:52.916675 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-4d573f6d-c1c0-4051-bd80-2932cd5bb617 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.152430 Jul 26 18:53:52.917253 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 2002/4022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:52 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:52.921818 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-56195f89-66bf-451c-b2cf-a2be3d100c40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:52.922515 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-56195f89-66bf-451c-b2cf-a2be3d100c40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:52.928824 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56195f89-66bf-451c-b2cf-a2be3d100c40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:52.929266 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56195f89-66bf-451c-b2cf-a2be3d100c40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:52.930015 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56195f89-66bf-451c-b2cf-a2be3d100c40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:52.930521 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-56195f89-66bf-451c-b2cf-a2be3d100c40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:52.967997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2e45b2c3-0ec3-47b3-9e2f-96932df37d5b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:52.977097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2e45b2c3-0ec3-47b3-9e2f-96932df37d5b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:52.978599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2e45b2c3-0ec3-47b3-9e2f-96932df37d5b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:52.979835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2e45b2c3-0ec3-47b3-9e2f-96932df37d5b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.157671 Jul 26 18:53:52.980361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2021/4023] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:52 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:52.984852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f4793278-8045-4431-8683-b38e94c4e338 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:52.985473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f4793278-8045-4431-8683-b38e94c4e338 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:52.991485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4793278-8045-4431-8683-b38e94c4e338 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:52.991926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4793278-8045-4431-8683-b38e94c4e338 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:52.992673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4793278-8045-4431-8683-b38e94c4e338 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:52.994129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f4793278-8045-4431-8683-b38e94c4e338 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:52.996014 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-56195f89-66bf-451c-b2cf-a2be3d100c40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:53.004175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-56195f89-66bf-451c-b2cf-a2be3d100c40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085899 Jul 26 18:53:53.004643 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 2003/4024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:52 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:53.066775 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-cbfd4148-121d-4244-8e2d-eb623712634d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:53.067089 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-cbfd4148-121d-4244-8e2d-eb623712634d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:53.073789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbfd4148-121d-4244-8e2d-eb623712634d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:53.074301 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbfd4148-121d-4244-8e2d-eb623712634d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:53.075719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbfd4148-121d-4244-8e2d-eb623712634d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:53.075719 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-cbfd4148-121d-4244-8e2d-eb623712634d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:53.127447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f4793278-8045-4431-8683-b38e94c4e338 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:53.135651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f4793278-8045-4431-8683-b38e94c4e338 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.154305 Jul 26 18:53:53.136196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2022/4025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:52 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:53.207668 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-cbfd4148-121d-4244-8e2d-eb623712634d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:53.215834 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-cbfd4148-121d-4244-8e2d-eb623712634d tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154396 Jul 26 18:53:53.216406 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 2004/4026] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:53 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:53.942374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3bd11900-a89e-47a2-8a30-466a65368845 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:53.943465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3bd11900-a89e-47a2-8a30-466a65368845 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:53.954475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3bd11900-a89e-47a2-8a30-466a65368845 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:53.955275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3bd11900-a89e-47a2-8a30-466a65368845 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:53.956564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3bd11900-a89e-47a2-8a30-466a65368845 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:53.957273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3bd11900-a89e-47a2-8a30-466a65368845 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:53.961458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:54.002927 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-35e08bc5-1540-423c-b986-eb6f6fadd92b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:54.003544 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-35e08bc5-1540-423c-b986-eb6f6fadd92b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:54.010445 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35e08bc5-1540-423c-b986-eb6f6fadd92b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:54.010888 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35e08bc5-1540-423c-b986-eb6f6fadd92b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:54.011680 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35e08bc5-1540-423c-b986-eb6f6fadd92b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:54.012111 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-35e08bc5-1540-423c-b986-eb6f6fadd92b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:54.096878 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3bd11900-a89e-47a2-8a30-466a65368845 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:54.105324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3bd11900-a89e-47a2-8a30-466a65368845 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.169548 Jul 26 18:53:54.105904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2023/4027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:53 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:54.110309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4419dff8-bd8a-425e-9c9b-fa2b8e42cfe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:54.110902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4419dff8-bd8a-425e-9c9b-fa2b8e42cfe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:54.116628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4419dff8-bd8a-425e-9c9b-fa2b8e42cfe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:54.117065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4419dff8-bd8a-425e-9c9b-fa2b8e42cfe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:54.117815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4419dff8-bd8a-425e-9c9b-fa2b8e42cfe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:54.118234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4419dff8-bd8a-425e-9c9b-fa2b8e42cfe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:54.143590 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-35e08bc5-1540-423c-b986-eb6f6fadd92b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:54.152865 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-35e08bc5-1540-423c-b986-eb6f6fadd92b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:54.154395 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.policy [None req-35e08bc5-1540-423c-b986-eb6f6fadd92b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117997) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:54.155593 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO nova.api.openstack.requestlog [None req-35e08bc5-1540-423c-b986-eb6f6fadd92b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 200 len: 1800 microversion: 2.20 time: 0.156824 Jul 26 18:53:54.156343 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: [pid: 117997|app: 0|req: 2005/4028] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:53 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:54.161465 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.api.openstack.wsgi [None req-6c58442d-5d26-4a3a-8801-16c436176798 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117997) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:54.162073 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG nova.compute.api [None req-6c58442d-5d26-4a3a-8801-16c436176798 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117997) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:54.168283 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c58442d-5d26-4a3a-8801-16c436176798 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:54.168738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c58442d-5d26-4a3a-8801-16c436176798 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:54.169504 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c58442d-5d26-4a3a-8801-16c436176798 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:54.169942 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG oslo_concurrency.lockutils [None req-6c58442d-5d26-4a3a-8801-16c436176798 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117997) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:54.180380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4419dff8-bd8a-425e-9c9b-fa2b8e42cfe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:54.188426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4419dff8-bd8a-425e-9c9b-fa2b8e42cfe3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.081594 Jul 26 18:53:54.188991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2024/4029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:54 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:54.193445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f2ff3e55-2374-48b4-b682-b8792f1f0904 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '.version_select at 0x7f3909527160>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:54.217871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f2ff3e55-2374-48b4-b682-b8792f1f0904 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998922636" status: 204 len: 0 microversion: 2.20 time: 0.027838 Jul 26 18:53:54.218543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2025/4030] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Jul 26 18:53:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998922636 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 18:53:54.236811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cc500789-cda9-48f4-af13-4c6418c70ede tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:54.237953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cc500789-cda9-48f4-af13-4c6418c70ede tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:54.244978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc500789-cda9-48f4-af13-4c6418c70ede tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:54.245759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc500789-cda9-48f4-af13-4c6418c70ede tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:54.246752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc500789-cda9-48f4-af13-4c6418c70ede tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:54.247549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc500789-cda9-48f4-af13-4c6418c70ede tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:54.356409 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:53:54.357935 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:53:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 18:53:54.377427 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Traceback (most recent call last): Jul 26 18:53:54.377653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 26 18:53:54.377653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: timer() Jul 26 18:53:54.377653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 26 18:53:54.377653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: cb(*args, **kw) Jul 26 18:53:54.377653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jul 26 18:53:54.377653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: waiter.switch() Jul 26 18:53:54.377653 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: greenlet.error: cannot switch to a different thread Jul 26 18:53:54.387533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cc500789-cda9-48f4-af13-4c6418c70ede tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:54.396342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cc500789-cda9-48f4-af13-4c6418c70ede tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163353 Jul 26 18:53:54.397010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2026/4031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:54 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:55.129407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d84afa84-622f-42d5-b386-35c5961d3e26 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:55.130353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d84afa84-622f-42d5-b386-35c5961d3e26 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:55.140489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d84afa84-622f-42d5-b386-35c5961d3e26 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:55.141100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d84afa84-622f-42d5-b386-35c5961d3e26 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:55.141867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d84afa84-622f-42d5-b386-35c5961d3e26 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:55.142305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d84afa84-622f-42d5-b386-35c5961d3e26 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:55.283014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d84afa84-622f-42d5-b386-35c5961d3e26 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:55.294416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d84afa84-622f-42d5-b386-35c5961d3e26 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.171644 Jul 26 18:53:55.297416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2027/4032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:55 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:55.376348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-54db4963-c170-46d9-bd60-e667bc861f8d req-633a2232-f93a-425d-95bc-45f7bbe68675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240d5470-7916-48a4-b90f-910c88d68384", "tag": "e225f24a-f0f4-4283-af60-d533e1dd5c9d"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:53:55.388640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-54db4963-c170-46d9-bd60-e667bc861f8d req-633a2232-f93a-425d-95bc-45f7bbe68675 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:55.389098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-54db4963-c170-46d9-bd60-e667bc861f8d req-633a2232-f93a-425d-95bc-45f7bbe68675 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:55.404926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-54db4963-c170-46d9-bd60-e667bc861f8d req-633a2232-f93a-425d-95bc-45f7bbe68675 service nova] Creating event network-changed:e225f24a-f0f4-4283-af60-d533e1dd5c9d for instance 240d5470-7916-48a4-b90f-910c88d68384 on hv-cinder-82549 Jul 26 18:53:55.411322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-54db4963-c170-46d9-bd60-e667bc861f8d req-633a2232-f93a-425d-95bc-45f7bbe68675 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114712 Jul 26 18:53:55.413733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2028/4033] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:53:55.419284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3c4cc84b-e989-4ddf-a4e6-b806ec23edeb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:55.420044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3c4cc84b-e989-4ddf-a4e6-b806ec23edeb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:55.427608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c4cc84b-e989-4ddf-a4e6-b806ec23edeb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:55.427608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c4cc84b-e989-4ddf-a4e6-b806ec23edeb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:55.428525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c4cc84b-e989-4ddf-a4e6-b806ec23edeb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:55.429045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c4cc84b-e989-4ddf-a4e6-b806ec23edeb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:55.540667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3c4cc84b-e989-4ddf-a4e6-b806ec23edeb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:55.549840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3c4cc84b-e989-4ddf-a4e6-b806ec23edeb tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.134860 Jul 26 18:53:55.557627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2029/4034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:55.557627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2b79ca14-6ef3-4462-8ccd-768ecc5270e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:55.557627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2b79ca14-6ef3-4462-8ccd-768ecc5270e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:55.562388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b79ca14-6ef3-4462-8ccd-768ecc5270e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:55.562885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b79ca14-6ef3-4462-8ccd-768ecc5270e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:55.563771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b79ca14-6ef3-4462-8ccd-768ecc5270e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:55.564206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2b79ca14-6ef3-4462-8ccd-768ecc5270e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:55.769621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2b79ca14-6ef3-4462-8ccd-768ecc5270e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:55.779511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2b79ca14-6ef3-4462-8ccd-768ecc5270e8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.227914 Jul 26 18:53:55.796380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2030/4035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:55 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:55.802371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-30216b42-007c-49bc-b9b6-a08bf872289b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Action: 'create', calling method: .version_select at 0x7f3909527ee0>, body: {"keypair": {"name": "tempest-keypair-876120400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZ4bzykeUl3nxOlZTXgdIskF5Y9+pdv2wNuTAX6xvJU4f2xoQZjHj/VlVxhTyB12YV2iw+MTLv0fdT6iXzl1BgVOYV6MiH0q4UAcwpaS4jcOz0upQB6XxHlDO5uAwiWeA=="}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:53:55.823246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-30216b42-007c-49bc-b9b6-a08bf872289b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Getting quotas for project b3955f1bf0e348ea85252259acb1b902. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:53:55.827430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-30216b42-007c-49bc-b9b6-a08bf872289b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Getting quotas for user 319c8a4be56b4fc2a00937f2fa36bcba and project b3955f1bf0e348ea85252259acb1b902. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:53:55.854662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-30216b42-007c-49bc-b9b6-a08bf872289b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.057513 Jul 26 18:53:55.857208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2031/4036] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Jul 26 18:53:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 18:53:56.323865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c9132bc1-9426-4b82-aa04-4fc113cb6bed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:56.325326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c9132bc1-9426-4b82-aa04-4fc113cb6bed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:56.328500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:53:56.336518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9132bc1-9426-4b82-aa04-4fc113cb6bed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:56.337447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9132bc1-9426-4b82-aa04-4fc113cb6bed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:56.338732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9132bc1-9426-4b82-aa04-4fc113cb6bed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:56.339426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9132bc1-9426-4b82-aa04-4fc113cb6bed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:56.481030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c9132bc1-9426-4b82-aa04-4fc113cb6bed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:56.490258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c9132bc1-9426-4b82-aa04-4fc113cb6bed tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.170293 Jul 26 18:53:56.490843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2032/4037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:56 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:53:56.571951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d3bc05b9-da90-4eac-8a5e-51846795414e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:56.572705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d3bc05b9-da90-4eac-8a5e-51846795414e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:56.579510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3bc05b9-da90-4eac-8a5e-51846795414e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:56.579965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3bc05b9-da90-4eac-8a5e-51846795414e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:56.580728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3bc05b9-da90-4eac-8a5e-51846795414e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:56.581164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3bc05b9-da90-4eac-8a5e-51846795414e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:56.644070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d3bc05b9-da90-4eac-8a5e-51846795414e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:56.652701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d3bc05b9-da90-4eac-8a5e-51846795414e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.084844 Jul 26 18:53:56.653252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2033/4038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:56 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:56.807723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f9fcfbf1-b14e-4671-b6bd-87214ec2522e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:56.808425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f9fcfbf1-b14e-4671-b6bd-87214ec2522e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:56.814745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9fcfbf1-b14e-4671-b6bd-87214ec2522e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:56.815236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9fcfbf1-b14e-4671-b6bd-87214ec2522e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:56.815989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9fcfbf1-b14e-4671-b6bd-87214ec2522e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:56.816423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9fcfbf1-b14e-4671-b6bd-87214ec2522e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:56.950659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f9fcfbf1-b14e-4671-b6bd-87214ec2522e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:56.959126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f9fcfbf1-b14e-4671-b6bd-87214ec2522e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.155295 Jul 26 18:53:56.959709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2034/4039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:56 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:57.273942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-112066451", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49290e90-7614-44e5-9ae8-1548f5f0c05d"}], "security_groups": [{"name": "tempest-securitygroup--596139465"}], "key_name": "tempest-keypair-876120400", "user_data": "}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:53:57.377940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.network.neutron [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] validate_networks() for [('49290e90-7614-44e5-9ae8-1548f5f0c05d', None, None, None, None, None)] {{(pid=117996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:53:57.817359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Flavor limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:53:57.817778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Image limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:53:57.818241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Flavor pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:53:57.818822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Image pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:53:57.819445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:53:57.833596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:57.834198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:57.835394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:57.835941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:57.855885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Getting quotas for project b3955f1bf0e348ea85252259acb1b902. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:53:57.860337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Getting quotas for user 319c8a4be56b4fc2a00937f2fa36bcba and project b3955f1bf0e348ea85252259acb1b902. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:53:57.872454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Going to run 1 instances... {{(pid=117996) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:53:57.874661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:53:57.926447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-15c08663-97cf-4ab7-8915-9f61e55dab05 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.657258 Jul 26 18:53:57.927139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2035/4040] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Jul 26 18:53:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 26 18:53:57.932436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-397cbece-d715-4d9e-9d77-0ed94cb4cdf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:57.933115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-397cbece-d715-4d9e-9d77-0ed94cb4cdf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] [instance: 9982c007-1157-4c63-93e8-3733712f06e0] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:57.939627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-397cbece-d715-4d9e-9d77-0ed94cb4cdf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:57.940550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-397cbece-d715-4d9e-9d77-0ed94cb4cdf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:57.942617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-397cbece-d715-4d9e-9d77-0ed94cb4cdf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:57.943065 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-397cbece-d715-4d9e-9d77-0ed94cb4cdf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:58.085243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-397cbece-d715-4d9e-9d77-0ed94cb4cdf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c4e94a090544d7a977dabe32884f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7168da907a4465b0e919131bb0373e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:58.093818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-397cbece-d715-4d9e-9d77-0ed94cb4cdf3 tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0" status: 200 len: 1601 microversion: 2.1 time: 0.165634 Jul 26 18:53:58.094391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2036/4041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:57 2022] GET /compute/v2.1/servers/9982c007-1157-4c63-93e8-3733712f06e0 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:58.098823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-83bff30d-db2e-445c-b0bf-2562e8c6f878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:58.099446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-83bff30d-db2e-445c-b0bf-2562e8c6f878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:58.105318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83bff30d-db2e-445c-b0bf-2562e8c6f878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:58.105766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83bff30d-db2e-445c-b0bf-2562e8c6f878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:58.106519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83bff30d-db2e-445c-b0bf-2562e8c6f878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:58.106981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-83bff30d-db2e-445c-b0bf-2562e8c6f878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:58.169082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-83bff30d-db2e-445c-b0bf-2562e8c6f878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:58.177840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-83bff30d-db2e-445c-b0bf-2562e8c6f878 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.082414 Jul 26 18:53:58.178497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2037/4042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:58 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:58.183058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c2747c60-fe1a-4c1b-aae3-a7ca08905b0d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:58.183649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c2747c60-fe1a-4c1b-aae3-a7ca08905b0d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:58.240274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c2747c60-fe1a-4c1b-aae3-a7ca08905b0d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:58.247738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c2747c60-fe1a-4c1b-aae3-a7ca08905b0d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:58.249329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c2747c60-fe1a-4c1b-aae3-a7ca08905b0d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:58.250452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c2747c60-fe1a-4c1b-aae3-a7ca08905b0d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 200 len: 1280 microversion: 2.20 time: 0.070970 Jul 26 18:53:58.257968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2038/4043] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:58 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:58.257968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c4c3a820-51fd-4cad-84dc-352e5b1805f8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:58.257968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c4c3a820-51fd-4cad-84dc-352e5b1805f8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:58.263895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4c3a820-51fd-4cad-84dc-352e5b1805f8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:58.264554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4c3a820-51fd-4cad-84dc-352e5b1805f8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:58.265333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4c3a820-51fd-4cad-84dc-352e5b1805f8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:58.265797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c4c3a820-51fd-4cad-84dc-352e5b1805f8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:58.401642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c4c3a820-51fd-4cad-84dc-352e5b1805f8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:58.410689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c4c3a820-51fd-4cad-84dc-352e5b1805f8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158635 Jul 26 18:53:58.411327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2039/4044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:58 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:58.415791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b54c8714-631e-4857-af18-82fcf3d89a4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] Calling method '.version_select at 0x7f3909527550>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:58.438776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b54c8714-631e-4857-af18-82fcf3d89a4b tempest-TestMinimumBasicScenario-1678954881 tempest-TestMinimumBasicScenario-1678954881-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1650664673" status: 202 len: 0 microversion: 2.1 time: 0.026447 Jul 26 18:53:58.439465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2040/4045] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Jul 26 18:53:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1650664673 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:53:59.202968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-549d0092-4812-4051-99c0-6d3bfcfe0b3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:59.203903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-549d0092-4812-4051-99c0-6d3bfcfe0b3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:59.210054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-549d0092-4812-4051-99c0-6d3bfcfe0b3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:59.210502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-549d0092-4812-4051-99c0-6d3bfcfe0b3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:59.211286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-549d0092-4812-4051-99c0-6d3bfcfe0b3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:59.211720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-549d0092-4812-4051-99c0-6d3bfcfe0b3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:59.283132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-549d0092-4812-4051-99c0-6d3bfcfe0b3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:59.291590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-549d0092-4812-4051-99c0-6d3bfcfe0b3f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095260 Jul 26 18:53:59.292147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2041/4046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:59 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:53:59.296909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-14f5c4b9-9daf-42ff-be46-67ad1fbb875b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:59.297511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-14f5c4b9-9daf-42ff-be46-67ad1fbb875b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:59.303406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14f5c4b9-9daf-42ff-be46-67ad1fbb875b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:59.303953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14f5c4b9-9daf-42ff-be46-67ad1fbb875b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:59.304702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14f5c4b9-9daf-42ff-be46-67ad1fbb875b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:59.305137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14f5c4b9-9daf-42ff-be46-67ad1fbb875b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:59.393099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-14f5c4b9-9daf-42ff-be46-67ad1fbb875b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:59.402408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-14f5c4b9-9daf-42ff-be46-67ad1fbb875b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:59.404778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-14f5c4b9-9daf-42ff-be46-67ad1fbb875b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:59.405933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-14f5c4b9-9daf-42ff-be46-67ad1fbb875b tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 200 len: 1338 microversion: 2.20 time: 0.112874 Jul 26 18:53:59.406614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2042/4047] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:53:59 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 1338 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:53:59.433368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f57333c7-cc22-496e-9d92-b323ec4b2e2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:53:59.433972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f57333c7-cc22-496e-9d92-b323ec4b2e2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:53:59.440346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f57333c7-cc22-496e-9d92-b323ec4b2e2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:59.440866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f57333c7-cc22-496e-9d92-b323ec4b2e2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:59.441686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f57333c7-cc22-496e-9d92-b323ec4b2e2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:53:59.442058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f57333c7-cc22-496e-9d92-b323ec4b2e2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:53:59.680123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f57333c7-cc22-496e-9d92-b323ec4b2e2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:53:59.688802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f57333c7-cc22-496e-9d92-b323ec4b2e2c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.259160 Jul 26 18:53:59.689725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2043/4048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:53:59 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:00.314264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f59ef799-2417-45ce-9157-ffdb54cf8581 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:00.315067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f59ef799-2417-45ce-9157-ffdb54cf8581 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:00.321517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f59ef799-2417-45ce-9157-ffdb54cf8581 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:00.322050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f59ef799-2417-45ce-9157-ffdb54cf8581 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:00.323175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f59ef799-2417-45ce-9157-ffdb54cf8581 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:00.323434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f59ef799-2417-45ce-9157-ffdb54cf8581 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:00.413635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f59ef799-2417-45ce-9157-ffdb54cf8581 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:00.432580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f59ef799-2417-45ce-9157-ffdb54cf8581 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.121796 Jul 26 18:54:00.446782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2044/4049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:00 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:00.446782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-52b6a92c-776f-4efd-8717-34cebb0796da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:00.446782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-52b6a92c-776f-4efd-8717-34cebb0796da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:00.457597 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52b6a92c-776f-4efd-8717-34cebb0796da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:00.458369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52b6a92c-776f-4efd-8717-34cebb0796da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:00.460881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52b6a92c-776f-4efd-8717-34cebb0796da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:00.461887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52b6a92c-776f-4efd-8717-34cebb0796da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:00.468674 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:00.700861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-52b6a92c-776f-4efd-8717-34cebb0796da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:00.711681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-52b6a92c-776f-4efd-8717-34cebb0796da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:00.713206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-52b6a92c-776f-4efd-8717-34cebb0796da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:00.714353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-52b6a92c-776f-4efd-8717-34cebb0796da tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 200 len: 1405 microversion: 2.20 time: 0.273260 Jul 26 18:54:00.715339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2045/4050] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:54:00 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 1405 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:54:00.724752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-8ea4c9d7-5ab7-43f1-bec6-a36c80a75472 req-a3e1f24c-3a2d-4042-9321-e0bb237e44f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf4c176-65d7-4270-bed8-8f038aa47288", "tag": "55c087d5-8838-4b6c-aa33-cdbad58cd768"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:54:00.734442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-8ea4c9d7-5ab7-43f1-bec6-a36c80a75472 req-a3e1f24c-3a2d-4042-9321-e0bb237e44f5 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:00.734878 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-8ea4c9d7-5ab7-43f1-bec6-a36c80a75472 req-a3e1f24c-3a2d-4042-9321-e0bb237e44f5 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:00.922335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-8ea4c9d7-5ab7-43f1-bec6-a36c80a75472 req-a3e1f24c-3a2d-4042-9321-e0bb237e44f5 service nova] Creating event network-changed:55c087d5-8838-4b6c-aa33-cdbad58cd768 for instance 0cf4c176-65d7-4270-bed8-8f038aa47288 on hv-cinder-82549 Jul 26 18:54:00.931932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-8ea4c9d7-5ab7-43f1-bec6-a36c80a75472 req-a3e1f24c-3a2d-4042-9321-e0bb237e44f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215337 Jul 26 18:54:00.934913 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2046/4051] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:54:00.941630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e5abfef6-a808-4e48-a61a-1e1745372a9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:00.946492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e5abfef6-a808-4e48-a61a-1e1745372a9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:00.967836 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5abfef6-a808-4e48-a61a-1e1745372a9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:00.968284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5abfef6-a808-4e48-a61a-1e1745372a9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:00.969095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5abfef6-a808-4e48-a61a-1e1745372a9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:00.969513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5abfef6-a808-4e48-a61a-1e1745372a9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:01.182553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e5abfef6-a808-4e48-a61a-1e1745372a9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:01.191656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e5abfef6-a808-4e48-a61a-1e1745372a9a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.254681 Jul 26 18:54:01.192643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2047/4052] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:00 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:01.453849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d024a5c4-dcc3-421e-a882-ac03820c9ac3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:01.454516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d024a5c4-dcc3-421e-a882-ac03820c9ac3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:01.461195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d024a5c4-dcc3-421e-a882-ac03820c9ac3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:01.461643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d024a5c4-dcc3-421e-a882-ac03820c9ac3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:01.462631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d024a5c4-dcc3-421e-a882-ac03820c9ac3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:01.463091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d024a5c4-dcc3-421e-a882-ac03820c9ac3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:01.532411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d024a5c4-dcc3-421e-a882-ac03820c9ac3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:01.541442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d024a5c4-dcc3-421e-a882-ac03820c9ac3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091284 Jul 26 18:54:01.544445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2048/4053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:01 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:54:01.737241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e793fe72-1f51-44bc-9c00-2003bf26c3dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:01.738163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e793fe72-1f51-44bc-9c00-2003bf26c3dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:01.750133 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e793fe72-1f51-44bc-9c00-2003bf26c3dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:01.750779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e793fe72-1f51-44bc-9c00-2003bf26c3dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:01.751820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e793fe72-1f51-44bc-9c00-2003bf26c3dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:01.752424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e793fe72-1f51-44bc-9c00-2003bf26c3dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:01.893052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e793fe72-1f51-44bc-9c00-2003bf26c3dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:01.901505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e793fe72-1f51-44bc-9c00-2003bf26c3dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:01.903204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e793fe72-1f51-44bc-9c00-2003bf26c3dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:01.904316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e793fe72-1f51-44bc-9c00-2003bf26c3dd tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 200 len: 1405 microversion: 2.20 time: 0.171123 Jul 26 18:54:01.904910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2049/4054] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:54:01 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:54:02.213843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7cbeba69-f044-4699-9479-10eba3c08974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:02.214705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7cbeba69-f044-4699-9479-10eba3c08974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:02.222123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cbeba69-f044-4699-9479-10eba3c08974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:02.222566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cbeba69-f044-4699-9479-10eba3c08974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:02.223445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cbeba69-f044-4699-9479-10eba3c08974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:02.223877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cbeba69-f044-4699-9479-10eba3c08974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:02.384003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7cbeba69-f044-4699-9479-10eba3c08974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:02.392525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7cbeba69-f044-4699-9479-10eba3c08974 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.182656 Jul 26 18:54:02.393092 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2050/4055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:54:02.480060 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:54:02.480661 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:54:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 18:54:02.564114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a37596e6-8bd1-4e09-8743-4676e3d6c8ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:02.564842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a37596e6-8bd1-4e09-8743-4676e3d6c8ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:02.572007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a37596e6-8bd1-4e09-8743-4676e3d6c8ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:02.572412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a37596e6-8bd1-4e09-8743-4676e3d6c8ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:02.573181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a37596e6-8bd1-4e09-8743-4676e3d6c8ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:02.573624 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a37596e6-8bd1-4e09-8743-4676e3d6c8ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:02.641617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a37596e6-8bd1-4e09-8743-4676e3d6c8ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:02.651445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a37596e6-8bd1-4e09-8743-4676e3d6c8ef tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091188 Jul 26 18:54:02.652100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2051/4056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:02 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:03.099413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-499a4887-f700-4f7c-8789-d4e6cca1320c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:03.099983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-499a4887-f700-4f7c-8789-d4e6cca1320c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:03.106535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-499a4887-f700-4f7c-8789-d4e6cca1320c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:03.107110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-499a4887-f700-4f7c-8789-d4e6cca1320c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:03.108011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-499a4887-f700-4f7c-8789-d4e6cca1320c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:03.108539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-499a4887-f700-4f7c-8789-d4e6cca1320c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:03.259739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-499a4887-f700-4f7c-8789-d4e6cca1320c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:03.269182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-499a4887-f700-4f7c-8789-d4e6cca1320c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:03.271382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-499a4887-f700-4f7c-8789-d4e6cca1320c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:03.272651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-499a4887-f700-4f7c-8789-d4e6cca1320c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 200 len: 1405 microversion: 2.20 time: 0.350153 Jul 26 18:54:03.273277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2052/4057] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:54:02 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 1405 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:54:03.414207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e8d3dfb8-dff5-4555-b7e6-660fe18554af tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:03.414726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e8d3dfb8-dff5-4555-b7e6-660fe18554af tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:03.421197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8d3dfb8-dff5-4555-b7e6-660fe18554af tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:03.421738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8d3dfb8-dff5-4555-b7e6-660fe18554af tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:03.422506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8d3dfb8-dff5-4555-b7e6-660fe18554af tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:03.422944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e8d3dfb8-dff5-4555-b7e6-660fe18554af tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:03.648576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e8d3dfb8-dff5-4555-b7e6-660fe18554af tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:03.658460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e8d3dfb8-dff5-4555-b7e6-660fe18554af tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.247678 Jul 26 18:54:03.659311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2053/4058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:03 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:54:03.680395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6828d026-7144-41e2-8bb8-471c9bb6ce2f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:03.681041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6828d026-7144-41e2-8bb8-471c9bb6ce2f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:03.697021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6828d026-7144-41e2-8bb8-471c9bb6ce2f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:03.697454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6828d026-7144-41e2-8bb8-471c9bb6ce2f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:03.698222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6828d026-7144-41e2-8bb8-471c9bb6ce2f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:03.698655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6828d026-7144-41e2-8bb8-471c9bb6ce2f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:03.784025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6828d026-7144-41e2-8bb8-471c9bb6ce2f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:03.792865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6828d026-7144-41e2-8bb8-471c9bb6ce2f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.123676 Jul 26 18:54:03.793726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2054/4059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:03 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:04.166678 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_api:SELECT=89 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:04.189107 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: DEBUG dbcounter [-] [117997] Writing DB stats nova_cell1:SELECT=71 {{(pid=117997) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:04.295190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1fea4040-072a-4b68-8110-b29765a8d31d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:04.295931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1fea4040-072a-4b68-8110-b29765a8d31d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:04.304139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1fea4040-072a-4b68-8110-b29765a8d31d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:04.304561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1fea4040-072a-4b68-8110-b29765a8d31d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:04.305333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1fea4040-072a-4b68-8110-b29765a8d31d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:04.305790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1fea4040-072a-4b68-8110-b29765a8d31d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:04.830734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1fea4040-072a-4b68-8110-b29765a8d31d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:04.841102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1fea4040-072a-4b68-8110-b29765a8d31d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:04.842741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1fea4040-072a-4b68-8110-b29765a8d31d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:04.844029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1fea4040-072a-4b68-8110-b29765a8d31d tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 200 len: 1405 microversion: 2.20 time: 0.552960 Jul 26 18:54:04.845365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2055/4060] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:54:04 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 1405 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:54:04.864344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4a93a933-bc01-4444-a31d-181311bb93ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:04.865231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4a93a933-bc01-4444-a31d-181311bb93ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:04.871581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a93a933-bc01-4444-a31d-181311bb93ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:04.872022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a93a933-bc01-4444-a31d-181311bb93ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:04.872778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a93a933-bc01-4444-a31d-181311bb93ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:04.873205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4a93a933-bc01-4444-a31d-181311bb93ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:05.077602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4a93a933-bc01-4444-a31d-181311bb93ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:05.086507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4a93a933-bc01-4444-a31d-181311bb93ae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.239916 Jul 26 18:54:05.087412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2056/4061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:04 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:05.091766 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7656a04f-02fc-4631-a06e-24241ed22e13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:05.092478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7656a04f-02fc-4631-a06e-24241ed22e13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:05.101381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7656a04f-02fc-4631-a06e-24241ed22e13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:05.102123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7656a04f-02fc-4631-a06e-24241ed22e13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:05.102908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7656a04f-02fc-4631-a06e-24241ed22e13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:05.103618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7656a04f-02fc-4631-a06e-24241ed22e13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:05.176550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7656a04f-02fc-4631-a06e-24241ed22e13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:05.186315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7656a04f-02fc-4631-a06e-24241ed22e13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.098136 Jul 26 18:54:05.186901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2057/4062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:05 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:05.869945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a331037c-caeb-4cbd-acf6-375d291fa0fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:05.870622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a331037c-caeb-4cbd-acf6-375d291fa0fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:05.878216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a331037c-caeb-4cbd-acf6-375d291fa0fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:05.878661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a331037c-caeb-4cbd-acf6-375d291fa0fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:05.879467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a331037c-caeb-4cbd-acf6-375d291fa0fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:05.879962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a331037c-caeb-4cbd-acf6-375d291fa0fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:06.166535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a331037c-caeb-4cbd-acf6-375d291fa0fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:06.175645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a331037c-caeb-4cbd-acf6-375d291fa0fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:06.177165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a331037c-caeb-4cbd-acf6-375d291fa0fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:06.178529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a331037c-caeb-4cbd-acf6-375d291fa0fe tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 200 len: 1405 microversion: 2.20 time: 0.312660 Jul 26 18:54:06.191797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2058/4063] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:54:05 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 1405 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 18:54:06.200470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-42b0db67-4230-44e6-a1f2-2b002dc493f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:06.201075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-42b0db67-4230-44e6-a1f2-2b002dc493f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:06.210701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42b0db67-4230-44e6-a1f2-2b002dc493f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:06.211190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42b0db67-4230-44e6-a1f2-2b002dc493f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:06.212360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42b0db67-4230-44e6-a1f2-2b002dc493f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:06.212801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42b0db67-4230-44e6-a1f2-2b002dc493f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:06.495395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-42b0db67-4230-44e6-a1f2-2b002dc493f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:06.506007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-42b0db67-4230-44e6-a1f2-2b002dc493f4 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.311865 Jul 26 18:54:06.506760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2059/4064] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:06 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:06.519703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6b3cd7d0-ea63-4d92-b00c-c4bfc7e76fc9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:06.520991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6b3cd7d0-ea63-4d92-b00c-c4bfc7e76fc9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:06.529522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b3cd7d0-ea63-4d92-b00c-c4bfc7e76fc9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:06.535178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b3cd7d0-ea63-4d92-b00c-c4bfc7e76fc9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:06.537257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b3cd7d0-ea63-4d92-b00c-c4bfc7e76fc9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:06.537921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6b3cd7d0-ea63-4d92-b00c-c4bfc7e76fc9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:06.612376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6b3cd7d0-ea63-4d92-b00c-c4bfc7e76fc9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:06.621217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6b3cd7d0-ea63-4d92-b00c-c4bfc7e76fc9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.112522 Jul 26 18:54:06.622877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2060/4065] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:06 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:06.690618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-64721062-4617-478d-99dc-88dfa05b4b76 req-8666c815-37fc-41d3-9662-5c08259e4555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf4c176-65d7-4270-bed8-8f038aa47288", "name": "network-vif-plugged", "status": "completed", "tag": "55c087d5-8838-4b6c-aa33-cdbad58cd768"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:54:06.700919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-64721062-4617-478d-99dc-88dfa05b4b76 req-8666c815-37fc-41d3-9662-5c08259e4555 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:06.701446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-64721062-4617-478d-99dc-88dfa05b4b76 req-8666c815-37fc-41d3-9662-5c08259e4555 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:06.713720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-64721062-4617-478d-99dc-88dfa05b4b76 req-8666c815-37fc-41d3-9662-5c08259e4555 service nova] Creating event network-vif-plugged:55c087d5-8838-4b6c-aa33-cdbad58cd768 for instance 0cf4c176-65d7-4270-bed8-8f038aa47288 on hv-cinder-82549 Jul 26 18:54:06.719781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-64721062-4617-478d-99dc-88dfa05b4b76 req-8666c815-37fc-41d3-9662-5c08259e4555 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095368 Jul 26 18:54:06.721727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2061/4066] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:54:07.203959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-154bc89a-ce31-4372-83ba-4d94e0f724c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:07.204747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-154bc89a-ce31-4372-83ba-4d94e0f724c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:07.212452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-154bc89a-ce31-4372-83ba-4d94e0f724c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:07.213420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-154bc89a-ce31-4372-83ba-4d94e0f724c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:07.214208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-154bc89a-ce31-4372-83ba-4d94e0f724c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:07.214645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-154bc89a-ce31-4372-83ba-4d94e0f724c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:07.429568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-154bc89a-ce31-4372-83ba-4d94e0f724c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:07.438658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-154bc89a-ce31-4372-83ba-4d94e0f724c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:07.440631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-154bc89a-ce31-4372-83ba-4d94e0f724c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:07.442174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-154bc89a-ce31-4372-83ba-4d94e0f724c3 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 200 len: 1405 microversion: 2.20 time: 0.242732 Jul 26 18:54:07.443260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2062/4067] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:54:07 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:54:07.531828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ef473253-9aea-46f0-bec6-eb7ba2cdadae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:07.532930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ef473253-9aea-46f0-bec6-eb7ba2cdadae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:07.540912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef473253-9aea-46f0-bec6-eb7ba2cdadae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:07.541902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef473253-9aea-46f0-bec6-eb7ba2cdadae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:07.543074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef473253-9aea-46f0-bec6-eb7ba2cdadae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:07.544018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ef473253-9aea-46f0-bec6-eb7ba2cdadae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:07.548076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:07.737703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ef473253-9aea-46f0-bec6-eb7ba2cdadae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:07.746086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ef473253-9aea-46f0-bec6-eb7ba2cdadae tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.221128 Jul 26 18:54:07.746956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2063/4068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:07 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:07.756376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-18e2db9e-5e6c-4ab6-b39d-08b9edf3ebde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:07.757267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-18e2db9e-5e6c-4ab6-b39d-08b9edf3ebde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:07.765867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18e2db9e-5e6c-4ab6-b39d-08b9edf3ebde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:07.767089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18e2db9e-5e6c-4ab6-b39d-08b9edf3ebde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:07.768071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18e2db9e-5e6c-4ab6-b39d-08b9edf3ebde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:07.768565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-18e2db9e-5e6c-4ab6-b39d-08b9edf3ebde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:07.844677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:07.866014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-18e2db9e-5e6c-4ab6-b39d-08b9edf3ebde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:07.876457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-18e2db9e-5e6c-4ab6-b39d-08b9edf3ebde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.128285 Jul 26 18:54:07.877567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2064/4069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:07 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:08.467504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2377644f-7ee8-4e30-8901-6ae11f43928f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:08.469860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2377644f-7ee8-4e30-8901-6ae11f43928f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:08.475318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=12 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:08.484404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2377644f-7ee8-4e30-8901-6ae11f43928f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:08.485671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2377644f-7ee8-4e30-8901-6ae11f43928f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:08.486857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2377644f-7ee8-4e30-8901-6ae11f43928f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:08.487564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2377644f-7ee8-4e30-8901-6ae11f43928f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:08.713808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2377644f-7ee8-4e30-8901-6ae11f43928f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:08.722671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2377644f-7ee8-4e30-8901-6ae11f43928f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:08.724260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2377644f-7ee8-4e30-8901-6ae11f43928f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:08.725536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2377644f-7ee8-4e30-8901-6ae11f43928f tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 200 len: 1405 microversion: 2.20 time: 0.264282 Jul 26 18:54:08.726135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2065/4070] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:54:08 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 1405 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:54:08.768222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-51813243-6daf-47c3-9bf7-33f3b7eab908 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:08.769226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-51813243-6daf-47c3-9bf7-33f3b7eab908 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:08.776880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51813243-6daf-47c3-9bf7-33f3b7eab908 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:08.777627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51813243-6daf-47c3-9bf7-33f3b7eab908 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:08.778819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51813243-6daf-47c3-9bf7-33f3b7eab908 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:08.779287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51813243-6daf-47c3-9bf7-33f3b7eab908 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:08.922386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-51813243-6daf-47c3-9bf7-33f3b7eab908 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:08.930819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-51813243-6daf-47c3-9bf7-33f3b7eab908 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.166998 Jul 26 18:54:08.932819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2066/4071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:08 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:54:08.940558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5ad59bdc-e133-4811-a247-7a5e4d5f7015 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:08.941564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5ad59bdc-e133-4811-a247-7a5e4d5f7015 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:08.947866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ad59bdc-e133-4811-a247-7a5e4d5f7015 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:08.948391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ad59bdc-e133-4811-a247-7a5e4d5f7015 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:08.949246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ad59bdc-e133-4811-a247-7a5e4d5f7015 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:08.949690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5ad59bdc-e133-4811-a247-7a5e4d5f7015 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:09.019181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5ad59bdc-e133-4811-a247-7a5e4d5f7015 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:09.030320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5ad59bdc-e133-4811-a247-7a5e4d5f7015 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093964 Jul 26 18:54:09.031188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2067/4072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:08 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:09.748737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f6583914-2d53-40cc-a1fa-9cc795e6f1c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:09.749421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f6583914-2d53-40cc-a1fa-9cc795e6f1c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:09.755857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6583914-2d53-40cc-a1fa-9cc795e6f1c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:09.756307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6583914-2d53-40cc-a1fa-9cc795e6f1c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:09.757044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6583914-2d53-40cc-a1fa-9cc795e6f1c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:09.757686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6583914-2d53-40cc-a1fa-9cc795e6f1c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:09.923251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f6583914-2d53-40cc-a1fa-9cc795e6f1c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:09.939473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f6583914-2d53-40cc-a1fa-9cc795e6f1c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:09.941443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f6583914-2d53-40cc-a1fa-9cc795e6f1c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:09.942899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f6583914-2d53-40cc-a1fa-9cc795e6f1c9 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 200 len: 1597 microversion: 2.20 time: 0.198331 Jul 26 18:54:09.960026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2068/4073] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 18:54:09 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 1597 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 18:54:09.966970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b4be70c5-3e2b-419d-8657-b969b080a554 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:09.967876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b4be70c5-3e2b-419d-8657-b969b080a554 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:09.974985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4be70c5-3e2b-419d-8657-b969b080a554 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:09.975668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4be70c5-3e2b-419d-8657-b969b080a554 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:09.976650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4be70c5-3e2b-419d-8657-b969b080a554 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:09.977271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b4be70c5-3e2b-419d-8657-b969b080a554 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:10.287294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b4be70c5-3e2b-419d-8657-b969b080a554 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:10.302174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b4be70c5-3e2b-419d-8657-b969b080a554 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.343206 Jul 26 18:54:10.303567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2069/4074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:09 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:10.309354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5d534f34-8aff-48ae-96e5-c5714f1d95b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:10.310129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5d534f34-8aff-48ae-96e5-c5714f1d95b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:10.319712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d534f34-8aff-48ae-96e5-c5714f1d95b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:10.320218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d534f34-8aff-48ae-96e5-c5714f1d95b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:10.321045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d534f34-8aff-48ae-96e5-c5714f1d95b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:10.321693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d534f34-8aff-48ae-96e5-c5714f1d95b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:10.484147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5d534f34-8aff-48ae-96e5-c5714f1d95b5 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.178594 Jul 26 18:54:10.497710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2070/4075] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Jul 26 18:54:10 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:54:10.504526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d1ae1d30-827f-4a80-809d-be07a305eba4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:10.506288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d1ae1d30-827f-4a80-809d-be07a305eba4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:10.525622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1ae1d30-827f-4a80-809d-be07a305eba4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:10.526332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1ae1d30-827f-4a80-809d-be07a305eba4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:10.530054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1ae1d30-827f-4a80-809d-be07a305eba4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:10.530639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1ae1d30-827f-4a80-809d-be07a305eba4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:10.648352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d1ae1d30-827f-4a80-809d-be07a305eba4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:10.679595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d1ae1d30-827f-4a80-809d-be07a305eba4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.178440 Jul 26 18:54:10.698981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2071/4076] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:10 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:11.325860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-71bb4777-49fd-4177-abad-0c44dd27b382 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:11.327291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-71bb4777-49fd-4177-abad-0c44dd27b382 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:11.332858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:11.346642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71bb4777-49fd-4177-abad-0c44dd27b382 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:11.347137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71bb4777-49fd-4177-abad-0c44dd27b382 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:11.347919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71bb4777-49fd-4177-abad-0c44dd27b382 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:11.348359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71bb4777-49fd-4177-abad-0c44dd27b382 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:11.659750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-71bb4777-49fd-4177-abad-0c44dd27b382 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:11.670013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-71bb4777-49fd-4177-abad-0c44dd27b382 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.349371 Jul 26 18:54:11.671437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2072/4077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:11.703495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c34e4fb3-357f-4f6f-a07c-cea3f31687d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:11.704611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c34e4fb3-357f-4f6f-a07c-cea3f31687d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:11.712959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c34e4fb3-357f-4f6f-a07c-cea3f31687d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:11.714061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c34e4fb3-357f-4f6f-a07c-cea3f31687d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:11.715269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c34e4fb3-357f-4f6f-a07c-cea3f31687d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:11.715959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c34e4fb3-357f-4f6f-a07c-cea3f31687d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:11.849003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c34e4fb3-357f-4f6f-a07c-cea3f31687d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:11.858736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c34e4fb3-357f-4f6f-a07c-cea3f31687d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.159725 Jul 26 18:54:11.873860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2073/4078] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:11 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:12.324607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-e94aa574-4b20-4148-8e06-480083b5c0e5 req-c4392d49-934e-4af8-9682-9a30a0644bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf4c176-65d7-4270-bed8-8f038aa47288", "tag": "55c087d5-8838-4b6c-aa33-cdbad58cd768"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:54:12.336775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-e94aa574-4b20-4148-8e06-480083b5c0e5 req-c4392d49-934e-4af8-9682-9a30a0644bab service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:12.338141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-e94aa574-4b20-4148-8e06-480083b5c0e5 req-c4392d49-934e-4af8-9682-9a30a0644bab service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:12.356993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-e94aa574-4b20-4148-8e06-480083b5c0e5 req-c4392d49-934e-4af8-9682-9a30a0644bab service nova] Creating event network-changed:55c087d5-8838-4b6c-aa33-cdbad58cd768 for instance 0cf4c176-65d7-4270-bed8-8f038aa47288 on hv-cinder-82549 Jul 26 18:54:12.365655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-e94aa574-4b20-4148-8e06-480083b5c0e5 req-c4392d49-934e-4af8-9682-9a30a0644bab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045297 Jul 26 18:54:12.372206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2074/4079] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:54:12.693083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-896ed6a9-0484-48ae-b33c-8b452c55aeb6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:12.694041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-896ed6a9-0484-48ae-b33c-8b452c55aeb6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:12.704262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-896ed6a9-0484-48ae-b33c-8b452c55aeb6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:12.706859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-896ed6a9-0484-48ae-b33c-8b452c55aeb6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:12.710255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-896ed6a9-0484-48ae-b33c-8b452c55aeb6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:12.710993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-896ed6a9-0484-48ae-b33c-8b452c55aeb6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:12.941922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-896ed6a9-0484-48ae-b33c-8b452c55aeb6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:12.951013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-896ed6a9-0484-48ae-b33c-8b452c55aeb6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.262677 Jul 26 18:54:12.956064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2075/4080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:12 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:54:12.961400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-72bb9e3f-ea90-46b7-89a1-b4c42822a0aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:12.965538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-72bb9e3f-ea90-46b7-89a1-b4c42822a0aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:12.974737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72bb9e3f-ea90-46b7-89a1-b4c42822a0aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:12.975546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72bb9e3f-ea90-46b7-89a1-b4c42822a0aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:12.976815 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72bb9e3f-ea90-46b7-89a1-b4c42822a0aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:12.977430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72bb9e3f-ea90-46b7-89a1-b4c42822a0aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:13.094601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-72bb9e3f-ea90-46b7-89a1-b4c42822a0aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:13.109509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-72bb9e3f-ea90-46b7-89a1-b4c42822a0aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.151780 Jul 26 18:54:13.110281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2076/4081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:12 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:13.976871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-69de4385-8cb7-4a9b-9172-c19bc5afabda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:13.977725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-69de4385-8cb7-4a9b-9172-c19bc5afabda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:13.985420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69de4385-8cb7-4a9b-9172-c19bc5afabda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:13.986364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69de4385-8cb7-4a9b-9172-c19bc5afabda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:13.987402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69de4385-8cb7-4a9b-9172-c19bc5afabda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:13.988077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69de4385-8cb7-4a9b-9172-c19bc5afabda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:14.184137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-69de4385-8cb7-4a9b-9172-c19bc5afabda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:14.198479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-69de4385-8cb7-4a9b-9172-c19bc5afabda tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.225737 Jul 26 18:54:14.199695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2077/4082] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:13 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:54:14.204958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bcc56fdc-a832-437b-8dc3-f2890220f7af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:14.205731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bcc56fdc-a832-437b-8dc3-f2890220f7af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:14.218884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bcc56fdc-a832-437b-8dc3-f2890220f7af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:14.220320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bcc56fdc-a832-437b-8dc3-f2890220f7af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:14.221485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bcc56fdc-a832-437b-8dc3-f2890220f7af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:14.222102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bcc56fdc-a832-437b-8dc3-f2890220f7af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:14.319765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bcc56fdc-a832-437b-8dc3-f2890220f7af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:14.331972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bcc56fdc-a832-437b-8dc3-f2890220f7af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.130932 Jul 26 18:54:14.336696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2078/4083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:14 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:14.963589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-306b400b-cb2f-4a07-80e2-6a2bd5409dfb tempest-TestShelveInstance-294642436 tempest-TestShelveInstance-294642436-project] Action: 'create', calling method: .version_select at 0x7f390956f430>, body: {"keypair": {"name": "tempest-TestShelveInstance-507627590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+U5mAUCHQFkH1T1oWyT4kZmahAFzftgatQ0e7/l4Zyz/AT2UUevxMVoI1eBsb2n+Ol5AFqntqEfz6u06a9MbrH6JftxtW9J14h463ULwphHJBkNH0ac8Borg6LG93liA=="}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:54:14.980160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-306b400b-cb2f-4a07-80e2-6a2bd5409dfb tempest-TestShelveInstance-294642436 tempest-TestShelveInstance-294642436-project] Getting quotas for project d65850e0d19149eba09eada22c0f78e1. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:54:14.984296 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-306b400b-cb2f-4a07-80e2-6a2bd5409dfb tempest-TestShelveInstance-294642436 tempest-TestShelveInstance-294642436-project] Getting quotas for user 54d208cf39054abd840af4e0e6b5245c and project d65850e0d19149eba09eada22c0f78e1. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:54:15.009514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-306b400b-cb2f-4a07-80e2-6a2bd5409dfb tempest-TestShelveInstance-294642436 tempest-TestShelveInstance-294642436-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.234629 Jul 26 18:54:15.010207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2079/4084] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Jul 26 18:54:14 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:54:15.220663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-81b97552-4098-4555-be33-e8f25697bd97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:15.221378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-81b97552-4098-4555-be33-e8f25697bd97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:15.229667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81b97552-4098-4555-be33-e8f25697bd97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:15.230223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81b97552-4098-4555-be33-e8f25697bd97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:15.231192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81b97552-4098-4555-be33-e8f25697bd97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:15.231881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81b97552-4098-4555-be33-e8f25697bd97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:15.387564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-81b97552-4098-4555-be33-e8f25697bd97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:15.396208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-81b97552-4098-4555-be33-e8f25697bd97 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.179268 Jul 26 18:54:15.396883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2080/4085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:15.401471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e1ce08bc-4f66-4b7d-9f21-6a22fd917429 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:15.402349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e1ce08bc-4f66-4b7d-9f21-6a22fd917429 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:15.416244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1ce08bc-4f66-4b7d-9f21-6a22fd917429 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:15.416687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1ce08bc-4f66-4b7d-9f21-6a22fd917429 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:15.417638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1ce08bc-4f66-4b7d-9f21-6a22fd917429 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:15.418097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1ce08bc-4f66-4b7d-9f21-6a22fd917429 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:15.503903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e1ce08bc-4f66-4b7d-9f21-6a22fd917429 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:15.506748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:15.514404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e1ce08bc-4f66-4b7d-9f21-6a22fd917429 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.116327 Jul 26 18:54:15.515327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2081/4086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:15 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:16.418470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5cb39bb1-4ae8-468e-a2f0-851e991d926b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:16.419229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5cb39bb1-4ae8-468e-a2f0-851e991d926b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:16.426094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cb39bb1-4ae8-468e-a2f0-851e991d926b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:16.426521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cb39bb1-4ae8-468e-a2f0-851e991d926b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:16.427326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cb39bb1-4ae8-468e-a2f0-851e991d926b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:16.427775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5cb39bb1-4ae8-468e-a2f0-851e991d926b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:16.574819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5cb39bb1-4ae8-468e-a2f0-851e991d926b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:16.585364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5cb39bb1-4ae8-468e-a2f0-851e991d926b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.171308 Jul 26 18:54:16.585961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2082/4087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:16.592198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f73f7a2b-bb2b-46c2-8bd8-b6359f7013f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:16.592813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f73f7a2b-bb2b-46c2-8bd8-b6359f7013f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:16.599943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f73f7a2b-bb2b-46c2-8bd8-b6359f7013f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:16.600395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f73f7a2b-bb2b-46c2-8bd8-b6359f7013f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:16.601171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f73f7a2b-bb2b-46c2-8bd8-b6359f7013f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:16.601606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f73f7a2b-bb2b-46c2-8bd8-b6359f7013f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:16.668765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f73f7a2b-bb2b-46c2-8bd8-b6359f7013f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:16.677655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f73f7a2b-bb2b-46c2-8bd8-b6359f7013f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089885 Jul 26 18:54:16.678540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2083/4088] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:16 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:17.610131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ff289207-4eaa-4f20-938e-625b11c05ea0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:17.611401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ff289207-4eaa-4f20-938e-625b11c05ea0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:17.621583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff289207-4eaa-4f20-938e-625b11c05ea0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:17.622057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff289207-4eaa-4f20-938e-625b11c05ea0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:17.622840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff289207-4eaa-4f20-938e-625b11c05ea0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:17.623315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff289207-4eaa-4f20-938e-625b11c05ea0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:17.767393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ff289207-4eaa-4f20-938e-625b11c05ea0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:17.776084 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ff289207-4eaa-4f20-938e-625b11c05ea0 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.172616 Jul 26 18:54:17.776660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2084/4089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:17 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:17.781359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7d1856e3-66b1-4c5c-9df0-2305d4d5d0ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:17.782078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7d1856e3-66b1-4c5c-9df0-2305d4d5d0ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:17.788716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d1856e3-66b1-4c5c-9df0-2305d4d5d0ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:17.789283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d1856e3-66b1-4c5c-9df0-2305d4d5d0ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:17.790028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d1856e3-66b1-4c5c-9df0-2305d4d5d0ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:17.790493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d1856e3-66b1-4c5c-9df0-2305d4d5d0ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:17.851755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7d1856e3-66b1-4c5c-9df0-2305d4d5d0ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:17.860681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7d1856e3-66b1-4c5c-9df0-2305d4d5d0ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083021 Jul 26 18:54:17.861184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2085/4090] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:17 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:18.798205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f884551b-4d4f-4e27-b51f-de34c23ac8d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:18.798840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f884551b-4d4f-4e27-b51f-de34c23ac8d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:18.806179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f884551b-4d4f-4e27-b51f-de34c23ac8d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:18.806631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f884551b-4d4f-4e27-b51f-de34c23ac8d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:18.807442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f884551b-4d4f-4e27-b51f-de34c23ac8d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:18.807876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f884551b-4d4f-4e27-b51f-de34c23ac8d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:18.944461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f884551b-4d4f-4e27-b51f-de34c23ac8d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:18.952991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f884551b-4d4f-4e27-b51f-de34c23ac8d9 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158828 Jul 26 18:54:18.953594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2086/4091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:18.958459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d6224223-5f94-421d-a2d0-c29eb38a8e10 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:18.959052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d6224223-5f94-421d-a2d0-c29eb38a8e10 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:18.965112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d6224223-5f94-421d-a2d0-c29eb38a8e10 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:18.965564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d6224223-5f94-421d-a2d0-c29eb38a8e10 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:18.966370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d6224223-5f94-421d-a2d0-c29eb38a8e10 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:18.966839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d6224223-5f94-421d-a2d0-c29eb38a8e10 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:19.033778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d6224223-5f94-421d-a2d0-c29eb38a8e10 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:19.042371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d6224223-5f94-421d-a2d0-c29eb38a8e10 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.087735 Jul 26 18:54:19.050907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2087/4092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:18 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:19.977043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e6e5a985-0911-4330-840e-7921f8152c3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:19.977714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e6e5a985-0911-4330-840e-7921f8152c3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:19.984734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6e5a985-0911-4330-840e-7921f8152c3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:19.985151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6e5a985-0911-4330-840e-7921f8152c3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:19.985941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6e5a985-0911-4330-840e-7921f8152c3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:19.986379 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6e5a985-0911-4330-840e-7921f8152c3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:20.118227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e6e5a985-0911-4330-840e-7921f8152c3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:20.130116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e6e5a985-0911-4330-840e-7921f8152c3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158307 Jul 26 18:54:20.130686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2088/4093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:19 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:20.135217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cb68e357-48de-40dd-9c99-a2408df97cc6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:20.135825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cb68e357-48de-40dd-9c99-a2408df97cc6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:20.141996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb68e357-48de-40dd-9c99-a2408df97cc6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:20.142453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb68e357-48de-40dd-9c99-a2408df97cc6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:20.143264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb68e357-48de-40dd-9c99-a2408df97cc6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:20.143698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb68e357-48de-40dd-9c99-a2408df97cc6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:20.210495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cb68e357-48de-40dd-9c99-a2408df97cc6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:20.218560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cb68e357-48de-40dd-9c99-a2408df97cc6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086868 Jul 26 18:54:20.219152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2089/4094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:20 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:21.156436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e0cb5ced-8021-4940-8bbd-63c7585d4000 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:21.157446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e0cb5ced-8021-4940-8bbd-63c7585d4000 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:21.168434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0cb5ced-8021-4940-8bbd-63c7585d4000 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:21.176544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0cb5ced-8021-4940-8bbd-63c7585d4000 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:21.179928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0cb5ced-8021-4940-8bbd-63c7585d4000 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:21.182104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0cb5ced-8021-4940-8bbd-63c7585d4000 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:21.318646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e0cb5ced-8021-4940-8bbd-63c7585d4000 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:21.327219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e0cb5ced-8021-4940-8bbd-63c7585d4000 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.177536 Jul 26 18:54:21.327802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2090/4095] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:21.339155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1990e2dc-3cd5-4f66-975a-89c79f6e7e09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:21.339155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1990e2dc-3cd5-4f66-975a-89c79f6e7e09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:21.339155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1990e2dc-3cd5-4f66-975a-89c79f6e7e09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:21.339512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1990e2dc-3cd5-4f66-975a-89c79f6e7e09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:21.340077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1990e2dc-3cd5-4f66-975a-89c79f6e7e09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:21.340510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1990e2dc-3cd5-4f66-975a-89c79f6e7e09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:21.405990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1990e2dc-3cd5-4f66-975a-89c79f6e7e09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:21.414418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1990e2dc-3cd5-4f66-975a-89c79f6e7e09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085567 Jul 26 18:54:21.415146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2091/4096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:21 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:22.352477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-234e85c7-c9b1-4014-a8fa-a446e30ccc4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:22.353232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-234e85c7-c9b1-4014-a8fa-a446e30ccc4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:22.361097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-234e85c7-c9b1-4014-a8fa-a446e30ccc4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:22.361593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-234e85c7-c9b1-4014-a8fa-a446e30ccc4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:22.362520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-234e85c7-c9b1-4014-a8fa-a446e30ccc4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:22.363044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-234e85c7-c9b1-4014-a8fa-a446e30ccc4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:22.501502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-234e85c7-c9b1-4014-a8fa-a446e30ccc4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:22.513522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-234e85c7-c9b1-4014-a8fa-a446e30ccc4b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167005 Jul 26 18:54:22.514254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2092/4097] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:22.518618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a067e730-df66-401a-8077-6b28ebe3629e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:22.519214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a067e730-df66-401a-8077-6b28ebe3629e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:22.525480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a067e730-df66-401a-8077-6b28ebe3629e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:22.525923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a067e730-df66-401a-8077-6b28ebe3629e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:22.526788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a067e730-df66-401a-8077-6b28ebe3629e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:22.527262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a067e730-df66-401a-8077-6b28ebe3629e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:22.596589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a067e730-df66-401a-8077-6b28ebe3629e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:22.605309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a067e730-df66-401a-8077-6b28ebe3629e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090038 Jul 26 18:54:22.605788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2093/4098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:22 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:23.540402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c950f1d6-5567-4243-9856-befaed7a243a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:23.541492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c950f1d6-5567-4243-9856-befaed7a243a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:23.552341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c950f1d6-5567-4243-9856-befaed7a243a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:23.553081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c950f1d6-5567-4243-9856-befaed7a243a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:23.554209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c950f1d6-5567-4243-9856-befaed7a243a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:23.554641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c950f1d6-5567-4243-9856-befaed7a243a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:23.702111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c950f1d6-5567-4243-9856-befaed7a243a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:23.714384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c950f1d6-5567-4243-9856-befaed7a243a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.180955 Jul 26 18:54:23.715170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2094/4099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:23 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:23.721187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5d267edf-87f4-42df-bb49-55a438a648a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:23.721945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5d267edf-87f4-42df-bb49-55a438a648a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:23.728641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d267edf-87f4-42df-bb49-55a438a648a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:23.729090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d267edf-87f4-42df-bb49-55a438a648a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:23.729850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d267edf-87f4-42df-bb49-55a438a648a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:23.730286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d267edf-87f4-42df-bb49-55a438a648a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:23.792132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5d267edf-87f4-42df-bb49-55a438a648a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:23.800425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5d267edf-87f4-42df-bb49-55a438a648a0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.084243 Jul 26 18:54:23.800985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2095/4100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:23 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:24.738110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2dd5a0fe-8c30-4d94-b573-a00b5fc75cfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:24.738787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2dd5a0fe-8c30-4d94-b573-a00b5fc75cfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:24.748408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2dd5a0fe-8c30-4d94-b573-a00b5fc75cfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:24.748989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2dd5a0fe-8c30-4d94-b573-a00b5fc75cfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:24.749796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2dd5a0fe-8c30-4d94-b573-a00b5fc75cfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:24.750232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2dd5a0fe-8c30-4d94-b573-a00b5fc75cfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:24.899856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2dd5a0fe-8c30-4d94-b573-a00b5fc75cfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:24.908434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2dd5a0fe-8c30-4d94-b573-a00b5fc75cfd tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.174350 Jul 26 18:54:24.909011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2096/4101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:24 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:24.913497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9899cce1-3c99-4f42-a725-430de6772ca5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:24.914093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9899cce1-3c99-4f42-a725-430de6772ca5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:24.922104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9899cce1-3c99-4f42-a725-430de6772ca5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:24.922631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9899cce1-3c99-4f42-a725-430de6772ca5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:24.923430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9899cce1-3c99-4f42-a725-430de6772ca5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:24.923866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9899cce1-3c99-4f42-a725-430de6772ca5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:24.986149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9899cce1-3c99-4f42-a725-430de6772ca5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:24.992083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=4 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:24.995175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9899cce1-3c99-4f42-a725-430de6772ca5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085201 Jul 26 18:54:24.995780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2097/4102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:24 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:25.934953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9d3e5772-e231-4cf5-b0ce-48b043dd1194 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:25.936062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9d3e5772-e231-4cf5-b0ce-48b043dd1194 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:25.946916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d3e5772-e231-4cf5-b0ce-48b043dd1194 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:25.947408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d3e5772-e231-4cf5-b0ce-48b043dd1194 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:25.948175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d3e5772-e231-4cf5-b0ce-48b043dd1194 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:25.948608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d3e5772-e231-4cf5-b0ce-48b043dd1194 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:25.963784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:26.086302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9d3e5772-e231-4cf5-b0ce-48b043dd1194 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:26.094752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9d3e5772-e231-4cf5-b0ce-48b043dd1194 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.166842 Jul 26 18:54:26.095347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2098/4103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:25 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:54:26.099688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1feaf357-dee3-449c-b96e-167cac7197ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:26.100291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1feaf357-dee3-449c-b96e-167cac7197ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:26.106117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1feaf357-dee3-449c-b96e-167cac7197ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:26.106564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1feaf357-dee3-449c-b96e-167cac7197ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:26.107342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1feaf357-dee3-449c-b96e-167cac7197ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:26.107796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1feaf357-dee3-449c-b96e-167cac7197ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:26.168830 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1feaf357-dee3-449c-b96e-167cac7197ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:26.177080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1feaf357-dee3-449c-b96e-167cac7197ec tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.080753 Jul 26 18:54:26.177650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2099/4104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:26 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:27.120702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bfbc92ec-0faf-49d6-8234-0142a5337911 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:27.121689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bfbc92ec-0faf-49d6-8234-0142a5337911 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:27.132705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfbc92ec-0faf-49d6-8234-0142a5337911 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:27.133443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfbc92ec-0faf-49d6-8234-0142a5337911 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:27.134682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfbc92ec-0faf-49d6-8234-0142a5337911 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:27.135447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bfbc92ec-0faf-49d6-8234-0142a5337911 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:27.288188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bfbc92ec-0faf-49d6-8234-0142a5337911 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:27.300725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bfbc92ec-0faf-49d6-8234-0142a5337911 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.186239 Jul 26 18:54:27.301391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2100/4105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:27 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:27.305886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6fd62c41-d48f-47c5-b16b-71d4720320f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:27.306495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6fd62c41-d48f-47c5-b16b-71d4720320f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:27.312394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6fd62c41-d48f-47c5-b16b-71d4720320f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:27.312820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6fd62c41-d48f-47c5-b16b-71d4720320f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:27.313575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6fd62c41-d48f-47c5-b16b-71d4720320f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:27.314003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6fd62c41-d48f-47c5-b16b-71d4720320f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:27.377871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6fd62c41-d48f-47c5-b16b-71d4720320f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:27.386070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6fd62c41-d48f-47c5-b16b-71d4720320f5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083710 Jul 26 18:54:27.386636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2101/4106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:27 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:28.326729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f7308672-1f43-4ff2-b917-18b64aedf081 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:28.328023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f7308672-1f43-4ff2-b917-18b64aedf081 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:28.338889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7308672-1f43-4ff2-b917-18b64aedf081 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:28.339677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7308672-1f43-4ff2-b917-18b64aedf081 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:28.340919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7308672-1f43-4ff2-b917-18b64aedf081 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:28.341627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7308672-1f43-4ff2-b917-18b64aedf081 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:28.485478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f7308672-1f43-4ff2-b917-18b64aedf081 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:28.496025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f7308672-1f43-4ff2-b917-18b64aedf081 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.176092 Jul 26 18:54:28.496612 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2102/4107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:28 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:28.500961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-96893bf6-211d-4004-9cff-707c9f0fea38 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:28.501551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-96893bf6-211d-4004-9cff-707c9f0fea38 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:28.507457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96893bf6-211d-4004-9cff-707c9f0fea38 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:28.507900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96893bf6-211d-4004-9cff-707c9f0fea38 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:28.508644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96893bf6-211d-4004-9cff-707c9f0fea38 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:28.509073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-96893bf6-211d-4004-9cff-707c9f0fea38 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:28.573427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-96893bf6-211d-4004-9cff-707c9f0fea38 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:28.581513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-96893bf6-211d-4004-9cff-707c9f0fea38 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083945 Jul 26 18:54:28.582000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2103/4108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:28 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:29.517796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-54fad312-c7dd-41b4-97d4-9b84950276ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:29.518503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-54fad312-c7dd-41b4-97d4-9b84950276ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:29.526012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54fad312-c7dd-41b4-97d4-9b84950276ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:29.526454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54fad312-c7dd-41b4-97d4-9b84950276ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:29.527346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54fad312-c7dd-41b4-97d4-9b84950276ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:29.528098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-54fad312-c7dd-41b4-97d4-9b84950276ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:29.672953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-54fad312-c7dd-41b4-97d4-9b84950276ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:29.685120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-54fad312-c7dd-41b4-97d4-9b84950276ee tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.170978 Jul 26 18:54:29.685907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2104/4109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:29 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:29.692556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1aad8e3e-7e0a-45b4-a7f2-0db92a2249d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:29.693462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1aad8e3e-7e0a-45b4-a7f2-0db92a2249d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:29.699878 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1aad8e3e-7e0a-45b4-a7f2-0db92a2249d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:29.700324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1aad8e3e-7e0a-45b4-a7f2-0db92a2249d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:29.701067 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1aad8e3e-7e0a-45b4-a7f2-0db92a2249d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:29.701492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1aad8e3e-7e0a-45b4-a7f2-0db92a2249d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:29.764668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1aad8e3e-7e0a-45b4-a7f2-0db92a2249d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:29.773054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1aad8e3e-7e0a-45b4-a7f2-0db92a2249d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085971 Jul 26 18:54:29.773518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2105/4110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:29 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:30.713107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-31d48604-9ce1-4492-aa72-8a66cf7ab82e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:30.713874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-31d48604-9ce1-4492-aa72-8a66cf7ab82e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:30.720728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31d48604-9ce1-4492-aa72-8a66cf7ab82e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:30.721176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31d48604-9ce1-4492-aa72-8a66cf7ab82e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:30.721995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31d48604-9ce1-4492-aa72-8a66cf7ab82e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:30.722432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31d48604-9ce1-4492-aa72-8a66cf7ab82e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:30.860557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-31d48604-9ce1-4492-aa72-8a66cf7ab82e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:30.870359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-31d48604-9ce1-4492-aa72-8a66cf7ab82e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162965 Jul 26 18:54:30.870940 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2106/4111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:30 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:30.876987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-30849684-bd11-4ccc-922a-0f9039ac0dfe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:30.877609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-30849684-bd11-4ccc-922a-0f9039ac0dfe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:30.884623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30849684-bd11-4ccc-922a-0f9039ac0dfe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:30.885082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30849684-bd11-4ccc-922a-0f9039ac0dfe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:30.886000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30849684-bd11-4ccc-922a-0f9039ac0dfe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:30.886595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30849684-bd11-4ccc-922a-0f9039ac0dfe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:30.961777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-30849684-bd11-4ccc-922a-0f9039ac0dfe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:30.969990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-30849684-bd11-4ccc-922a-0f9039ac0dfe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.098077 Jul 26 18:54:30.970574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2107/4112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:30 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:31.897115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e7fabf76-f931-46b0-958e-3722d7aaa670 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:31.898155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e7fabf76-f931-46b0-958e-3722d7aaa670 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:31.909226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7fabf76-f931-46b0-958e-3722d7aaa670 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:31.909965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7fabf76-f931-46b0-958e-3722d7aaa670 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:31.911262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7fabf76-f931-46b0-958e-3722d7aaa670 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:31.911977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7fabf76-f931-46b0-958e-3722d7aaa670 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:32.051354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e7fabf76-f931-46b0-958e-3722d7aaa670 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:32.059577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e7fabf76-f931-46b0-958e-3722d7aaa670 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.169397 Jul 26 18:54:32.060134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2108/4113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:31 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:32.064542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-549bbcfb-752a-4984-8bbc-7b1ed7fe0fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:32.065543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-549bbcfb-752a-4984-8bbc-7b1ed7fe0fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:32.071204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-549bbcfb-752a-4984-8bbc-7b1ed7fe0fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:32.071648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-549bbcfb-752a-4984-8bbc-7b1ed7fe0fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:32.072389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-549bbcfb-752a-4984-8bbc-7b1ed7fe0fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:32.072812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-549bbcfb-752a-4984-8bbc-7b1ed7fe0fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:32.133279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-549bbcfb-752a-4984-8bbc-7b1ed7fe0fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:32.141333 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-549bbcfb-752a-4984-8bbc-7b1ed7fe0fdf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.080283 Jul 26 18:54:32.141896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2109/4114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:33.085240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8740895b-8cb2-4072-b2b3-6980c2e01f3c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:33.086424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8740895b-8cb2-4072-b2b3-6980c2e01f3c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:33.093022 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8740895b-8cb2-4072-b2b3-6980c2e01f3c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:33.093502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8740895b-8cb2-4072-b2b3-6980c2e01f3c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:33.094260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8740895b-8cb2-4072-b2b3-6980c2e01f3c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:33.094692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8740895b-8cb2-4072-b2b3-6980c2e01f3c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:33.225013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8740895b-8cb2-4072-b2b3-6980c2e01f3c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:33.233171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8740895b-8cb2-4072-b2b3-6980c2e01f3c tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154646 Jul 26 18:54:33.233716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2110/4115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:33 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:33.238028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5fed60a5-780c-4671-bdbc-3d691a8fd0a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:33.238620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5fed60a5-780c-4671-bdbc-3d691a8fd0a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:33.244673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fed60a5-780c-4671-bdbc-3d691a8fd0a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:33.245122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fed60a5-780c-4671-bdbc-3d691a8fd0a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:33.245870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fed60a5-780c-4671-bdbc-3d691a8fd0a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:33.246302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5fed60a5-780c-4671-bdbc-3d691a8fd0a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:33.307086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5fed60a5-780c-4671-bdbc-3d691a8fd0a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:33.315649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5fed60a5-780c-4671-bdbc-3d691a8fd0a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.080950 Jul 26 18:54:33.316223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2111/4116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:33 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:34.258781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8b50a41f-7e4e-4a73-8429-8938fe858ad1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:34.259628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8b50a41f-7e4e-4a73-8429-8938fe858ad1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:34.268125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b50a41f-7e4e-4a73-8429-8938fe858ad1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:34.268688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b50a41f-7e4e-4a73-8429-8938fe858ad1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:34.269629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b50a41f-7e4e-4a73-8429-8938fe858ad1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:34.270164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8b50a41f-7e4e-4a73-8429-8938fe858ad1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:34.403959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8b50a41f-7e4e-4a73-8429-8938fe858ad1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:34.412569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8b50a41f-7e4e-4a73-8429-8938fe858ad1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160358 Jul 26 18:54:34.413144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2112/4117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:34 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:34.417529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d10545de-0008-4419-9341-ee602c0d0f16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:34.418126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d10545de-0008-4419-9341-ee602c0d0f16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:34.423981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d10545de-0008-4419-9341-ee602c0d0f16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:34.424404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d10545de-0008-4419-9341-ee602c0d0f16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:34.425149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d10545de-0008-4419-9341-ee602c0d0f16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:34.425581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d10545de-0008-4419-9341-ee602c0d0f16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:34.488133 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d10545de-0008-4419-9341-ee602c0d0f16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:34.496374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d10545de-0008-4419-9341-ee602c0d0f16 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.082283 Jul 26 18:54:34.496937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2113/4118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:34 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:35.438500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-62f1a13e-3de4-4dba-8217-2ad8d46948b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:35.439744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-62f1a13e-3de4-4dba-8217-2ad8d46948b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:35.450757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-62f1a13e-3de4-4dba-8217-2ad8d46948b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:35.451546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-62f1a13e-3de4-4dba-8217-2ad8d46948b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:35.452787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-62f1a13e-3de4-4dba-8217-2ad8d46948b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:35.453498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-62f1a13e-3de4-4dba-8217-2ad8d46948b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:35.595348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-62f1a13e-3de4-4dba-8217-2ad8d46948b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:35.604992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-62f1a13e-3de4-4dba-8217-2ad8d46948b2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.172982 Jul 26 18:54:35.605565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2114/4119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:35 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:35.609931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fc12b80f-8145-45be-969a-172dd0368f29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:35.610524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fc12b80f-8145-45be-969a-172dd0368f29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:35.616287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc12b80f-8145-45be-969a-172dd0368f29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:35.616734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc12b80f-8145-45be-969a-172dd0368f29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:35.617481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc12b80f-8145-45be-969a-172dd0368f29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:35.617918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc12b80f-8145-45be-969a-172dd0368f29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:35.620423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:35.687009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fc12b80f-8145-45be-969a-172dd0368f29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:35.695623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fc12b80f-8145-45be-969a-172dd0368f29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089025 Jul 26 18:54:35.696178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2115/4120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:36.630245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d3d81aa0-9ce2-462e-a171-f3edc97533f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:36.631403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d3d81aa0-9ce2-462e-a171-f3edc97533f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:36.639140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3d81aa0-9ce2-462e-a171-f3edc97533f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:36.639616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3d81aa0-9ce2-462e-a171-f3edc97533f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:36.640378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3d81aa0-9ce2-462e-a171-f3edc97533f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:36.640810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d3d81aa0-9ce2-462e-a171-f3edc97533f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:36.780613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d3d81aa0-9ce2-462e-a171-f3edc97533f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:36.789910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d3d81aa0-9ce2-462e-a171-f3edc97533f7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.166102 Jul 26 18:54:36.790751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2116/4121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:36 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:36.795152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-151d0c71-d884-4acb-bf68-1b264a4c9316 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:36.795748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-151d0c71-d884-4acb-bf68-1b264a4c9316 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:36.797384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:36.802284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-151d0c71-d884-4acb-bf68-1b264a4c9316 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:36.802729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-151d0c71-d884-4acb-bf68-1b264a4c9316 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:36.803511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-151d0c71-d884-4acb-bf68-1b264a4c9316 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:36.803935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-151d0c71-d884-4acb-bf68-1b264a4c9316 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:36.866864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-151d0c71-d884-4acb-bf68-1b264a4c9316 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:36.875395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-151d0c71-d884-4acb-bf68-1b264a4c9316 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083649 Jul 26 18:54:36.875957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2117/4122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:36 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:37.815329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-21d32d38-7795-47a0-9ef3-951c00f97350 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:37.816176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-21d32d38-7795-47a0-9ef3-951c00f97350 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:37.824056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21d32d38-7795-47a0-9ef3-951c00f97350 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:37.824497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21d32d38-7795-47a0-9ef3-951c00f97350 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:37.825247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21d32d38-7795-47a0-9ef3-951c00f97350 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:37.825673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21d32d38-7795-47a0-9ef3-951c00f97350 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:37.957818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-21d32d38-7795-47a0-9ef3-951c00f97350 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:37.970254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-21d32d38-7795-47a0-9ef3-951c00f97350 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160584 Jul 26 18:54:37.971053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2118/4123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:37 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:37.975369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ccfb294f-2512-44f1-b4b0-96c7f38bddd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:37.975961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ccfb294f-2512-44f1-b4b0-96c7f38bddd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:37.981709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccfb294f-2512-44f1-b4b0-96c7f38bddd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:37.982160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccfb294f-2512-44f1-b4b0-96c7f38bddd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:37.982910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccfb294f-2512-44f1-b4b0-96c7f38bddd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:37.983369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccfb294f-2512-44f1-b4b0-96c7f38bddd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:38.042951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ccfb294f-2512-44f1-b4b0-96c7f38bddd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:38.050926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ccfb294f-2512-44f1-b4b0-96c7f38bddd1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.078940 Jul 26 18:54:38.051495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2119/4124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:37 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:38.995591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7cf4e4df-c55e-4f4a-8402-5484579a033a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:38.996443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7cf4e4df-c55e-4f4a-8402-5484579a033a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:39.005212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cf4e4df-c55e-4f4a-8402-5484579a033a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:39.005655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cf4e4df-c55e-4f4a-8402-5484579a033a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:39.006596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cf4e4df-c55e-4f4a-8402-5484579a033a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:39.007287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cf4e4df-c55e-4f4a-8402-5484579a033a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:39.148118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7cf4e4df-c55e-4f4a-8402-5484579a033a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:39.157322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7cf4e4df-c55e-4f4a-8402-5484579a033a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.168145 Jul 26 18:54:39.157905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2120/4125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:38 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:39.162291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-986fb3dd-0043-4867-9a95-47e5786b0624 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:39.162889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-986fb3dd-0043-4867-9a95-47e5786b0624 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:39.168582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-986fb3dd-0043-4867-9a95-47e5786b0624 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:39.169077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-986fb3dd-0043-4867-9a95-47e5786b0624 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:39.169831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-986fb3dd-0043-4867-9a95-47e5786b0624 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:39.170259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-986fb3dd-0043-4867-9a95-47e5786b0624 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:39.236902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-986fb3dd-0043-4867-9a95-47e5786b0624 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:39.245579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-986fb3dd-0043-4867-9a95-47e5786b0624 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086730 Jul 26 18:54:39.246145 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2121/4126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:39 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:40.182857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-86f90dab-44d2-4ba3-817d-e692b2b4bebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:40.183997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-86f90dab-44d2-4ba3-817d-e692b2b4bebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:40.195392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86f90dab-44d2-4ba3-817d-e692b2b4bebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:40.196131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86f90dab-44d2-4ba3-817d-e692b2b4bebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:40.197378 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86f90dab-44d2-4ba3-817d-e692b2b4bebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:40.198054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-86f90dab-44d2-4ba3-817d-e692b2b4bebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:40.338531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-86f90dab-44d2-4ba3-817d-e692b2b4bebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:40.350943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-86f90dab-44d2-4ba3-817d-e692b2b4bebf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.174355 Jul 26 18:54:40.351898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2122/4127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:40 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:40.357160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-69d59e5b-f7a4-4a43-b721-bec58f6a8b81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:40.357760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-69d59e5b-f7a4-4a43-b721-bec58f6a8b81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:40.363645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69d59e5b-f7a4-4a43-b721-bec58f6a8b81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:40.364097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69d59e5b-f7a4-4a43-b721-bec58f6a8b81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:40.364853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69d59e5b-f7a4-4a43-b721-bec58f6a8b81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:40.365282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69d59e5b-f7a4-4a43-b721-bec58f6a8b81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:40.426611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-69d59e5b-f7a4-4a43-b721-bec58f6a8b81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:40.435029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-69d59e5b-f7a4-4a43-b721-bec58f6a8b81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.082102 Jul 26 18:54:40.435629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2123/4128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:40 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:41.377801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b5b9bd5d-abb7-46c9-a97b-c2765dd3c2fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:41.378914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b5b9bd5d-abb7-46c9-a97b-c2765dd3c2fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:41.389902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5b9bd5d-abb7-46c9-a97b-c2765dd3c2fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:41.390640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5b9bd5d-abb7-46c9-a97b-c2765dd3c2fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:41.392070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5b9bd5d-abb7-46c9-a97b-c2765dd3c2fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:41.392828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b5b9bd5d-abb7-46c9-a97b-c2765dd3c2fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:41.532282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b5b9bd5d-abb7-46c9-a97b-c2765dd3c2fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:41.540365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b5b9bd5d-abb7-46c9-a97b-c2765dd3c2fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.169066 Jul 26 18:54:41.540969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2124/4129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:41 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:41.545332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-51e6029f-3f92-45b4-be23-30bfea480353 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:41.545912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-51e6029f-3f92-45b4-be23-30bfea480353 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:41.551803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51e6029f-3f92-45b4-be23-30bfea480353 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:41.552247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51e6029f-3f92-45b4-be23-30bfea480353 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:41.552993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51e6029f-3f92-45b4-be23-30bfea480353 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:41.553418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51e6029f-3f92-45b4-be23-30bfea480353 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:41.612656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-51e6029f-3f92-45b4-be23-30bfea480353 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:41.620649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-51e6029f-3f92-45b4-be23-30bfea480353 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.078730 Jul 26 18:54:41.621178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2125/4130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:41 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:42.561961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aa35015b-457e-48e5-9f8a-24a6958e3060 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:42.562708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aa35015b-457e-48e5-9f8a-24a6958e3060 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:42.569613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa35015b-457e-48e5-9f8a-24a6958e3060 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:42.570054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa35015b-457e-48e5-9f8a-24a6958e3060 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:42.570803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa35015b-457e-48e5-9f8a-24a6958e3060 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:42.571261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aa35015b-457e-48e5-9f8a-24a6958e3060 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:42.718020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-aa35015b-457e-48e5-9f8a-24a6958e3060 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:42.726262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aa35015b-457e-48e5-9f8a-24a6958e3060 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.168213 Jul 26 18:54:42.726826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2126/4131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:42 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:42.731262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c43b13f6-40b8-4bb3-af1a-80425e808528 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:42.731874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c43b13f6-40b8-4bb3-af1a-80425e808528 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:42.737571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c43b13f6-40b8-4bb3-af1a-80425e808528 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:42.738043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c43b13f6-40b8-4bb3-af1a-80425e808528 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:42.738772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c43b13f6-40b8-4bb3-af1a-80425e808528 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:42.739252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c43b13f6-40b8-4bb3-af1a-80425e808528 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:42.799593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c43b13f6-40b8-4bb3-af1a-80425e808528 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:42.807757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c43b13f6-40b8-4bb3-af1a-80425e808528 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.079962 Jul 26 18:54:42.808317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2127/4132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:42 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:43.751160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1fe6fc3e-abc6-446c-bdff-ae0f18642e42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:43.751883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1fe6fc3e-abc6-446c-bdff-ae0f18642e42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:43.760507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1fe6fc3e-abc6-446c-bdff-ae0f18642e42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:43.761061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1fe6fc3e-abc6-446c-bdff-ae0f18642e42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:43.762004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1fe6fc3e-abc6-446c-bdff-ae0f18642e42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:43.762544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1fe6fc3e-abc6-446c-bdff-ae0f18642e42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:43.908429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1fe6fc3e-abc6-446c-bdff-ae0f18642e42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:43.916690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1fe6fc3e-abc6-446c-bdff-ae0f18642e42 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.170566 Jul 26 18:54:43.917280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2128/4133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:43 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:43.922834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4c8f6e4a-3191-49ab-addd-9d6639de628e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:43.923950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4c8f6e4a-3191-49ab-addd-9d6639de628e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:43.931821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c8f6e4a-3191-49ab-addd-9d6639de628e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:43.932492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c8f6e4a-3191-49ab-addd-9d6639de628e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:43.933253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c8f6e4a-3191-49ab-addd-9d6639de628e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:43.933685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4c8f6e4a-3191-49ab-addd-9d6639de628e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:44.001407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4c8f6e4a-3191-49ab-addd-9d6639de628e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:44.009446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4c8f6e4a-3191-49ab-addd-9d6639de628e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091221 Jul 26 18:54:44.010116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2129/4134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:44.943593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-acc07cb8-1128-4370-b4d4-61ea3b21f832 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:44.944681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-acc07cb8-1128-4370-b4d4-61ea3b21f832 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:44.955622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-acc07cb8-1128-4370-b4d4-61ea3b21f832 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:44.956359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-acc07cb8-1128-4370-b4d4-61ea3b21f832 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:44.957597 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-acc07cb8-1128-4370-b4d4-61ea3b21f832 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:44.958303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-acc07cb8-1128-4370-b4d4-61ea3b21f832 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:45.095256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-acc07cb8-1128-4370-b4d4-61ea3b21f832 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:45.103590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-acc07cb8-1128-4370-b4d4-61ea3b21f832 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.166500 Jul 26 18:54:45.104158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2130/4135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:44 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:45.108462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-046d55b9-2b45-4a53-8027-9bbad81fce1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:45.109052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-046d55b9-2b45-4a53-8027-9bbad81fce1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:45.114869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-046d55b9-2b45-4a53-8027-9bbad81fce1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:45.115344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-046d55b9-2b45-4a53-8027-9bbad81fce1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:45.116091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-046d55b9-2b45-4a53-8027-9bbad81fce1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:45.116520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-046d55b9-2b45-4a53-8027-9bbad81fce1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:45.184771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-046d55b9-2b45-4a53-8027-9bbad81fce1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:45.186970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:45.193986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-046d55b9-2b45-4a53-8027-9bbad81fce1f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.088878 Jul 26 18:54:45.194571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2131/4136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:45 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:46.124591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b00f3e1b-fa48-4d98-8d4c-98366c2e473a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:46.125272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b00f3e1b-fa48-4d98-8d4c-98366c2e473a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:46.132560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b00f3e1b-fa48-4d98-8d4c-98366c2e473a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:46.133003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b00f3e1b-fa48-4d98-8d4c-98366c2e473a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:46.133758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b00f3e1b-fa48-4d98-8d4c-98366c2e473a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:46.134190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b00f3e1b-fa48-4d98-8d4c-98366c2e473a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:46.286374 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b00f3e1b-fa48-4d98-8d4c-98366c2e473a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:46.294869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b00f3e1b-fa48-4d98-8d4c-98366c2e473a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.174341 Jul 26 18:54:46.295462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2132/4137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:46 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:46.299852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1ba4b818-e191-4285-bbef-85cdb7f6dfb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:46.300440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1ba4b818-e191-4285-bbef-85cdb7f6dfb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:46.306489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ba4b818-e191-4285-bbef-85cdb7f6dfb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:46.306929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ba4b818-e191-4285-bbef-85cdb7f6dfb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:46.307767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ba4b818-e191-4285-bbef-85cdb7f6dfb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:46.308195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1ba4b818-e191-4285-bbef-85cdb7f6dfb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:46.369452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1ba4b818-e191-4285-bbef-85cdb7f6dfb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:46.377521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1ba4b818-e191-4285-bbef-85cdb7f6dfb2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.081124 Jul 26 18:54:46.378080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2133/4138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:46 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:47.322308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a9987751-07af-43aa-8cf4-77e129f247fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:47.324131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a9987751-07af-43aa-8cf4-77e129f247fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:47.334846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9987751-07af-43aa-8cf4-77e129f247fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:47.335649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9987751-07af-43aa-8cf4-77e129f247fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:47.336902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9987751-07af-43aa-8cf4-77e129f247fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:47.337630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a9987751-07af-43aa-8cf4-77e129f247fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:47.476482 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a9987751-07af-43aa-8cf4-77e129f247fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:47.488964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a9987751-07af-43aa-8cf4-77e129f247fe tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.173681 Jul 26 18:54:47.489888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2134/4139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:47 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:47.496428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-840821f3-9ba9-4e8a-ac1d-b7ec7e30116b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:47.497019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-840821f3-9ba9-4e8a-ac1d-b7ec7e30116b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:47.502797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-840821f3-9ba9-4e8a-ac1d-b7ec7e30116b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:47.503281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-840821f3-9ba9-4e8a-ac1d-b7ec7e30116b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:47.504020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-840821f3-9ba9-4e8a-ac1d-b7ec7e30116b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:47.504446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-840821f3-9ba9-4e8a-ac1d-b7ec7e30116b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:47.578762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-840821f3-9ba9-4e8a-ac1d-b7ec7e30116b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:47.587463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-840821f3-9ba9-4e8a-ac1d-b7ec7e30116b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.096298 Jul 26 18:54:47.588017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2135/4140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:47 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:48.516869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-21dbcdfd-0c3a-4fc8-a650-21d0e2eaf7a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:48.517964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-21dbcdfd-0c3a-4fc8-a650-21d0e2eaf7a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:48.529274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21dbcdfd-0c3a-4fc8-a650-21d0e2eaf7a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:48.530020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21dbcdfd-0c3a-4fc8-a650-21d0e2eaf7a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:48.531328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21dbcdfd-0c3a-4fc8-a650-21d0e2eaf7a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:48.532053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-21dbcdfd-0c3a-4fc8-a650-21d0e2eaf7a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:48.672522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-21dbcdfd-0c3a-4fc8-a650-21d0e2eaf7a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:48.686573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-21dbcdfd-0c3a-4fc8-a650-21d0e2eaf7a8 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.176361 Jul 26 18:54:48.687200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2136/4141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:48 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:48.691685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7c582f8c-d2bf-4a60-af8d-433bcc347138 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:48.692284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7c582f8c-d2bf-4a60-af8d-433bcc347138 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:48.698636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c582f8c-d2bf-4a60-af8d-433bcc347138 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:48.699129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c582f8c-d2bf-4a60-af8d-433bcc347138 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:48.700032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c582f8c-d2bf-4a60-af8d-433bcc347138 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:48.700520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7c582f8c-d2bf-4a60-af8d-433bcc347138 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:48.770731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7c582f8c-d2bf-4a60-af8d-433bcc347138 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:48.779203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7c582f8c-d2bf-4a60-af8d-433bcc347138 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091022 Jul 26 18:54:48.779777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2137/4142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:48 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:49.717437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d1ff7f5a-a25a-495f-b940-c820413813aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:49.718560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d1ff7f5a-a25a-495f-b940-c820413813aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:49.729768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1ff7f5a-a25a-495f-b940-c820413813aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:49.730508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1ff7f5a-a25a-495f-b940-c820413813aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:49.731859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1ff7f5a-a25a-495f-b940-c820413813aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:49.732587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1ff7f5a-a25a-495f-b940-c820413813aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:49.877997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d1ff7f5a-a25a-495f-b940-c820413813aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:49.886676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d1ff7f5a-a25a-495f-b940-c820413813aa tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.175963 Jul 26 18:54:49.887319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2138/4143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:49 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:49.891777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aca20848-5af5-45ea-8b61-ad19bceaaf3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:49.892385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aca20848-5af5-45ea-8b61-ad19bceaaf3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:49.898724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aca20848-5af5-45ea-8b61-ad19bceaaf3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:49.899196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aca20848-5af5-45ea-8b61-ad19bceaaf3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:49.899953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aca20848-5af5-45ea-8b61-ad19bceaaf3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:49.900384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aca20848-5af5-45ea-8b61-ad19bceaaf3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:49.966654 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-aca20848-5af5-45ea-8b61-ad19bceaaf3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:49.974874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aca20848-5af5-45ea-8b61-ad19bceaaf3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086539 Jul 26 18:54:49.975386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2139/4144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:49 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:50.912617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b9617d2c-cdf9-4c2d-acc5-960056127d6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:50.913681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b9617d2c-cdf9-4c2d-acc5-960056127d6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:50.924687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9617d2c-cdf9-4c2d-acc5-960056127d6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:50.925422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9617d2c-cdf9-4c2d-acc5-960056127d6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:50.926681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9617d2c-cdf9-4c2d-acc5-960056127d6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:50.927445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9617d2c-cdf9-4c2d-acc5-960056127d6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:51.065364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b9617d2c-cdf9-4c2d-acc5-960056127d6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:51.073537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b9617d2c-cdf9-4c2d-acc5-960056127d6a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.167411 Jul 26 18:54:51.074080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2140/4145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:50 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:51.078407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bda41ecc-7b03-4e2e-9b61-2c2c41caf80d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:51.078994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bda41ecc-7b03-4e2e-9b61-2c2c41caf80d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:51.084619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bda41ecc-7b03-4e2e-9b61-2c2c41caf80d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:51.085088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bda41ecc-7b03-4e2e-9b61-2c2c41caf80d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:51.085834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bda41ecc-7b03-4e2e-9b61-2c2c41caf80d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:51.086261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bda41ecc-7b03-4e2e-9b61-2c2c41caf80d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:51.147688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bda41ecc-7b03-4e2e-9b61-2c2c41caf80d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:51.155876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bda41ecc-7b03-4e2e-9b61-2c2c41caf80d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.080831 Jul 26 18:54:51.156449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2141/4146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:52.096541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-14d7ed36-d253-460c-9e72-ea3899e84372 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:52.097232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-14d7ed36-d253-460c-9e72-ea3899e84372 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:52.105543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14d7ed36-d253-460c-9e72-ea3899e84372 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:52.106366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14d7ed36-d253-460c-9e72-ea3899e84372 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:52.107413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14d7ed36-d253-460c-9e72-ea3899e84372 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:52.107931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-14d7ed36-d253-460c-9e72-ea3899e84372 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:52.239210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-14d7ed36-d253-460c-9e72-ea3899e84372 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:52.247869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-14d7ed36-d253-460c-9e72-ea3899e84372 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.156075 Jul 26 18:54:52.248451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2142/4147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:52 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:52.252920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-48110bea-84ae-4b41-8bae-9d322b31b800 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:52.253577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-48110bea-84ae-4b41-8bae-9d322b31b800 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:52.259403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48110bea-84ae-4b41-8bae-9d322b31b800 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:52.259855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48110bea-84ae-4b41-8bae-9d322b31b800 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:52.260617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48110bea-84ae-4b41-8bae-9d322b31b800 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:52.261055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48110bea-84ae-4b41-8bae-9d322b31b800 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:52.326576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-48110bea-84ae-4b41-8bae-9d322b31b800 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:52.334869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-48110bea-84ae-4b41-8bae-9d322b31b800 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085414 Jul 26 18:54:52.335574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2143/4148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:52 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:53.273701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-30e87a77-97e6-4382-9fd8-0b670fbe0950 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:53.274812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-30e87a77-97e6-4382-9fd8-0b670fbe0950 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:53.285657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30e87a77-97e6-4382-9fd8-0b670fbe0950 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:53.286394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30e87a77-97e6-4382-9fd8-0b670fbe0950 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:53.287709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30e87a77-97e6-4382-9fd8-0b670fbe0950 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:53.288415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-30e87a77-97e6-4382-9fd8-0b670fbe0950 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:53.425175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-30e87a77-97e6-4382-9fd8-0b670fbe0950 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:53.437192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-30e87a77-97e6-4382-9fd8-0b670fbe0950 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.170124 Jul 26 18:54:53.438050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2144/4149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:53 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:53.442411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-71cb1318-7767-434e-b679-ebda69abd135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:53.442970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-71cb1318-7767-434e-b679-ebda69abd135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:53.448846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71cb1318-7767-434e-b679-ebda69abd135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:53.449292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71cb1318-7767-434e-b679-ebda69abd135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:53.450035 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71cb1318-7767-434e-b679-ebda69abd135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:53.450460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-71cb1318-7767-434e-b679-ebda69abd135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:53.511858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-71cb1318-7767-434e-b679-ebda69abd135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:53.520451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-71cb1318-7767-434e-b679-ebda69abd135 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.081114 Jul 26 18:54:53.520985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2145/4150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:53 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:54.220537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7b08c271-6124-42c1-aa32-502f5333bec6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:54.221586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7b08c271-6124-42c1-aa32-502f5333bec6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:54.231163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b08c271-6124-42c1-aa32-502f5333bec6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:54.231608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b08c271-6124-42c1-aa32-502f5333bec6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:54.232358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b08c271-6124-42c1-aa32-502f5333bec6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:54.232782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b08c271-6124-42c1-aa32-502f5333bec6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:54.369745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7b08c271-6124-42c1-aa32-502f5333bec6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:54.378350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7b08c271-6124-42c1-aa32-502f5333bec6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 200 len: 1726 microversion: 2.1 time: 0.164364 Jul 26 18:54:54.378915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2146/4151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:54 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:54.399732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3dc965ec-1761-4ced-8811-4ae99578ab8b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '.version_select at 0x7f390a3d4160>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:54.421820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3dc965ec-1761-4ced-8811-4ae99578ab8b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311746217" status: 202 len: 0 microversion: 2.1 time: 0.025551 Jul 26 18:54:54.422340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2147/4152] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Jul 26 18:54:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311746217 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:54:54.458934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f8bb6655-7173-4f16-90ae-5a27ec9cce50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:54.459609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f8bb6655-7173-4f16-90ae-5a27ec9cce50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:54.466702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8bb6655-7173-4f16-90ae-5a27ec9cce50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:54.467269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8bb6655-7173-4f16-90ae-5a27ec9cce50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:54.468274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8bb6655-7173-4f16-90ae-5a27ec9cce50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:54.468791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8bb6655-7173-4f16-90ae-5a27ec9cce50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:54.691469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f8bb6655-7173-4f16-90ae-5a27ec9cce50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:54.700161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f8bb6655-7173-4f16-90ae-5a27ec9cce50 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.245049 Jul 26 18:54:54.700745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2148/4153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:54 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:54.705178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9665aeeb-2ad5-4a7c-ad32-4279985e8481 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:54.705771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9665aeeb-2ad5-4a7c-ad32-4279985e8481 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:54.711814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9665aeeb-2ad5-4a7c-ad32-4279985e8481 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:54.712258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9665aeeb-2ad5-4a7c-ad32-4279985e8481 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:54.713009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9665aeeb-2ad5-4a7c-ad32-4279985e8481 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:54.713437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9665aeeb-2ad5-4a7c-ad32-4279985e8481 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:54.728229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:54.779878 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9665aeeb-2ad5-4a7c-ad32-4279985e8481 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:54.793099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9665aeeb-2ad5-4a7c-ad32-4279985e8481 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091315 Jul 26 18:54:54.793663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2149/4154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:54 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:55.404149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-152b22e0-4c59-4a85-a152-815fee2799b3 req-f97d362e-ca95-42ce-a826-af010272a696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ada35c-e092-41a1-a9c4-2177b7e8ae31", "tag": "249fd822-02ca-4f9a-bf6e-53fdc2629e85"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:54:55.415220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-152b22e0-4c59-4a85-a152-815fee2799b3 req-f97d362e-ca95-42ce-a826-af010272a696 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:55.415691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-152b22e0-4c59-4a85-a152-815fee2799b3 req-f97d362e-ca95-42ce-a826-af010272a696 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:55.431225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-152b22e0-4c59-4a85-a152-815fee2799b3 req-f97d362e-ca95-42ce-a826-af010272a696 service nova] Creating event network-changed:249fd822-02ca-4f9a-bf6e-53fdc2629e85 for instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 on hv-cinder-82549 Jul 26 18:54:55.434591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-152b22e0-4c59-4a85-a152-815fee2799b3 req-f97d362e-ca95-42ce-a826-af010272a696 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033384 Jul 26 18:54:55.434591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2150/4155] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:54:55.616331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-734ed868-b0a4-459d-9579-ab86c30510b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Action: 'create', calling method: .version_select at 0x7f39095c91f0>, body: {"keypair": {"name": "tempest-keypair-1983348969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+gnZ9KqsND2ujN6Kt4TolmqfrZ8uwXa7MOu1DJyT6JbRbaMrxSWzewx04595sdhUwa0Ok3Azskk4rA6aWilLr2wKvGYZdbioC+rsDtL9Edd/owBQkY47rLLQa7KCHSTA=="}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:54:55.632962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-734ed868-b0a4-459d-9579-ab86c30510b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for project 765e809e332e4a478e09be17e6b3c385. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:54:55.637230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-734ed868-b0a4-459d-9579-ab86c30510b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for user 40f43a6429474c5e96db487ee85bbd84 and project 765e809e332e4a478e09be17e6b3c385. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:54:55.663231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-734ed868-b0a4-459d-9579-ab86c30510b4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051435 Jul 26 18:54:55.664147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2151/4156] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Jul 26 18:54:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:54:55.722406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e29adc00-f691-421b-b3a5-db6de41c657b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:55.722730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e29adc00-f691-421b-b3a5-db6de41c657b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:55.730300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e29adc00-f691-421b-b3a5-db6de41c657b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:55.730742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e29adc00-f691-421b-b3a5-db6de41c657b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:55.731563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e29adc00-f691-421b-b3a5-db6de41c657b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:55.732001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e29adc00-f691-421b-b3a5-db6de41c657b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:55.970559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e29adc00-f691-421b-b3a5-db6de41c657b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:55.995214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e29adc00-f691-421b-b3a5-db6de41c657b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.276949 Jul 26 18:54:56.009238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2152/4157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:55 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:54:56.009238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5540d9e6-356a-4deb-8f0d-5562650d0cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:56.009238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5540d9e6-356a-4deb-8f0d-5562650d0cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:56.012610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5540d9e6-356a-4deb-8f0d-5562650d0cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:56.013053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5540d9e6-356a-4deb-8f0d-5562650d0cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:56.013822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5540d9e6-356a-4deb-8f0d-5562650d0cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:56.014263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5540d9e6-356a-4deb-8f0d-5562650d0cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:56.361172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5540d9e6-356a-4deb-8f0d-5562650d0cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:56.370672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5540d9e6-356a-4deb-8f0d-5562650d0cd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.373201 Jul 26 18:54:56.371461 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2153/4158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:57.118433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ac4b452a-5bba-4f1b-80d4-df7f11d21201 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:57.119091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ac4b452a-5bba-4f1b-80d4-df7f11d21201 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:57.125304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac4b452a-5bba-4f1b-80d4-df7f11d21201 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:57.125696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac4b452a-5bba-4f1b-80d4-df7f11d21201 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:57.126489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac4b452a-5bba-4f1b-80d4-df7f11d21201 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:57.126925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ac4b452a-5bba-4f1b-80d4-df7f11d21201 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:57.281018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ac4b452a-5bba-4f1b-80d4-df7f11d21201 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:57.290923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ac4b452a-5bba-4f1b-80d4-df7f11d21201 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.278135 Jul 26 18:54:57.291622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2154/4159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:57 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:54:57.296875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-121973488", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3e4e1db-4202-4baf-8f51-705a169c7395"}], "security_groups": [{"name": "tempest-securitygroup--601211637"}], "key_name": "tempest-keypair-1983348969", "user_data": "}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:54:57.419167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.network.neutron [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] validate_networks() for [('b3e4e1db-4202-4baf-8f51-705a169c7395', None, None, None, None, None)] {{(pid=117996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:54:57.809923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Flavor limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:54:57.810339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Image limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:54:57.810804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Flavor pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:54:57.811239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Image pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:54:57.811643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:54:57.822702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:57.823301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:57.824105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:57.824530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:57.841043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for project 765e809e332e4a478e09be17e6b3c385. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:54:57.845140 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for user 40f43a6429474c5e96db487ee85bbd84 and project 765e809e332e4a478e09be17e6b3c385. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:54:57.855167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:54:57.859771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Going to run 1 instances... {{(pid=117996) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:54:57.862031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:54:57.918490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-960fb127-87e0-4c35-bcb4-14908396007e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.625738 Jul 26 18:54:57.919131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2155/4160] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:54:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 18:54:57.923714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6d157bed-6763-49db-9c14-ac708a9bcd0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:57.924306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6d157bed-6763-49db-9c14-ac708a9bcd0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:57.930943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d157bed-6763-49db-9c14-ac708a9bcd0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:57.931510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d157bed-6763-49db-9c14-ac708a9bcd0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:57.932362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d157bed-6763-49db-9c14-ac708a9bcd0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:57.932786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6d157bed-6763-49db-9c14-ac708a9bcd0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:58.004717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6d157bed-6763-49db-9c14-ac708a9bcd0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:58.013403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6d157bed-6763-49db-9c14-ac708a9bcd0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093266 Jul 26 18:54:58.014187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2156/4161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:57 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:58.026407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dd9933ef-f2df-4c8e-99a1-ae8282768e8b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:58.026821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dd9933ef-f2df-4c8e-99a1-ae8282768e8b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:58.081921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dd9933ef-f2df-4c8e-99a1-ae8282768e8b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:58.090219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dd9933ef-f2df-4c8e-99a1-ae8282768e8b tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1241 microversion: 2.1 time: 0.070305 Jul 26 18:54:58.090784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2157/4162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:58 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:58.315003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-161eaebe-6264-47ba-9b77-6ca82ac0f7b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:58.315871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-161eaebe-6264-47ba-9b77-6ca82ac0f7b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:58.323501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-161eaebe-6264-47ba-9b77-6ca82ac0f7b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:58.323875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-161eaebe-6264-47ba-9b77-6ca82ac0f7b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:58.324579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-161eaebe-6264-47ba-9b77-6ca82ac0f7b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:58.325010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-161eaebe-6264-47ba-9b77-6ca82ac0f7b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:58.474548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-161eaebe-6264-47ba-9b77-6ca82ac0f7b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:58.482992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-161eaebe-6264-47ba-9b77-6ca82ac0f7b5 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.172369 Jul 26 18:54:58.483600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2158/4163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:58 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:59.035953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-796ef5e2-b87c-4533-bb84-57889d91bcf0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:59.036466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-796ef5e2-b87c-4533-bb84-57889d91bcf0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:59.045212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-796ef5e2-b87c-4533-bb84-57889d91bcf0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:59.045909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-796ef5e2-b87c-4533-bb84-57889d91bcf0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:59.047616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-796ef5e2-b87c-4533-bb84-57889d91bcf0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:59.048218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-796ef5e2-b87c-4533-bb84-57889d91bcf0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:59.128543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-796ef5e2-b87c-4533-bb84-57889d91bcf0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:59.137881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-796ef5e2-b87c-4533-bb84-57889d91bcf0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.106169 Jul 26 18:54:59.138467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2159/4164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:59 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:59.150334 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b1df77af-38da-4503-aa12-7123a7096ea2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:59.151218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b1df77af-38da-4503-aa12-7123a7096ea2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:59.159741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1df77af-38da-4503-aa12-7123a7096ea2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:59.160181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1df77af-38da-4503-aa12-7123a7096ea2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:59.160937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1df77af-38da-4503-aa12-7123a7096ea2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:59.161536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b1df77af-38da-4503-aa12-7123a7096ea2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:59.225644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b1df77af-38da-4503-aa12-7123a7096ea2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:59.233313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b1df77af-38da-4503-aa12-7123a7096ea2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1299 microversion: 2.1 time: 0.093909 Jul 26 18:54:59.233916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2160/4165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:59 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:54:59.504902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e7e2bb84-c862-46c0-b481-a79457346fa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:54:59.505581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e7e2bb84-c862-46c0-b481-a79457346fa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:54:59.511914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7e2bb84-c862-46c0-b481-a79457346fa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:59.512368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7e2bb84-c862-46c0-b481-a79457346fa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:59.513162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7e2bb84-c862-46c0-b481-a79457346fa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:54:59.513575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e7e2bb84-c862-46c0-b481-a79457346fa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:54:59.726006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e7e2bb84-c862-46c0-b481-a79457346fa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:54:59.734563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e7e2bb84-c862-46c0-b481-a79457346fa1 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.233729 Jul 26 18:54:59.735187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2161/4166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:54:59 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:00.159623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-70811422-b80d-4ff0-8055-16ffaf3c8c2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:00.160308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-70811422-b80d-4ff0-8055-16ffaf3c8c2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:00.167057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-70811422-b80d-4ff0-8055-16ffaf3c8c2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:00.167718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-70811422-b80d-4ff0-8055-16ffaf3c8c2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:00.168470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-70811422-b80d-4ff0-8055-16ffaf3c8c2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:00.168896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-70811422-b80d-4ff0-8055-16ffaf3c8c2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:00.257480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-70811422-b80d-4ff0-8055-16ffaf3c8c2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:00.265713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-70811422-b80d-4ff0-8055-16ffaf3c8c2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.110242 Jul 26 18:55:00.266331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2162/4167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:00 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:00.271183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4f2be9a5-e5da-4f84-952d-8379d6401c2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:00.271777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4f2be9a5-e5da-4f84-952d-8379d6401c2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:00.277993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f2be9a5-e5da-4f84-952d-8379d6401c2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:00.278394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f2be9a5-e5da-4f84-952d-8379d6401c2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:00.279167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f2be9a5-e5da-4f84-952d-8379d6401c2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:00.279594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f2be9a5-e5da-4f84-952d-8379d6401c2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:00.483763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4f2be9a5-e5da-4f84-952d-8379d6401c2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:00.491252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4f2be9a5-e5da-4f84-952d-8379d6401c2c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1366 microversion: 2.1 time: 0.223931 Jul 26 18:55:00.491818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2163/4168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:00 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:00.591061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-4e2484e0-17f4-4273-b305-d735f8c110e6 req-5780df8d-6abb-49b7-ab8e-7e73aa62c6fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8bb7af-2f89-4a8d-9a16-0e5a157af92d", "tag": "bf55529b-4812-49fa-afa9-ead56591987a"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:55:00.601563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-4e2484e0-17f4-4273-b305-d735f8c110e6 req-5780df8d-6abb-49b7-ab8e-7e73aa62c6fb service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:00.602036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-4e2484e0-17f4-4273-b305-d735f8c110e6 req-5780df8d-6abb-49b7-ab8e-7e73aa62c6fb service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:00.617070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-4e2484e0-17f4-4273-b305-d735f8c110e6 req-5780df8d-6abb-49b7-ab8e-7e73aa62c6fb service nova] Creating event network-changed:bf55529b-4812-49fa-afa9-ead56591987a for instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d on hv-cinder-82549 Jul 26 18:55:00.622326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-4e2484e0-17f4-4273-b305-d735f8c110e6 req-5780df8d-6abb-49b7-ab8e-7e73aa62c6fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035712 Jul 26 18:55:00.623297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2164/4169] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:55:00.757251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0a3e02c1-3682-4dd7-83b9-33195491ece7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:00.758031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0a3e02c1-3682-4dd7-83b9-33195491ece7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:00.764670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a3e02c1-3682-4dd7-83b9-33195491ece7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:00.765197 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a3e02c1-3682-4dd7-83b9-33195491ece7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:00.766031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a3e02c1-3682-4dd7-83b9-33195491ece7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:00.766533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0a3e02c1-3682-4dd7-83b9-33195491ece7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:00.986675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0a3e02c1-3682-4dd7-83b9-33195491ece7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:00.994949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0a3e02c1-3682-4dd7-83b9-33195491ece7 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.242179 Jul 26 18:55:00.995556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2165/4170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:00 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:01.287055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5e7f423c-6bc4-4931-92f4-a0393fd9ada7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:01.287690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5e7f423c-6bc4-4931-92f4-a0393fd9ada7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:01.294837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e7f423c-6bc4-4931-92f4-a0393fd9ada7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:01.295315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e7f423c-6bc4-4931-92f4-a0393fd9ada7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:01.296079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e7f423c-6bc4-4931-92f4-a0393fd9ada7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:01.296518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e7f423c-6bc4-4931-92f4-a0393fd9ada7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:01.359808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5e7f423c-6bc4-4931-92f4-a0393fd9ada7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:01.367851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5e7f423c-6bc4-4931-92f4-a0393fd9ada7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.084825 Jul 26 18:55:01.368433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2166/4171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:01 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:01.515803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-49e108f3-d488-4f77-8817-afe29812e98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:01.516727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-49e108f3-d488-4f77-8817-afe29812e98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:01.526472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49e108f3-d488-4f77-8817-afe29812e98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:01.527190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49e108f3-d488-4f77-8817-afe29812e98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:01.528332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49e108f3-d488-4f77-8817-afe29812e98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:01.528989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49e108f3-d488-4f77-8817-afe29812e98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:01.673968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-49e108f3-d488-4f77-8817-afe29812e98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:01.685130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-49e108f3-d488-4f77-8817-afe29812e98c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1366 microversion: 2.1 time: 0.175115 Jul 26 18:55:01.685910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2167/4172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:01 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:02.020356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-51416c55-0c5a-465f-96ee-94a4ac56cf0e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:02.021447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-51416c55-0c5a-465f-96ee-94a4ac56cf0e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:02.030600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51416c55-0c5a-465f-96ee-94a4ac56cf0e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:02.031063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51416c55-0c5a-465f-96ee-94a4ac56cf0e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:02.031840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51416c55-0c5a-465f-96ee-94a4ac56cf0e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:02.032271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51416c55-0c5a-465f-96ee-94a4ac56cf0e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:02.164276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-51416c55-0c5a-465f-96ee-94a4ac56cf0e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:02.174052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-51416c55-0c5a-465f-96ee-94a4ac56cf0e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160738 Jul 26 18:55:02.174602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2168/4173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:02 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:02.389483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-834915ff-4309-474c-b37b-f15daa17b523 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:02.390001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-834915ff-4309-474c-b37b-f15daa17b523 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:02.397454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-834915ff-4309-474c-b37b-f15daa17b523 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:02.397911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-834915ff-4309-474c-b37b-f15daa17b523 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:02.398677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-834915ff-4309-474c-b37b-f15daa17b523 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:02.399268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-834915ff-4309-474c-b37b-f15daa17b523 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:02.461839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-834915ff-4309-474c-b37b-f15daa17b523 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:02.470410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-834915ff-4309-474c-b37b-f15daa17b523 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085113 Jul 26 18:55:02.470984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2169/4174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:02 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:02.711778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-89f37431-cc52-48a9-a903-70898d66b799 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:02.712427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-89f37431-cc52-48a9-a903-70898d66b799 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:02.719005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89f37431-cc52-48a9-a903-70898d66b799 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:02.720279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89f37431-cc52-48a9-a903-70898d66b799 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:02.721057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89f37431-cc52-48a9-a903-70898d66b799 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:02.721506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89f37431-cc52-48a9-a903-70898d66b799 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:02.724271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:55:02.866842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-89f37431-cc52-48a9-a903-70898d66b799 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:02.874855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-89f37431-cc52-48a9-a903-70898d66b799 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1366 microversion: 2.1 time: 0.167095 Jul 26 18:55:02.875481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2170/4175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:02 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:03.199943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b9209bd7-10f9-4f6f-a69f-605dc373371e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:03.200575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b9209bd7-10f9-4f6f-a69f-605dc373371e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:03.207720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9209bd7-10f9-4f6f-a69f-605dc373371e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:03.208218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9209bd7-10f9-4f6f-a69f-605dc373371e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:03.209060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9209bd7-10f9-4f6f-a69f-605dc373371e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:03.209539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b9209bd7-10f9-4f6f-a69f-605dc373371e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:03.350325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b9209bd7-10f9-4f6f-a69f-605dc373371e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:03.363163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b9209bd7-10f9-4f6f-a69f-605dc373371e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.169939 Jul 26 18:55:03.364020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2171/4176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:03 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:03.495014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-24b0ef7f-3711-4cc6-97de-77ab9730bc8b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:03.496055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-24b0ef7f-3711-4cc6-97de-77ab9730bc8b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:03.503308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24b0ef7f-3711-4cc6-97de-77ab9730bc8b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:03.503754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24b0ef7f-3711-4cc6-97de-77ab9730bc8b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:03.504501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24b0ef7f-3711-4cc6-97de-77ab9730bc8b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:03.504925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24b0ef7f-3711-4cc6-97de-77ab9730bc8b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:03.577388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-24b0ef7f-3711-4cc6-97de-77ab9730bc8b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:03.585737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-24b0ef7f-3711-4cc6-97de-77ab9730bc8b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.096891 Jul 26 18:55:03.586300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2172/4177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:03 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:03.897214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4de64559-8487-4738-87e2-3e677ed4ba73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:03.897930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4de64559-8487-4738-87e2-3e677ed4ba73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:03.905376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4de64559-8487-4738-87e2-3e677ed4ba73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:03.906099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4de64559-8487-4738-87e2-3e677ed4ba73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:03.907366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4de64559-8487-4738-87e2-3e677ed4ba73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:03.908008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4de64559-8487-4738-87e2-3e677ed4ba73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:04.138339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4de64559-8487-4738-87e2-3e677ed4ba73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:04.148372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4de64559-8487-4738-87e2-3e677ed4ba73 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1366 microversion: 2.1 time: 0.255917 Jul 26 18:55:04.149147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2173/4178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:03 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:04.387729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a51d46f5-966c-4304-be12-6ae09df89c46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:04.388327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a51d46f5-966c-4304-be12-6ae09df89c46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:04.395911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a51d46f5-966c-4304-be12-6ae09df89c46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:04.396353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a51d46f5-966c-4304-be12-6ae09df89c46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:04.397103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a51d46f5-966c-4304-be12-6ae09df89c46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:04.397528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a51d46f5-966c-4304-be12-6ae09df89c46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:04.533605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a51d46f5-966c-4304-be12-6ae09df89c46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:04.541944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a51d46f5-966c-4304-be12-6ae09df89c46 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.158170 Jul 26 18:55:04.542525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2174/4179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:04 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:04.605883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fc79f7a4-bc50-4a94-b079-16970a042de4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:04.606492 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fc79f7a4-bc50-4a94-b079-16970a042de4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:04.613036 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc79f7a4-bc50-4a94-b079-16970a042de4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:04.613496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc79f7a4-bc50-4a94-b079-16970a042de4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:04.614252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc79f7a4-bc50-4a94-b079-16970a042de4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:04.614688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc79f7a4-bc50-4a94-b079-16970a042de4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:04.680138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fc79f7a4-bc50-4a94-b079-16970a042de4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:04.689860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fc79f7a4-bc50-4a94-b079-16970a042de4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.087872 Jul 26 18:55:04.690435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2175/4180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:04 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:05.170153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-97dce320-6310-4382-960b-f7c8d299dc14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:05.170858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-97dce320-6310-4382-960b-f7c8d299dc14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:05.177396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97dce320-6310-4382-960b-f7c8d299dc14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:05.177838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97dce320-6310-4382-960b-f7c8d299dc14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:05.178594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97dce320-6310-4382-960b-f7c8d299dc14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:05.178999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-97dce320-6310-4382-960b-f7c8d299dc14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:05.308818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-97dce320-6310-4382-960b-f7c8d299dc14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:05.316430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-97dce320-6310-4382-960b-f7c8d299dc14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1366 microversion: 2.1 time: 0.150283 Jul 26 18:55:05.317000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2176/4181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:05 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:05.563544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3a90a9de-895d-4579-83f1-38acaaf4406f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:05.564144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3a90a9de-895d-4579-83f1-38acaaf4406f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:05.571121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a90a9de-895d-4579-83f1-38acaaf4406f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:05.571560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a90a9de-895d-4579-83f1-38acaaf4406f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:05.572306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a90a9de-895d-4579-83f1-38acaaf4406f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:05.572706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a90a9de-895d-4579-83f1-38acaaf4406f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:05.714489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3a90a9de-895d-4579-83f1-38acaaf4406f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:05.723437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3a90a9de-895d-4579-83f1-38acaaf4406f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.163930 Jul 26 18:55:05.724008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2177/4182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:05 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:05.728359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d0c58634-21cb-4af3-9fdc-ae13fc15f461 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:05.728955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d0c58634-21cb-4af3-9fdc-ae13fc15f461 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:05.734850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0c58634-21cb-4af3-9fdc-ae13fc15f461 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:05.735320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0c58634-21cb-4af3-9fdc-ae13fc15f461 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:05.736080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0c58634-21cb-4af3-9fdc-ae13fc15f461 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:05.736554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0c58634-21cb-4af3-9fdc-ae13fc15f461 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:05.806631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d0c58634-21cb-4af3-9fdc-ae13fc15f461 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:05.815531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d0c58634-21cb-4af3-9fdc-ae13fc15f461 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090482 Jul 26 18:55:05.816040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2178/4183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:05 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:06.345255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-50dec9b9-84d9-4878-b972-19c729a03f42 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:06.346131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-50dec9b9-84d9-4878-b972-19c729a03f42 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:06.354295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50dec9b9-84d9-4878-b972-19c729a03f42 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:06.354882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50dec9b9-84d9-4878-b972-19c729a03f42 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:06.355923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50dec9b9-84d9-4878-b972-19c729a03f42 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:06.356489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50dec9b9-84d9-4878-b972-19c729a03f42 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:06.494211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-50dec9b9-84d9-4878-b972-19c729a03f42 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:06.502313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-50dec9b9-84d9-4878-b972-19c729a03f42 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1366 microversion: 2.1 time: 0.163331 Jul 26 18:55:06.502898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2179/4184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:06 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:06.602543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-d7efcfdc-5389-4549-8cca-ccf611968244 req-85876f86-3f47-4688-81b7-dae165358c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8bb7af-2f89-4a8d-9a16-0e5a157af92d", "name": "network-vif-plugged", "status": "completed", "tag": "bf55529b-4812-49fa-afa9-ead56591987a"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:55:06.613565 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-d7efcfdc-5389-4549-8cca-ccf611968244 req-85876f86-3f47-4688-81b7-dae165358c18 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:06.614515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-d7efcfdc-5389-4549-8cca-ccf611968244 req-85876f86-3f47-4688-81b7-dae165358c18 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:06.626132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-d7efcfdc-5389-4549-8cca-ccf611968244 req-85876f86-3f47-4688-81b7-dae165358c18 service nova] Creating event network-vif-plugged:bf55529b-4812-49fa-afa9-ead56591987a for instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d on hv-cinder-82549 Jul 26 18:55:06.631201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-d7efcfdc-5389-4549-8cca-ccf611968244 req-85876f86-3f47-4688-81b7-dae165358c18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032615 Jul 26 18:55:06.631796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2180/4185] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:55:06.746342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f80235c1-d7b0-4924-8441-b07e876f9ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:06.748883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f80235c1-d7b0-4924-8441-b07e876f9ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:06.754769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f80235c1-d7b0-4924-8441-b07e876f9ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:06.755237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f80235c1-d7b0-4924-8441-b07e876f9ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:06.756004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f80235c1-d7b0-4924-8441-b07e876f9ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:06.756449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f80235c1-d7b0-4924-8441-b07e876f9ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:06.950421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f80235c1-d7b0-4924-8441-b07e876f9ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:06.963545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f80235c1-d7b0-4924-8441-b07e876f9ee6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.221654 Jul 26 18:55:06.964433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2181/4186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:06 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:06.968857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a1bd79f8-dfe6-4fff-b4a8-20931b88e211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:06.969431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a1bd79f8-dfe6-4fff-b4a8-20931b88e211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:06.975059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1bd79f8-dfe6-4fff-b4a8-20931b88e211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:06.975494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1bd79f8-dfe6-4fff-b4a8-20931b88e211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:06.976236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1bd79f8-dfe6-4fff-b4a8-20931b88e211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:06.976665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1bd79f8-dfe6-4fff-b4a8-20931b88e211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:07.040317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a1bd79f8-dfe6-4fff-b4a8-20931b88e211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:07.050359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a1bd79f8-dfe6-4fff-b4a8-20931b88e211 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.084680 Jul 26 18:55:07.051314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2182/4187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:06 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:07.524191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3179921d-24a2-4223-a595-7628ae066854 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:07.524946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3179921d-24a2-4223-a595-7628ae066854 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:07.531121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3179921d-24a2-4223-a595-7628ae066854 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:07.531557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3179921d-24a2-4223-a595-7628ae066854 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:07.532312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3179921d-24a2-4223-a595-7628ae066854 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:07.532745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3179921d-24a2-4223-a595-7628ae066854 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:07.664157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3179921d-24a2-4223-a595-7628ae066854 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:07.675049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3179921d-24a2-4223-a595-7628ae066854 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1366 microversion: 2.1 time: 0.155112 Jul 26 18:55:07.675625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2183/4188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:07 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:07.989536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ae017ee7-2f92-4369-a4ea-3074f8c6650a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:07.990625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ae017ee7-2f92-4369-a4ea-3074f8c6650a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:07.993812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:55:08.001793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae017ee7-2f92-4369-a4ea-3074f8c6650a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:08.002242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae017ee7-2f92-4369-a4ea-3074f8c6650a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:08.003003 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae017ee7-2f92-4369-a4ea-3074f8c6650a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:08.003463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae017ee7-2f92-4369-a4ea-3074f8c6650a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:08.086544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=12 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:55:08.138509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ae017ee7-2f92-4369-a4ea-3074f8c6650a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:08.147555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ae017ee7-2f92-4369-a4ea-3074f8c6650a tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.164630 Jul 26 18:55:08.148195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2184/4189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:07 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:08.153051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-aea7d5da-5d55-4a03-848d-69b0deacd3c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:08.153659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-aea7d5da-5d55-4a03-848d-69b0deacd3c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:08.159657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aea7d5da-5d55-4a03-848d-69b0deacd3c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:08.160104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aea7d5da-5d55-4a03-848d-69b0deacd3c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:08.160859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aea7d5da-5d55-4a03-848d-69b0deacd3c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:08.161291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-aea7d5da-5d55-4a03-848d-69b0deacd3c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:08.223114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-aea7d5da-5d55-4a03-848d-69b0deacd3c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:08.234694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-aea7d5da-5d55-4a03-848d-69b0deacd3c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.084948 Jul 26 18:55:08.235300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2185/4190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:08 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:08.700819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f5839e6f-fc03-4315-9b16-0f1d32019c14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:08.701856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f5839e6f-fc03-4315-9b16-0f1d32019c14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:08.713112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5839e6f-fc03-4315-9b16-0f1d32019c14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:08.713848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5839e6f-fc03-4315-9b16-0f1d32019c14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:08.715087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5839e6f-fc03-4315-9b16-0f1d32019c14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:08.715844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f5839e6f-fc03-4315-9b16-0f1d32019c14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:08.865311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f5839e6f-fc03-4315-9b16-0f1d32019c14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:08.877165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f5839e6f-fc03-4315-9b16-0f1d32019c14 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1366 microversion: 2.1 time: 0.182918 Jul 26 18:55:08.878028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2186/4191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:08 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:09.172952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-970ca7b0-422f-49f5-9287-ff76d3be40d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:09.174011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-970ca7b0-422f-49f5-9287-ff76d3be40d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:09.182592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-970ca7b0-422f-49f5-9287-ff76d3be40d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:09.183232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-970ca7b0-422f-49f5-9287-ff76d3be40d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:09.183998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-970ca7b0-422f-49f5-9287-ff76d3be40d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:09.184434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-970ca7b0-422f-49f5-9287-ff76d3be40d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:09.199831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:55:09.325890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-970ca7b0-422f-49f5-9287-ff76d3be40d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:09.338023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-970ca7b0-422f-49f5-9287-ff76d3be40d3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.171030 Jul 26 18:55:09.338778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2187/4192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:09 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:09.343210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3fc6f610-0e66-406c-b014-b1b0bf3da1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:09.343879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3fc6f610-0e66-406c-b014-b1b0bf3da1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:09.349820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3fc6f610-0e66-406c-b014-b1b0bf3da1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:09.350269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3fc6f610-0e66-406c-b014-b1b0bf3da1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:09.351060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3fc6f610-0e66-406c-b014-b1b0bf3da1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:09.351473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3fc6f610-0e66-406c-b014-b1b0bf3da1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:09.412635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3fc6f610-0e66-406c-b014-b1b0bf3da1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:09.420951 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3fc6f610-0e66-406c-b014-b1b0bf3da1a8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.081138 Jul 26 18:55:09.421559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2188/4193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:09 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:09.898705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-04885452-7ea2-4b21-bd05-46a0f1c0a715 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:09.899458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-04885452-7ea2-4b21-bd05-46a0f1c0a715 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:09.905942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04885452-7ea2-4b21-bd05-46a0f1c0a715 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:09.906364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04885452-7ea2-4b21-bd05-46a0f1c0a715 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:09.907146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04885452-7ea2-4b21-bd05-46a0f1c0a715 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:09.907620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-04885452-7ea2-4b21-bd05-46a0f1c0a715 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:10.062115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-04885452-7ea2-4b21-bd05-46a0f1c0a715 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:10.071802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-04885452-7ea2-4b21-bd05-46a0f1c0a715 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1557 microversion: 2.1 time: 0.177441 Jul 26 18:55:10.072702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2189/4194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:09 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1557 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:10.095270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8da4f56b-27d3-44bf-bfc7-a356c228af29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:10.095755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8da4f56b-27d3-44bf-bfc7-a356c228af29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:10.102165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8da4f56b-27d3-44bf-bfc7-a356c228af29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:10.102604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8da4f56b-27d3-44bf-bfc7-a356c228af29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:10.103414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8da4f56b-27d3-44bf-bfc7-a356c228af29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:10.103846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8da4f56b-27d3-44bf-bfc7-a356c228af29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:10.184437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8da4f56b-27d3-44bf-bfc7-a356c228af29 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095291 Jul 26 18:55:10.185047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2190/4195] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Jul 26 18:55:10 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:55:10.359810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7b4c2550-30f9-4cb9-a0b4-0b944d4451ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:10.360316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7b4c2550-30f9-4cb9-a0b4-0b944d4451ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:10.366994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b4c2550-30f9-4cb9-a0b4-0b944d4451ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:10.367472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b4c2550-30f9-4cb9-a0b4-0b944d4451ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:10.368210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b4c2550-30f9-4cb9-a0b4-0b944d4451ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:10.368668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7b4c2550-30f9-4cb9-a0b4-0b944d4451ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:10.625946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7b4c2550-30f9-4cb9-a0b4-0b944d4451ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:10.634682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7b4c2550-30f9-4cb9-a0b4-0b944d4451ca tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.278919 Jul 26 18:55:10.635286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2191/4196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:10 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:10.644238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bb10f045-b61d-44e8-9e9f-ee0787d3e69e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:10.644238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bb10f045-b61d-44e8-9e9f-ee0787d3e69e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:10.646386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb10f045-b61d-44e8-9e9f-ee0787d3e69e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:10.646802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb10f045-b61d-44e8-9e9f-ee0787d3e69e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:10.647582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb10f045-b61d-44e8-9e9f-ee0787d3e69e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:10.648015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb10f045-b61d-44e8-9e9f-ee0787d3e69e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:10.744706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bb10f045-b61d-44e8-9e9f-ee0787d3e69e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:10.749252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bb10f045-b61d-44e8-9e9f-ee0787d3e69e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.112983 Jul 26 18:55:10.749855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2192/4197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:10 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:11.451920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-aded3fc7-9fee-43e1-b597-e47a4f8eefcb req-fc650e60-ed3f-4ec9-ba49-62e6d2c23fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8bb7af-2f89-4a8d-9a16-0e5a157af92d", "tag": "bf55529b-4812-49fa-afa9-ead56591987a"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:55:11.462223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-aded3fc7-9fee-43e1-b597-e47a4f8eefcb req-fc650e60-ed3f-4ec9-ba49-62e6d2c23fa3 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:11.462656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-aded3fc7-9fee-43e1-b597-e47a4f8eefcb req-fc650e60-ed3f-4ec9-ba49-62e6d2c23fa3 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:11.474713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-aded3fc7-9fee-43e1-b597-e47a4f8eefcb req-fc650e60-ed3f-4ec9-ba49-62e6d2c23fa3 service nova] Creating event network-changed:bf55529b-4812-49fa-afa9-ead56591987a for instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d on hv-cinder-82549 Jul 26 18:55:11.479619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-aded3fc7-9fee-43e1-b597-e47a4f8eefcb req-fc650e60-ed3f-4ec9-ba49-62e6d2c23fa3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031393 Jul 26 18:55:11.480290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2193/4198] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:55:11.657777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dd78c0d2-8f6a-4e50-a430-f484afc69d45 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:11.658470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dd78c0d2-8f6a-4e50-a430-f484afc69d45 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:11.665630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd78c0d2-8f6a-4e50-a430-f484afc69d45 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:11.666047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd78c0d2-8f6a-4e50-a430-f484afc69d45 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:11.666811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd78c0d2-8f6a-4e50-a430-f484afc69d45 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:11.667271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd78c0d2-8f6a-4e50-a430-f484afc69d45 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:11.876293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dd78c0d2-8f6a-4e50-a430-f484afc69d45 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:11.885015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dd78c0d2-8f6a-4e50-a430-f484afc69d45 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.231543 Jul 26 18:55:11.899284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2194/4199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:11 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:11.899284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ad428475-bb36-4272-a586-c3d4e69bb63c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:11.899284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ad428475-bb36-4272-a586-c3d4e69bb63c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:11.899284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad428475-bb36-4272-a586-c3d4e69bb63c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:11.899284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad428475-bb36-4272-a586-c3d4e69bb63c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:11.899925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad428475-bb36-4272-a586-c3d4e69bb63c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:11.899925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad428475-bb36-4272-a586-c3d4e69bb63c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:11.990179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ad428475-bb36-4272-a586-c3d4e69bb63c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:11.998331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ad428475-bb36-4272-a586-c3d4e69bb63c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.111121 Jul 26 18:55:11.999057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2195/4200] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:11 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:12.909321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-68666a2f-a9f9-4536-941f-8fa400dba044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:12.909937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-68666a2f-a9f9-4536-941f-8fa400dba044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:12.917398 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68666a2f-a9f9-4536-941f-8fa400dba044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:12.917852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68666a2f-a9f9-4536-941f-8fa400dba044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:12.918617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68666a2f-a9f9-4536-941f-8fa400dba044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:12.919060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68666a2f-a9f9-4536-941f-8fa400dba044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:13.050064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-68666a2f-a9f9-4536-941f-8fa400dba044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:13.058705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-68666a2f-a9f9-4536-941f-8fa400dba044 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.154911 Jul 26 18:55:13.059298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2196/4201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:12 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:13.063893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2344d79d-dede-4606-a829-22f9a2cb2e19 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:13.064483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2344d79d-dede-4606-a829-22f9a2cb2e19 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:13.070250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2344d79d-dede-4606-a829-22f9a2cb2e19 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:13.070714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2344d79d-dede-4606-a829-22f9a2cb2e19 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:13.071501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2344d79d-dede-4606-a829-22f9a2cb2e19 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:13.071942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2344d79d-dede-4606-a829-22f9a2cb2e19 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:13.143349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2344d79d-dede-4606-a829-22f9a2cb2e19 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:13.156026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2344d79d-dede-4606-a829-22f9a2cb2e19 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095480 Jul 26 18:55:13.156671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2197/4202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:13 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:14.084777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-77adf051-d44b-4ea7-bf32-d76ce6099dd2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:14.085737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-77adf051-d44b-4ea7-bf32-d76ce6099dd2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:14.097000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77adf051-d44b-4ea7-bf32-d76ce6099dd2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:14.097747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77adf051-d44b-4ea7-bf32-d76ce6099dd2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:14.099068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77adf051-d44b-4ea7-bf32-d76ce6099dd2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:14.099809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77adf051-d44b-4ea7-bf32-d76ce6099dd2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:14.239153 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-77adf051-d44b-4ea7-bf32-d76ce6099dd2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:14.247368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-77adf051-d44b-4ea7-bf32-d76ce6099dd2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.169362 Jul 26 18:55:14.247938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2198/4203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:14 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:14.372889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dad9a83b-3eba-4614-9101-f2855626e4ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:14.373493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dad9a83b-3eba-4614-9101-f2855626e4ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:14.379742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dad9a83b-3eba-4614-9101-f2855626e4ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:14.380182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dad9a83b-3eba-4614-9101-f2855626e4ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:14.380928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dad9a83b-3eba-4614-9101-f2855626e4ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:14.381355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dad9a83b-3eba-4614-9101-f2855626e4ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:14.441859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dad9a83b-3eba-4614-9101-f2855626e4ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:14.450018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dad9a83b-3eba-4614-9101-f2855626e4ab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.201150 Jul 26 18:55:14.450582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2199/4204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:14 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:15.273324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c95ac23d-530b-47ba-8a9f-3dbbd2586558 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:15.274344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c95ac23d-530b-47ba-8a9f-3dbbd2586558 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:15.285238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c95ac23d-530b-47ba-8a9f-3dbbd2586558 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:15.285718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c95ac23d-530b-47ba-8a9f-3dbbd2586558 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:15.286470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c95ac23d-530b-47ba-8a9f-3dbbd2586558 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:15.286895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c95ac23d-530b-47ba-8a9f-3dbbd2586558 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:15.432181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c95ac23d-530b-47ba-8a9f-3dbbd2586558 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:15.443179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c95ac23d-530b-47ba-8a9f-3dbbd2586558 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.176745 Jul 26 18:55:15.443750 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2200/4205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:15 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:15.472095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d74f120e-fe8f-4946-a1ee-142da0b28f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:15.472696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d74f120e-fe8f-4946-a1ee-142da0b28f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:15.478681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d74f120e-fe8f-4946-a1ee-142da0b28f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:15.479146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d74f120e-fe8f-4946-a1ee-142da0b28f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:15.479921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d74f120e-fe8f-4946-a1ee-142da0b28f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:15.480354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d74f120e-fe8f-4946-a1ee-142da0b28f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:15.545595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d74f120e-fe8f-4946-a1ee-142da0b28f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:15.554068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d74f120e-fe8f-4946-a1ee-142da0b28f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086029 Jul 26 18:55:15.554716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2201/4206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:15 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:16.303085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8130f323-4d2a-4864-95b2-c48e86110a56 tempest-TestShelveInstance-294642436 tempest-TestShelveInstance-294642436-project] Calling method '.version_select at 0x7f390a1eeaf0>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:16.310304 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:55:16.327136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8130f323-4d2a-4864-95b2-c48e86110a56 tempest-TestShelveInstance-294642436 tempest-TestShelveInstance-294642436-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-507627590" status: 202 len: 0 microversion: 2.1 time: 0.027959 Jul 26 18:55:16.327739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2202/4207] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Jul 26 18:55:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-507627590 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 18:55:16.465144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-72b8f785-3f07-41bd-bf10-14057a92894b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:16.465797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-72b8f785-3f07-41bd-bf10-14057a92894b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:16.473190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72b8f785-3f07-41bd-bf10-14057a92894b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:16.473634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72b8f785-3f07-41bd-bf10-14057a92894b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:16.474391 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72b8f785-3f07-41bd-bf10-14057a92894b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:16.474824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72b8f785-3f07-41bd-bf10-14057a92894b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:16.613324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-72b8f785-3f07-41bd-bf10-14057a92894b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:16.622293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-72b8f785-3f07-41bd-bf10-14057a92894b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.161377 Jul 26 18:55:16.622861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2203/4208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:16 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:16.642736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f1ebb8db-642f-4d3c-8573-6a60daf7e47d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:16.643567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f1ebb8db-642f-4d3c-8573-6a60daf7e47d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:16.650720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1ebb8db-642f-4d3c-8573-6a60daf7e47d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:16.651201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1ebb8db-642f-4d3c-8573-6a60daf7e47d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:16.652011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1ebb8db-642f-4d3c-8573-6a60daf7e47d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:16.652444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1ebb8db-642f-4d3c-8573-6a60daf7e47d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:16.723007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f1ebb8db-642f-4d3c-8573-6a60daf7e47d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:16.731500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f1ebb8db-642f-4d3c-8573-6a60daf7e47d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.107541 Jul 26 18:55:16.732090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2204/4209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:16 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:17.646193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ad7a8a49-61b5-4d5c-89cd-72899432e385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:17.646808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ad7a8a49-61b5-4d5c-89cd-72899432e385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:17.653769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad7a8a49-61b5-4d5c-89cd-72899432e385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:17.654215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad7a8a49-61b5-4d5c-89cd-72899432e385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:17.655235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad7a8a49-61b5-4d5c-89cd-72899432e385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:17.655823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ad7a8a49-61b5-4d5c-89cd-72899432e385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:17.836370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ad7a8a49-61b5-4d5c-89cd-72899432e385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:17.844762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ad7a8a49-61b5-4d5c-89cd-72899432e385 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.202842 Jul 26 18:55:17.845865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2205/4210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:17 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:17.861237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3759f738-995a-48c4-87df-e3458ce75482 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:17.863579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3759f738-995a-48c4-87df-e3458ce75482 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:17.872311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3759f738-995a-48c4-87df-e3458ce75482 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:17.872999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3759f738-995a-48c4-87df-e3458ce75482 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:17.874115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3759f738-995a-48c4-87df-e3458ce75482 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:17.874639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3759f738-995a-48c4-87df-e3458ce75482 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:17.880166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:55:17.945467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3759f738-995a-48c4-87df-e3458ce75482 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:17.953587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3759f738-995a-48c4-87df-e3458ce75482 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.106550 Jul 26 18:55:17.954174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2206/4211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:17 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:18.869355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-eb2e5486-0f64-4752-980e-0a2412cc4488 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:18.870026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-eb2e5486-0f64-4752-980e-0a2412cc4488 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:18.877237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb2e5486-0f64-4752-980e-0a2412cc4488 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:18.877675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb2e5486-0f64-4752-980e-0a2412cc4488 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:18.878532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb2e5486-0f64-4752-980e-0a2412cc4488 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:18.879124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-eb2e5486-0f64-4752-980e-0a2412cc4488 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:19.032661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-eb2e5486-0f64-4752-980e-0a2412cc4488 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:19.048740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-eb2e5486-0f64-4752-980e-0a2412cc4488 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.183339 Jul 26 18:55:19.059825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2207/4212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:18 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:19.078547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9ae020dc-9374-4a89-b985-64841ee14f47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:19.079370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9ae020dc-9374-4a89-b985-64841ee14f47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:19.086948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ae020dc-9374-4a89-b985-64841ee14f47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:19.087443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ae020dc-9374-4a89-b985-64841ee14f47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:19.088233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ae020dc-9374-4a89-b985-64841ee14f47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:19.088657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ae020dc-9374-4a89-b985-64841ee14f47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:19.167255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9ae020dc-9374-4a89-b985-64841ee14f47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:19.176628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9ae020dc-9374-4a89-b985-64841ee14f47 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.115466 Jul 26 18:55:19.177212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2208/4213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:19 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:20.072315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8927e948-e9da-471f-9d57-3528d5ef15ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:20.073034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8927e948-e9da-471f-9d57-3528d5ef15ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:20.079493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8927e948-e9da-471f-9d57-3528d5ef15ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:20.079912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8927e948-e9da-471f-9d57-3528d5ef15ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:20.080665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8927e948-e9da-471f-9d57-3528d5ef15ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:20.081174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8927e948-e9da-471f-9d57-3528d5ef15ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:20.219854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8927e948-e9da-471f-9d57-3528d5ef15ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:20.229037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8927e948-e9da-471f-9d57-3528d5ef15ff tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.160135 Jul 26 18:55:20.230192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2209/4214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:20 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:20.235462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-514a8081-cd6d-45b7-9d95-eab44a1ddb18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:20.236286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-514a8081-cd6d-45b7-9d95-eab44a1ddb18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:20.249267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-514a8081-cd6d-45b7-9d95-eab44a1ddb18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:20.249720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-514a8081-cd6d-45b7-9d95-eab44a1ddb18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:20.250494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-514a8081-cd6d-45b7-9d95-eab44a1ddb18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:20.250926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-514a8081-cd6d-45b7-9d95-eab44a1ddb18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:20.313400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-514a8081-cd6d-45b7-9d95-eab44a1ddb18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:20.321665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-514a8081-cd6d-45b7-9d95-eab44a1ddb18 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090225 Jul 26 18:55:20.322221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2210/4215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:20 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:21.251664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-276eba7b-55c6-42e2-a02e-5e42ed6f32de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:21.252495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-276eba7b-55c6-42e2-a02e-5e42ed6f32de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:21.259788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-276eba7b-55c6-42e2-a02e-5e42ed6f32de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:21.260235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-276eba7b-55c6-42e2-a02e-5e42ed6f32de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:21.260996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-276eba7b-55c6-42e2-a02e-5e42ed6f32de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:21.261567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-276eba7b-55c6-42e2-a02e-5e42ed6f32de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:21.400637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-276eba7b-55c6-42e2-a02e-5e42ed6f32de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:21.408831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-276eba7b-55c6-42e2-a02e-5e42ed6f32de tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.162259 Jul 26 18:55:21.409525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2211/4216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:21 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:21.414081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-36dd6966-9f9f-4039-a6af-750e0dc173b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:21.414706 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-36dd6966-9f9f-4039-a6af-750e0dc173b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:21.421282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36dd6966-9f9f-4039-a6af-750e0dc173b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:21.422009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36dd6966-9f9f-4039-a6af-750e0dc173b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:21.422760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36dd6966-9f9f-4039-a6af-750e0dc173b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:21.423222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36dd6966-9f9f-4039-a6af-750e0dc173b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:21.512034 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-36dd6966-9f9f-4039-a6af-750e0dc173b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:21.521505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-36dd6966-9f9f-4039-a6af-750e0dc173b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.110726 Jul 26 18:55:21.536739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2212/4217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:21 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:22.430284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b338f340-5c32-481b-a6c3-483bead231eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:22.430986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b338f340-5c32-481b-a6c3-483bead231eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:22.438138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b338f340-5c32-481b-a6c3-483bead231eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:22.438653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b338f340-5c32-481b-a6c3-483bead231eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:22.439521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b338f340-5c32-481b-a6c3-483bead231eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:22.440060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b338f340-5c32-481b-a6c3-483bead231eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:22.596270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b338f340-5c32-481b-a6c3-483bead231eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:22.606745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b338f340-5c32-481b-a6c3-483bead231eb tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.179384 Jul 26 18:55:22.619319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2213/4218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:22 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:22.624564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-518da975-f381-4e92-ba9e-b0c5ec7e4ce5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:22.625241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-518da975-f381-4e92-ba9e-b0c5ec7e4ce5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:22.631629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-518da975-f381-4e92-ba9e-b0c5ec7e4ce5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:22.632154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-518da975-f381-4e92-ba9e-b0c5ec7e4ce5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:22.632998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-518da975-f381-4e92-ba9e-b0c5ec7e4ce5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:22.633501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-518da975-f381-4e92-ba9e-b0c5ec7e4ce5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:22.707591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-518da975-f381-4e92-ba9e-b0c5ec7e4ce5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:22.715585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-518da975-f381-4e92-ba9e-b0c5ec7e4ce5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.094964 Jul 26 18:55:22.716154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2214/4219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:22 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:23.627613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-26c9ad76-d134-4e63-914a-c0508ea0cc1b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:23.628267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-26c9ad76-d134-4e63-914a-c0508ea0cc1b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: e26b67fc-cc0a-41a7-8568-17f2eed10fb2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:23.635048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26c9ad76-d134-4e63-914a-c0508ea0cc1b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:23.635508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26c9ad76-d134-4e63-914a-c0508ea0cc1b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:23.636275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26c9ad76-d134-4e63-914a-c0508ea0cc1b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:23.636716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-26c9ad76-d134-4e63-914a-c0508ea0cc1b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:23.778923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-26c9ad76-d134-4e63-914a-c0508ea0cc1b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:23.792383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-26c9ad76-d134-4e63-914a-c0508ea0cc1b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2" status: 200 len: 1736 microversion: 2.1 time: 0.168654 Jul 26 18:55:23.793094 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2215/4220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:23 2022] GET /compute/v2.1/servers/e26b67fc-cc0a-41a7-8568-17f2eed10fb2 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:23.811597 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f15970a9-ea24-4f32-9707-1d9e55b26150 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:23.812201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f15970a9-ea24-4f32-9707-1d9e55b26150 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:23.819074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f15970a9-ea24-4f32-9707-1d9e55b26150 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:23.819526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f15970a9-ea24-4f32-9707-1d9e55b26150 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:23.820477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f15970a9-ea24-4f32-9707-1d9e55b26150 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:23.820910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f15970a9-ea24-4f32-9707-1d9e55b26150 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:23.884409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f15970a9-ea24-4f32-9707-1d9e55b26150 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:23.892715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f15970a9-ea24-4f32-9707-1d9e55b26150 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.098561 Jul 26 18:55:23.893426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2216/4221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:23 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:23.898313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6c4bfdfb-4e7d-4f92-ae59-e2aa8ef5f11f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '.version_select at 0x7f39097c4a60>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:23.918317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6c4bfdfb-4e7d-4f92-ae59-e2aa8ef5f11f tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413116797" status: 202 len: 0 microversion: 2.1 time: 0.023927 Jul 26 18:55:23.918908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2217/4222] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Jul 26 18:55:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413116797 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 18:55:24.852871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-4f54e66e-44bf-4bfb-af95-627ccd272177 req-42987f0d-5465-4d1b-bbfe-a28e61d35828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26b67fc-cc0a-41a7-8568-17f2eed10fb2", "tag": "b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:55:24.886187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-4f54e66e-44bf-4bfb-af95-627ccd272177 req-42987f0d-5465-4d1b-bbfe-a28e61d35828 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:24.886546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-4f54e66e-44bf-4bfb-af95-627ccd272177 req-42987f0d-5465-4d1b-bbfe-a28e61d35828 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:24.899048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-4f54e66e-44bf-4bfb-af95-627ccd272177 req-42987f0d-5465-4d1b-bbfe-a28e61d35828 service nova] Creating event network-changed:b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2 for instance e26b67fc-cc0a-41a7-8568-17f2eed10fb2 on hv-cinder-82549 Jul 26 18:55:24.904434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-4f54e66e-44bf-4bfb-af95-627ccd272177 req-42987f0d-5465-4d1b-bbfe-a28e61d35828 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055690 Jul 26 18:55:24.906162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2218/4223] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:55:24.914953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e1355c15-cfe2-4c8c-9af8-98eceb0e270b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:24.915688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e1355c15-cfe2-4c8c-9af8-98eceb0e270b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:24.922018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1355c15-cfe2-4c8c-9af8-98eceb0e270b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:24.922528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1355c15-cfe2-4c8c-9af8-98eceb0e270b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:24.923322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1355c15-cfe2-4c8c-9af8-98eceb0e270b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:24.923758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1355c15-cfe2-4c8c-9af8-98eceb0e270b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:25.053357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e1355c15-cfe2-4c8c-9af8-98eceb0e270b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:25.065628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e1355c15-cfe2-4c8c-9af8-98eceb0e270b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.154798 Jul 26 18:55:25.067330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2219/4224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:24 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:26.088785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-40f3e0dc-3e8a-4ef4-85a3-ae0b6d0f58f6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:26.090201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-40f3e0dc-3e8a-4ef4-85a3-ae0b6d0f58f6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:26.099005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40f3e0dc-3e8a-4ef4-85a3-ae0b6d0f58f6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:26.099906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40f3e0dc-3e8a-4ef4-85a3-ae0b6d0f58f6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:26.101342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40f3e0dc-3e8a-4ef4-85a3-ae0b6d0f58f6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:26.101926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-40f3e0dc-3e8a-4ef4-85a3-ae0b6d0f58f6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:26.317593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-40f3e0dc-3e8a-4ef4-85a3-ae0b6d0f58f6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:26.326628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-40f3e0dc-3e8a-4ef4-85a3-ae0b6d0f58f6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.242791 Jul 26 18:55:26.327314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2220/4225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:26 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:26.348675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-847d5499-6f4e-4b85-9985-79a03820cf55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:26.349167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-847d5499-6f4e-4b85-9985-79a03820cf55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:26.355942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-847d5499-6f4e-4b85-9985-79a03820cf55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:26.356508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-847d5499-6f4e-4b85-9985-79a03820cf55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:26.357388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-847d5499-6f4e-4b85-9985-79a03820cf55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:26.357822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-847d5499-6f4e-4b85-9985-79a03820cf55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:26.387253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-847d5499-6f4e-4b85-9985-79a03820cf55 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288/ips" status: 200 len: 152 microversion: 2.20 time: 0.046534 Jul 26 18:55:26.387848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2221/4226] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Jul 26 18:55:26 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 18:55:27.353049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ab4bad73-2ba2-4318-9454-4427b8dde89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:27.354462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ab4bad73-2ba2-4318-9454-4427b8dde89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:27.361010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab4bad73-2ba2-4318-9454-4427b8dde89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:27.361450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab4bad73-2ba2-4318-9454-4427b8dde89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:27.362310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab4bad73-2ba2-4318-9454-4427b8dde89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:27.362742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab4bad73-2ba2-4318-9454-4427b8dde89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:27.432840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ab4bad73-2ba2-4318-9454-4427b8dde89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:27.441561 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ab4bad73-2ba2-4318-9454-4427b8dde89a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095254 Jul 26 18:55:27.442246 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2222/4227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:27 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:28.462211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-98464aa8-55a3-49d3-89b8-ac885b7e0846 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:28.462862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-98464aa8-55a3-49d3-89b8-ac885b7e0846 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:28.469942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98464aa8-55a3-49d3-89b8-ac885b7e0846 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:28.470478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98464aa8-55a3-49d3-89b8-ac885b7e0846 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:28.471646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98464aa8-55a3-49d3-89b8-ac885b7e0846 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:28.473073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98464aa8-55a3-49d3-89b8-ac885b7e0846 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:28.549194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-98464aa8-55a3-49d3-89b8-ac885b7e0846 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:28.560588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-98464aa8-55a3-49d3-89b8-ac885b7e0846 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.102204 Jul 26 18:55:28.561152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2223/4228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:28 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:29.584496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a70f9932-ad10-4d50-afd8-d6dcdac70e5c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:29.585179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a70f9932-ad10-4d50-afd8-d6dcdac70e5c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:29.592501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a70f9932-ad10-4d50-afd8-d6dcdac70e5c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:29.592916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a70f9932-ad10-4d50-afd8-d6dcdac70e5c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:29.593873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a70f9932-ad10-4d50-afd8-d6dcdac70e5c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:29.594339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a70f9932-ad10-4d50-afd8-d6dcdac70e5c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:29.669738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a70f9932-ad10-4d50-afd8-d6dcdac70e5c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:29.672180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:55:29.680849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a70f9932-ad10-4d50-afd8-d6dcdac70e5c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.100286 Jul 26 18:55:29.681752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2224/4229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:29 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:30.701941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d124510a-1c0e-4b34-a77e-f9079b679fb1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:30.702570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d124510a-1c0e-4b34-a77e-f9079b679fb1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:30.709636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d124510a-1c0e-4b34-a77e-f9079b679fb1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:30.710089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d124510a-1c0e-4b34-a77e-f9079b679fb1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:30.710860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d124510a-1c0e-4b34-a77e-f9079b679fb1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:30.711381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d124510a-1c0e-4b34-a77e-f9079b679fb1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:30.775245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d124510a-1c0e-4b34-a77e-f9079b679fb1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:30.784787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d124510a-1c0e-4b34-a77e-f9079b679fb1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086671 Jul 26 18:55:30.785384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2225/4230] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:30 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:31.810661 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c8621b7b-1bad-42ba-86b9-f5bf110a1f9d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:31.812084 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c8621b7b-1bad-42ba-86b9-f5bf110a1f9d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:31.819463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8621b7b-1bad-42ba-86b9-f5bf110a1f9d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:31.819921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8621b7b-1bad-42ba-86b9-f5bf110a1f9d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:31.820704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8621b7b-1bad-42ba-86b9-f5bf110a1f9d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:31.821132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8621b7b-1bad-42ba-86b9-f5bf110a1f9d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:31.900494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c8621b7b-1bad-42ba-86b9-f5bf110a1f9d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:31.923498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c8621b7b-1bad-42ba-86b9-f5bf110a1f9d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.121492 Jul 26 18:55:31.924302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2226/4231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:31 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:32.945146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3a36da37-b230-4e2e-99f8-6b0d865c5f8d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:32.946514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3a36da37-b230-4e2e-99f8-6b0d865c5f8d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:32.955080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a36da37-b230-4e2e-99f8-6b0d865c5f8d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:32.955883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a36da37-b230-4e2e-99f8-6b0d865c5f8d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:32.956813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a36da37-b230-4e2e-99f8-6b0d865c5f8d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:32.957387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a36da37-b230-4e2e-99f8-6b0d865c5f8d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:33.039180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3a36da37-b230-4e2e-99f8-6b0d865c5f8d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:33.050141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3a36da37-b230-4e2e-99f8-6b0d865c5f8d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.108867 Jul 26 18:55:33.051435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2227/4232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:34.072728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-caaf7344-3b99-4e62-981e-e5358a9ce32a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:34.074096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-caaf7344-3b99-4e62-981e-e5358a9ce32a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:34.084471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-caaf7344-3b99-4e62-981e-e5358a9ce32a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:34.088261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-caaf7344-3b99-4e62-981e-e5358a9ce32a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:34.089472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-caaf7344-3b99-4e62-981e-e5358a9ce32a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:34.090343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-caaf7344-3b99-4e62-981e-e5358a9ce32a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:34.192434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-caaf7344-3b99-4e62-981e-e5358a9ce32a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:34.208534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-caaf7344-3b99-4e62-981e-e5358a9ce32a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.141009 Jul 26 18:55:34.209350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2228/4233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:34 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:34.615900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e846b489-5aa6-497c-aa29-e1f7b69923e3 tempest-TestVolumeBootPattern-376576048 tempest-TestVolumeBootPattern-376576048-project] Action: 'create', calling method: .version_select at 0x7f39098ca1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-933572589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCYjuE3YyYZk1HISIFRUQqPSaL6f0T/wWmiYlbA2SA6ebrNnXvJFmepPDi6ca57yi9X+5H0sQ9mcN/k09U5ph4i/LxBPsGZ+yjCfkbQTgbZM1gvEEsxpX3hVoB8u1VfKg=="}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:55:34.633607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-e846b489-5aa6-497c-aa29-e1f7b69923e3 tempest-TestVolumeBootPattern-376576048 tempest-TestVolumeBootPattern-376576048-project] Getting quotas for project 898795d3ea074b7581da36e0e3cedf5d. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:55:34.637809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-e846b489-5aa6-497c-aa29-e1f7b69923e3 tempest-TestVolumeBootPattern-376576048 tempest-TestVolumeBootPattern-376576048-project] Getting quotas for user 8b947299d79f475087d862bebed5bfe6 and project 898795d3ea074b7581da36e0e3cedf5d. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:55:34.661648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e846b489-5aa6-497c-aa29-e1f7b69923e3 tempest-TestVolumeBootPattern-376576048 tempest-TestVolumeBootPattern-376576048-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.215528 Jul 26 18:55:34.662263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2229/4234] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Jul 26 18:55:34 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:55:35.232982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a3d669f3-04fd-4891-ae75-1d32bc09d476 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:35.235611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a3d669f3-04fd-4891-ae75-1d32bc09d476 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:35.261930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3d669f3-04fd-4891-ae75-1d32bc09d476 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:35.262380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3d669f3-04fd-4891-ae75-1d32bc09d476 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:35.263248 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3d669f3-04fd-4891-ae75-1d32bc09d476 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:35.263723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3d669f3-04fd-4891-ae75-1d32bc09d476 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:35.353244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a3d669f3-04fd-4891-ae75-1d32bc09d476 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:35.362169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a3d669f3-04fd-4891-ae75-1d32bc09d476 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.133914 Jul 26 18:55:35.363327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2230/4235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:36.384279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3cb5a5ce-57bb-433f-b281-26fcd34b4c76 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:36.384938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3cb5a5ce-57bb-433f-b281-26fcd34b4c76 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:36.391625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3cb5a5ce-57bb-433f-b281-26fcd34b4c76 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:36.392052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3cb5a5ce-57bb-433f-b281-26fcd34b4c76 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:36.392806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3cb5a5ce-57bb-433f-b281-26fcd34b4c76 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:36.393236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3cb5a5ce-57bb-433f-b281-26fcd34b4c76 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:36.456993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3cb5a5ce-57bb-433f-b281-26fcd34b4c76 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:36.465417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3cb5a5ce-57bb-433f-b281-26fcd34b4c76 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085617 Jul 26 18:55:36.465997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2231/4236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:36 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:37.486849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5e9636b1-2696-41d6-add2-5d5e10b4a55a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:37.487485 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5e9636b1-2696-41d6-add2-5d5e10b4a55a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:37.494557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e9636b1-2696-41d6-add2-5d5e10b4a55a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:37.494999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e9636b1-2696-41d6-add2-5d5e10b4a55a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:37.495777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e9636b1-2696-41d6-add2-5d5e10b4a55a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:37.496204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5e9636b1-2696-41d6-add2-5d5e10b4a55a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:37.560279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5e9636b1-2696-41d6-add2-5d5e10b4a55a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:37.568538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5e9636b1-2696-41d6-add2-5d5e10b4a55a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085806 Jul 26 18:55:37.569160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2232/4237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:37 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:38.589179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-be1e5c4d-9920-43b9-9c88-2fd7beba9085 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:38.589804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-be1e5c4d-9920-43b9-9c88-2fd7beba9085 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:38.597077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be1e5c4d-9920-43b9-9c88-2fd7beba9085 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:38.597535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be1e5c4d-9920-43b9-9c88-2fd7beba9085 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:38.598308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be1e5c4d-9920-43b9-9c88-2fd7beba9085 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:38.598741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be1e5c4d-9920-43b9-9c88-2fd7beba9085 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:38.662310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-be1e5c4d-9920-43b9-9c88-2fd7beba9085 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:38.670887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-be1e5c4d-9920-43b9-9c88-2fd7beba9085 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085586 Jul 26 18:55:38.671570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2233/4238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:38 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:39.696451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2db58aba-b0fb-4524-832d-96b66e4dce87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:39.697505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2db58aba-b0fb-4524-832d-96b66e4dce87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:39.707511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2db58aba-b0fb-4524-832d-96b66e4dce87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:39.707967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2db58aba-b0fb-4524-832d-96b66e4dce87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:39.708732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2db58aba-b0fb-4524-832d-96b66e4dce87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:39.709158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2db58aba-b0fb-4524-832d-96b66e4dce87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:39.772270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2db58aba-b0fb-4524-832d-96b66e4dce87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:39.781051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2db58aba-b0fb-4524-832d-96b66e4dce87 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091193 Jul 26 18:55:39.781847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2234/4239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:39 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:40.802364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3d314b09-4f01-4b31-8672-9dff59ed2ea7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:40.802988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3d314b09-4f01-4b31-8672-9dff59ed2ea7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:40.810542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d314b09-4f01-4b31-8672-9dff59ed2ea7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:40.811004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d314b09-4f01-4b31-8672-9dff59ed2ea7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:40.811813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d314b09-4f01-4b31-8672-9dff59ed2ea7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:40.812241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3d314b09-4f01-4b31-8672-9dff59ed2ea7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:40.875883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3d314b09-4f01-4b31-8672-9dff59ed2ea7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:40.884952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3d314b09-4f01-4b31-8672-9dff59ed2ea7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086631 Jul 26 18:55:40.885532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2235/4240] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:40 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:41.910746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-31c8250c-1bfd-4a05-8a92-ac940a50dae4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:41.911806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-31c8250c-1bfd-4a05-8a92-ac940a50dae4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:41.923073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31c8250c-1bfd-4a05-8a92-ac940a50dae4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:41.923828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31c8250c-1bfd-4a05-8a92-ac940a50dae4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:41.925144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31c8250c-1bfd-4a05-8a92-ac940a50dae4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:41.925585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-31c8250c-1bfd-4a05-8a92-ac940a50dae4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:41.990445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-31c8250c-1bfd-4a05-8a92-ac940a50dae4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:42.002599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-31c8250c-1bfd-4a05-8a92-ac940a50dae4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.097907 Jul 26 18:55:42.003325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2236/4241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:41 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:43.024387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-16ed3cb6-9368-4bc3-ae48-16b3a3f9e74d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:43.024992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-16ed3cb6-9368-4bc3-ae48-16b3a3f9e74d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:43.031588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16ed3cb6-9368-4bc3-ae48-16b3a3f9e74d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:43.032025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16ed3cb6-9368-4bc3-ae48-16b3a3f9e74d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:43.032773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16ed3cb6-9368-4bc3-ae48-16b3a3f9e74d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:43.033195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16ed3cb6-9368-4bc3-ae48-16b3a3f9e74d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:43.097724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-16ed3cb6-9368-4bc3-ae48-16b3a3f9e74d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:43.106196 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-16ed3cb6-9368-4bc3-ae48-16b3a3f9e74d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086197 Jul 26 18:55:43.106772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2237/4242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:55:44.128299 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f9697e21-fe37-47a1-9159-f5a8261b0b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:44.128944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f9697e21-fe37-47a1-9159-f5a8261b0b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:44.136928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9697e21-fe37-47a1-9159-f5a8261b0b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:44.137453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9697e21-fe37-47a1-9159-f5a8261b0b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:44.138325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9697e21-fe37-47a1-9159-f5a8261b0b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:44.138822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f9697e21-fe37-47a1-9159-f5a8261b0b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:44.207350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f9697e21-fe37-47a1-9159-f5a8261b0b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:44.215861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f9697e21-fe37-47a1-9159-f5a8261b0b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.092160 Jul 26 18:55:44.216428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2238/4243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:44 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:45.240801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cc1f4a09-0cde-4a81-84a0-cf811d4b4b66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:45.241834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cc1f4a09-0cde-4a81-84a0-cf811d4b4b66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:45.244736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=4 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:55:45.254841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc1f4a09-0cde-4a81-84a0-cf811d4b4b66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:45.255305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc1f4a09-0cde-4a81-84a0-cf811d4b4b66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:45.256058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc1f4a09-0cde-4a81-84a0-cf811d4b4b66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:45.256490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc1f4a09-0cde-4a81-84a0-cf811d4b4b66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:45.327511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cc1f4a09-0cde-4a81-84a0-cf811d4b4b66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:45.335397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cc1f4a09-0cde-4a81-84a0-cf811d4b4b66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.101074 Jul 26 18:55:45.335956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2239/4244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:45 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:46.359956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b6fc4a3e-176d-452f-a923-120eb6eaaa26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:46.360909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b6fc4a3e-176d-452f-a923-120eb6eaaa26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:46.369241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6fc4a3e-176d-452f-a923-120eb6eaaa26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:46.369684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6fc4a3e-176d-452f-a923-120eb6eaaa26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:46.370439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6fc4a3e-176d-452f-a923-120eb6eaaa26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:46.370866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6fc4a3e-176d-452f-a923-120eb6eaaa26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:46.436428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b6fc4a3e-176d-452f-a923-120eb6eaaa26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:46.444789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b6fc4a3e-176d-452f-a923-120eb6eaaa26 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091387 Jul 26 18:55:46.445364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2240/4245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:46 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:47.469909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dadf155d-4642-47ff-affa-302f0eea81c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:47.471335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dadf155d-4642-47ff-affa-302f0eea81c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:47.474584 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:55:47.483834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dadf155d-4642-47ff-affa-302f0eea81c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:47.484575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dadf155d-4642-47ff-affa-302f0eea81c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:47.485841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dadf155d-4642-47ff-affa-302f0eea81c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:47.486555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dadf155d-4642-47ff-affa-302f0eea81c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:47.552903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dadf155d-4642-47ff-affa-302f0eea81c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:47.564742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dadf155d-4642-47ff-affa-302f0eea81c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.101178 Jul 26 18:55:47.565414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2241/4246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:47 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:48.595857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c382158f-5f8f-422f-9585-a2637dcbb4c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:48.596567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c382158f-5f8f-422f-9585-a2637dcbb4c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:48.604241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c382158f-5f8f-422f-9585-a2637dcbb4c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:48.604683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c382158f-5f8f-422f-9585-a2637dcbb4c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:48.605432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c382158f-5f8f-422f-9585-a2637dcbb4c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:48.605862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c382158f-5f8f-422f-9585-a2637dcbb4c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:48.620639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:55:48.668012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c382158f-5f8f-422f-9585-a2637dcbb4c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:48.676158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c382158f-5f8f-422f-9585-a2637dcbb4c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086704 Jul 26 18:55:48.676728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2242/4247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:48 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:49.702548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6ba6cb93-c71d-40c6-8ac2-2c657dae9140 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:49.703723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6ba6cb93-c71d-40c6-8ac2-2c657dae9140 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:49.712595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ba6cb93-c71d-40c6-8ac2-2c657dae9140 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:49.713042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ba6cb93-c71d-40c6-8ac2-2c657dae9140 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:49.713801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ba6cb93-c71d-40c6-8ac2-2c657dae9140 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:49.714229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ba6cb93-c71d-40c6-8ac2-2c657dae9140 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:49.782652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6ba6cb93-c71d-40c6-8ac2-2c657dae9140 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:49.791127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6ba6cb93-c71d-40c6-8ac2-2c657dae9140 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095846 Jul 26 18:55:49.791725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2243/4248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:49 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:50.812417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0821de32-69ab-43dc-bc43-1297908434c9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:50.813040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0821de32-69ab-43dc-bc43-1297908434c9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:50.820200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0821de32-69ab-43dc-bc43-1297908434c9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:50.820643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0821de32-69ab-43dc-bc43-1297908434c9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:50.821473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0821de32-69ab-43dc-bc43-1297908434c9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:50.821906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0821de32-69ab-43dc-bc43-1297908434c9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:50.897041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0821de32-69ab-43dc-bc43-1297908434c9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:50.905353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0821de32-69ab-43dc-bc43-1297908434c9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.096871 Jul 26 18:55:50.905921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2244/4249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:50 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:51.930291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e11e177e-2628-41af-9b6f-1773362c125b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:51.931061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e11e177e-2628-41af-9b6f-1773362c125b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:51.938882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e11e177e-2628-41af-9b6f-1773362c125b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:51.939436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e11e177e-2628-41af-9b6f-1773362c125b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:51.940316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e11e177e-2628-41af-9b6f-1773362c125b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:51.940814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e11e177e-2628-41af-9b6f-1773362c125b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:52.005800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e11e177e-2628-41af-9b6f-1773362c125b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:52.014144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e11e177e-2628-41af-9b6f-1773362c125b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089941 Jul 26 18:55:52.014702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2245/4250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:53.039384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-77939c95-0134-4a70-a9c4-8cc4651d90f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:53.040127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-77939c95-0134-4a70-a9c4-8cc4651d90f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:53.047973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77939c95-0134-4a70-a9c4-8cc4651d90f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:53.048517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77939c95-0134-4a70-a9c4-8cc4651d90f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:53.049399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77939c95-0134-4a70-a9c4-8cc4651d90f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:53.049905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-77939c95-0134-4a70-a9c4-8cc4651d90f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:53.119184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-77939c95-0134-4a70-a9c4-8cc4651d90f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:53.127514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-77939c95-0134-4a70-a9c4-8cc4651d90f1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.094624 Jul 26 18:55:53.128089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2246/4251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:53 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:54.149695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cc0205a6-4e21-44f0-bd48-c98215051613 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:54.150500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cc0205a6-4e21-44f0-bd48-c98215051613 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:54.158163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc0205a6-4e21-44f0-bd48-c98215051613 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:54.158659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc0205a6-4e21-44f0-bd48-c98215051613 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:54.159540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc0205a6-4e21-44f0-bd48-c98215051613 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:54.160010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cc0205a6-4e21-44f0-bd48-c98215051613 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:54.223173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cc0205a6-4e21-44f0-bd48-c98215051613 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:54.231831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cc0205a6-4e21-44f0-bd48-c98215051613 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086993 Jul 26 18:55:54.232396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2247/4252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:54 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:55.257426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3a8f273b-24ff-453e-95ae-43ddee026d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:55.258467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3a8f273b-24ff-453e-95ae-43ddee026d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:55.266722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a8f273b-24ff-453e-95ae-43ddee026d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:55.267271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a8f273b-24ff-453e-95ae-43ddee026d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:55.268121 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a8f273b-24ff-453e-95ae-43ddee026d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:55.268606 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a8f273b-24ff-453e-95ae-43ddee026d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:55.343459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3a8f273b-24ff-453e-95ae-43ddee026d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:55.351937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3a8f273b-24ff-453e-95ae-43ddee026d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.101054 Jul 26 18:55:55.352511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2248/4253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:56.377541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6faeb414-de08-45f7-aaf4-6d75256ee090 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:56.378478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6faeb414-de08-45f7-aaf4-6d75256ee090 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:56.389396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6faeb414-de08-45f7-aaf4-6d75256ee090 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:56.390132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6faeb414-de08-45f7-aaf4-6d75256ee090 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:56.391440 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6faeb414-de08-45f7-aaf4-6d75256ee090 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:56.392151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6faeb414-de08-45f7-aaf4-6d75256ee090 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:56.461864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6faeb414-de08-45f7-aaf4-6d75256ee090 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:56.470535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6faeb414-de08-45f7-aaf4-6d75256ee090 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.099799 Jul 26 18:55:56.471103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2249/4254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:56 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:57.500713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fb3f7ea6-9e3b-4478-8bec-c928f1e2d03c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:57.501792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fb3f7ea6-9e3b-4478-8bec-c928f1e2d03c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:57.512813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb3f7ea6-9e3b-4478-8bec-c928f1e2d03c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:57.513295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb3f7ea6-9e3b-4478-8bec-c928f1e2d03c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:57.514050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb3f7ea6-9e3b-4478-8bec-c928f1e2d03c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:57.514477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb3f7ea6-9e3b-4478-8bec-c928f1e2d03c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:57.584466 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fb3f7ea6-9e3b-4478-8bec-c928f1e2d03c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:57.592796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fb3f7ea6-9e3b-4478-8bec-c928f1e2d03c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.101150 Jul 26 18:55:57.593396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2250/4255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:57 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:58.617890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a0c2147b-f8a6-4773-870f-b510af23eede tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:58.618935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a0c2147b-f8a6-4773-870f-b510af23eede tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:58.628277 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0c2147b-f8a6-4773-870f-b510af23eede tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:58.628723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0c2147b-f8a6-4773-870f-b510af23eede tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:58.629488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0c2147b-f8a6-4773-870f-b510af23eede tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:58.629919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a0c2147b-f8a6-4773-870f-b510af23eede tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:58.706571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a0c2147b-f8a6-4773-870f-b510af23eede tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:58.716911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a0c2147b-f8a6-4773-870f-b510af23eede tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.106380 Jul 26 18:55:58.717564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2251/4256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:58 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:55:59.747475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fcca438e-9a34-4e93-9c14-1328be9b7bfa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:55:59.748526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fcca438e-9a34-4e93-9c14-1328be9b7bfa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:55:59.760751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fcca438e-9a34-4e93-9c14-1328be9b7bfa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:59.761498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fcca438e-9a34-4e93-9c14-1328be9b7bfa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:59.762764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fcca438e-9a34-4e93-9c14-1328be9b7bfa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:55:59.763617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fcca438e-9a34-4e93-9c14-1328be9b7bfa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:55:59.839540 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fcca438e-9a34-4e93-9c14-1328be9b7bfa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:55:59.848230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fcca438e-9a34-4e93-9c14-1328be9b7bfa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.107390 Jul 26 18:55:59.848788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2252/4257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:55:59 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:00.873500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3a37bd79-f21e-4da3-854b-c6f05c5b661d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:00.875477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3a37bd79-f21e-4da3-854b-c6f05c5b661d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:00.882994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a37bd79-f21e-4da3-854b-c6f05c5b661d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:00.883613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a37bd79-f21e-4da3-854b-c6f05c5b661d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:00.884409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a37bd79-f21e-4da3-854b-c6f05c5b661d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:00.884854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a37bd79-f21e-4da3-854b-c6f05c5b661d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:00.949223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3a37bd79-f21e-4da3-854b-c6f05c5b661d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:00.957649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3a37bd79-f21e-4da3-854b-c6f05c5b661d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090615 Jul 26 18:56:00.958213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2253/4258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:00 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:01.982979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-46b634bc-6d71-4b9f-a303-b0df89cc8dc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:01.984024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-46b634bc-6d71-4b9f-a303-b0df89cc8dc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:01.991662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-46b634bc-6d71-4b9f-a303-b0df89cc8dc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:01.992151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-46b634bc-6d71-4b9f-a303-b0df89cc8dc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:01.992989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-46b634bc-6d71-4b9f-a303-b0df89cc8dc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:01.993629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-46b634bc-6d71-4b9f-a303-b0df89cc8dc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:02.058456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-46b634bc-6d71-4b9f-a303-b0df89cc8dc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:02.066720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-46b634bc-6d71-4b9f-a303-b0df89cc8dc4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090294 Jul 26 18:56:02.067322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2254/4259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:01 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:03.092734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-da58e0bc-bb4b-48c1-abbe-15481a4701aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:03.093848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-da58e0bc-bb4b-48c1-abbe-15481a4701aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:03.100410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da58e0bc-bb4b-48c1-abbe-15481a4701aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:03.100850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da58e0bc-bb4b-48c1-abbe-15481a4701aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:03.101602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da58e0bc-bb4b-48c1-abbe-15481a4701aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:03.102032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da58e0bc-bb4b-48c1-abbe-15481a4701aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:03.163635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-da58e0bc-bb4b-48c1-abbe-15481a4701aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:03.171918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-da58e0bc-bb4b-48c1-abbe-15481a4701aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086534 Jul 26 18:56:03.172481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2255/4260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:03 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:04.198136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dee09eb6-dcc6-43cb-97fa-ebe6bbb3654f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:04.199130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dee09eb6-dcc6-43cb-97fa-ebe6bbb3654f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:04.207592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dee09eb6-dcc6-43cb-97fa-ebe6bbb3654f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:04.208032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dee09eb6-dcc6-43cb-97fa-ebe6bbb3654f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:04.208793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dee09eb6-dcc6-43cb-97fa-ebe6bbb3654f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:04.209211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dee09eb6-dcc6-43cb-97fa-ebe6bbb3654f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:04.279058 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dee09eb6-dcc6-43cb-97fa-ebe6bbb3654f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:04.287821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dee09eb6-dcc6-43cb-97fa-ebe6bbb3654f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.097139 Jul 26 18:56:04.288390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2256/4261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:04 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:05.310383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c59a02f9-303b-447a-a3d1-6d156d60601f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:05.311112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c59a02f9-303b-447a-a3d1-6d156d60601f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:05.318516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c59a02f9-303b-447a-a3d1-6d156d60601f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:05.318965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c59a02f9-303b-447a-a3d1-6d156d60601f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:05.319760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c59a02f9-303b-447a-a3d1-6d156d60601f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:05.320188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c59a02f9-303b-447a-a3d1-6d156d60601f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:05.387991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c59a02f9-303b-447a-a3d1-6d156d60601f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:05.397341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c59a02f9-303b-447a-a3d1-6d156d60601f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091296 Jul 26 18:56:05.397921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2257/4262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:05 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:06.422426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a812acd1-f242-4b7d-8d1d-1f5a35680fb3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:06.423495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a812acd1-f242-4b7d-8d1d-1f5a35680fb3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:06.430917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a812acd1-f242-4b7d-8d1d-1f5a35680fb3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:06.431411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a812acd1-f242-4b7d-8d1d-1f5a35680fb3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:06.432212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a812acd1-f242-4b7d-8d1d-1f5a35680fb3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:06.432666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a812acd1-f242-4b7d-8d1d-1f5a35680fb3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:06.499637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a812acd1-f242-4b7d-8d1d-1f5a35680fb3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:06.506864 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:56:06.507421 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:56:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 18:56:06.508263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a812acd1-f242-4b7d-8d1d-1f5a35680fb3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.092172 Jul 26 18:56:06.508809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2258/4263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:06 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:07.529463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1d28fa5e-37b8-47e5-ae9e-4be217e495c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:07.530268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1d28fa5e-37b8-47e5-ae9e-4be217e495c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:07.536858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d28fa5e-37b8-47e5-ae9e-4be217e495c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:07.537491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d28fa5e-37b8-47e5-ae9e-4be217e495c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:07.538253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d28fa5e-37b8-47e5-ae9e-4be217e495c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:07.538758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d28fa5e-37b8-47e5-ae9e-4be217e495c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:07.541488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:56:07.617755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1d28fa5e-37b8-47e5-ae9e-4be217e495c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:07.627762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1d28fa5e-37b8-47e5-ae9e-4be217e495c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.101958 Jul 26 18:56:07.628372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2259/4264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:07 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:08.653295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-60031979-8861-4d84-bce2-4ee6cc1a9357 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:08.655085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-60031979-8861-4d84-bce2-4ee6cc1a9357 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:08.664967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60031979-8861-4d84-bce2-4ee6cc1a9357 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:08.665411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60031979-8861-4d84-bce2-4ee6cc1a9357 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:08.666172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60031979-8861-4d84-bce2-4ee6cc1a9357 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:08.666602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-60031979-8861-4d84-bce2-4ee6cc1a9357 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:08.730857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-60031979-8861-4d84-bce2-4ee6cc1a9357 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:08.739948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-60031979-8861-4d84-bce2-4ee6cc1a9357 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093385 Jul 26 18:56:08.740521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2260/4265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:08 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:09.761477 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-65ff4703-dca7-4749-a1d5-2d73d5ef9b85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:09.762123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-65ff4703-dca7-4749-a1d5-2d73d5ef9b85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:09.770317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65ff4703-dca7-4749-a1d5-2d73d5ef9b85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:09.770761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65ff4703-dca7-4749-a1d5-2d73d5ef9b85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:09.771587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65ff4703-dca7-4749-a1d5-2d73d5ef9b85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:09.772130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-65ff4703-dca7-4749-a1d5-2d73d5ef9b85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:09.839973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-65ff4703-dca7-4749-a1d5-2d73d5ef9b85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:09.849734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-65ff4703-dca7-4749-a1d5-2d73d5ef9b85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.092204 Jul 26 18:56:09.859070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2261/4266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:09 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:09.935563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-b7336387-54e3-4af1-919e-860ace450595 req-6fbf24ca-df32-4148-be00-993a5b7d659b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9982c007-1157-4c63-93e8-3733712f06e0", "name": "network-vif-deleted", "tag": "4e31fc31-19bc-4733-a6d9-9e1a584d4781"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:56:09.945476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-b7336387-54e3-4af1-919e-860ace450595 req-6fbf24ca-df32-4148-be00-993a5b7d659b service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:09.945966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-b7336387-54e3-4af1-919e-860ace450595 req-6fbf24ca-df32-4148-be00-993a5b7d659b service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:09.957179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-b7336387-54e3-4af1-919e-860ace450595 req-6fbf24ca-df32-4148-be00-993a5b7d659b service nova] Creating event network-vif-deleted:4e31fc31-19bc-4733-a6d9-9e1a584d4781 for instance 9982c007-1157-4c63-93e8-3733712f06e0 on hv-cinder-82549 Jul 26 18:56:09.962713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-b7336387-54e3-4af1-919e-860ace450595 req-6fbf24ca-df32-4148-be00-993a5b7d659b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031426 Jul 26 18:56:09.963581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2262/4267] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:56:10.873718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e5af86e7-322b-4ff0-98b1-75f212c3c3c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:10.874681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e5af86e7-322b-4ff0-98b1-75f212c3c3c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:10.884436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5af86e7-322b-4ff0-98b1-75f212c3c3c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:10.885079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5af86e7-322b-4ff0-98b1-75f212c3c3c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:10.886408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5af86e7-322b-4ff0-98b1-75f212c3c3c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:10.887069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5af86e7-322b-4ff0-98b1-75f212c3c3c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:10.954097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e5af86e7-322b-4ff0-98b1-75f212c3c3c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:10.962453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e5af86e7-322b-4ff0-98b1-75f212c3c3c8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095519 Jul 26 18:56:10.963031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2263/4268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:10 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:11.984290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4af4bb63-a47f-46f8-849d-847da388843a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:11.984963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4af4bb63-a47f-46f8-849d-847da388843a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:11.991837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4af4bb63-a47f-46f8-849d-847da388843a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:11.992279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4af4bb63-a47f-46f8-849d-847da388843a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:11.993028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4af4bb63-a47f-46f8-849d-847da388843a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:11.993454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4af4bb63-a47f-46f8-849d-847da388843a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:12.064343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4af4bb63-a47f-46f8-849d-847da388843a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:12.074828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4af4bb63-a47f-46f8-849d-847da388843a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.094597 Jul 26 18:56:12.075710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2264/4269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:11 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:13.101961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f7660fe0-1055-408b-aa1e-62784028870c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:13.102943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f7660fe0-1055-408b-aa1e-62784028870c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:13.113829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7660fe0-1055-408b-aa1e-62784028870c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:13.114569 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7660fe0-1055-408b-aa1e-62784028870c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:13.115865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7660fe0-1055-408b-aa1e-62784028870c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:13.116587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f7660fe0-1055-408b-aa1e-62784028870c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:13.184559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f7660fe0-1055-408b-aa1e-62784028870c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:13.194071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f7660fe0-1055-408b-aa1e-62784028870c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.098796 Jul 26 18:56:13.194676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2265/4270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:13 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:14.220177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c092dec9-c07b-49d3-88fa-1e774b1d07f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:14.221298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c092dec9-c07b-49d3-88fa-1e774b1d07f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:14.230808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c092dec9-c07b-49d3-88fa-1e774b1d07f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:14.231290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c092dec9-c07b-49d3-88fa-1e774b1d07f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:14.232080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c092dec9-c07b-49d3-88fa-1e774b1d07f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:14.232521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c092dec9-c07b-49d3-88fa-1e774b1d07f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:14.304758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c092dec9-c07b-49d3-88fa-1e774b1d07f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:14.313430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c092dec9-c07b-49d3-88fa-1e774b1d07f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.100809 Jul 26 18:56:14.313984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2266/4271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:14 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:15.335808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d1f96cee-2ccf-466a-8eab-bed61c7e9cc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:15.336446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d1f96cee-2ccf-466a-8eab-bed61c7e9cc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:15.343489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1f96cee-2ccf-466a-8eab-bed61c7e9cc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:15.343932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1f96cee-2ccf-466a-8eab-bed61c7e9cc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:15.344676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1f96cee-2ccf-466a-8eab-bed61c7e9cc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:15.345119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d1f96cee-2ccf-466a-8eab-bed61c7e9cc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:15.413883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d1f96cee-2ccf-466a-8eab-bed61c7e9cc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:15.422242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d1f96cee-2ccf-466a-8eab-bed61c7e9cc5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090596 Jul 26 18:56:15.422813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2267/4272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:15 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:56:16.446410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cf90cb9f-7988-4f4c-881c-2061b858c2e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:16.447100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cf90cb9f-7988-4f4c-881c-2061b858c2e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:16.454144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf90cb9f-7988-4f4c-881c-2061b858c2e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:16.454575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf90cb9f-7988-4f4c-881c-2061b858c2e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:16.455359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf90cb9f-7988-4f4c-881c-2061b858c2e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:16.455767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cf90cb9f-7988-4f4c-881c-2061b858c2e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:16.529103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cf90cb9f-7988-4f4c-881c-2061b858c2e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:16.537346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cf90cb9f-7988-4f4c-881c-2061b858c2e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095161 Jul 26 18:56:16.537924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2268/4273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:16 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:17.562027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-75cf7cce-c947-4cf9-aa8d-1ec4143c241a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:17.562954 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-75cf7cce-c947-4cf9-aa8d-1ec4143c241a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:17.565274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=56 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:56:17.571183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75cf7cce-c947-4cf9-aa8d-1ec4143c241a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:17.571637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75cf7cce-c947-4cf9-aa8d-1ec4143c241a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:17.572421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75cf7cce-c947-4cf9-aa8d-1ec4143c241a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:17.572852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-75cf7cce-c947-4cf9-aa8d-1ec4143c241a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:17.637251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-75cf7cce-c947-4cf9-aa8d-1ec4143c241a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:17.646018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-75cf7cce-c947-4cf9-aa8d-1ec4143c241a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090692 Jul 26 18:56:17.646593 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2269/4274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:17 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:18.671522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8ddffbc5-8525-413e-8799-4ad703d8d3ad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:18.672521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8ddffbc5-8525-413e-8799-4ad703d8d3ad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:18.679809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ddffbc5-8525-413e-8799-4ad703d8d3ad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:18.680258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ddffbc5-8525-413e-8799-4ad703d8d3ad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:18.681041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ddffbc5-8525-413e-8799-4ad703d8d3ad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:18.681471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8ddffbc5-8525-413e-8799-4ad703d8d3ad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:18.744938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8ddffbc5-8525-413e-8799-4ad703d8d3ad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:18.755514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8ddffbc5-8525-413e-8799-4ad703d8d3ad tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090197 Jul 26 18:56:18.756420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2270/4275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:18 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:56:19.782909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-37ad727d-da55-45c2-b5cb-d0c047fe6354 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:19.783496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-37ad727d-da55-45c2-b5cb-d0c047fe6354 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:19.790636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37ad727d-da55-45c2-b5cb-d0c047fe6354 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:19.791111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37ad727d-da55-45c2-b5cb-d0c047fe6354 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:19.791874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37ad727d-da55-45c2-b5cb-d0c047fe6354 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:19.792306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-37ad727d-da55-45c2-b5cb-d0c047fe6354 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:19.855650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-37ad727d-da55-45c2-b5cb-d0c047fe6354 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:19.863953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-37ad727d-da55-45c2-b5cb-d0c047fe6354 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086117 Jul 26 18:56:19.864520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2271/4276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:19 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:20.885545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-354da1b8-a967-4efb-8449-a93289faf6e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:20.886179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-354da1b8-a967-4efb-8449-a93289faf6e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:20.893543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-354da1b8-a967-4efb-8449-a93289faf6e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:20.893980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-354da1b8-a967-4efb-8449-a93289faf6e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:20.895130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-354da1b8-a967-4efb-8449-a93289faf6e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:20.895560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-354da1b8-a967-4efb-8449-a93289faf6e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:20.967297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-354da1b8-a967-4efb-8449-a93289faf6e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:20.982974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-354da1b8-a967-4efb-8449-a93289faf6e9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.101891 Jul 26 18:56:20.983581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2272/4277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:20 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:22.008975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d45d8dad-8a9e-4027-b733-93416a4118af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:22.009956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d45d8dad-8a9e-4027-b733-93416a4118af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:22.021214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d45d8dad-8a9e-4027-b733-93416a4118af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:22.021944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d45d8dad-8a9e-4027-b733-93416a4118af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:22.023229 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d45d8dad-8a9e-4027-b733-93416a4118af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:22.023939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d45d8dad-8a9e-4027-b733-93416a4118af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:22.088113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d45d8dad-8a9e-4027-b733-93416a4118af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:22.096136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d45d8dad-8a9e-4027-b733-93416a4118af tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093752 Jul 26 18:56:22.096694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2273/4278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:22 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:23.121338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c9479948-008f-41d8-9499-e3b4d71c9f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:23.122393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c9479948-008f-41d8-9499-e3b4d71c9f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:23.133191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9479948-008f-41d8-9499-e3b4d71c9f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:23.133947 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9479948-008f-41d8-9499-e3b4d71c9f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:23.135234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9479948-008f-41d8-9499-e3b4d71c9f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:23.135959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9479948-008f-41d8-9499-e3b4d71c9f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:23.201268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c9479948-008f-41d8-9499-e3b4d71c9f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:23.209418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c9479948-008f-41d8-9499-e3b4d71c9f85 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.094788 Jul 26 18:56:23.209985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2274/4279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:23 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:24.233837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a014996d-4523-4b29-9aa6-84d2971c68ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:24.234880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a014996d-4523-4b29-9aa6-84d2971c68ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:24.245980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a014996d-4523-4b29-9aa6-84d2971c68ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:24.246719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a014996d-4523-4b29-9aa6-84d2971c68ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:24.248024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a014996d-4523-4b29-9aa6-84d2971c68ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:24.248743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a014996d-4523-4b29-9aa6-84d2971c68ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:24.311383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a014996d-4523-4b29-9aa6-84d2971c68ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:24.320909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a014996d-4523-4b29-9aa6-84d2971c68ce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093240 Jul 26 18:56:24.321495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2275/4280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:24 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:25.346519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-51261235-e5ec-4e8e-8fb2-174749821750 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:25.347656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-51261235-e5ec-4e8e-8fb2-174749821750 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:25.358717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51261235-e5ec-4e8e-8fb2-174749821750 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:25.359520 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51261235-e5ec-4e8e-8fb2-174749821750 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:25.360769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51261235-e5ec-4e8e-8fb2-174749821750 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:25.361484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-51261235-e5ec-4e8e-8fb2-174749821750 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:25.377444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:56:25.428038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-51261235-e5ec-4e8e-8fb2-174749821750 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:25.439413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-51261235-e5ec-4e8e-8fb2-174749821750 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.099033 Jul 26 18:56:25.440198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2276/4281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:25 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:26.464538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-48c87433-0471-4aeb-a48f-64aa58a974cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:26.465554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-48c87433-0471-4aeb-a48f-64aa58a974cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:26.474371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48c87433-0471-4aeb-a48f-64aa58a974cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:26.474817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48c87433-0471-4aeb-a48f-64aa58a974cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:26.475608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48c87433-0471-4aeb-a48f-64aa58a974cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:26.476061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-48c87433-0471-4aeb-a48f-64aa58a974cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:26.787211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-48c87433-0471-4aeb-a48f-64aa58a974cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:26.795625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-48c87433-0471-4aeb-a48f-64aa58a974cf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.335967 Jul 26 18:56:26.796206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2277/4282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:26 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:26.910541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6606c01b-c396-4693-8953-d3ce4898befa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:26.911076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6606c01b-c396-4693-8953-d3ce4898befa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:26.920531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6606c01b-c396-4693-8953-d3ce4898befa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:26.921101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6606c01b-c396-4693-8953-d3ce4898befa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:26.922245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6606c01b-c396-4693-8953-d3ce4898befa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:26.922912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6606c01b-c396-4693-8953-d3ce4898befa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:26.947245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6606c01b-c396-4693-8953-d3ce4898befa tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d/ips" status: 200 len: 151 microversion: 2.1 time: 0.150007 Jul 26 18:56:26.947777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2278/4283] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Jul 26 18:56:26 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d/ips => generated 151 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:56:27.822927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-978a243f-9ea1-4542-ba46-16a8ea5b0d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:27.823646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-978a243f-9ea1-4542-ba46-16a8ea5b0d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:27.831472 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-978a243f-9ea1-4542-ba46-16a8ea5b0d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:27.831936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-978a243f-9ea1-4542-ba46-16a8ea5b0d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:27.832700 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-978a243f-9ea1-4542-ba46-16a8ea5b0d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:27.833139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-978a243f-9ea1-4542-ba46-16a8ea5b0d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:27.900125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-978a243f-9ea1-4542-ba46-16a8ea5b0d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:27.908538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-978a243f-9ea1-4542-ba46-16a8ea5b0d66 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090133 Jul 26 18:56:27.909116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2279/4284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:27 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:28.933328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9a9eee31-f64b-435a-b5d1-d5ff567fbd96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:28.934382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9a9eee31-f64b-435a-b5d1-d5ff567fbd96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:28.943769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a9eee31-f64b-435a-b5d1-d5ff567fbd96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:28.944216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a9eee31-f64b-435a-b5d1-d5ff567fbd96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:28.944979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a9eee31-f64b-435a-b5d1-d5ff567fbd96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:28.945411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9a9eee31-f64b-435a-b5d1-d5ff567fbd96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:29.010406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9a9eee31-f64b-435a-b5d1-d5ff567fbd96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:29.018987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9a9eee31-f64b-435a-b5d1-d5ff567fbd96 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.092328 Jul 26 18:56:29.019969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2280/4285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:28 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:30.042762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5657d024-2e01-4de6-8729-dbeab4006f2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:30.043470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5657d024-2e01-4de6-8729-dbeab4006f2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:30.050665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5657d024-2e01-4de6-8729-dbeab4006f2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:30.051171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5657d024-2e01-4de6-8729-dbeab4006f2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:30.051967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5657d024-2e01-4de6-8729-dbeab4006f2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:30.052421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5657d024-2e01-4de6-8729-dbeab4006f2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:30.119332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5657d024-2e01-4de6-8729-dbeab4006f2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:30.127662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5657d024-2e01-4de6-8729-dbeab4006f2d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089203 Jul 26 18:56:30.128235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2281/4286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:30 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:31.153553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0e978b5f-984c-4c7e-a0bb-22e0f389d5aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:31.154538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0e978b5f-984c-4c7e-a0bb-22e0f389d5aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:31.164164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e978b5f-984c-4c7e-a0bb-22e0f389d5aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:31.164610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e978b5f-984c-4c7e-a0bb-22e0f389d5aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:31.165358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e978b5f-984c-4c7e-a0bb-22e0f389d5aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:31.165820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e978b5f-984c-4c7e-a0bb-22e0f389d5aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:31.229484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0e978b5f-984c-4c7e-a0bb-22e0f389d5aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:31.238113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0e978b5f-984c-4c7e-a0bb-22e0f389d5aa tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091262 Jul 26 18:56:31.238688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2282/4287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:31 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:32.264097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5c69e6a2-a9f3-4034-870a-5609770f0330 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:32.265702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5c69e6a2-a9f3-4034-870a-5609770f0330 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:32.275188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c69e6a2-a9f3-4034-870a-5609770f0330 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:32.275613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c69e6a2-a9f3-4034-870a-5609770f0330 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:32.276388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c69e6a2-a9f3-4034-870a-5609770f0330 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:32.276820 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5c69e6a2-a9f3-4034-870a-5609770f0330 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:32.340274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5c69e6a2-a9f3-4034-870a-5609770f0330 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:32.349312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5c69e6a2-a9f3-4034-870a-5609770f0330 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.092436 Jul 26 18:56:32.349988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2283/4288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:33.375083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8e0c181a-b204-4171-9eaf-7cb1dbfe7b15 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:33.376132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8e0c181a-b204-4171-9eaf-7cb1dbfe7b15 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:33.384684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e0c181a-b204-4171-9eaf-7cb1dbfe7b15 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:33.385137 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e0c181a-b204-4171-9eaf-7cb1dbfe7b15 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:33.385905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e0c181a-b204-4171-9eaf-7cb1dbfe7b15 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:33.386347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e0c181a-b204-4171-9eaf-7cb1dbfe7b15 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:33.453518 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8e0c181a-b204-4171-9eaf-7cb1dbfe7b15 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:33.461927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8e0c181a-b204-4171-9eaf-7cb1dbfe7b15 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093416 Jul 26 18:56:33.462503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2284/4289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:33 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:34.487180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e3b4336a-edfb-4e9a-9ef0-c1fb9ce6be94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:34.488219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e3b4336a-edfb-4e9a-9ef0-c1fb9ce6be94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:34.496186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e3b4336a-edfb-4e9a-9ef0-c1fb9ce6be94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:34.496631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e3b4336a-edfb-4e9a-9ef0-c1fb9ce6be94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:34.497395 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e3b4336a-edfb-4e9a-9ef0-c1fb9ce6be94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:34.497816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e3b4336a-edfb-4e9a-9ef0-c1fb9ce6be94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:34.560473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e3b4336a-edfb-4e9a-9ef0-c1fb9ce6be94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:34.568684 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e3b4336a-edfb-4e9a-9ef0-c1fb9ce6be94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.087984 Jul 26 18:56:34.569242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2285/4290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:34 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:56:35.593723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bc296423-e55f-475c-a55c-0adfb3727c0f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:35.594728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bc296423-e55f-475c-a55c-0adfb3727c0f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:35.604344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc296423-e55f-475c-a55c-0adfb3727c0f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:35.604787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc296423-e55f-475c-a55c-0adfb3727c0f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:35.605537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc296423-e55f-475c-a55c-0adfb3727c0f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:35.605962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bc296423-e55f-475c-a55c-0adfb3727c0f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:35.674002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bc296423-e55f-475c-a55c-0adfb3727c0f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:35.682272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bc296423-e55f-475c-a55c-0adfb3727c0f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095150 Jul 26 18:56:35.682857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2286/4291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:36.708669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a87d15bf-88b9-4d70-8754-0c55cfb39a0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:36.709659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a87d15bf-88b9-4d70-8754-0c55cfb39a0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:36.717372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a87d15bf-88b9-4d70-8754-0c55cfb39a0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:36.717812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a87d15bf-88b9-4d70-8754-0c55cfb39a0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:36.718567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a87d15bf-88b9-4d70-8754-0c55cfb39a0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:36.718990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a87d15bf-88b9-4d70-8754-0c55cfb39a0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:36.784985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a87d15bf-88b9-4d70-8754-0c55cfb39a0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:36.793582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a87d15bf-88b9-4d70-8754-0c55cfb39a0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091697 Jul 26 18:56:36.794144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2287/4292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:36 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:37.817955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7cb0f272-2049-4482-af50-b2370e284b40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:37.818741 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7cb0f272-2049-4482-af50-b2370e284b40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:37.826227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cb0f272-2049-4482-af50-b2370e284b40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:37.826663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cb0f272-2049-4482-af50-b2370e284b40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:37.827449 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cb0f272-2049-4482-af50-b2370e284b40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:37.827872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7cb0f272-2049-4482-af50-b2370e284b40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:37.894740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7cb0f272-2049-4482-af50-b2370e284b40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:37.903535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7cb0f272-2049-4482-af50-b2370e284b40 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090383 Jul 26 18:56:37.904088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2288/4293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:37 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:38.989270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-36b9d3a4-f851-4dd9-b4de-44f12fc7c851 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:38.990291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-36b9d3a4-f851-4dd9-b4de-44f12fc7c851 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:39.000936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36b9d3a4-f851-4dd9-b4de-44f12fc7c851 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:39.001649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36b9d3a4-f851-4dd9-b4de-44f12fc7c851 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:39.003005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36b9d3a4-f851-4dd9-b4de-44f12fc7c851 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:39.003701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36b9d3a4-f851-4dd9-b4de-44f12fc7c851 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:39.067920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-36b9d3a4-f851-4dd9-b4de-44f12fc7c851 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:39.076071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-36b9d3a4-f851-4dd9-b4de-44f12fc7c851 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093469 Jul 26 18:56:39.076642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2289/4294] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:38 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:40.101408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dd90598d-939e-4c5a-8881-8790c08b45fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:40.102278 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dd90598d-939e-4c5a-8881-8790c08b45fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:40.109843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd90598d-939e-4c5a-8881-8790c08b45fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:40.110340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd90598d-939e-4c5a-8881-8790c08b45fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:40.111210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd90598d-939e-4c5a-8881-8790c08b45fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:40.111685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dd90598d-939e-4c5a-8881-8790c08b45fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:40.178264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dd90598d-939e-4c5a-8881-8790c08b45fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:40.186566 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dd90598d-939e-4c5a-8881-8790c08b45fe tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091849 Jul 26 18:56:40.187167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2290/4295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:40 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:41.210931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fa6ff20f-1817-4500-969c-29545c416f3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:41.211988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fa6ff20f-1817-4500-969c-29545c416f3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:41.218849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa6ff20f-1817-4500-969c-29545c416f3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:41.219325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa6ff20f-1817-4500-969c-29545c416f3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:41.220080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa6ff20f-1817-4500-969c-29545c416f3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:41.220510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa6ff20f-1817-4500-969c-29545c416f3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:41.281190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fa6ff20f-1817-4500-969c-29545c416f3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:41.289253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fa6ff20f-1817-4500-969c-29545c416f3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.084893 Jul 26 18:56:41.289821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2291/4296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:41 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:42.311054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ca0caa51-4521-4811-88af-8de30c1ef47c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:42.311691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ca0caa51-4521-4811-88af-8de30c1ef47c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:42.318613 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca0caa51-4521-4811-88af-8de30c1ef47c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:42.319048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca0caa51-4521-4811-88af-8de30c1ef47c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:42.319840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca0caa51-4521-4811-88af-8de30c1ef47c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:42.320275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ca0caa51-4521-4811-88af-8de30c1ef47c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:42.382002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ca0caa51-4521-4811-88af-8de30c1ef47c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:42.390348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ca0caa51-4521-4811-88af-8de30c1ef47c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083197 Jul 26 18:56:42.390847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2292/4297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:42 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:43.415870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4de78a0e-2f94-487e-bd26-1922a3eeaff7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:43.416879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4de78a0e-2f94-487e-bd26-1922a3eeaff7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:43.425025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4de78a0e-2f94-487e-bd26-1922a3eeaff7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:43.425557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4de78a0e-2f94-487e-bd26-1922a3eeaff7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:43.426532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4de78a0e-2f94-487e-bd26-1922a3eeaff7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:43.427104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4de78a0e-2f94-487e-bd26-1922a3eeaff7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:43.444558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:56:43.493736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4de78a0e-2f94-487e-bd26-1922a3eeaff7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:43.502392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4de78a0e-2f94-487e-bd26-1922a3eeaff7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093231 Jul 26 18:56:43.502970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2293/4298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:44.526583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-986f0c59-5955-4d34-8acb-17cc81504912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:44.527231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-986f0c59-5955-4d34-8acb-17cc81504912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:44.534193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-986f0c59-5955-4d34-8acb-17cc81504912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:44.534640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-986f0c59-5955-4d34-8acb-17cc81504912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:44.535437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-986f0c59-5955-4d34-8acb-17cc81504912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:44.535870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-986f0c59-5955-4d34-8acb-17cc81504912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:44.600028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-986f0c59-5955-4d34-8acb-17cc81504912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:44.608241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-986f0c59-5955-4d34-8acb-17cc81504912 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.087616 Jul 26 18:56:44.608806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2294/4299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:44 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:45.633106 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8e17cc59-56d1-4270-a0c0-56d6fa56b051 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:45.634167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8e17cc59-56d1-4270-a0c0-56d6fa56b051 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:45.641699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e17cc59-56d1-4270-a0c0-56d6fa56b051 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:45.642142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e17cc59-56d1-4270-a0c0-56d6fa56b051 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:45.642895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e17cc59-56d1-4270-a0c0-56d6fa56b051 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:45.643345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8e17cc59-56d1-4270-a0c0-56d6fa56b051 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:45.713467 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8e17cc59-56d1-4270-a0c0-56d6fa56b051 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:45.722516 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8e17cc59-56d1-4270-a0c0-56d6fa56b051 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095985 Jul 26 18:56:45.723138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2295/4300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:45 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:46.749258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5904f27d-686a-4007-92bd-8f406d005fa7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:46.750255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5904f27d-686a-4007-92bd-8f406d005fa7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:46.761420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5904f27d-686a-4007-92bd-8f406d005fa7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:46.762159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5904f27d-686a-4007-92bd-8f406d005fa7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:46.763476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5904f27d-686a-4007-92bd-8f406d005fa7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:46.764192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5904f27d-686a-4007-92bd-8f406d005fa7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:46.831163 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5904f27d-686a-4007-92bd-8f406d005fa7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:46.844340 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5904f27d-686a-4007-92bd-8f406d005fa7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.101527 Jul 26 18:56:46.845144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2296/4301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:46 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:47.872814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c5e1cb71-9e38-4ebb-a1e4-b904fbce4165 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:47.873778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c5e1cb71-9e38-4ebb-a1e4-b904fbce4165 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:47.877560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=56 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:56:47.886200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5e1cb71-9e38-4ebb-a1e4-b904fbce4165 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:47.886648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5e1cb71-9e38-4ebb-a1e4-b904fbce4165 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:47.887439 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5e1cb71-9e38-4ebb-a1e4-b904fbce4165 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:47.887871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5e1cb71-9e38-4ebb-a1e4-b904fbce4165 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:47.960423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c5e1cb71-9e38-4ebb-a1e4-b904fbce4165 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:47.968673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c5e1cb71-9e38-4ebb-a1e4-b904fbce4165 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.102545 Jul 26 18:56:47.969249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2297/4302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:47 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:48.993662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-98a45513-900f-439f-95d6-8ce4da942c6e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:48.994734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-98a45513-900f-439f-95d6-8ce4da942c6e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:49.002368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98a45513-900f-439f-95d6-8ce4da942c6e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:49.002806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98a45513-900f-439f-95d6-8ce4da942c6e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:49.003676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98a45513-900f-439f-95d6-8ce4da942c6e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:49.004152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-98a45513-900f-439f-95d6-8ce4da942c6e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:49.071481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-98a45513-900f-439f-95d6-8ce4da942c6e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:49.080143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-98a45513-900f-439f-95d6-8ce4da942c6e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093213 Jul 26 18:56:49.080704 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2298/4303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:48 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:50.112431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c59f4028-320b-4578-ac4b-b7fdba6d2bbd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:50.113535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c59f4028-320b-4578-ac4b-b7fdba6d2bbd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:50.124931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c59f4028-320b-4578-ac4b-b7fdba6d2bbd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:50.125761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c59f4028-320b-4578-ac4b-b7fdba6d2bbd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:50.127112 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c59f4028-320b-4578-ac4b-b7fdba6d2bbd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:50.127833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c59f4028-320b-4578-ac4b-b7fdba6d2bbd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:50.193525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c59f4028-320b-4578-ac4b-b7fdba6d2bbd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:50.201933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c59f4028-320b-4578-ac4b-b7fdba6d2bbd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.096376 Jul 26 18:56:50.202500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2299/4304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:50 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:51.227063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2175aba9-83fc-4403-9bd3-cd3e9b0e8b04 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:51.228138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2175aba9-83fc-4403-9bd3-cd3e9b0e8b04 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:51.239146 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2175aba9-83fc-4403-9bd3-cd3e9b0e8b04 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:51.239939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2175aba9-83fc-4403-9bd3-cd3e9b0e8b04 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:51.241199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2175aba9-83fc-4403-9bd3-cd3e9b0e8b04 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:51.241927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2175aba9-83fc-4403-9bd3-cd3e9b0e8b04 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:51.304344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2175aba9-83fc-4403-9bd3-cd3e9b0e8b04 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:51.312843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2175aba9-83fc-4403-9bd3-cd3e9b0e8b04 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.092334 Jul 26 18:56:51.313411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2300/4305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:52.337840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fa04476f-305e-4477-8433-c0fd86c639b8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:52.338792 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fa04476f-305e-4477-8433-c0fd86c639b8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:52.349895 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa04476f-305e-4477-8433-c0fd86c639b8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:52.350708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa04476f-305e-4477-8433-c0fd86c639b8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:52.352052 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa04476f-305e-4477-8433-c0fd86c639b8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:52.352780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fa04476f-305e-4477-8433-c0fd86c639b8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:52.414086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fa04476f-305e-4477-8433-c0fd86c639b8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:52.426232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fa04476f-305e-4477-8433-c0fd86c639b8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.094672 Jul 26 18:56:52.427100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2301/4306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:52 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:53.452758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cbf087fb-be2a-41b9-b352-b29e0088b2fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:53.453945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cbf087fb-be2a-41b9-b352-b29e0088b2fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:53.464314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbf087fb-be2a-41b9-b352-b29e0088b2fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:53.464764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbf087fb-be2a-41b9-b352-b29e0088b2fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:53.465524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbf087fb-be2a-41b9-b352-b29e0088b2fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:53.465957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cbf087fb-be2a-41b9-b352-b29e0088b2fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:53.537708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cbf087fb-be2a-41b9-b352-b29e0088b2fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:53.549663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cbf087fb-be2a-41b9-b352-b29e0088b2fc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.103288 Jul 26 18:56:53.550404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2302/4307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:53 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:54.578090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0e44f9d1-13e3-4d27-9a7e-95fac61f5b97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:54.579468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0e44f9d1-13e3-4d27-9a7e-95fac61f5b97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:54.592596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e44f9d1-13e3-4d27-9a7e-95fac61f5b97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:54.593381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e44f9d1-13e3-4d27-9a7e-95fac61f5b97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:54.594617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e44f9d1-13e3-4d27-9a7e-95fac61f5b97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:54.595372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0e44f9d1-13e3-4d27-9a7e-95fac61f5b97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:54.662117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0e44f9d1-13e3-4d27-9a7e-95fac61f5b97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:54.670431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0e44f9d1-13e3-4d27-9a7e-95fac61f5b97 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.100076 Jul 26 18:56:54.670993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2303/4308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:54 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:55.695385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-884d35b4-bb8f-49aa-a108-8b179487133c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:55.696493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-884d35b4-bb8f-49aa-a108-8b179487133c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:55.707558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-884d35b4-bb8f-49aa-a108-8b179487133c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:55.708303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-884d35b4-bb8f-49aa-a108-8b179487133c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:55.709552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-884d35b4-bb8f-49aa-a108-8b179487133c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:55.710271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-884d35b4-bb8f-49aa-a108-8b179487133c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:55.774306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-884d35b4-bb8f-49aa-a108-8b179487133c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:55.782847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-884d35b4-bb8f-49aa-a108-8b179487133c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.094048 Jul 26 18:56:55.783452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2304/4309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:56.804809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c85b0301-6fcd-43a4-bad6-89b18745af4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:56.805514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c85b0301-6fcd-43a4-bad6-89b18745af4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:56.813132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c85b0301-6fcd-43a4-bad6-89b18745af4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:56.813630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c85b0301-6fcd-43a4-bad6-89b18745af4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:56.814465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c85b0301-6fcd-43a4-bad6-89b18745af4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:56.814946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c85b0301-6fcd-43a4-bad6-89b18745af4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:56.877385 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c85b0301-6fcd-43a4-bad6-89b18745af4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:56.885638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c85b0301-6fcd-43a4-bad6-89b18745af4c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085241 Jul 26 18:56:56.886180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2305/4310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:56 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:57.915124 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e1f79a57-3d28-48e1-8b6e-ad1f29dc5eab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:57.916156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e1f79a57-3d28-48e1-8b6e-ad1f29dc5eab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:57.927170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1f79a57-3d28-48e1-8b6e-ad1f29dc5eab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:57.927919 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1f79a57-3d28-48e1-8b6e-ad1f29dc5eab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:57.929178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1f79a57-3d28-48e1-8b6e-ad1f29dc5eab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:57.929899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1f79a57-3d28-48e1-8b6e-ad1f29dc5eab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:57.994868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e1f79a57-3d28-48e1-8b6e-ad1f29dc5eab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:58.003426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e1f79a57-3d28-48e1-8b6e-ad1f29dc5eab tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.094659 Jul 26 18:56:58.003932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2306/4311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:57 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:56:59.027595 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e650c454-238b-43e9-a29c-8b500df0079b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:56:59.028267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e650c454-238b-43e9-a29c-8b500df0079b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:56:59.036021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e650c454-238b-43e9-a29c-8b500df0079b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:59.036523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e650c454-238b-43e9-a29c-8b500df0079b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:59.037310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e650c454-238b-43e9-a29c-8b500df0079b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:56:59.037771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e650c454-238b-43e9-a29c-8b500df0079b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:56:59.103033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e650c454-238b-43e9-a29c-8b500df0079b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:56:59.111352 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e650c454-238b-43e9-a29c-8b500df0079b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089806 Jul 26 18:56:59.111914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2307/4312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:56:59 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:00.136208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f50e7983-578f-429c-a0da-e23f9cf44d46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:00.136874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f50e7983-578f-429c-a0da-e23f9cf44d46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:00.147349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f50e7983-578f-429c-a0da-e23f9cf44d46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:00.147925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f50e7983-578f-429c-a0da-e23f9cf44d46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:00.148962 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f50e7983-578f-429c-a0da-e23f9cf44d46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:00.149914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f50e7983-578f-429c-a0da-e23f9cf44d46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:00.221464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f50e7983-578f-429c-a0da-e23f9cf44d46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:00.230303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f50e7983-578f-429c-a0da-e23f9cf44d46 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.100579 Jul 26 18:57:00.230855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2308/4313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:00 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:01.255594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-373af629-4498-49af-86ad-6e110027d5c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:01.256642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-373af629-4498-49af-86ad-6e110027d5c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:01.265808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-373af629-4498-49af-86ad-6e110027d5c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:01.266255 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-373af629-4498-49af-86ad-6e110027d5c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:01.267010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-373af629-4498-49af-86ad-6e110027d5c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:01.267473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-373af629-4498-49af-86ad-6e110027d5c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:01.330069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-373af629-4498-49af-86ad-6e110027d5c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:01.338538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-373af629-4498-49af-86ad-6e110027d5c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089550 Jul 26 18:57:01.339135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2309/4314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:01 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:02.369774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7dc474f6-d1cf-452d-a105-aaf8a74b5d39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:02.370828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7dc474f6-d1cf-452d-a105-aaf8a74b5d39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:02.378626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dc474f6-d1cf-452d-a105-aaf8a74b5d39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:02.379126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dc474f6-d1cf-452d-a105-aaf8a74b5d39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:02.379930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dc474f6-d1cf-452d-a105-aaf8a74b5d39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:02.380383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dc474f6-d1cf-452d-a105-aaf8a74b5d39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:02.383057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:57:02.450309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7dc474f6-d1cf-452d-a105-aaf8a74b5d39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:02.462833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7dc474f6-d1cf-452d-a105-aaf8a74b5d39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.099421 Jul 26 18:57:02.463726 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2310/4315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:02 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:03.488031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-694e7b0f-cd6a-4349-9aae-6c337f563cea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:03.488710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-694e7b0f-cd6a-4349-9aae-6c337f563cea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:03.497583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-694e7b0f-cd6a-4349-9aae-6c337f563cea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:03.498178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-694e7b0f-cd6a-4349-9aae-6c337f563cea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:03.499273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-694e7b0f-cd6a-4349-9aae-6c337f563cea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:03.499847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-694e7b0f-cd6a-4349-9aae-6c337f563cea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:03.578989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-694e7b0f-cd6a-4349-9aae-6c337f563cea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:03.592495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-694e7b0f-cd6a-4349-9aae-6c337f563cea tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.109057 Jul 26 18:57:03.593085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2311/4316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:03 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:57:04.616814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f6c5e406-a4c6-49b9-b19e-549080174fdd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:04.617506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f6c5e406-a4c6-49b9-b19e-549080174fdd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:04.626279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6c5e406-a4c6-49b9-b19e-549080174fdd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:04.626731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6c5e406-a4c6-49b9-b19e-549080174fdd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:04.627532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6c5e406-a4c6-49b9-b19e-549080174fdd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:04.627969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6c5e406-a4c6-49b9-b19e-549080174fdd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:04.700930 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f6c5e406-a4c6-49b9-b19e-549080174fdd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:04.709319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f6c5e406-a4c6-49b9-b19e-549080174fdd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.098887 Jul 26 18:57:04.709908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2312/4317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:04 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:05.734672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2ece406e-4168-4c2a-86f1-ed578a86464c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:05.735856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2ece406e-4168-4c2a-86f1-ed578a86464c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:05.746831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ece406e-4168-4c2a-86f1-ed578a86464c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:05.747784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ece406e-4168-4c2a-86f1-ed578a86464c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:05.749111 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ece406e-4168-4c2a-86f1-ed578a86464c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:05.749801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2ece406e-4168-4c2a-86f1-ed578a86464c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:05.817596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2ece406e-4168-4c2a-86f1-ed578a86464c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:05.826014 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2ece406e-4168-4c2a-86f1-ed578a86464c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.097934 Jul 26 18:57:05.826870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2313/4318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:05 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:06.848672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cb516cbc-9700-4644-b9bd-3e726992a5ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:06.852441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cb516cbc-9700-4644-b9bd-3e726992a5ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:06.857162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb516cbc-9700-4644-b9bd-3e726992a5ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:06.857607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb516cbc-9700-4644-b9bd-3e726992a5ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:06.858359 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb516cbc-9700-4644-b9bd-3e726992a5ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:06.858783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb516cbc-9700-4644-b9bd-3e726992a5ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:06.930221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cb516cbc-9700-4644-b9bd-3e726992a5ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:06.938570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cb516cbc-9700-4644-b9bd-3e726992a5ba tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095290 Jul 26 18:57:06.939169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2314/4319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:06 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:07.959665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-36f634bb-c544-48af-9ea0-9f43b1ea9e56 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:07.960454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-36f634bb-c544-48af-9ea0-9f43b1ea9e56 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:07.967469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36f634bb-c544-48af-9ea0-9f43b1ea9e56 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:07.967922 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36f634bb-c544-48af-9ea0-9f43b1ea9e56 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:07.968688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36f634bb-c544-48af-9ea0-9f43b1ea9e56 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:07.969125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-36f634bb-c544-48af-9ea0-9f43b1ea9e56 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:08.040305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-36f634bb-c544-48af-9ea0-9f43b1ea9e56 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:08.048832 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-36f634bb-c544-48af-9ea0-9f43b1ea9e56 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093119 Jul 26 18:57:08.049405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2315/4320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:07 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:09.069754 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-892d6a42-011f-4fca-a2eb-8a1861969cc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:09.070382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-892d6a42-011f-4fca-a2eb-8a1861969cc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:09.077099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-892d6a42-011f-4fca-a2eb-8a1861969cc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:09.077552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-892d6a42-011f-4fca-a2eb-8a1861969cc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:09.078307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-892d6a42-011f-4fca-a2eb-8a1861969cc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:09.078739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-892d6a42-011f-4fca-a2eb-8a1861969cc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:09.140004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-892d6a42-011f-4fca-a2eb-8a1861969cc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:09.151337 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-892d6a42-011f-4fca-a2eb-8a1861969cc1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085156 Jul 26 18:57:09.151937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2316/4321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:09 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:10.174733 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-22c7a745-be9f-42bb-914a-4a4a5fa08fd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:10.175434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-22c7a745-be9f-42bb-914a-4a4a5fa08fd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:10.182851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-22c7a745-be9f-42bb-914a-4a4a5fa08fd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:10.183345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-22c7a745-be9f-42bb-914a-4a4a5fa08fd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:10.184128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-22c7a745-be9f-42bb-914a-4a4a5fa08fd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:10.184576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-22c7a745-be9f-42bb-914a-4a4a5fa08fd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:10.248833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-22c7a745-be9f-42bb-914a-4a4a5fa08fd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:10.257117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-22c7a745-be9f-42bb-914a-4a4a5fa08fd0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086568 Jul 26 18:57:10.257689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2317/4322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:10 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:11.283560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-61e9f3b8-e062-47a7-b201-9e3adb86fbac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:11.284426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-61e9f3b8-e062-47a7-b201-9e3adb86fbac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:11.292694 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61e9f3b8-e062-47a7-b201-9e3adb86fbac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:11.293242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61e9f3b8-e062-47a7-b201-9e3adb86fbac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:11.294187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61e9f3b8-e062-47a7-b201-9e3adb86fbac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:11.294717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-61e9f3b8-e062-47a7-b201-9e3adb86fbac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:11.366890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-61e9f3b8-e062-47a7-b201-9e3adb86fbac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:11.375207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-61e9f3b8-e062-47a7-b201-9e3adb86fbac tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.097436 Jul 26 18:57:11.375784 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2318/4323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:11 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:12.400953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f95e47af-4227-4ca0-a1ea-b5f829cb818c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:12.401904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f95e47af-4227-4ca0-a1ea-b5f829cb818c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:12.413159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f95e47af-4227-4ca0-a1ea-b5f829cb818c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:12.413787 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f95e47af-4227-4ca0-a1ea-b5f829cb818c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:12.415338 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f95e47af-4227-4ca0-a1ea-b5f829cb818c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:12.416053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f95e47af-4227-4ca0-a1ea-b5f829cb818c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:12.481459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f95e47af-4227-4ca0-a1ea-b5f829cb818c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:12.490219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f95e47af-4227-4ca0-a1ea-b5f829cb818c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.096212 Jul 26 18:57:12.490797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2319/4324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:12 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:13.515103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c524dff3-d8cf-4203-bfb2-4179715c512e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:13.516157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c524dff3-d8cf-4203-bfb2-4179715c512e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:13.527670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c524dff3-d8cf-4203-bfb2-4179715c512e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:13.528412 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c524dff3-d8cf-4203-bfb2-4179715c512e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:13.529657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c524dff3-d8cf-4203-bfb2-4179715c512e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:13.530377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c524dff3-d8cf-4203-bfb2-4179715c512e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:13.591745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c524dff3-d8cf-4203-bfb2-4179715c512e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:13.600345 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c524dff3-d8cf-4203-bfb2-4179715c512e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091806 Jul 26 18:57:13.600912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2320/4325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:13 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:14.384932 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:57:14.385525 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:57:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 18:57:14.624414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1d35870d-7fc3-493c-a1fa-7a847a0ffb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:14.625347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1d35870d-7fc3-493c-a1fa-7a847a0ffb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:14.636508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d35870d-7fc3-493c-a1fa-7a847a0ffb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:14.637235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d35870d-7fc3-493c-a1fa-7a847a0ffb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:14.638465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d35870d-7fc3-493c-a1fa-7a847a0ffb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:14.639220 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d35870d-7fc3-493c-a1fa-7a847a0ffb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:14.700985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1d35870d-7fc3-493c-a1fa-7a847a0ffb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:14.709386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1d35870d-7fc3-493c-a1fa-7a847a0ffb9a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091478 Jul 26 18:57:14.709941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2321/4326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:14 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:15.733764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2438fdf2-eeb2-40cc-a34b-17dbf42cb823 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:15.734727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2438fdf2-eeb2-40cc-a34b-17dbf42cb823 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:15.745714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2438fdf2-eeb2-40cc-a34b-17dbf42cb823 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:15.746432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2438fdf2-eeb2-40cc-a34b-17dbf42cb823 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:15.747761 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2438fdf2-eeb2-40cc-a34b-17dbf42cb823 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:15.748474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2438fdf2-eeb2-40cc-a34b-17dbf42cb823 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:15.818270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2438fdf2-eeb2-40cc-a34b-17dbf42cb823 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:15.826748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2438fdf2-eeb2-40cc-a34b-17dbf42cb823 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.099499 Jul 26 18:57:15.827342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2322/4327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:15 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:16.854251 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-32e6f335-17fa-4f79-a3f4-ac6dcea95b3e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:16.855344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-32e6f335-17fa-4f79-a3f4-ac6dcea95b3e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:16.864752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32e6f335-17fa-4f79-a3f4-ac6dcea95b3e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:16.865203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32e6f335-17fa-4f79-a3f4-ac6dcea95b3e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:16.865968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32e6f335-17fa-4f79-a3f4-ac6dcea95b3e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:16.866401 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-32e6f335-17fa-4f79-a3f4-ac6dcea95b3e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:16.990621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-32e6f335-17fa-4f79-a3f4-ac6dcea95b3e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:17.003256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-32e6f335-17fa-4f79-a3f4-ac6dcea95b3e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.155198 Jul 26 18:57:17.003870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2323/4328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:16 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:17.341143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:57:17.341483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 18:57:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 18:57:18.025000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7f402d67-b793-46e9-a92a-093b33c0ca60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:18.025558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7f402d67-b793-46e9-a92a-093b33c0ca60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:18.027957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=54 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:57:18.034066 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f402d67-b793-46e9-a92a-093b33c0ca60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:18.034510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f402d67-b793-46e9-a92a-093b33c0ca60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:18.035303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f402d67-b793-46e9-a92a-093b33c0ca60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:18.035734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f402d67-b793-46e9-a92a-093b33c0ca60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:18.101115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7f402d67-b793-46e9-a92a-093b33c0ca60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:18.109572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7f402d67-b793-46e9-a92a-093b33c0ca60 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.088754 Jul 26 18:57:18.110141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2324/4329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:18 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:19.134159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-76a3695f-aa35-4c3a-8f80-35765cd0b2c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:19.135318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-76a3695f-aa35-4c3a-8f80-35765cd0b2c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:19.146142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76a3695f-aa35-4c3a-8f80-35765cd0b2c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:19.146590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76a3695f-aa35-4c3a-8f80-35765cd0b2c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:19.147389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76a3695f-aa35-4c3a-8f80-35765cd0b2c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:19.147822 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76a3695f-aa35-4c3a-8f80-35765cd0b2c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:19.225354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-76a3695f-aa35-4c3a-8f80-35765cd0b2c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:19.237783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-76a3695f-aa35-4c3a-8f80-35765cd0b2c5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.110051 Jul 26 18:57:19.238627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2325/4330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:19 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:20.269382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f879a398-3d27-4530-b634-64ccf18fb2f7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:20.270151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f879a398-3d27-4530-b634-64ccf18fb2f7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:20.277494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f879a398-3d27-4530-b634-64ccf18fb2f7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:20.277949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f879a398-3d27-4530-b634-64ccf18fb2f7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:20.278742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f879a398-3d27-4530-b634-64ccf18fb2f7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:20.279216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f879a398-3d27-4530-b634-64ccf18fb2f7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:20.350538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f879a398-3d27-4530-b634-64ccf18fb2f7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:20.352776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:57:20.359907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f879a398-3d27-4530-b634-64ccf18fb2f7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.097291 Jul 26 18:57:20.360473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2326/4331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:20 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:21.385151 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c6005d7d-67cc-4942-be65-7de8ab9f4dd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:21.386241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c6005d7d-67cc-4942-be65-7de8ab9f4dd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:21.396934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6005d7d-67cc-4942-be65-7de8ab9f4dd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:21.397377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6005d7d-67cc-4942-be65-7de8ab9f4dd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:21.398128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6005d7d-67cc-4942-be65-7de8ab9f4dd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:21.398559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c6005d7d-67cc-4942-be65-7de8ab9f4dd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:21.460330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c6005d7d-67cc-4942-be65-7de8ab9f4dd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:21.468383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c6005d7d-67cc-4942-be65-7de8ab9f4dd8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090072 Jul 26 18:57:21.468945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2327/4332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:21 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:22.489956 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:57:22.490792 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:57:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 18:57:22.494796 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-832d6dc0-28b4-42df-87d2-e2a5f982d412 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:22.495840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-832d6dc0-28b4-42df-87d2-e2a5f982d412 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:22.506191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-832d6dc0-28b4-42df-87d2-e2a5f982d412 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:22.506666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-832d6dc0-28b4-42df-87d2-e2a5f982d412 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:22.507468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-832d6dc0-28b4-42df-87d2-e2a5f982d412 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:22.507898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-832d6dc0-28b4-42df-87d2-e2a5f982d412 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:22.585393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-832d6dc0-28b4-42df-87d2-e2a5f982d412 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:22.595770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-832d6dc0-28b4-42df-87d2-e2a5f982d412 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.108330 Jul 26 18:57:22.596350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2328/4333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:22 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:23.626849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d5ae611e-f695-49f9-a50d-a8877a7eca12 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:23.627984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d5ae611e-f695-49f9-a50d-a8877a7eca12 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:23.636363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5ae611e-f695-49f9-a50d-a8877a7eca12 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:23.636809 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5ae611e-f695-49f9-a50d-a8877a7eca12 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:23.637568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5ae611e-f695-49f9-a50d-a8877a7eca12 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:23.637997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d5ae611e-f695-49f9-a50d-a8877a7eca12 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:23.701530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d5ae611e-f695-49f9-a50d-a8877a7eca12 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:23.709669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d5ae611e-f695-49f9-a50d-a8877a7eca12 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089283 Jul 26 18:57:23.710241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2329/4334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:23 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:24.735431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2703315e-e942-476a-aeaa-b6c8296bbb1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:24.736464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2703315e-e942-476a-aeaa-b6c8296bbb1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:24.745159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2703315e-e942-476a-aeaa-b6c8296bbb1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:24.745604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2703315e-e942-476a-aeaa-b6c8296bbb1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:24.746365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2703315e-e942-476a-aeaa-b6c8296bbb1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:24.746795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2703315e-e942-476a-aeaa-b6c8296bbb1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:24.819198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2703315e-e942-476a-aeaa-b6c8296bbb1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:24.827460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2703315e-e942-476a-aeaa-b6c8296bbb1a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.098568 Jul 26 18:57:24.828028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2330/4335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:24 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:25.851471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c9f455a5-ca7a-4be4-a596-5e6534aa878c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:25.852138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c9f455a5-ca7a-4be4-a596-5e6534aa878c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:25.858799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9f455a5-ca7a-4be4-a596-5e6534aa878c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:25.859270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9f455a5-ca7a-4be4-a596-5e6534aa878c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:25.860023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9f455a5-ca7a-4be4-a596-5e6534aa878c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:25.860508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c9f455a5-ca7a-4be4-a596-5e6534aa878c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:25.925322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c9f455a5-ca7a-4be4-a596-5e6534aa878c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:25.933568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c9f455a5-ca7a-4be4-a596-5e6534aa878c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086024 Jul 26 18:57:25.934096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2331/4336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:25 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:57:26.958790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7f6754ad-50d0-4453-b4ad-b8215e3c00de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:26.959858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7f6754ad-50d0-4453-b4ad-b8215e3c00de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:26.970818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f6754ad-50d0-4453-b4ad-b8215e3c00de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:26.971625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f6754ad-50d0-4453-b4ad-b8215e3c00de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:26.972884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f6754ad-50d0-4453-b4ad-b8215e3c00de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:26.973609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7f6754ad-50d0-4453-b4ad-b8215e3c00de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:27.041024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7f6754ad-50d0-4453-b4ad-b8215e3c00de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:27.049193 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7f6754ad-50d0-4453-b4ad-b8215e3c00de tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.097085 Jul 26 18:57:27.049756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2332/4337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:26 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:27.054243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e995ae61-71f6-4ecd-8e41-b516459a00b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:27.054729 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e995ae61-71f6-4ecd-8e41-b516459a00b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:27.060596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e995ae61-71f6-4ecd-8e41-b516459a00b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:27.061044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e995ae61-71f6-4ecd-8e41-b516459a00b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:27.061800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e995ae61-71f6-4ecd-8e41-b516459a00b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:27.062235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e995ae61-71f6-4ecd-8e41-b516459a00b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:27.087006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e995ae61-71f6-4ecd-8e41-b516459a00b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Going to try to terminate instance {{(pid=117996) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 18:57:27.165559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e995ae61-71f6-4ecd-8e41-b516459a00b6 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 204 len: 0 microversion: 2.1 time: 0.114537 Jul 26 18:57:27.166187 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2333/4338] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 18:57:27 2022] DELETE /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 18:57:27.174712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-823d8888-5df1-431d-96de-c70696bfdf74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:27.175442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-823d8888-5df1-431d-96de-c70696bfdf74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:27.181426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-823d8888-5df1-431d-96de-c70696bfdf74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:27.181872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-823d8888-5df1-431d-96de-c70696bfdf74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:27.182629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-823d8888-5df1-431d-96de-c70696bfdf74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:27.183098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-823d8888-5df1-431d-96de-c70696bfdf74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:27.324210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-823d8888-5df1-431d-96de-c70696bfdf74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:27.332344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-823d8888-5df1-431d-96de-c70696bfdf74 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1682 microversion: 2.1 time: 0.161793 Jul 26 18:57:27.332915 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2334/4339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:27 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:57:28.074077 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0c55c217-4022-4fce-96b5-bf21d94af2d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:28.075171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0c55c217-4022-4fce-96b5-bf21d94af2d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:28.085414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c55c217-4022-4fce-96b5-bf21d94af2d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:28.085885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c55c217-4022-4fce-96b5-bf21d94af2d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:28.086630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c55c217-4022-4fce-96b5-bf21d94af2d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:28.087057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0c55c217-4022-4fce-96b5-bf21d94af2d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:28.156287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0c55c217-4022-4fce-96b5-bf21d94af2d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:28.164824 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0c55c217-4022-4fce-96b5-bf21d94af2d7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.097399 Jul 26 18:57:28.165392 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2335/4340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:28 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:57:28.360486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-69e877d3-8007-4c22-8e1d-4d750e50a512 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:28.361366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-69e877d3-8007-4c22-8e1d-4d750e50a512 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:28.372154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69e877d3-8007-4c22-8e1d-4d750e50a512 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:28.373502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69e877d3-8007-4c22-8e1d-4d750e50a512 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:28.375701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69e877d3-8007-4c22-8e1d-4d750e50a512 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:28.376755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-69e877d3-8007-4c22-8e1d-4d750e50a512 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:28.520089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-69e877d3-8007-4c22-8e1d-4d750e50a512 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:28.528292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-69e877d3-8007-4c22-8e1d-4d750e50a512 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1682 microversion: 2.1 time: 0.174509 Jul 26 18:57:28.528869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2336/4341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:28 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:29.185147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-92beddb1-babf-4b16-9340-2d0d1125461d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:29.185838 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-92beddb1-babf-4b16-9340-2d0d1125461d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:29.192969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92beddb1-babf-4b16-9340-2d0d1125461d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:29.193425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92beddb1-babf-4b16-9340-2d0d1125461d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:29.194238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92beddb1-babf-4b16-9340-2d0d1125461d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:29.194669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92beddb1-babf-4b16-9340-2d0d1125461d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:29.261955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-92beddb1-babf-4b16-9340-2d0d1125461d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:29.270842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-92beddb1-babf-4b16-9340-2d0d1125461d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089641 Jul 26 18:57:29.271496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2337/4342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:29 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:29.549119 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-17e22b9a-e163-4367-bcd5-5b22e3a096e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:29.549712 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-17e22b9a-e163-4367-bcd5-5b22e3a096e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:29.556191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17e22b9a-e163-4367-bcd5-5b22e3a096e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:29.556632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17e22b9a-e163-4367-bcd5-5b22e3a096e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:29.557366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17e22b9a-e163-4367-bcd5-5b22e3a096e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:29.557790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-17e22b9a-e163-4367-bcd5-5b22e3a096e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:29.619108 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-17e22b9a-e163-4367-bcd5-5b22e3a096e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:29.626725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-17e22b9a-e163-4367-bcd5-5b22e3a096e5 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 200 len: 1615 microversion: 2.1 time: 0.081609 Jul 26 18:57:29.627315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2338/4343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:29 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 1615 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:29.786464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-d987d136-1279-42c0-8dac-e0e15b2b5d78 req-7fb240dc-f5f7-4077-b6ce-a64684c35d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8bb7af-2f89-4a8d-9a16-0e5a157af92d", "name": "network-vif-deleted", "tag": "bf55529b-4812-49fa-afa9-ead56591987a"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:57:29.795332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-d987d136-1279-42c0-8dac-e0e15b2b5d78 req-7fb240dc-f5f7-4077-b6ce-a64684c35d0f service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:29.795770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-d987d136-1279-42c0-8dac-e0e15b2b5d78 req-7fb240dc-f5f7-4077-b6ce-a64684c35d0f service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:29.807688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-d987d136-1279-42c0-8dac-e0e15b2b5d78 req-7fb240dc-f5f7-4077-b6ce-a64684c35d0f service nova] Creating event network-vif-deleted:bf55529b-4812-49fa-afa9-ead56591987a for instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d on hv-cinder-82549 Jul 26 18:57:29.812512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-d987d136-1279-42c0-8dac-e0e15b2b5d78 req-7fb240dc-f5f7-4077-b6ce-a64684c35d0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032545 Jul 26 18:57:29.813347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2339/4344] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:57:30.292249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1d27e78a-b186-4f7c-acfb-979643d014d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:30.294545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1d27e78a-b186-4f7c-acfb-979643d014d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:30.302441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d27e78a-b186-4f7c-acfb-979643d014d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:30.302905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d27e78a-b186-4f7c-acfb-979643d014d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:30.304109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d27e78a-b186-4f7c-acfb-979643d014d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:30.304735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1d27e78a-b186-4f7c-acfb-979643d014d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:30.374139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1d27e78a-b186-4f7c-acfb-979643d014d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:30.382460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1d27e78a-b186-4f7c-acfb-979643d014d2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.094499 Jul 26 18:57:30.383142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2340/4345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:30 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:30.649044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fb99efb3-3383-418b-9712-520a3b1db550 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:30.649667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fb99efb3-3383-418b-9712-520a3b1db550 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:30.656619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb99efb3-3383-418b-9712-520a3b1db550 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:30.657068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb99efb3-3383-418b-9712-520a3b1db550 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:30.657841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb99efb3-3383-418b-9712-520a3b1db550 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:30.658271 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb99efb3-3383-418b-9712-520a3b1db550 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:30.672559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-fb99efb3-3383-418b-9712-520a3b1db550 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] HTTP exception thrown: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fb99efb3-3383-418b-9712-520a3b1db550 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Request method failure captured: Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d HTTP/1.1 Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJoSQxtv8AwmMak-ApkBvAGOclo4VruA3O1ksriTQ-6wpon0S82Ytovbh7gPvY9VGGxzAgXUWiTbl5QGYG92BM1Znn6HEH2ee4X47ZQi-xr6Z5aM7IRi8fPr5rzuGUs2sNA27Ubz43AnXU59xT2N4VBOhhHlHD4N7kOEcCcjjtSB-I Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 18:57:30.674282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 18:57:30.675711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_765e809e332e4a478e09be17e6b3c385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}] Jul 26 18:57:30.675711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeNegativeTest-201653783 Jul 26 18:57:30.675711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 18:57:30.675711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 18:57:30.675711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 18:57:30.675711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 18:57:30.675711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 18:57:30.675711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 40f43a6429474c5e96db487ee85bbd84 Jul 26 18:57:30.675711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 18:57:30.675711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 18:57:30.675711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 18:57:30.675711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '2b8bb7af-2f89-4a8d-9a16-0e5a157af92d'} Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 18:57:30.676436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 18:57:30.677848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 18:57:30.678949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fb99efb3-3383-418b-9712-520a3b1db550 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Returning 404 to user: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 18:57:30.678949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fb99efb3-3383-418b-9712-520a3b1db550 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 404 len: 111 microversion: 2.1 time: 0.030785 Jul 26 18:57:30.678949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2341/4346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:30 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 18:57:30.684605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f62e66d5-3fd9-4386-93a1-07078961cc62 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '.version_select at 0x7f39097d9550>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:30.706090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f62e66d5-3fd9-4386-93a1-07078961cc62 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1983348969" status: 202 len: 0 microversion: 2.1 time: 0.025057 Jul 26 18:57:30.706961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2342/4347] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Jul 26 18:57:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1983348969 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 18:57:31.353462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-99273e40-905d-41f8-aad3-54aaa3838a9c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Action: 'create', calling method: .version_select at 0x7f390a12ae50>, body: {"keypair": {"name": "tempest-keypair-1432867433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKCM5CGHRXV62xaJh2HKhOyiKi7pPcrFRTp6r97PudrcrY2ip9STRRnn6Gd7H8BEhurJ7aMqTA8CeEAeHAWQMPUcQsJOLwhMPn2zv8GJzmA/fdOXJwvIvm8xkjrx679cw=="}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:57:31.371294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-99273e40-905d-41f8-aad3-54aaa3838a9c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for project 765e809e332e4a478e09be17e6b3c385. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:57:31.375855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-99273e40-905d-41f8-aad3-54aaa3838a9c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for user 40f43a6429474c5e96db487ee85bbd84 and project 765e809e332e4a478e09be17e6b3c385. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:57:31.404403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-99273e40-905d-41f8-aad3-54aaa3838a9c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054638 Jul 26 18:57:31.405279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2343/4348] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Jul 26 18:57:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:57:31.411011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-10da8a13-d935-4984-92e1-ce53d098a7e2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:31.411011 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-10da8a13-d935-4984-92e1-ce53d098a7e2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:31.416468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-10da8a13-d935-4984-92e1-ce53d098a7e2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:31.416937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-10da8a13-d935-4984-92e1-ce53d098a7e2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:31.417689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-10da8a13-d935-4984-92e1-ce53d098a7e2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:31.418117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-10da8a13-d935-4984-92e1-ce53d098a7e2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:31.483083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-10da8a13-d935-4984-92e1-ce53d098a7e2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:31.491655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-10da8a13-d935-4984-92e1-ce53d098a7e2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085380 Jul 26 18:57:31.492579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2344/4349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:31 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:32.512974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cb198e00-e6df-4b12-8cb0-5c91b667c57d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:32.513627 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-cb198e00-e6df-4b12-8cb0-5c91b667c57d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:32.520802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb198e00-e6df-4b12-8cb0-5c91b667c57d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:32.521236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb198e00-e6df-4b12-8cb0-5c91b667c57d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:32.522103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb198e00-e6df-4b12-8cb0-5c91b667c57d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:32.522536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-cb198e00-e6df-4b12-8cb0-5c91b667c57d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:32.525303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:57:32.596641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-cb198e00-e6df-4b12-8cb0-5c91b667c57d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:32.604825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cb198e00-e6df-4b12-8cb0-5c91b667c57d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095799 Jul 26 18:57:32.605393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2345/4350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:57:32.641061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-795571269", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3e4e1db-4202-4baf-8f51-705a169c7395"}], "security_groups": [{"name": "tempest-securitygroup--1024300778"}], "key_name": "tempest-keypair-1432867433", "user_data": "}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:57:32.751580 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.network.neutron [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] validate_networks() for [('b3e4e1db-4202-4baf-8f51-705a169c7395', None, None, None, None, None)] {{(pid=117996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:57:33.148896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Flavor limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:57:33.149490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Image limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:57:33.150247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Flavor pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:57:33.150912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Image pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:57:33.151615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:57:33.165590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:33.166047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:33.166837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:33.167301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:33.184411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for project 765e809e332e4a478e09be17e6b3c385. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:57:33.188910 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Getting quotas for user 40f43a6429474c5e96db487ee85bbd84 and project 765e809e332e4a478e09be17e6b3c385. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:57:33.201321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Going to run 1 instances... {{(pid=117996) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:57:33.203639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:57:33.250494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7815ee95-d49f-4bee-bd48-e429816e2de9 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.613736 Jul 26 18:57:33.251165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2346/4351] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:57:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 18:57:33.261973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8aff143f-4990-4bc6-9737-aa5043ac101a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:33.262607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8aff143f-4990-4bc6-9737-aa5043ac101a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:33.315783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8aff143f-4990-4bc6-9737-aa5043ac101a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:33.324109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8aff143f-4990-4bc6-9737-aa5043ac101a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 200 len: 1241 microversion: 2.1 time: 0.065983 Jul 26 18:57:33.324676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2347/4352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:33 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:57:33.626692 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-543b9afb-f7a4-4a8d-a527-39125ea512ff tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:33.627400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-543b9afb-f7a4-4a8d-a527-39125ea512ff tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:33.634431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-543b9afb-f7a4-4a8d-a527-39125ea512ff tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:33.634884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-543b9afb-f7a4-4a8d-a527-39125ea512ff tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:33.635751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-543b9afb-f7a4-4a8d-a527-39125ea512ff tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:33.636215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-543b9afb-f7a4-4a8d-a527-39125ea512ff tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:33.701599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-543b9afb-f7a4-4a8d-a527-39125ea512ff tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:33.709839 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-543b9afb-f7a4-4a8d-a527-39125ea512ff tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.087624 Jul 26 18:57:33.710399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2348/4353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:33 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:57:34.344430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d57cd7e3-e9af-416b-917b-558d8d5ef6bc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:34.345068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d57cd7e3-e9af-416b-917b-558d8d5ef6bc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:34.351793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d57cd7e3-e9af-416b-917b-558d8d5ef6bc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:34.352240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d57cd7e3-e9af-416b-917b-558d8d5ef6bc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:34.352996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d57cd7e3-e9af-416b-917b-558d8d5ef6bc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:34.353421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d57cd7e3-e9af-416b-917b-558d8d5ef6bc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:34.421994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d57cd7e3-e9af-416b-917b-558d8d5ef6bc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:34.430147 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d57cd7e3-e9af-416b-917b-558d8d5ef6bc tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 200 len: 1301 microversion: 2.1 time: 0.089614 Jul 26 18:57:34.430722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2349/4354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:34 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 1301 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:34.730000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-810df737-270c-4285-a4e6-75a7fa4664d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:34.730656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-810df737-270c-4285-a4e6-75a7fa4664d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:34.736789 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-810df737-270c-4285-a4e6-75a7fa4664d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:34.737248 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-810df737-270c-4285-a4e6-75a7fa4664d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:34.738104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-810df737-270c-4285-a4e6-75a7fa4664d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:34.738615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-810df737-270c-4285-a4e6-75a7fa4664d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:34.804560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-810df737-270c-4285-a4e6-75a7fa4664d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:34.812753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-810df737-270c-4285-a4e6-75a7fa4664d5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086723 Jul 26 18:57:34.813331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2350/4355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:34 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:57:35.452283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c080241c-68d6-4f78-a858-dfa14586fc61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:35.452927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c080241c-68d6-4f78-a858-dfa14586fc61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:35.459651 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c080241c-68d6-4f78-a858-dfa14586fc61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:35.460099 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c080241c-68d6-4f78-a858-dfa14586fc61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:35.460852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c080241c-68d6-4f78-a858-dfa14586fc61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:35.461291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c080241c-68d6-4f78-a858-dfa14586fc61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:35.603219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c080241c-68d6-4f78-a858-dfa14586fc61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:35.613152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c080241c-68d6-4f78-a858-dfa14586fc61 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.164819 Jul 26 18:57:35.614437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2351/4356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:35 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:35.807941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-6dd31b61-2796-4ec5-b859-fbf2292ed14d req-384cd3f7-9847-46cc-aaf9-92ac34280fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9", "tag": "9d61659b-0084-4644-aeab-7d60ea233659"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:57:35.825242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-6dd31b61-2796-4ec5-b859-fbf2292ed14d req-384cd3f7-9847-46cc-aaf9-92ac34280fd7 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:35.825678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-6dd31b61-2796-4ec5-b859-fbf2292ed14d req-384cd3f7-9847-46cc-aaf9-92ac34280fd7 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:35.846619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-6dd31b61-2796-4ec5-b859-fbf2292ed14d req-384cd3f7-9847-46cc-aaf9-92ac34280fd7 service nova] Creating event network-changed:9d61659b-0084-4644-aeab-7d60ea233659 for instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 on hv-cinder-82549 Jul 26 18:57:35.852562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-6dd31b61-2796-4ec5-b859-fbf2292ed14d req-384cd3f7-9847-46cc-aaf9-92ac34280fd7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049149 Jul 26 18:57:35.853177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2352/4357] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:57:35.859743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-56bfe0cd-be37-4214-b67a-87126c8f576e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:35.860450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-56bfe0cd-be37-4214-b67a-87126c8f576e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:35.866933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-56bfe0cd-be37-4214-b67a-87126c8f576e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:35.867724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-56bfe0cd-be37-4214-b67a-87126c8f576e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:35.868504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-56bfe0cd-be37-4214-b67a-87126c8f576e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:35.868938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-56bfe0cd-be37-4214-b67a-87126c8f576e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:35.936482 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-56bfe0cd-be37-4214-b67a-87126c8f576e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:35.945192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-56bfe0cd-be37-4214-b67a-87126c8f576e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090471 Jul 26 18:57:35.945788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2353/4358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:36.638746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ee1e2039-e8d3-4b64-a3a4-5aacb7c2060a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:36.639811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ee1e2039-e8d3-4b64-a3a4-5aacb7c2060a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:36.650245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ee1e2039-e8d3-4b64-a3a4-5aacb7c2060a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:36.650691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ee1e2039-e8d3-4b64-a3a4-5aacb7c2060a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:36.651487 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ee1e2039-e8d3-4b64-a3a4-5aacb7c2060a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:36.651925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ee1e2039-e8d3-4b64-a3a4-5aacb7c2060a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:36.801743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ee1e2039-e8d3-4b64-a3a4-5aacb7c2060a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:36.809753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ee1e2039-e8d3-4b64-a3a4-5aacb7c2060a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.177497 Jul 26 18:57:36.810339 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2354/4359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:36 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:36.968667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2e22e131-6baa-4bd2-9fdd-d3dda59795d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:36.969525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2e22e131-6baa-4bd2-9fdd-d3dda59795d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:36.978019 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e22e131-6baa-4bd2-9fdd-d3dda59795d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:36.978470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e22e131-6baa-4bd2-9fdd-d3dda59795d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:36.979259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e22e131-6baa-4bd2-9fdd-d3dda59795d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:36.979685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e22e131-6baa-4bd2-9fdd-d3dda59795d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:37.045020 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2e22e131-6baa-4bd2-9fdd-d3dda59795d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:37.053148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2e22e131-6baa-4bd2-9fdd-d3dda59795d4 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090096 Jul 26 18:57:37.053716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2355/4360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:36 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:37.835628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9d6ea9fc-10c4-4896-b980-d01972089d7c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:37.836497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9d6ea9fc-10c4-4896-b980-d01972089d7c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:37.838422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:57:37.844074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d6ea9fc-10c4-4896-b980-d01972089d7c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:37.844511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d6ea9fc-10c4-4896-b980-d01972089d7c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:37.845269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d6ea9fc-10c4-4896-b980-d01972089d7c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:37.845708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d6ea9fc-10c4-4896-b980-d01972089d7c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:37.987735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9d6ea9fc-10c4-4896-b980-d01972089d7c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:37.995755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9d6ea9fc-10c4-4896-b980-d01972089d7c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.167486 Jul 26 18:57:37.996321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2356/4361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:37 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:38.083745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-52e3f297-e1b3-4afe-bcba-d8de24f345a2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:38.084619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-52e3f297-e1b3-4afe-bcba-d8de24f345a2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:38.091517 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52e3f297-e1b3-4afe-bcba-d8de24f345a2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:38.091963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52e3f297-e1b3-4afe-bcba-d8de24f345a2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:38.092714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52e3f297-e1b3-4afe-bcba-d8de24f345a2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:38.093148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52e3f297-e1b3-4afe-bcba-d8de24f345a2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:38.162933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-52e3f297-e1b3-4afe-bcba-d8de24f345a2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:38.171537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-52e3f297-e1b3-4afe-bcba-d8de24f345a2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093955 Jul 26 18:57:38.172233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2357/4362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:38 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:39.017765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dc9744a7-26fa-4b07-b9d2-1b0af5826fbd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:39.018404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dc9744a7-26fa-4b07-b9d2-1b0af5826fbd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:39.024828 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dc9744a7-26fa-4b07-b9d2-1b0af5826fbd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:39.025276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dc9744a7-26fa-4b07-b9d2-1b0af5826fbd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:39.026028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dc9744a7-26fa-4b07-b9d2-1b0af5826fbd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:39.026455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dc9744a7-26fa-4b07-b9d2-1b0af5826fbd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:39.157834 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dc9744a7-26fa-4b07-b9d2-1b0af5826fbd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:39.165336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dc9744a7-26fa-4b07-b9d2-1b0af5826fbd tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.151777 Jul 26 18:57:39.165887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2358/4363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:39 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:39.191803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dab008c3-103f-4730-98fd-6a1f6b1e831a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:39.192424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dab008c3-103f-4730-98fd-6a1f6b1e831a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:39.198632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dab008c3-103f-4730-98fd-6a1f6b1e831a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:39.199114 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dab008c3-103f-4730-98fd-6a1f6b1e831a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:39.199876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dab008c3-103f-4730-98fd-6a1f6b1e831a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:39.200311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dab008c3-103f-4730-98fd-6a1f6b1e831a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:39.261167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-dab008c3-103f-4730-98fd-6a1f6b1e831a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:39.269813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dab008c3-103f-4730-98fd-6a1f6b1e831a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.081855 Jul 26 18:57:39.270585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2359/4364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:39 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:57:40.190471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e6e4e9a6-54a6-4df1-bf47-271c9a1e92f8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:40.191456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e6e4e9a6-54a6-4df1-bf47-271c9a1e92f8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:40.202614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6e4e9a6-54a6-4df1-bf47-271c9a1e92f8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:40.203425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6e4e9a6-54a6-4df1-bf47-271c9a1e92f8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:40.204714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6e4e9a6-54a6-4df1-bf47-271c9a1e92f8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:40.205495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e6e4e9a6-54a6-4df1-bf47-271c9a1e92f8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:40.339927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e6e4e9a6-54a6-4df1-bf47-271c9a1e92f8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:40.347762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e6e4e9a6-54a6-4df1-bf47-271c9a1e92f8 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.163835 Jul 26 18:57:40.348330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2360/4365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:40 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:40.352641 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-50d06f3e-e906-43cd-a930-0ac6975f66a3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:40.353245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-50d06f3e-e906-43cd-a930-0ac6975f66a3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:40.359478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50d06f3e-e906-43cd-a930-0ac6975f66a3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:40.359929 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50d06f3e-e906-43cd-a930-0ac6975f66a3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:40.360701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50d06f3e-e906-43cd-a930-0ac6975f66a3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:40.361128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-50d06f3e-e906-43cd-a930-0ac6975f66a3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:40.425527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-50d06f3e-e906-43cd-a930-0ac6975f66a3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:40.433803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-50d06f3e-e906-43cd-a930-0ac6975f66a3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.084530 Jul 26 18:57:40.434373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2361/4366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:40 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:41.368675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f8e773bd-3f8c-4659-8275-d16ccd8f8588 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:41.369273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f8e773bd-3f8c-4659-8275-d16ccd8f8588 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:41.376148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8e773bd-3f8c-4659-8275-d16ccd8f8588 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:41.376589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8e773bd-3f8c-4659-8275-d16ccd8f8588 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:41.377332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8e773bd-3f8c-4659-8275-d16ccd8f8588 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:41.377757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f8e773bd-3f8c-4659-8275-d16ccd8f8588 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:41.516230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f8e773bd-3f8c-4659-8275-d16ccd8f8588 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:41.524659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f8e773bd-3f8c-4659-8275-d16ccd8f8588 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.159913 Jul 26 18:57:41.525230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2362/4367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:41 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:57:41.529735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-bb52550b-aa05-4052-b2b1-0c88fb251bd5 req-17b799e4-3b4b-4df0-8b34-e576baba4fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9", "name": "network-vif-plugged", "status": "completed", "tag": "9d61659b-0084-4644-aeab-7d60ea233659"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:57:41.538660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-bb52550b-aa05-4052-b2b1-0c88fb251bd5 req-17b799e4-3b4b-4df0-8b34-e576baba4fd3 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:41.539130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-bb52550b-aa05-4052-b2b1-0c88fb251bd5 req-17b799e4-3b4b-4df0-8b34-e576baba4fd3 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:41.550312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-bb52550b-aa05-4052-b2b1-0c88fb251bd5 req-17b799e4-3b4b-4df0-8b34-e576baba4fd3 service nova] Creating event network-vif-plugged:9d61659b-0084-4644-aeab-7d60ea233659 for instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 on hv-cinder-82549 Jul 26 18:57:41.555286 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-bb52550b-aa05-4052-b2b1-0c88fb251bd5 req-17b799e4-3b4b-4df0-8b34-e576baba4fd3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028881 Jul 26 18:57:41.555850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2363/4368] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:57:41.560986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b196eb68-688a-4ffb-94f9-5eda8b3a260c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:41.561682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b196eb68-688a-4ffb-94f9-5eda8b3a260c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:41.567853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b196eb68-688a-4ffb-94f9-5eda8b3a260c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:41.568298 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b196eb68-688a-4ffb-94f9-5eda8b3a260c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:41.569047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b196eb68-688a-4ffb-94f9-5eda8b3a260c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:41.569469 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b196eb68-688a-4ffb-94f9-5eda8b3a260c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:41.631372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b196eb68-688a-4ffb-94f9-5eda8b3a260c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:41.633911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:57:41.641394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b196eb68-688a-4ffb-94f9-5eda8b3a260c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.084386 Jul 26 18:57:41.642157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2364/4369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:41 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:42.549456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8765c6f6-3ce8-491d-a9a9-8296bca8369c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:42.550548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8765c6f6-3ce8-491d-a9a9-8296bca8369c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:42.560150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8765c6f6-3ce8-491d-a9a9-8296bca8369c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:42.560599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8765c6f6-3ce8-491d-a9a9-8296bca8369c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:42.561361 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8765c6f6-3ce8-491d-a9a9-8296bca8369c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:42.561794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8765c6f6-3ce8-491d-a9a9-8296bca8369c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:42.694427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8765c6f6-3ce8-491d-a9a9-8296bca8369c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:42.702291 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8765c6f6-3ce8-491d-a9a9-8296bca8369c tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 200 len: 1367 microversion: 2.1 time: 0.159349 Jul 26 18:57:42.702857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2365/4370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:42 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:42.707213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-89ce9f8c-431c-49dc-ae2c-20afd0ac0340 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:42.707810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-89ce9f8c-431c-49dc-ae2c-20afd0ac0340 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:42.713678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89ce9f8c-431c-49dc-ae2c-20afd0ac0340 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:42.714127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89ce9f8c-431c-49dc-ae2c-20afd0ac0340 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:42.714875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89ce9f8c-431c-49dc-ae2c-20afd0ac0340 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:42.715348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-89ce9f8c-431c-49dc-ae2c-20afd0ac0340 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:42.779411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-89ce9f8c-431c-49dc-ae2c-20afd0ac0340 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:42.787714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-89ce9f8c-431c-49dc-ae2c-20afd0ac0340 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083861 Jul 26 18:57:42.788323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2366/4371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:42 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:43.727063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-455264cf-fe98-4dca-8558-fe833d2b5422 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:43.728115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-455264cf-fe98-4dca-8558-fe833d2b5422 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:43.731063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:57:43.732217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=12 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:57:43.743071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-455264cf-fe98-4dca-8558-fe833d2b5422 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:43.743847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-455264cf-fe98-4dca-8558-fe833d2b5422 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:43.745097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-455264cf-fe98-4dca-8558-fe833d2b5422 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:43.745827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-455264cf-fe98-4dca-8558-fe833d2b5422 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:43.886570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-455264cf-fe98-4dca-8558-fe833d2b5422 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:43.894683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-455264cf-fe98-4dca-8558-fe833d2b5422 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 200 len: 1558 microversion: 2.1 time: 0.174094 Jul 26 18:57:43.895294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2367/4372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:43 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:43.899731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-80020ace-58b0-470f-b775-5c39541e0cd7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:43.900266 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-80020ace-58b0-470f-b775-5c39541e0cd7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:43.905987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80020ace-58b0-470f-b775-5c39541e0cd7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:43.906433 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80020ace-58b0-470f-b775-5c39541e0cd7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:43.907210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80020ace-58b0-470f-b775-5c39541e0cd7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:43.907642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-80020ace-58b0-470f-b775-5c39541e0cd7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:43.977737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-80020ace-58b0-470f-b775-5c39541e0cd7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:43.986150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-80020ace-58b0-470f-b775-5c39541e0cd7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089944 Jul 26 18:57:43.986725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2368/4373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:43.991173 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e1ff417e-9744-41c1-b43c-f5deb6f1d6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:43.991660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e1ff417e-9744-41c1-b43c-f5deb6f1d6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:43.997407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1ff417e-9744-41c1-b43c-f5deb6f1d6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:43.997855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1ff417e-9744-41c1-b43c-f5deb6f1d6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:43.998609 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1ff417e-9744-41c1-b43c-f5deb6f1d6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:43.999104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e1ff417e-9744-41c1-b43c-f5deb6f1d6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:44.077941 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e1ff417e-9744-41c1-b43c-f5deb6f1d6a2 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090066 Jul 26 18:57:44.078549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2369/4374] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Jul 26 18:57:43 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:57:45.007104 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ff962597-27e2-4036-a404-f5714cf72978 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:45.007728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ff962597-27e2-4036-a404-f5714cf72978 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:45.017336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff962597-27e2-4036-a404-f5714cf72978 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:45.017866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff962597-27e2-4036-a404-f5714cf72978 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:45.019115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff962597-27e2-4036-a404-f5714cf72978 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:45.019625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff962597-27e2-4036-a404-f5714cf72978 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:45.084773 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ff962597-27e2-4036-a404-f5714cf72978 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:45.093348 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ff962597-27e2-4036-a404-f5714cf72978 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090248 Jul 26 18:57:45.094257 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2370/4375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:45 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:45.107677 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-c9a2b6d6-41a2-4c83-bba1-06b4565ce8fc req-133b731f-0da4-489b-ab3f-4971d00255c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9", "tag": "9d61659b-0084-4644-aeab-7d60ea233659"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:57:45.117013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-c9a2b6d6-41a2-4c83-bba1-06b4565ce8fc req-133b731f-0da4-489b-ab3f-4971d00255c3 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:45.117447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-c9a2b6d6-41a2-4c83-bba1-06b4565ce8fc req-133b731f-0da4-489b-ab3f-4971d00255c3 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:45.128265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-c9a2b6d6-41a2-4c83-bba1-06b4565ce8fc req-133b731f-0da4-489b-ab3f-4971d00255c3 service nova] Creating event network-changed:9d61659b-0084-4644-aeab-7d60ea233659 for instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 on hv-cinder-82549 Jul 26 18:57:45.133363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-c9a2b6d6-41a2-4c83-bba1-06b4565ce8fc req-133b731f-0da4-489b-ab3f-4971d00255c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029206 Jul 26 18:57:45.134308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2371/4376] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:57:46.115006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-945099dc-e896-46fa-809d-4c3c99b202b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:46.115738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-945099dc-e896-46fa-809d-4c3c99b202b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:46.122628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-945099dc-e896-46fa-809d-4c3c99b202b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:46.123082 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-945099dc-e896-46fa-809d-4c3c99b202b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:46.123870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-945099dc-e896-46fa-809d-4c3c99b202b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:46.124297 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-945099dc-e896-46fa-809d-4c3c99b202b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:46.199150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-945099dc-e896-46fa-809d-4c3c99b202b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:46.207872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-945099dc-e896-46fa-809d-4c3c99b202b9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.097705 Jul 26 18:57:46.208437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2372/4377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:46 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:47.228672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5dc9ab93-6800-4601-80c2-49d01624bfee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:47.229309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5dc9ab93-6800-4601-80c2-49d01624bfee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:47.236448 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5dc9ab93-6800-4601-80c2-49d01624bfee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:47.236876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5dc9ab93-6800-4601-80c2-49d01624bfee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:47.237626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5dc9ab93-6800-4601-80c2-49d01624bfee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:47.238051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5dc9ab93-6800-4601-80c2-49d01624bfee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:47.310282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5dc9ab93-6800-4601-80c2-49d01624bfee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:47.318713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5dc9ab93-6800-4601-80c2-49d01624bfee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.094021 Jul 26 18:57:47.319306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2373/4378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:47 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:48.341642 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-44bc7c00-9a57-4267-9879-ff08f143fc08 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:48.342306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-44bc7c00-9a57-4267-9879-ff08f143fc08 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:48.350037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44bc7c00-9a57-4267-9879-ff08f143fc08 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:48.350532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44bc7c00-9a57-4267-9879-ff08f143fc08 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:48.351404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44bc7c00-9a57-4267-9879-ff08f143fc08 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:48.351884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-44bc7c00-9a57-4267-9879-ff08f143fc08 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:48.417849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-44bc7c00-9a57-4267-9879-ff08f143fc08 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:48.430280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-44bc7c00-9a57-4267-9879-ff08f143fc08 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.092754 Jul 26 18:57:48.431010 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2374/4379] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:48 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:49.456587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-90255d53-7639-4068-9f1d-f863b97f8e05 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:49.457547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-90255d53-7639-4068-9f1d-f863b97f8e05 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:49.468599 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90255d53-7639-4068-9f1d-f863b97f8e05 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:49.469343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90255d53-7639-4068-9f1d-f863b97f8e05 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:49.470601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90255d53-7639-4068-9f1d-f863b97f8e05 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:49.471372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-90255d53-7639-4068-9f1d-f863b97f8e05 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:49.540877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-90255d53-7639-4068-9f1d-f863b97f8e05 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:49.549498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-90255d53-7639-4068-9f1d-f863b97f8e05 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.099766 Jul 26 18:57:49.550070 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2375/4380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:49 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:50.574332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9e704b9c-4076-40a7-b591-6d30cdcb132a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:50.575484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9e704b9c-4076-40a7-b591-6d30cdcb132a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:50.586417 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e704b9c-4076-40a7-b591-6d30cdcb132a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:50.587209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e704b9c-4076-40a7-b591-6d30cdcb132a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:50.588460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e704b9c-4076-40a7-b591-6d30cdcb132a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:50.589186 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9e704b9c-4076-40a7-b591-6d30cdcb132a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:50.653923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9e704b9c-4076-40a7-b591-6d30cdcb132a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:50.662079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9e704b9c-4076-40a7-b591-6d30cdcb132a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.094181 Jul 26 18:57:50.662670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2376/4381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:50 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:51.686938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3aaa7b53-dd87-4f5d-9e85-4b281720f409 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:51.688043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3aaa7b53-dd87-4f5d-9e85-4b281720f409 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:51.698869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3aaa7b53-dd87-4f5d-9e85-4b281720f409 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:51.699664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3aaa7b53-dd87-4f5d-9e85-4b281720f409 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:51.700620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3aaa7b53-dd87-4f5d-9e85-4b281720f409 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:51.701044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3aaa7b53-dd87-4f5d-9e85-4b281720f409 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:51.764424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3aaa7b53-dd87-4f5d-9e85-4b281720f409 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:51.773120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3aaa7b53-dd87-4f5d-9e85-4b281720f409 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.092707 Jul 26 18:57:51.773660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2377/4382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:52.794931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-81263afc-5498-4bad-bb28-98c221ebcd37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:52.795721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-81263afc-5498-4bad-bb28-98c221ebcd37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:52.802708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81263afc-5498-4bad-bb28-98c221ebcd37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:52.803185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81263afc-5498-4bad-bb28-98c221ebcd37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:52.803946 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81263afc-5498-4bad-bb28-98c221ebcd37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:52.804381 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-81263afc-5498-4bad-bb28-98c221ebcd37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:52.872617 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-81263afc-5498-4bad-bb28-98c221ebcd37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:52.880877 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-81263afc-5498-4bad-bb28-98c221ebcd37 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090848 Jul 26 18:57:52.881488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2378/4383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:52 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:53.904097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9fa89344-59bb-4a64-bcfb-11c190c0e6f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:53.904967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9fa89344-59bb-4a64-bcfb-11c190c0e6f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:53.912948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fa89344-59bb-4a64-bcfb-11c190c0e6f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:53.913479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fa89344-59bb-4a64-bcfb-11c190c0e6f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:53.914363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fa89344-59bb-4a64-bcfb-11c190c0e6f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:53.914871 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fa89344-59bb-4a64-bcfb-11c190c0e6f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:53.985012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9fa89344-59bb-4a64-bcfb-11c190c0e6f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:53.993118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9fa89344-59bb-4a64-bcfb-11c190c0e6f9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093722 Jul 26 18:57:53.993686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2379/4384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:53 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:55.018200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7a5910d9-26c8-44fa-a843-f225d8eaa4d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:55.019634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7a5910d9-26c8-44fa-a843-f225d8eaa4d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:55.030046 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a5910d9-26c8-44fa-a843-f225d8eaa4d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:55.030860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a5910d9-26c8-44fa-a843-f225d8eaa4d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:55.032182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a5910d9-26c8-44fa-a843-f225d8eaa4d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:55.032974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a5910d9-26c8-44fa-a843-f225d8eaa4d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:55.105184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7a5910d9-26c8-44fa-a843-f225d8eaa4d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:55.115148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7a5910d9-26c8-44fa-a843-f225d8eaa4d8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.103656 Jul 26 18:57:55.115732 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2380/4385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:56.139662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e47e9979-db54-4ff8-b37f-b29c139a339e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:56.140718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e47e9979-db54-4ff8-b37f-b29c139a339e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:56.152263 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e47e9979-db54-4ff8-b37f-b29c139a339e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:56.153006 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e47e9979-db54-4ff8-b37f-b29c139a339e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:56.154269 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e47e9979-db54-4ff8-b37f-b29c139a339e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:56.154992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e47e9979-db54-4ff8-b37f-b29c139a339e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:56.216847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e47e9979-db54-4ff8-b37f-b29c139a339e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:56.225574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e47e9979-db54-4ff8-b37f-b29c139a339e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.092595 Jul 26 18:57:56.226152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2381/4386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:56 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:57.250672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e5653891-b16e-453a-bfc6-305dcd8a714c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:57.251853 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e5653891-b16e-453a-bfc6-305dcd8a714c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:57.262723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5653891-b16e-453a-bfc6-305dcd8a714c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:57.263508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5653891-b16e-453a-bfc6-305dcd8a714c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:57.264740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5653891-b16e-453a-bfc6-305dcd8a714c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:57.265506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5653891-b16e-453a-bfc6-305dcd8a714c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:57.280779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:57:57.328762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e5653891-b16e-453a-bfc6-305dcd8a714c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:57.337190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e5653891-b16e-453a-bfc6-305dcd8a714c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093010 Jul 26 18:57:57.337772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2382/4387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:57 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:58.362267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4f2549ac-bfcc-453c-985a-c217eb01ae61 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:58.363415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4f2549ac-bfcc-453c-985a-c217eb01ae61 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:58.374200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f2549ac-bfcc-453c-985a-c217eb01ae61 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:58.374945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f2549ac-bfcc-453c-985a-c217eb01ae61 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:58.375900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f2549ac-bfcc-453c-985a-c217eb01ae61 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:58.376331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4f2549ac-bfcc-453c-985a-c217eb01ae61 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:58.449866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4f2549ac-bfcc-453c-985a-c217eb01ae61 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:58.458437 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4f2549ac-bfcc-453c-985a-c217eb01ae61 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.102795 Jul 26 18:57:58.459055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2383/4388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:58 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:57:59.483585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-27e26ea7-7128-4a3a-be08-8d041a076c51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:57:59.484788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-27e26ea7-7128-4a3a-be08-8d041a076c51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:57:59.492474 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27e26ea7-7128-4a3a-be08-8d041a076c51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:59.493038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27e26ea7-7128-4a3a-be08-8d041a076c51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:59.493980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27e26ea7-7128-4a3a-be08-8d041a076c51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:57:59.494525 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27e26ea7-7128-4a3a-be08-8d041a076c51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:57:59.562422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-27e26ea7-7128-4a3a-be08-8d041a076c51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:57:59.570724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-27e26ea7-7128-4a3a-be08-8d041a076c51 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093743 Jul 26 18:57:59.571344 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2384/4389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:57:59 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:00.598154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-28e31ca5-e890-45a5-8b9e-df8287ed273f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:00.599149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-28e31ca5-e890-45a5-8b9e-df8287ed273f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:00.608980 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28e31ca5-e890-45a5-8b9e-df8287ed273f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:00.609632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28e31ca5-e890-45a5-8b9e-df8287ed273f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:00.610532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28e31ca5-e890-45a5-8b9e-df8287ed273f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:00.611095 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28e31ca5-e890-45a5-8b9e-df8287ed273f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:00.680786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-28e31ca5-e890-45a5-8b9e-df8287ed273f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:00.689723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-28e31ca5-e890-45a5-8b9e-df8287ed273f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.098984 Jul 26 18:58:00.690626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2385/4390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:00 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:01.715409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-27a4007c-e0a8-47dd-bac5-7961704a4d31 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:01.716464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-27a4007c-e0a8-47dd-bac5-7961704a4d31 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:01.728977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27a4007c-e0a8-47dd-bac5-7961704a4d31 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:01.730002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27a4007c-e0a8-47dd-bac5-7961704a4d31 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:01.731311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27a4007c-e0a8-47dd-bac5-7961704a4d31 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:01.732024 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-27a4007c-e0a8-47dd-bac5-7961704a4d31 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:01.794948 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-27a4007c-e0a8-47dd-bac5-7961704a4d31 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:01.803629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-27a4007c-e0a8-47dd-bac5-7961704a4d31 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.094767 Jul 26 18:58:01.804191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2386/4391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:01 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:02.828256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e75108b5-8833-4859-ad7b-4b50bda90805 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:02.829272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e75108b5-8833-4859-ad7b-4b50bda90805 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:02.840281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e75108b5-8833-4859-ad7b-4b50bda90805 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:02.841012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e75108b5-8833-4859-ad7b-4b50bda90805 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:02.842253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e75108b5-8833-4859-ad7b-4b50bda90805 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:02.842964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e75108b5-8833-4859-ad7b-4b50bda90805 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:02.914188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e75108b5-8833-4859-ad7b-4b50bda90805 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:02.929602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e75108b5-8833-4859-ad7b-4b50bda90805 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.107923 Jul 26 18:58:02.930324 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2387/4392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:02 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:03.955240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-88accd13-23c3-46d4-9eef-6737f97b5a93 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:03.956275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-88accd13-23c3-46d4-9eef-6737f97b5a93 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:03.966850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88accd13-23c3-46d4-9eef-6737f97b5a93 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:03.967679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88accd13-23c3-46d4-9eef-6737f97b5a93 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:03.968925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88accd13-23c3-46d4-9eef-6737f97b5a93 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:03.969648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-88accd13-23c3-46d4-9eef-6737f97b5a93 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:04.042041 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-88accd13-23c3-46d4-9eef-6737f97b5a93 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:04.051063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-88accd13-23c3-46d4-9eef-6737f97b5a93 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.102642 Jul 26 18:58:04.051668 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2388/4393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:03 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:05.072608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2bab8508-9df2-4869-b519-fe5ffdb32af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:05.073237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2bab8508-9df2-4869-b519-fe5ffdb32af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:05.080030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bab8508-9df2-4869-b519-fe5ffdb32af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:05.080478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bab8508-9df2-4869-b519-fe5ffdb32af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:05.081237 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bab8508-9df2-4869-b519-fe5ffdb32af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:05.081671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2bab8508-9df2-4869-b519-fe5ffdb32af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:05.144008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2bab8508-9df2-4869-b519-fe5ffdb32af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:05.152159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2bab8508-9df2-4869-b519-fe5ffdb32af5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083606 Jul 26 18:58:05.152727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2389/4394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:05 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:06.175864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fad11c38-7567-4d35-a8f7-8f385dcf2059 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:06.176567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fad11c38-7567-4d35-a8f7-8f385dcf2059 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:06.184158 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fad11c38-7567-4d35-a8f7-8f385dcf2059 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:06.184658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fad11c38-7567-4d35-a8f7-8f385dcf2059 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:06.185501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fad11c38-7567-4d35-a8f7-8f385dcf2059 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:06.185986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fad11c38-7567-4d35-a8f7-8f385dcf2059 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:06.250552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fad11c38-7567-4d35-a8f7-8f385dcf2059 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:06.259311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fad11c38-7567-4d35-a8f7-8f385dcf2059 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.088632 Jul 26 18:58:06.259883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2390/4395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:06 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:07.287564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a1760a48-1c62-4f72-adc8-39458c3d928a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:07.288245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a1760a48-1c62-4f72-adc8-39458c3d928a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:07.296403 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1760a48-1c62-4f72-adc8-39458c3d928a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:07.296966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1760a48-1c62-4f72-adc8-39458c3d928a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:07.298051 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1760a48-1c62-4f72-adc8-39458c3d928a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:07.298629 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1760a48-1c62-4f72-adc8-39458c3d928a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:07.369795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a1760a48-1c62-4f72-adc8-39458c3d928a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:07.378032 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a1760a48-1c62-4f72-adc8-39458c3d928a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095844 Jul 26 18:58:07.378608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2391/4396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:07 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:08.404572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e0f77939-ae58-4675-899b-854fcdf1cbbf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:08.405562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e0f77939-ae58-4675-899b-854fcdf1cbbf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:08.408575 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=72 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:58:08.414812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0f77939-ae58-4675-899b-854fcdf1cbbf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:08.415330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0f77939-ae58-4675-899b-854fcdf1cbbf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:08.416217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0f77939-ae58-4675-899b-854fcdf1cbbf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:08.416649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0f77939-ae58-4675-899b-854fcdf1cbbf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:08.484794 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e0f77939-ae58-4675-899b-854fcdf1cbbf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:08.493321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e0f77939-ae58-4675-899b-854fcdf1cbbf tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095456 Jul 26 18:58:08.493886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2392/4397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:08 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:09.517607 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3a4d8acf-9570-4f50-9dc8-0899d009ec2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:09.518610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3a4d8acf-9570-4f50-9dc8-0899d009ec2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:09.525451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a4d8acf-9570-4f50-9dc8-0899d009ec2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:09.525900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a4d8acf-9570-4f50-9dc8-0899d009ec2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:09.526660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a4d8acf-9570-4f50-9dc8-0899d009ec2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:09.527127 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3a4d8acf-9570-4f50-9dc8-0899d009ec2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:09.587551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3a4d8acf-9570-4f50-9dc8-0899d009ec2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:09.595671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3a4d8acf-9570-4f50-9dc8-0899d009ec2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083844 Jul 26 18:58:09.596242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2393/4398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:09 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:10.626791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-15040b6f-ef35-45dd-a314-2e7319df24c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:10.627616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-15040b6f-ef35-45dd-a314-2e7319df24c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:10.636184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15040b6f-ef35-45dd-a314-2e7319df24c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:10.636680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15040b6f-ef35-45dd-a314-2e7319df24c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:10.637656 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15040b6f-ef35-45dd-a314-2e7319df24c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:10.638195 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15040b6f-ef35-45dd-a314-2e7319df24c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:10.712808 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15040b6f-ef35-45dd-a314-2e7319df24c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:10.721256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-15040b6f-ef35-45dd-a314-2e7319df24c6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.100722 Jul 26 18:58:10.721884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2394/4399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:10 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:11.746418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4066311a-3af5-487e-a35f-e11bdced7b27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:11.747748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4066311a-3af5-487e-a35f-e11bdced7b27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:11.759365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4066311a-3af5-487e-a35f-e11bdced7b27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:11.760107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4066311a-3af5-487e-a35f-e11bdced7b27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:11.761365 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4066311a-3af5-487e-a35f-e11bdced7b27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:11.762087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4066311a-3af5-487e-a35f-e11bdced7b27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:11.831408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4066311a-3af5-487e-a35f-e11bdced7b27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:11.839921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4066311a-3af5-487e-a35f-e11bdced7b27 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.100307 Jul 26 18:58:11.840496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2395/4400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:11 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:12.865215 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a1b13b86-3a97-4d96-88ba-fc2debc197c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:12.866247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a1b13b86-3a97-4d96-88ba-fc2debc197c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:12.877050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1b13b86-3a97-4d96-88ba-fc2debc197c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:12.877506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1b13b86-3a97-4d96-88ba-fc2debc197c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:12.878303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1b13b86-3a97-4d96-88ba-fc2debc197c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:12.878736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1b13b86-3a97-4d96-88ba-fc2debc197c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:12.943632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a1b13b86-3a97-4d96-88ba-fc2debc197c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:12.951844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a1b13b86-3a97-4d96-88ba-fc2debc197c1 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093254 Jul 26 18:58:12.952420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2396/4401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:12 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:13.978064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0be05e40-9f4d-48bb-b8cb-05681d4b0fa5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:13.979141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0be05e40-9f4d-48bb-b8cb-05681d4b0fa5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:13.988319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0be05e40-9f4d-48bb-b8cb-05681d4b0fa5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:13.988768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0be05e40-9f4d-48bb-b8cb-05681d4b0fa5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:13.989550 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0be05e40-9f4d-48bb-b8cb-05681d4b0fa5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:13.989986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0be05e40-9f4d-48bb-b8cb-05681d4b0fa5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:14.053050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-0be05e40-9f4d-48bb-b8cb-05681d4b0fa5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:14.061194 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0be05e40-9f4d-48bb-b8cb-05681d4b0fa5 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089750 Jul 26 18:58:14.061759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2397/4402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:13 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:15.082133 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-67edb74a-d5f3-4a3e-b522-8b2367c22583 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:15.082758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-67edb74a-d5f3-4a3e-b522-8b2367c22583 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:15.089660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-67edb74a-d5f3-4a3e-b522-8b2367c22583 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:15.090103 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-67edb74a-d5f3-4a3e-b522-8b2367c22583 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:15.090855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-67edb74a-d5f3-4a3e-b522-8b2367c22583 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:15.091313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-67edb74a-d5f3-4a3e-b522-8b2367c22583 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:15.154985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-67edb74a-d5f3-4a3e-b522-8b2367c22583 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:15.163201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-67edb74a-d5f3-4a3e-b522-8b2367c22583 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085033 Jul 26 18:58:15.163763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2398/4403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:15 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:16.191100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6ee18609-7de5-462d-9a83-de337f0de467 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:16.192159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6ee18609-7de5-462d-9a83-de337f0de467 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:16.202676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ee18609-7de5-462d-9a83-de337f0de467 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:16.203494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ee18609-7de5-462d-9a83-de337f0de467 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:16.204307 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ee18609-7de5-462d-9a83-de337f0de467 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:16.204743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6ee18609-7de5-462d-9a83-de337f0de467 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:16.207308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:58:16.266709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6ee18609-7de5-462d-9a83-de337f0de467 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:16.275400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6ee18609-7de5-462d-9a83-de337f0de467 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090799 Jul 26 18:58:16.275969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2399/4404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:16 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:17.301791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e12d60c9-22ee-4b0b-ae3b-1b72043f1c68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:17.302831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e12d60c9-22ee-4b0b-ae3b-1b72043f1c68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:17.317351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e12d60c9-22ee-4b0b-ae3b-1b72043f1c68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:17.317801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e12d60c9-22ee-4b0b-ae3b-1b72043f1c68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:17.318635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e12d60c9-22ee-4b0b-ae3b-1b72043f1c68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:17.319142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e12d60c9-22ee-4b0b-ae3b-1b72043f1c68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:17.392924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e12d60c9-22ee-4b0b-ae3b-1b72043f1c68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:17.401894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e12d60c9-22ee-4b0b-ae3b-1b72043f1c68 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.106700 Jul 26 18:58:17.402465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2400/4405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:17 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:18.427430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-20ba7488-62aa-4e64-afef-0cf198809f65 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:18.428455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-20ba7488-62aa-4e64-afef-0cf198809f65 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:18.440683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-20ba7488-62aa-4e64-afef-0cf198809f65 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:18.441435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-20ba7488-62aa-4e64-afef-0cf198809f65 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:18.442701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-20ba7488-62aa-4e64-afef-0cf198809f65 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:18.443512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-20ba7488-62aa-4e64-afef-0cf198809f65 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:18.526785 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-20ba7488-62aa-4e64-afef-0cf198809f65 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:18.535102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-20ba7488-62aa-4e64-afef-0cf198809f65 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.114357 Jul 26 18:58:18.535705 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2401/4406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:18 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:19.560319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-52f056c8-e949-4160-8414-52f53c9c7f94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:19.561366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-52f056c8-e949-4160-8414-52f53c9c7f94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:19.568795 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52f056c8-e949-4160-8414-52f53c9c7f94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:19.569250 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52f056c8-e949-4160-8414-52f53c9c7f94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:19.570004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52f056c8-e949-4160-8414-52f53c9c7f94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:19.570441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-52f056c8-e949-4160-8414-52f53c9c7f94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:19.638676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-52f056c8-e949-4160-8414-52f53c9c7f94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:19.647547 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-52f056c8-e949-4160-8414-52f53c9c7f94 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093840 Jul 26 18:58:19.648125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2402/4407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:19 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:20.672811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7d926994-126a-4e95-a001-1a383322ff39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:20.673560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7d926994-126a-4e95-a001-1a383322ff39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:20.680366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d926994-126a-4e95-a001-1a383322ff39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:20.680806 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d926994-126a-4e95-a001-1a383322ff39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:20.681559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d926994-126a-4e95-a001-1a383322ff39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:20.681987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7d926994-126a-4e95-a001-1a383322ff39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:20.745541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7d926994-126a-4e95-a001-1a383322ff39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:20.757531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7d926994-126a-4e95-a001-1a383322ff39 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090974 Jul 26 18:58:20.758310 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2403/4408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:20 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:21.782171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-68ab247a-87b8-41a8-bb98-8a92009eabd2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:21.782769 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-68ab247a-87b8-41a8-bb98-8a92009eabd2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:21.789797 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68ab247a-87b8-41a8-bb98-8a92009eabd2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:21.790273 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68ab247a-87b8-41a8-bb98-8a92009eabd2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:21.791115 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68ab247a-87b8-41a8-bb98-8a92009eabd2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:21.791545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-68ab247a-87b8-41a8-bb98-8a92009eabd2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:22.017634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-68ab247a-87b8-41a8-bb98-8a92009eabd2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:22.028203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-68ab247a-87b8-41a8-bb98-8a92009eabd2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.251975 Jul 26 18:58:22.028780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2404/4409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:21 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:23.061306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bb9d91e5-44c3-475b-8f37-92502572578f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:23.062396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bb9d91e5-44c3-475b-8f37-92502572578f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:23.069206 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb9d91e5-44c3-475b-8f37-92502572578f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:23.069652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb9d91e5-44c3-475b-8f37-92502572578f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:23.070685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb9d91e5-44c3-475b-8f37-92502572578f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:23.071216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb9d91e5-44c3-475b-8f37-92502572578f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:23.130986 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-bb9d91e5-44c3-475b-8f37-92502572578f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:23.138974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bb9d91e5-44c3-475b-8f37-92502572578f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.084236 Jul 26 18:58:23.139638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2405/4410] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:23 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:24.164458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e0fa2279-78b9-4089-bac5-67d5ead5cba7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:24.165454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e0fa2279-78b9-4089-bac5-67d5ead5cba7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:24.174755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0fa2279-78b9-4089-bac5-67d5ead5cba7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:24.175231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0fa2279-78b9-4089-bac5-67d5ead5cba7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:24.175977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0fa2279-78b9-4089-bac5-67d5ead5cba7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:24.176406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e0fa2279-78b9-4089-bac5-67d5ead5cba7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:24.237528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e0fa2279-78b9-4089-bac5-67d5ead5cba7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:24.245772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e0fa2279-78b9-4089-bac5-67d5ead5cba7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.087879 Jul 26 18:58:24.246318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2406/4411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:24 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:25.270916 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-72a65ee0-b22e-44ac-945e-0eb2c153237b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:25.271992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-72a65ee0-b22e-44ac-945e-0eb2c153237b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:25.282309 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72a65ee0-b22e-44ac-945e-0eb2c153237b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:25.282753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72a65ee0-b22e-44ac-945e-0eb2c153237b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:25.283538 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72a65ee0-b22e-44ac-945e-0eb2c153237b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:25.283970 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-72a65ee0-b22e-44ac-945e-0eb2c153237b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:25.354428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-72a65ee0-b22e-44ac-945e-0eb2c153237b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:25.362555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-72a65ee0-b22e-44ac-945e-0eb2c153237b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.098495 Jul 26 18:58:25.363102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2407/4412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:25 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:26.387601 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5496eb9f-a54d-4af7-abce-25a0f424fd80 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:26.388579 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5496eb9f-a54d-4af7-abce-25a0f424fd80 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:26.396531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5496eb9f-a54d-4af7-abce-25a0f424fd80 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:26.396978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5496eb9f-a54d-4af7-abce-25a0f424fd80 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:26.397743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5496eb9f-a54d-4af7-abce-25a0f424fd80 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:26.398179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5496eb9f-a54d-4af7-abce-25a0f424fd80 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:26.462189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5496eb9f-a54d-4af7-abce-25a0f424fd80 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:26.470411 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5496eb9f-a54d-4af7-abce-25a0f424fd80 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089525 Jul 26 18:58:26.470964 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2408/4413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:26 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:27.495559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-95f17905-d8e9-4bd8-8166-5ddd20abedde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:27.496649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-95f17905-d8e9-4bd8-8166-5ddd20abedde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:27.507631 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95f17905-d8e9-4bd8-8166-5ddd20abedde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:27.508376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95f17905-d8e9-4bd8-8166-5ddd20abedde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:27.509620 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95f17905-d8e9-4bd8-8166-5ddd20abedde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:27.510452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-95f17905-d8e9-4bd8-8166-5ddd20abedde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:27.813555 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-95f17905-d8e9-4bd8-8166-5ddd20abedde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:27.821752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-95f17905-d8e9-4bd8-8166-5ddd20abedde tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.332704 Jul 26 18:58:27.822306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2409/4414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:27 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:58:28.849610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e71c9997-5eda-4de0-85fd-7c585da3703d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:28.850559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e71c9997-5eda-4de0-85fd-7c585da3703d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:28.860821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e71c9997-5eda-4de0-85fd-7c585da3703d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:28.861275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e71c9997-5eda-4de0-85fd-7c585da3703d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:28.862048 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e71c9997-5eda-4de0-85fd-7c585da3703d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:28.862478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e71c9997-5eda-4de0-85fd-7c585da3703d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:28.928025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-e71c9997-5eda-4de0-85fd-7c585da3703d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:28.936249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e71c9997-5eda-4de0-85fd-7c585da3703d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093267 Jul 26 18:58:28.936817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2410/4415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:28 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:29.957436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-34633bc2-bdbb-444d-a613-741e4ea117f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:29.958120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-34633bc2-bdbb-444d-a613-741e4ea117f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:29.965005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34633bc2-bdbb-444d-a613-741e4ea117f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:29.965455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34633bc2-bdbb-444d-a613-741e4ea117f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:29.966213 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34633bc2-bdbb-444d-a613-741e4ea117f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:29.966643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34633bc2-bdbb-444d-a613-741e4ea117f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:30.028818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-34633bc2-bdbb-444d-a613-741e4ea117f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:30.037123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-34633bc2-bdbb-444d-a613-741e4ea117f3 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.083648 Jul 26 18:58:30.037685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2411/4416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:29 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:31.062174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-643a0b8f-80a7-4399-995a-1ab7f9ae071e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:31.063275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-643a0b8f-80a7-4399-995a-1ab7f9ae071e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:31.074191 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-643a0b8f-80a7-4399-995a-1ab7f9ae071e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:31.074957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-643a0b8f-80a7-4399-995a-1ab7f9ae071e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:31.076267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-643a0b8f-80a7-4399-995a-1ab7f9ae071e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:31.077001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-643a0b8f-80a7-4399-995a-1ab7f9ae071e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:31.140714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-643a0b8f-80a7-4399-995a-1ab7f9ae071e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:31.149275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-643a0b8f-80a7-4399-995a-1ab7f9ae071e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093849 Jul 26 18:58:31.149850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2412/4417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:31 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:32.174564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3c307dee-47c6-4627-ab79-976374cb4619 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:32.175630 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3c307dee-47c6-4627-ab79-976374cb4619 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:32.186462 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c307dee-47c6-4627-ab79-976374cb4619 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:32.187328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c307dee-47c6-4627-ab79-976374cb4619 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:32.188093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c307dee-47c6-4627-ab79-976374cb4619 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:32.188527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3c307dee-47c6-4627-ab79-976374cb4619 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:32.251142 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3c307dee-47c6-4627-ab79-976374cb4619 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:32.263658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3c307dee-47c6-4627-ab79-976374cb4619 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093622 Jul 26 18:58:32.264242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2413/4418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:32 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:33.289247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1160b7fd-9ac9-4f16-832b-1badd8691a67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:33.290288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1160b7fd-9ac9-4f16-832b-1badd8691a67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:33.299406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1160b7fd-9ac9-4f16-832b-1badd8691a67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:33.299885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1160b7fd-9ac9-4f16-832b-1badd8691a67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:33.300675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1160b7fd-9ac9-4f16-832b-1badd8691a67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:33.301117 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1160b7fd-9ac9-4f16-832b-1badd8691a67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:33.363495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1160b7fd-9ac9-4f16-832b-1badd8691a67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:33.372683 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1160b7fd-9ac9-4f16-832b-1badd8691a67 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089901 Jul 26 18:58:33.373305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2414/4419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:33 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:58:34.398107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9fa54b43-bdd9-48af-aed7-0ebeb25dd4ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:34.399209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9fa54b43-bdd9-48af-aed7-0ebeb25dd4ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:34.408819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fa54b43-bdd9-48af-aed7-0ebeb25dd4ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:34.409267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fa54b43-bdd9-48af-aed7-0ebeb25dd4ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:34.410037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fa54b43-bdd9-48af-aed7-0ebeb25dd4ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:34.410470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9fa54b43-bdd9-48af-aed7-0ebeb25dd4ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:34.472425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9fa54b43-bdd9-48af-aed7-0ebeb25dd4ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:34.474623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:58:34.482093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9fa54b43-bdd9-48af-aed7-0ebeb25dd4ee tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091043 Jul 26 18:58:34.482653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2415/4420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:34 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:35.507489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-055e052e-295d-4e69-ace9-7e20aec10589 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:35.508582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-055e052e-295d-4e69-ace9-7e20aec10589 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:35.519893 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-055e052e-295d-4e69-ace9-7e20aec10589 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:35.520326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-055e052e-295d-4e69-ace9-7e20aec10589 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:35.521136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-055e052e-295d-4e69-ace9-7e20aec10589 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:35.521552 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-055e052e-295d-4e69-ace9-7e20aec10589 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:35.582961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-055e052e-295d-4e69-ace9-7e20aec10589 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:35.590928 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-055e052e-295d-4e69-ace9-7e20aec10589 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090355 Jul 26 18:58:35.591509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2416/4421] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:35 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:36.612031 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d9075dd8-a07a-4acc-b5c1-89b74bdd9f45 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:36.612715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d9075dd8-a07a-4acc-b5c1-89b74bdd9f45 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:36.619702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d9075dd8-a07a-4acc-b5c1-89b74bdd9f45 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:36.620148 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d9075dd8-a07a-4acc-b5c1-89b74bdd9f45 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:36.620896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d9075dd8-a07a-4acc-b5c1-89b74bdd9f45 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:36.621326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d9075dd8-a07a-4acc-b5c1-89b74bdd9f45 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:36.688596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d9075dd8-a07a-4acc-b5c1-89b74bdd9f45 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:36.700202 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d9075dd8-a07a-4acc-b5c1-89b74bdd9f45 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091729 Jul 26 18:58:36.700968 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2417/4422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:36 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:37.726175 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-404ca781-2e14-4a95-bafc-adc61df5130d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:37.727260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-404ca781-2e14-4a95-bafc-adc61df5130d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:37.738207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-404ca781-2e14-4a95-bafc-adc61df5130d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:37.738660 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-404ca781-2e14-4a95-bafc-adc61df5130d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:37.739456 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-404ca781-2e14-4a95-bafc-adc61df5130d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:37.739888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-404ca781-2e14-4a95-bafc-adc61df5130d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:37.801842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-404ca781-2e14-4a95-bafc-adc61df5130d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:37.809942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-404ca781-2e14-4a95-bafc-adc61df5130d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090317 Jul 26 18:58:37.810507 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2418/4423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:37 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:38.834870 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6079b832-fc3d-4403-878c-8b78dba70c29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:38.835857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6079b832-fc3d-4403-878c-8b78dba70c29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:38.839496 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=54 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:58:38.848621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6079b832-fc3d-4403-878c-8b78dba70c29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:38.849055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6079b832-fc3d-4403-878c-8b78dba70c29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:38.849842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6079b832-fc3d-4403-878c-8b78dba70c29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:38.850268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6079b832-fc3d-4403-878c-8b78dba70c29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:38.922574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6079b832-fc3d-4403-878c-8b78dba70c29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:38.930746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6079b832-fc3d-4403-878c-8b78dba70c29 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.102187 Jul 26 18:58:38.931328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2419/4424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:38 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:39.952498 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9d59bc11-9e9d-4266-b2ab-3451a675aa33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:39.953247 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9d59bc11-9e9d-4266-b2ab-3451a675aa33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:39.960418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d59bc11-9e9d-4266-b2ab-3451a675aa33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:39.960860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d59bc11-9e9d-4266-b2ab-3451a675aa33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:39.961610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d59bc11-9e9d-4266-b2ab-3451a675aa33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:39.962038 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9d59bc11-9e9d-4266-b2ab-3451a675aa33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:40.031781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-9d59bc11-9e9d-4266-b2ab-3451a675aa33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:40.040245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9d59bc11-9e9d-4266-b2ab-3451a675aa33 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091850 Jul 26 18:58:40.040805 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2420/4425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:39 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:58:41.064583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5d241f4f-60d5-4f25-9843-0569d1b1c7dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:41.065572 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5d241f4f-60d5-4f25-9843-0569d1b1c7dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:41.072777 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d241f4f-60d5-4f25-9843-0569d1b1c7dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:41.073222 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d241f4f-60d5-4f25-9843-0569d1b1c7dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:41.073974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d241f4f-60d5-4f25-9843-0569d1b1c7dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:41.074420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d241f4f-60d5-4f25-9843-0569d1b1c7dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:41.138007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5d241f4f-60d5-4f25-9843-0569d1b1c7dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:41.146978 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5d241f4f-60d5-4f25-9843-0569d1b1c7dc tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.088960 Jul 26 18:58:41.147594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2421/4426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:41 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:42.172098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a3c35b92-d3b2-438b-8694-9b3110c890bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:42.173074 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a3c35b92-d3b2-438b-8694-9b3110c890bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:42.181015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3c35b92-d3b2-438b-8694-9b3110c890bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:42.181460 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3c35b92-d3b2-438b-8694-9b3110c890bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:42.182214 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3c35b92-d3b2-438b-8694-9b3110c890bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:42.182653 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a3c35b92-d3b2-438b-8694-9b3110c890bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:42.243349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a3c35b92-d3b2-438b-8694-9b3110c890bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:42.251975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a3c35b92-d3b2-438b-8694-9b3110c890bd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086488 Jul 26 18:58:42.252541 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2422/4427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:42 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:43.277281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8d88897c-7733-4b85-b458-23fdb8dfa762 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:43.278323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-8d88897c-7733-4b85-b458-23fdb8dfa762 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:43.288376 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d88897c-7733-4b85-b458-23fdb8dfa762 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:43.288825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d88897c-7733-4b85-b458-23fdb8dfa762 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:43.289614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d88897c-7733-4b85-b458-23fdb8dfa762 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:43.290045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-8d88897c-7733-4b85-b458-23fdb8dfa762 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:43.363672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-8d88897c-7733-4b85-b458-23fdb8dfa762 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:43.371943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8d88897c-7733-4b85-b458-23fdb8dfa762 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.101380 Jul 26 18:58:43.372523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2423/4428] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:43 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:44.397050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fb800afc-280b-4005-a2bf-235b3274bea9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:44.398141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fb800afc-280b-4005-a2bf-235b3274bea9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:44.404831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb800afc-280b-4005-a2bf-235b3274bea9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:44.405282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb800afc-280b-4005-a2bf-235b3274bea9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:44.406042 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb800afc-280b-4005-a2bf-235b3274bea9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:44.406481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb800afc-280b-4005-a2bf-235b3274bea9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:44.467559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fb800afc-280b-4005-a2bf-235b3274bea9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:44.475751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fb800afc-280b-4005-a2bf-235b3274bea9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.085210 Jul 26 18:58:44.476323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2424/4429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:44 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:45.503047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c8c3b637-5da6-4dad-ba1e-8f59ba631674 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:45.504211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c8c3b637-5da6-4dad-ba1e-8f59ba631674 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:45.511854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8c3b637-5da6-4dad-ba1e-8f59ba631674 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:45.512312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8c3b637-5da6-4dad-ba1e-8f59ba631674 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:45.513096 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8c3b637-5da6-4dad-ba1e-8f59ba631674 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:45.513528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8c3b637-5da6-4dad-ba1e-8f59ba631674 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:45.581691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c8c3b637-5da6-4dad-ba1e-8f59ba631674 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:45.590318 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c8c3b637-5da6-4dad-ba1e-8f59ba631674 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095384 Jul 26 18:58:45.590881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2425/4430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:45 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:46.611463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fb4293a4-c632-499f-b513-aa1ae9bc128e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:46.612165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fb4293a4-c632-499f-b513-aa1ae9bc128e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:46.619558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb4293a4-c632-499f-b513-aa1ae9bc128e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:46.620000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb4293a4-c632-499f-b513-aa1ae9bc128e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:46.620748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb4293a4-c632-499f-b513-aa1ae9bc128e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:46.621179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fb4293a4-c632-499f-b513-aa1ae9bc128e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:46.691863 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-fb4293a4-c632-499f-b513-aa1ae9bc128e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:46.700543 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fb4293a4-c632-499f-b513-aa1ae9bc128e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.093075 Jul 26 18:58:46.701081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2426/4431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:46 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:47.728917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-24502841-1e7b-45af-a84d-be11bce88327 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:47.729975 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-24502841-1e7b-45af-a84d-be11bce88327 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:47.740874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24502841-1e7b-45af-a84d-be11bce88327 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:47.741672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24502841-1e7b-45af-a84d-be11bce88327 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:47.742908 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24502841-1e7b-45af-a84d-be11bce88327 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:47.743664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-24502841-1e7b-45af-a84d-be11bce88327 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:47.810347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-24502841-1e7b-45af-a84d-be11bce88327 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:47.818639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-24502841-1e7b-45af-a84d-be11bce88327 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.096293 Jul 26 18:58:47.819283 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2427/4432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:47 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:48.844802 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-15f247d6-0261-4869-b6b3-d35c31441cfd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:48.845535 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-15f247d6-0261-4869-b6b3-d35c31441cfd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:48.853486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15f247d6-0261-4869-b6b3-d35c31441cfd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:48.854012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15f247d6-0261-4869-b6b3-d35c31441cfd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:48.854889 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15f247d6-0261-4869-b6b3-d35c31441cfd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:48.855429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-15f247d6-0261-4869-b6b3-d35c31441cfd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:48.923101 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-15f247d6-0261-4869-b6b3-d35c31441cfd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:48.931322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-15f247d6-0261-4869-b6b3-d35c31441cfd tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.091076 Jul 26 18:58:48.931855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2428/4433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:48 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:49.957932 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-42f88331-b2de-4510-9663-7d061e4d1b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:49.958969 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-42f88331-b2de-4510-9663-7d061e4d1b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:49.970083 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42f88331-b2de-4510-9663-7d061e4d1b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:49.970865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42f88331-b2de-4510-9663-7d061e4d1b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:49.972174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42f88331-b2de-4510-9663-7d061e4d1b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:49.972898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-42f88331-b2de-4510-9663-7d061e4d1b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:50.040844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-42f88331-b2de-4510-9663-7d061e4d1b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:50.051192 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-42f88331-b2de-4510-9663-7d061e4d1b54 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.099894 Jul 26 18:58:50.051740 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2429/4434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:49 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:51.076394 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7a508756-7578-4c56-b33e-616d51496814 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:51.077362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7a508756-7578-4c56-b33e-616d51496814 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:51.087582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a508756-7578-4c56-b33e-616d51496814 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:51.088037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a508756-7578-4c56-b33e-616d51496814 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:51.088800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a508756-7578-4c56-b33e-616d51496814 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:51.089231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7a508756-7578-4c56-b33e-616d51496814 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:51.154078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7a508756-7578-4c56-b33e-616d51496814 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:51.162491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7a508756-7578-4c56-b33e-616d51496814 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.092768 Jul 26 18:58:51.163075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2430/4435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:51 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:52.187756 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f6dd421f-399c-4927-b40a-2943e1f28484 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:52.188898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f6dd421f-399c-4927-b40a-2943e1f28484 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:52.198702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6dd421f-399c-4927-b40a-2943e1f28484 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:52.199200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6dd421f-399c-4927-b40a-2943e1f28484 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:52.199944 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6dd421f-399c-4927-b40a-2943e1f28484 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:52.200371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f6dd421f-399c-4927-b40a-2943e1f28484 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:52.262319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f6dd421f-399c-4927-b40a-2943e1f28484 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:52.271157 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f6dd421f-399c-4927-b40a-2943e1f28484 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090021 Jul 26 18:58:52.271771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2431/4436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:52 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:53.296330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b6e95d0d-885e-4fe5-93db-76615bdeda6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:53.297406 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b6e95d0d-885e-4fe5-93db-76615bdeda6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:53.308510 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6e95d0d-885e-4fe5-93db-76615bdeda6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:53.309259 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6e95d0d-885e-4fe5-93db-76615bdeda6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:53.310521 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6e95d0d-885e-4fe5-93db-76615bdeda6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:53.311332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b6e95d0d-885e-4fe5-93db-76615bdeda6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:53.326057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:58:53.374205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b6e95d0d-885e-4fe5-93db-76615bdeda6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:53.382418 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b6e95d0d-885e-4fe5-93db-76615bdeda6b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.092590 Jul 26 18:58:53.382991 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2432/4437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:53 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:54.408057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-db312e1f-3e8e-4e8f-97fa-19158fb0d3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:54.409062 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-db312e1f-3e8e-4e8f-97fa-19158fb0d3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:54.420335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db312e1f-3e8e-4e8f-97fa-19158fb0d3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:54.421078 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db312e1f-3e8e-4e8f-97fa-19158fb0d3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:54.422419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db312e1f-3e8e-4e8f-97fa-19158fb0d3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:54.423211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-db312e1f-3e8e-4e8f-97fa-19158fb0d3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:54.489924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-db312e1f-3e8e-4e8f-97fa-19158fb0d3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:54.501880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-db312e1f-3e8e-4e8f-97fa-19158fb0d3c2 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.100493 Jul 26 18:58:54.502505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2433/4438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:54 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:55.528813 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5d055768-7fcb-4c1f-a17b-c452791f767c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:55.529872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5d055768-7fcb-4c1f-a17b-c452791f767c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:55.538413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d055768-7fcb-4c1f-a17b-c452791f767c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:55.538859 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d055768-7fcb-4c1f-a17b-c452791f767c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:55.539667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d055768-7fcb-4c1f-a17b-c452791f767c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:55.540102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5d055768-7fcb-4c1f-a17b-c452791f767c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:55.614506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5d055768-7fcb-4c1f-a17b-c452791f767c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:55.627436 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5d055768-7fcb-4c1f-a17b-c452791f767c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.105833 Jul 26 18:58:55.628341 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2434/4439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:55 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:56.658505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2090ac78-02c7-495b-b12f-9cded06b6214 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:56.659559 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2090ac78-02c7-495b-b12f-9cded06b6214 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:56.670430 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2090ac78-02c7-495b-b12f-9cded06b6214 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:56.671230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2090ac78-02c7-495b-b12f-9cded06b6214 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:56.672483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2090ac78-02c7-495b-b12f-9cded06b6214 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:56.673218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2090ac78-02c7-495b-b12f-9cded06b6214 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:56.740626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2090ac78-02c7-495b-b12f-9cded06b6214 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:56.749747 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2090ac78-02c7-495b-b12f-9cded06b6214 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.097366 Jul 26 18:58:56.750546 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2435/4440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:56 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:57.775372 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f844f112-08b3-4d32-afa4-1e77690f290a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:57.776364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f844f112-08b3-4d32-afa4-1e77690f290a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:57.786446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f844f112-08b3-4d32-afa4-1e77690f290a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:57.786896 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f844f112-08b3-4d32-afa4-1e77690f290a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:57.787682 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f844f112-08b3-4d32-afa4-1e77690f290a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:57.788109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f844f112-08b3-4d32-afa4-1e77690f290a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:57.855002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f844f112-08b3-4d32-afa4-1e77690f290a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:57.863203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f844f112-08b3-4d32-afa4-1e77690f290a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.094415 Jul 26 18:58:57.863765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2436/4441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:57 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:58.888100 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-49c0e0e8-6c0f-4eea-9d45-6717f64fb18c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:58.889093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-49c0e0e8-6c0f-4eea-9d45-6717f64fb18c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:58:58.898218 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49c0e0e8-6c0f-4eea-9d45-6717f64fb18c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:58.898670 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49c0e0e8-6c0f-4eea-9d45-6717f64fb18c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:58.899465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49c0e0e8-6c0f-4eea-9d45-6717f64fb18c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:58:58.899882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-49c0e0e8-6c0f-4eea-9d45-6717f64fb18c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:58:58.962878 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-49c0e0e8-6c0f-4eea-9d45-6717f64fb18c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:58:58.971182 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-49c0e0e8-6c0f-4eea-9d45-6717f64fb18c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089615 Jul 26 18:58:58.971753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2437/4442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:58 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:58:59.993343 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-07284d89-e49d-4f96-9099-c53aa2f1c361 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:58:59.994134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-07284d89-e49d-4f96-9099-c53aa2f1c361 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:00.002375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07284d89-e49d-4f96-9099-c53aa2f1c361 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:00.002818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07284d89-e49d-4f96-9099-c53aa2f1c361 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:00.003864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07284d89-e49d-4f96-9099-c53aa2f1c361 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:00.004303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-07284d89-e49d-4f96-9099-c53aa2f1c361 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:00.066759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-07284d89-e49d-4f96-9099-c53aa2f1c361 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:00.079349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-07284d89-e49d-4f96-9099-c53aa2f1c361 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.090309 Jul 26 18:59:00.080120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2438/4443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:58:59 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:00.084611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4155a13c-7543-4c53-b0a0-4f5ac80ae729 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:00.085088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4155a13c-7543-4c53-b0a0-4f5ac80ae729 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:00.090850 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4155a13c-7543-4c53-b0a0-4f5ac80ae729 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:00.091330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4155a13c-7543-4c53-b0a0-4f5ac80ae729 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:00.092097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4155a13c-7543-4c53-b0a0-4f5ac80ae729 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:00.092523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4155a13c-7543-4c53-b0a0-4f5ac80ae729 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:00.120274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4155a13c-7543-4c53-b0a0-4f5ac80ae729 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9/ips" status: 200 len: 150 microversion: 2.1 time: 0.038673 Jul 26 18:59:00.121264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2439/4444] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Jul 26 18:59:00 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:59:01.102881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-adaf8c82-3bef-4905-aac3-d6db6a9af42d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:01.107523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-adaf8c82-3bef-4905-aac3-d6db6a9af42d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:01.115122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-adaf8c82-3bef-4905-aac3-d6db6a9af42d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:01.115567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-adaf8c82-3bef-4905-aac3-d6db6a9af42d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:01.116301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-adaf8c82-3bef-4905-aac3-d6db6a9af42d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:01.116727 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-adaf8c82-3bef-4905-aac3-d6db6a9af42d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:01.187542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-adaf8c82-3bef-4905-aac3-d6db6a9af42d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:01.196144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-adaf8c82-3bef-4905-aac3-d6db6a9af42d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.097628 Jul 26 18:59:01.196720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2440/4445] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:01 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:02.225363 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2e9a91f6-c74f-4ed6-bb5a-858b2b829770 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:02.226004 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2e9a91f6-c74f-4ed6-bb5a-858b2b829770 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:02.233775 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e9a91f6-c74f-4ed6-bb5a-858b2b829770 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:02.234292 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e9a91f6-c74f-4ed6-bb5a-858b2b829770 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:02.235184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e9a91f6-c74f-4ed6-bb5a-858b2b829770 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:02.235723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e9a91f6-c74f-4ed6-bb5a-858b2b829770 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:02.298912 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2e9a91f6-c74f-4ed6-bb5a-858b2b829770 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:02.307386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2e9a91f6-c74f-4ed6-bb5a-858b2b829770 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086948 Jul 26 18:59:02.307963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2441/4446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:02 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:03.332735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ea39722f-413d-4acc-ae4a-6b5d71278506 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:03.333835 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ea39722f-413d-4acc-ae4a-6b5d71278506 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:03.344203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea39722f-413d-4acc-ae4a-6b5d71278506 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:03.344937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea39722f-413d-4acc-ae4a-6b5d71278506 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:03.346168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea39722f-413d-4acc-ae4a-6b5d71278506 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:03.346880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea39722f-413d-4acc-ae4a-6b5d71278506 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:03.422900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ea39722f-413d-4acc-ae4a-6b5d71278506 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:03.435958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ea39722f-413d-4acc-ae4a-6b5d71278506 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.108233 Jul 26 18:59:03.435958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2442/4447] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:03 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:04.463276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7e643d9a-fb46-4375-9eff-ddd59451397f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:04.464245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7e643d9a-fb46-4375-9eff-ddd59451397f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:04.474268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e643d9a-fb46-4375-9eff-ddd59451397f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:04.474681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e643d9a-fb46-4375-9eff-ddd59451397f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:04.475476 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e643d9a-fb46-4375-9eff-ddd59451397f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:04.475909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e643d9a-fb46-4375-9eff-ddd59451397f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:04.537335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7e643d9a-fb46-4375-9eff-ddd59451397f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:04.545842 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7e643d9a-fb46-4375-9eff-ddd59451397f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.089198 Jul 26 18:59:04.546413 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2443/4448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:04 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:05.567528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-be804464-64bc-4933-9b34-9b6611d0d61d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:05.568211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-be804464-64bc-4933-9b34-9b6611d0d61d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:05.575205 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be804464-64bc-4933-9b34-9b6611d0d61d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:05.575658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be804464-64bc-4933-9b34-9b6611d0d61d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:05.576419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be804464-64bc-4933-9b34-9b6611d0d61d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:05.576849 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-be804464-64bc-4933-9b34-9b6611d0d61d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:05.640996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-be804464-64bc-4933-9b34-9b6611d0d61d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:05.649701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-be804464-64bc-4933-9b34-9b6611d0d61d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.086164 Jul 26 18:59:05.650264 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2444/4449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:05 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:06.675149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4042d858-ec5c-4ab8-8bba-7e9d79380ec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:06.676164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4042d858-ec5c-4ab8-8bba-7e9d79380ec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:06.687423 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4042d858-ec5c-4ab8-8bba-7e9d79380ec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:06.688267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4042d858-ec5c-4ab8-8bba-7e9d79380ec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:06.689441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4042d858-ec5c-4ab8-8bba-7e9d79380ec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:06.690164 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4042d858-ec5c-4ab8-8bba-7e9d79380ec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:06.755150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4042d858-ec5c-4ab8-8bba-7e9d79380ec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:06.763708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4042d858-ec5c-4ab8-8bba-7e9d79380ec8 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.095282 Jul 26 18:59:06.764275 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2445/4450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:06 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:07.785349 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2115374b-06c0-42da-9350-0eb24d0cfdce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:07.786179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2115374b-06c0-42da-9350-0eb24d0cfdce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:07.793211 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2115374b-06c0-42da-9350-0eb24d0cfdce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:07.793658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2115374b-06c0-42da-9350-0eb24d0cfdce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:07.794442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2115374b-06c0-42da-9350-0eb24d0cfdce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:07.794865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2115374b-06c0-42da-9350-0eb24d0cfdce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:07.861276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2115374b-06c0-42da-9350-0eb24d0cfdce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:07.869454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2115374b-06c0-42da-9350-0eb24d0cfdce tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.088089 Jul 26 18:59:07.870757 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2446/4451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:07 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:08.894858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-87fa6f03-d4be-4824-919a-6e6301f0c705 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:08.895972 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-87fa6f03-d4be-4824-919a-6e6301f0c705 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:08.899920 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=56 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:59:08.909636 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87fa6f03-d4be-4824-919a-6e6301f0c705 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:08.910382 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87fa6f03-d4be-4824-919a-6e6301f0c705 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:08.911722 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87fa6f03-d4be-4824-919a-6e6301f0c705 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:08.912454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-87fa6f03-d4be-4824-919a-6e6301f0c705 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:08.976854 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-87fa6f03-d4be-4824-919a-6e6301f0c705 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:08.985377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-87fa6f03-d4be-4824-919a-6e6301f0c705 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.097646 Jul 26 18:59:08.985957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2447/4452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:08 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:10.010442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f616b022-960e-44d2-8101-9d5380472d13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:10.011524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f616b022-960e-44d2-8101-9d5380472d13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:10.023005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f616b022-960e-44d2-8101-9d5380472d13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:10.023814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f616b022-960e-44d2-8101-9d5380472d13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:10.025060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f616b022-960e-44d2-8101-9d5380472d13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:10.025783 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f616b022-960e-44d2-8101-9d5380472d13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:10.097445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f616b022-960e-44d2-8101-9d5380472d13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:10.107002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f616b022-960e-44d2-8101-9d5380472d13 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.103200 Jul 26 18:59:10.114134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2448/4453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:10 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:11.133950 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-659454b1-54c8-4dd1-aa47-eada31648a09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:11.135113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-659454b1-54c8-4dd1-aa47-eada31648a09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:11.143667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-659454b1-54c8-4dd1-aa47-eada31648a09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:11.144118 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-659454b1-54c8-4dd1-aa47-eada31648a09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:11.144886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-659454b1-54c8-4dd1-aa47-eada31648a09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:11.145319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-659454b1-54c8-4dd1-aa47-eada31648a09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:11.160132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=100 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:59:11.216030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-659454b1-54c8-4dd1-aa47-eada31648a09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:11.225335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-659454b1-54c8-4dd1-aa47-eada31648a09 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.098006 Jul 26 18:59:11.225935 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2449/4454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:11 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:12.251008 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3f23b416-8e3f-48af-aa63-2c2bcd45a542 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:12.252319 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3f23b416-8e3f-48af-aa63-2c2bcd45a542 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:12.259370 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f23b416-8e3f-48af-aa63-2c2bcd45a542 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:12.259811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f23b416-8e3f-48af-aa63-2c2bcd45a542 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:12.260567 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f23b416-8e3f-48af-aa63-2c2bcd45a542 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:12.260990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3f23b416-8e3f-48af-aa63-2c2bcd45a542 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:12.335573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3f23b416-8e3f-48af-aa63-2c2bcd45a542 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:12.346742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3f23b416-8e3f-48af-aa63-2c2bcd45a542 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.102388 Jul 26 18:59:12.347358 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2450/4455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:12 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:13.372323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c8d9486f-001b-4ac2-be4a-57c619044032 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:13.373330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c8d9486f-001b-4ac2-be4a-57c619044032 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:13.384468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8d9486f-001b-4ac2-be4a-57c619044032 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:13.385207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8d9486f-001b-4ac2-be4a-57c619044032 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:13.386468 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8d9486f-001b-4ac2-be4a-57c619044032 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:13.387226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c8d9486f-001b-4ac2-be4a-57c619044032 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:13.460408 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c8d9486f-001b-4ac2-be4a-57c619044032 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:13.468571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c8d9486f-001b-4ac2-be4a-57c619044032 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.103302 Jul 26 18:59:13.469130 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2451/4456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:13 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:14.494488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-323d5e96-d46b-4e34-b549-b541cff834b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:14.495652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-323d5e96-d46b-4e34-b549-b541cff834b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:14.507185 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-323d5e96-d46b-4e34-b549-b541cff834b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:14.507628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-323d5e96-d46b-4e34-b549-b541cff834b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:14.508393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-323d5e96-d46b-4e34-b549-b541cff834b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:14.508827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-323d5e96-d46b-4e34-b549-b541cff834b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:14.580548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-323d5e96-d46b-4e34-b549-b541cff834b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:14.589056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-323d5e96-d46b-4e34-b549-b541cff834b6 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 200 len: 1368 microversion: 2.1 time: 0.101321 Jul 26 18:59:14.589623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2452/4457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:14 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:59:14.609519 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-067df73f-b10f-4a32-969a-edf7aa95ec0e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '.version_select at 0x7f390a2a6ee0>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:14.633354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-067df73f-b10f-4a32-969a-edf7aa95ec0e tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-669500741" status: 202 len: 0 microversion: 2.1 time: 0.027419 Jul 26 18:59:14.633926 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2453/4458] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Jul 26 18:59:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-669500741 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 18:59:15.546623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-87e31c68-d2ed-4140-9c25-f80412216689 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Action: 'create', calling method: .version_select at 0x7f390a271940>, body: {"keypair": {"name": "tempest-keypair-2029423332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0TjKRMLCRAJ+1NN74bT+4KQ71wO0VzAZOyUFwXGYGKbLUJUZYyXOMJXAWVHVOT81+1qEwDkDMLloBRu/62y33Q1SCa/ak6UT6ErxFrpAKn1Qn6nyRnw2fuxgxoVay0Cw=="}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:59:15.563939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-87e31c68-d2ed-4140-9c25-f80412216689 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Getting quotas for project d28d9e015838454a91f519b76b8ee3a7. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:59:15.567938 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-87e31c68-d2ed-4140-9c25-f80412216689 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Getting quotas for user 2bc8e3428cac482c8bf505107ad00e00 and project d28d9e015838454a91f519b76b8ee3a7. Resources: {'key_pairs'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:59:15.592189 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-87e31c68-d2ed-4140-9c25-f80412216689 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050130 Jul 26 18:59:15.592831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2454/4459] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Jul 26 18:59:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:59:16.983000 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2039252219", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "621ebb67-4f4a-4dae-b4d5-d0989c4ef140"}], "security_groups": [{"name": "tempest-securitygroup--833774146"}], "key_name": "tempest-keypair-2029423332", "user_data": "}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:59:17.088084 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.network.neutron [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] validate_networks() for [('621ebb67-4f4a-4dae-b4d5-d0989c4ef140', None, None, None, None, None)] {{(pid=117996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 18:59:17.531573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Flavor limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 18:59:17.532016 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Image limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 18:59:17.532483 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Flavor pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 18:59:17.532886 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Image pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 18:59:17.533285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 18:59:17.542882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:17.543351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:17.544132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:17.544588 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:17.561480 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Getting quotas for project d28d9e015838454a91f519b76b8ee3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 18:59:17.566061 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Getting quotas for user 2bc8e3428cac482c8bf505107ad00e00 and project d28d9e015838454a91f519b76b8ee3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 18:59:17.578059 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Going to run 1 instances... {{(pid=117996) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 18:59:17.580347 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 18:59:17.629742 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0f3cb73d-2d05-4a2e-9190-de8fe2a19120 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.653412 Jul 26 18:59:17.630383 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2455/4460] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 18:59:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 18:59:17.640702 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3e1482f1-b33e-4a1b-bfd9-a5efe3c1407b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:17.641300 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3e1482f1-b33e-4a1b-bfd9-a5efe3c1407b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:17.694826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-3e1482f1-b33e-4a1b-bfd9-a5efe3c1407b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:17.702424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3e1482f1-b33e-4a1b-bfd9-a5efe3c1407b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1238 microversion: 2.1 time: 0.065292 Jul 26 18:59:17.703135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2456/4461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:17 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:18.723902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-162acf07-8b1d-4b80-a4be-81a703f85c81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:18.724574 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-162acf07-8b1d-4b80-a4be-81a703f85c81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:18.732281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-162acf07-8b1d-4b80-a4be-81a703f85c81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:18.732725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-162acf07-8b1d-4b80-a4be-81a703f85c81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:18.733473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-162acf07-8b1d-4b80-a4be-81a703f85c81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:18.733909 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-162acf07-8b1d-4b80-a4be-81a703f85c81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:18.803570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-162acf07-8b1d-4b80-a4be-81a703f85c81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:18.811804 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-162acf07-8b1d-4b80-a4be-81a703f85c81 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1298 microversion: 2.1 time: 0.092474 Jul 26 18:59:18.812622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2457/4462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:18 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:19.833490 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c2ccdf0e-0a64-46a8-b5f5-15274b66683f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:19.834138 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c2ccdf0e-0a64-46a8-b5f5-15274b66683f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:19.841771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2ccdf0e-0a64-46a8-b5f5-15274b66683f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:19.842219 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2ccdf0e-0a64-46a8-b5f5-15274b66683f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:19.843144 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2ccdf0e-0a64-46a8-b5f5-15274b66683f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:19.843770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c2ccdf0e-0a64-46a8-b5f5-15274b66683f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:19.992154 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c2ccdf0e-0a64-46a8-b5f5-15274b66683f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:20.001223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c2ccdf0e-0a64-46a8-b5f5-15274b66683f tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1363 microversion: 2.1 time: 0.171682 Jul 26 18:59:20.001957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2458/4463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:19 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:59:20.339605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-f343c481-94b4-44b4-ac40-5a8b64c442d5 req-78a68a53-63b8-440a-8e0d-363c295b5280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b204d62-a8cd-48f0-ac18-608dbbe30e4d", "tag": "f8b3c256-726c-4aa5-b7b6-3d1687940164"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:59:20.352380 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-f343c481-94b4-44b4-ac40-5a8b64c442d5 req-78a68a53-63b8-440a-8e0d-363c295b5280 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:20.352905 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-f343c481-94b4-44b4-ac40-5a8b64c442d5 req-78a68a53-63b8-440a-8e0d-363c295b5280 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:20.366596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-f343c481-94b4-44b4-ac40-5a8b64c442d5 req-78a68a53-63b8-440a-8e0d-363c295b5280 service nova] Creating event network-changed:f8b3c256-726c-4aa5-b7b6-3d1687940164 for instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d on hv-cinder-82549 Jul 26 18:59:20.373149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-f343c481-94b4-44b4-ac40-5a8b64c442d5 req-78a68a53-63b8-440a-8e0d-363c295b5280 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108121 Jul 26 18:59:20.374072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2459/4464] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:59:21.029458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a73ddee7-f1ad-4ba2-bbaf-f8a8dd3bb087 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:21.030557 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a73ddee7-f1ad-4ba2-bbaf-f8a8dd3bb087 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:21.040149 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a73ddee7-f1ad-4ba2-bbaf-f8a8dd3bb087 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:21.040602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a73ddee7-f1ad-4ba2-bbaf-f8a8dd3bb087 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:21.041375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a73ddee7-f1ad-4ba2-bbaf-f8a8dd3bb087 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:21.041807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a73ddee7-f1ad-4ba2-bbaf-f8a8dd3bb087 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:21.173162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a73ddee7-f1ad-4ba2-bbaf-f8a8dd3bb087 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:21.180721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a73ddee7-f1ad-4ba2-bbaf-f8a8dd3bb087 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1363 microversion: 2.1 time: 0.159520 Jul 26 18:59:21.181288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2460/4465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:21 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:22.206295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a1c1dcba-7aef-4ffd-8f70-9899d237b907 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:22.207475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a1c1dcba-7aef-4ffd-8f70-9899d237b907 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:22.216249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1c1dcba-7aef-4ffd-8f70-9899d237b907 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:22.216696 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1c1dcba-7aef-4ffd-8f70-9899d237b907 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:22.217450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1c1dcba-7aef-4ffd-8f70-9899d237b907 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:22.217887 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a1c1dcba-7aef-4ffd-8f70-9899d237b907 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:22.355045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a1c1dcba-7aef-4ffd-8f70-9899d237b907 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:22.366770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a1c1dcba-7aef-4ffd-8f70-9899d237b907 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1363 microversion: 2.1 time: 0.167098 Jul 26 18:59:22.367644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2461/4466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:22 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:23.390560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1367c5cb-6b00-45d5-b157-62f67888696c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:23.391172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1367c5cb-6b00-45d5-b157-62f67888696c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:23.398455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1367c5cb-6b00-45d5-b157-62f67888696c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:23.399047 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1367c5cb-6b00-45d5-b157-62f67888696c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:23.399860 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1367c5cb-6b00-45d5-b157-62f67888696c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:23.400420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1367c5cb-6b00-45d5-b157-62f67888696c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:23.532254 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1367c5cb-6b00-45d5-b157-62f67888696c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:23.540501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1367c5cb-6b00-45d5-b157-62f67888696c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1363 microversion: 2.1 time: 0.155687 Jul 26 18:59:23.541178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2462/4467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:23 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:24.565858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b3b1e9b1-da28-43ff-b788-c517d47bc4ae tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:24.566914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b3b1e9b1-da28-43ff-b788-c517d47bc4ae tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:24.578282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3b1e9b1-da28-43ff-b788-c517d47bc4ae tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:24.579081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3b1e9b1-da28-43ff-b788-c517d47bc4ae tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:24.580335 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3b1e9b1-da28-43ff-b788-c517d47bc4ae tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:24.581063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b3b1e9b1-da28-43ff-b788-c517d47bc4ae tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:24.713882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-b3b1e9b1-da28-43ff-b788-c517d47bc4ae tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:24.721503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b3b1e9b1-da28-43ff-b788-c517d47bc4ae tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1363 microversion: 2.1 time: 0.162366 Jul 26 18:59:24.722072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2463/4468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:24 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:25.743089 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1a9e0ab1-e680-46e7-abb3-3ff23a192cc0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:25.743718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1a9e0ab1-e680-46e7-abb3-3ff23a192cc0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:25.751131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a9e0ab1-e680-46e7-abb3-3ff23a192cc0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:25.751582 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a9e0ab1-e680-46e7-abb3-3ff23a192cc0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:25.752354 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a9e0ab1-e680-46e7-abb3-3ff23a192cc0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:25.752788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a9e0ab1-e680-46e7-abb3-3ff23a192cc0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:25.891231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-1a9e0ab1-e680-46e7-abb3-3ff23a192cc0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:25.900604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1a9e0ab1-e680-46e7-abb3-3ff23a192cc0 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1363 microversion: 2.1 time: 0.161654 Jul 26 18:59:25.901305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2464/4469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:25 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:26.516175 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 18:59:26.516738 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 18:59:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 18:59:26.926826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6774b435-7e84-4985-a3ca-585b5155095c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:26.927720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6774b435-7e84-4985-a3ca-585b5155095c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:26.939295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6774b435-7e84-4985-a3ca-585b5155095c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:26.940040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6774b435-7e84-4985-a3ca-585b5155095c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:26.941293 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6774b435-7e84-4985-a3ca-585b5155095c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:26.942016 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6774b435-7e84-4985-a3ca-585b5155095c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:27.076596 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-6774b435-7e84-4985-a3ca-585b5155095c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:27.084611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6774b435-7e84-4985-a3ca-585b5155095c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1363 microversion: 2.1 time: 0.164614 Jul 26 18:59:27.085174 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2465/4470] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:26 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:27.819743 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:59:27.820542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=12 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 18:59:27.876258 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-6d176095-2acb-43d2-9c65-51e2a3b1994b req-bd9bab48-b1b0-490e-8dea-edc8fc4d76f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b204d62-a8cd-48f0-ac18-608dbbe30e4d", "name": "network-vif-plugged", "status": "completed", "tag": "f8b3c256-726c-4aa5-b7b6-3d1687940164"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:59:27.886610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-6d176095-2acb-43d2-9c65-51e2a3b1994b req-bd9bab48-b1b0-490e-8dea-edc8fc4d76f2 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:27.887512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-6d176095-2acb-43d2-9c65-51e2a3b1994b req-bd9bab48-b1b0-490e-8dea-edc8fc4d76f2 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:27.900717 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-6d176095-2acb-43d2-9c65-51e2a3b1994b req-bd9bab48-b1b0-490e-8dea-edc8fc4d76f2 service nova] Creating event network-vif-plugged:f8b3c256-726c-4aa5-b7b6-3d1687940164 for instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d on hv-cinder-82549 Jul 26 18:59:27.906076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-6d176095-2acb-43d2-9c65-51e2a3b1994b req-bd9bab48-b1b0-490e-8dea-edc8fc4d76f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091070 Jul 26 18:59:27.906658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2466/4471] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 18:59:28.105906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5045674b-c818-4051-8f97-09823c858950 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:28.106600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-5045674b-c818-4051-8f97-09823c858950 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:28.114207 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5045674b-c818-4051-8f97-09823c858950 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:28.114655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5045674b-c818-4051-8f97-09823c858950 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:28.115450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5045674b-c818-4051-8f97-09823c858950 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:28.115869 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-5045674b-c818-4051-8f97-09823c858950 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:28.247387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-5045674b-c818-4051-8f97-09823c858950 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:28.255166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5045674b-c818-4051-8f97-09823c858950 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1363 microversion: 2.1 time: 0.153914 Jul 26 18:59:28.255711 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2467/4472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:28 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:29.280495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-16bea944-7947-4154-bf00-a2f40d76e65a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:29.281577 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-16bea944-7947-4154-bf00-a2f40d76e65a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:29.292640 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16bea944-7947-4154-bf00-a2f40d76e65a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:29.293434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16bea944-7947-4154-bf00-a2f40d76e65a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:29.294673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16bea944-7947-4154-bf00-a2f40d76e65a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:29.295573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-16bea944-7947-4154-bf00-a2f40d76e65a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:29.442054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-16bea944-7947-4154-bf00-a2f40d76e65a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:29.449817 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-16bea944-7947-4154-bf00-a2f40d76e65a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1363 microversion: 2.1 time: 0.175883 Jul 26 18:59:29.450396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2468/4473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:29 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 18:59:30.474952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-28b183c4-4af2-449c-b9f8-edfe7c61074b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:30.476529 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-28b183c4-4af2-449c-b9f8-edfe7c61074b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:30.487581 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28b183c4-4af2-449c-b9f8-edfe7c61074b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:30.488248 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28b183c4-4af2-449c-b9f8-edfe7c61074b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:30.489505 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28b183c4-4af2-449c-b9f8-edfe7c61074b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:30.490233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-28b183c4-4af2-449c-b9f8-edfe7c61074b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:30.632013 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-28b183c4-4af2-449c-b9f8-edfe7c61074b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 18:59:30.641290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-28b183c4-4af2-449c-b9f8-edfe7c61074b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1548 microversion: 2.1 time: 0.172848 Jul 26 18:59:30.641856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2469/4474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 18:59:30 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 18:59:30.661221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-19f68fa6-2a6e-48d5-b621-ebc6879827d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 18:59:30.661699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-19f68fa6-2a6e-48d5-b621-ebc6879827d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 18:59:30.667530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19f68fa6-2a6e-48d5-b621-ebc6879827d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:30.667990 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19f68fa6-2a6e-48d5-b621-ebc6879827d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:30.668708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19f68fa6-2a6e-48d5-b621-ebc6879827d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:30.669132 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-19f68fa6-2a6e-48d5-b621-ebc6879827d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:30.745482 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-19f68fa6-2a6e-48d5-b621-ebc6879827d9 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087782 Jul 26 18:59:30.746098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2470/4475] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Jul 26 18:59:30 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 18:59:31.748900 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-d1657def-8235-4866-9382-a12fa91fb67a req-c75d65ce-276a-46cf-b563-777a64cc8469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b204d62-a8cd-48f0-ac18-608dbbe30e4d", "tag": "f8b3c256-726c-4aa5-b7b6-3d1687940164"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 18:59:31.759284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-d1657def-8235-4866-9382-a12fa91fb67a req-c75d65ce-276a-46cf-b563-777a64cc8469 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 18:59:31.759772 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-d1657def-8235-4866-9382-a12fa91fb67a req-c75d65ce-276a-46cf-b563-777a64cc8469 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 18:59:31.772690 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-d1657def-8235-4866-9382-a12fa91fb67a req-c75d65ce-276a-46cf-b563-777a64cc8469 service nova] Creating event network-changed:f8b3c256-726c-4aa5-b7b6-3d1687940164 for instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d on hv-cinder-82549 Jul 26 18:59:31.777847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-d1657def-8235-4866-9382-a12fa91fb67a req-c75d65ce-276a-46cf-b563-777a64cc8469 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089621 Jul 26 18:59:31.778428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2471/4476] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 18:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:00:00.193564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:00:00.194212 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=99 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:00:00.198377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-92caa558-f9e3-46d5-af43-1e89df235ded tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:00:00.198979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-92caa558-f9e3-46d5-af43-1e89df235ded tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:00:00.207244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92caa558-f9e3-46d5-af43-1e89df235ded tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:00.207686 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92caa558-f9e3-46d5-af43-1e89df235ded tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:00.208434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92caa558-f9e3-46d5-af43-1e89df235ded tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:00.208861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92caa558-f9e3-46d5-af43-1e89df235ded tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:00.234375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-92caa558-f9e3-46d5-af43-1e89df235ded tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Going to try to terminate instance {{(pid=117996) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:00:00.314554 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-92caa558-f9e3-46d5-af43-1e89df235ded tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "DELETE /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 204 len: 0 microversion: 2.1 time: 0.122623 Jul 26 19:00:00.315400 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2472/4477] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 19:00:00 2022] DELETE /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:00:00.324396 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-33a8b2aa-09d5-47bd-b9a3-adfb5e2adb25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:00:00.325086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-33a8b2aa-09d5-47bd-b9a3-adfb5e2adb25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:00:00.331109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33a8b2aa-09d5-47bd-b9a3-adfb5e2adb25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:00.331558 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33a8b2aa-09d5-47bd-b9a3-adfb5e2adb25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:00.332320 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33a8b2aa-09d5-47bd-b9a3-adfb5e2adb25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:00.332749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33a8b2aa-09d5-47bd-b9a3-adfb5e2adb25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:00.471421 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-33a8b2aa-09d5-47bd-b9a3-adfb5e2adb25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:00:00.479426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-33a8b2aa-09d5-47bd-b9a3-adfb5e2adb25 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 200 len: 1682 microversion: 2.1 time: 0.159258 Jul 26 19:00:00.480055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2473/4478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:00:00 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:00:01.502181 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-479041ed-ec33-4599-88e3-65021404fb63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:00:01.503007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-479041ed-ec33-4599-88e3-65021404fb63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:00:01.509790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-479041ed-ec33-4599-88e3-65021404fb63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:01.510256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-479041ed-ec33-4599-88e3-65021404fb63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:01.511040 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-479041ed-ec33-4599-88e3-65021404fb63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:01.511508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-479041ed-ec33-4599-88e3-65021404fb63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:01.657139 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-479041ed-ec33-4599-88e3-65021404fb63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:00:01.665373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-479041ed-ec33-4599-88e3-65021404fb63 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 200 len: 1682 microversion: 2.1 time: 0.167156 Jul 26 19:00:01.665952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2474/4479] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:00:01 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:00:02.688949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-064bb41d-8e4e-4a77-b21e-56f7635fed9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:00:02.690570 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-064bb41d-8e4e-4a77-b21e-56f7635fed9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:00:02.698885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-064bb41d-8e4e-4a77-b21e-56f7635fed9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:02.699407 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-064bb41d-8e4e-4a77-b21e-56f7635fed9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:02.700179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-064bb41d-8e4e-4a77-b21e-56f7635fed9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:02.700614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-064bb41d-8e4e-4a77-b21e-56f7635fed9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:02.769325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-064bb41d-8e4e-4a77-b21e-56f7635fed9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f43a6429474c5e96db487ee85bbd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765e809e332e4a478e09be17e6b3c385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:00:02.777560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-064bb41d-8e4e-4a77-b21e-56f7635fed9a tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 200 len: 1614 microversion: 2.1 time: 0.092887 Jul 26 19:00:02.778353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2475/4480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:00:02 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 1614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:00:02.971446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-1a3213e8-1269-4a25-801a-d130bc2d8ca9 req-f02e3761-6432-431b-ab54-87762bed8841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9", "name": "network-vif-deleted", "tag": "9d61659b-0084-4644-aeab-7d60ea233659"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:00:02.990486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-1a3213e8-1269-4a25-801a-d130bc2d8ca9 req-f02e3761-6432-431b-ab54-87762bed8841 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:02.990884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-1a3213e8-1269-4a25-801a-d130bc2d8ca9 req-f02e3761-6432-431b-ab54-87762bed8841 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:03.007998 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-1a3213e8-1269-4a25-801a-d130bc2d8ca9 req-f02e3761-6432-431b-ab54-87762bed8841 service nova] Creating event network-vif-deleted:9d61659b-0084-4644-aeab-7d60ea233659 for instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 on hv-cinder-82549 Jul 26 19:00:03.013234 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-1a3213e8-1269-4a25-801a-d130bc2d8ca9 req-f02e3761-6432-431b-ab54-87762bed8841 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047440 Jul 26 19:00:03.013843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2476/4481] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 19:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:00:03.799952 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-474af63a-2db7-4484-adc2-72c30ae85e91 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:00:03.800615 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-474af63a-2db7-4484-adc2-72c30ae85e91 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:00:03.807816 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-474af63a-2db7-4484-adc2-72c30ae85e91 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:03.808509 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-474af63a-2db7-4484-adc2-72c30ae85e91 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:03.809279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-474af63a-2db7-4484-adc2-72c30ae85e91 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:03.809715 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-474af63a-2db7-4484-adc2-72c30ae85e91 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:03.824866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-474af63a-2db7-4484-adc2-72c30ae85e91 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] HTTP exception thrown: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-474af63a-2db7-4484-adc2-72c30ae85e91 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Request method failure captured: Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 HTTP/1.1 Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJoSQxtv8AwmMak-ApkBvAGOclo4VruA3O1ksriTQ-6wpon0S82Ytovbh7gPvY9VGGxzAgXUWiTbl5QGYG92BM1Znn6HEH2ee4X47ZQi-xr6Z5aM7IRi8fPr5rzuGUs2sNA27Ubz43AnXU59xT2N4VBOhhHlHD4N7kOEcCcjjtSB-I Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:00:03.826602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:00:03.827883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_765e809e332e4a478e09be17e6b3c385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}] Jul 26 19:00:03.827883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:03.827883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:03.827883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:03.827883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:03.827883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:00:03.827883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:00:03.827883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 40f43a6429474c5e96db487ee85bbd84 Jul 26 19:00:03.827883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:03.827883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:00:03.827883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:03.827883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9'} Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:00:03.828685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:03.829767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:03.830831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-474af63a-2db7-4484-adc2-72c30ae85e91 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Returning 404 to user: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:00:03.830831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-474af63a-2db7-4484-adc2-72c30ae85e91 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 404 len: 111 microversion: 2.1 time: 0.032885 Jul 26 19:00:03.830831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2477/4482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:00:03 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:00:03.837735 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-5741a72c-d62f-4f6e-bf45-f846616e4ed7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '.version_select at 0x7f390a116310>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:00:03.857502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-5741a72c-d62f-4f6e-bf45-f846616e4ed7 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1432867433" status: 202 len: 0 microversion: 2.1 time: 0.023930 Jul 26 19:00:03.858085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2478/4483] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Jul 26 19:00:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1432867433 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 19:00:04.519261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9ff1c214-a1dd-4378-b168-cc3c086a9951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:00:04.519755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-9ff1c214-a1dd-4378-b168-cc3c086a9951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:00:04.527369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ff1c214-a1dd-4378-b168-cc3c086a9951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:04.527807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ff1c214-a1dd-4378-b168-cc3c086a9951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:04.528556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ff1c214-a1dd-4378-b168-cc3c086a9951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:04.528983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-9ff1c214-a1dd-4378-b168-cc3c086a9951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:04.542328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-9ff1c214-a1dd-4378-b168-cc3c086a9951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] HTTP exception thrown: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9ff1c214-a1dd-4378-b168-cc3c086a9951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Request method failure captured: Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: DELETE /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 HTTP/1.1 Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJoSQxtv8AwmMak-ApkBvAGOclo4VruA3O1ksriTQ-6wpon0S82Ytovbh7gPvY9VGGxzAgXUWiTbl5QGYG92BM1Znn6HEH2ee4X47ZQi-xr6Z5aM7IRi8fPr5rzuGUs2sNA27Ubz43AnXU59xT2N4VBOhhHlHD4N7kOEcCcjjtSB-I Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:00:04.543976 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:00:04.545329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_765e809e332e4a478e09be17e6b3c385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}] Jul 26 19:00:04.545329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.545329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:04.545329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.545329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:04.545329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:00:04.545329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:00:04.545329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 40f43a6429474c5e96db487ee85bbd84 Jul 26 19:00:04.545329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:04.545329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:00:04.545329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:04.545329 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9'} Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:00:04.546050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:04.547268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.548330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-9ff1c214-a1dd-4378-b168-cc3c086a9951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Returning 404 to user: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:00:04.548330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-9ff1c214-a1dd-4378-b168-cc3c086a9951 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "DELETE /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 404 len: 111 microversion: 2.1 time: 0.030556 Jul 26 19:00:04.548330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2479/4484] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 19:00:04 2022] DELETE /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:00:04.553489 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c666d83a-0e85-46ba-be21-80dfcc524699 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:00:04.554090 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c666d83a-0e85-46ba-be21-80dfcc524699 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:00:04.560113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c666d83a-0e85-46ba-be21-80dfcc524699 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:04.560560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c666d83a-0e85-46ba-be21-80dfcc524699 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:04.561313 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c666d83a-0e85-46ba-be21-80dfcc524699 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:04.561745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c666d83a-0e85-46ba-be21-80dfcc524699 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:04.575388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-c666d83a-0e85-46ba-be21-80dfcc524699 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] HTTP exception thrown: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c666d83a-0e85-46ba-be21-80dfcc524699 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Request method failure captured: Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 HTTP/1.1 Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJoSQxtv8AwmMak-ApkBvAGOclo4VruA3O1ksriTQ-6wpon0S82Ytovbh7gPvY9VGGxzAgXUWiTbl5QGYG92BM1Znn6HEH2ee4X47ZQi-xr6Z5aM7IRi8fPr5rzuGUs2sNA27Ubz43AnXU59xT2N4VBOhhHlHD4N7kOEcCcjjtSB-I Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:00:04.576885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:00:04.578276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_765e809e332e4a478e09be17e6b3c385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}] Jul 26 19:00:04.578276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.578276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:04.578276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.578276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:04.578276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:00:04.578276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:00:04.578276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 40f43a6429474c5e96db487ee85bbd84 Jul 26 19:00:04.578276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:04.578276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:00:04.578276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:04.578276 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9'} Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:00:04.579068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. Jul 26 19:00:04.580330 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.581454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c666d83a-0e85-46ba-be21-80dfcc524699 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Returning 404 to user: Instance 419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:00:04.581454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c666d83a-0e85-46ba-be21-80dfcc524699 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9" status: 404 len: 111 microversion: 2.1 time: 0.028325 Jul 26 19:00:04.581454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2480/4485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:00:04 2022] GET /compute/v2.1/servers/419d2c5f-43ef-4bc0-9bd1-d8ab4835b4f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:00:04.586134 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-91d3c46c-ff11-4d23-8b08-29ef4381bb8e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:00:04.586611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-91d3c46c-ff11-4d23-8b08-29ef4381bb8e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:00:04.592643 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91d3c46c-ff11-4d23-8b08-29ef4381bb8e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:04.593053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91d3c46c-ff11-4d23-8b08-29ef4381bb8e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:04.593827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91d3c46c-ff11-4d23-8b08-29ef4381bb8e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:04.594252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-91d3c46c-ff11-4d23-8b08-29ef4381bb8e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:04.607539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-91d3c46c-ff11-4d23-8b08-29ef4381bb8e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] HTTP exception thrown: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-91d3c46c-ff11-4d23-8b08-29ef4381bb8e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Request method failure captured: Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: DELETE /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d HTTP/1.1 Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJoSQxtv8AwmMak-ApkBvAGOclo4VruA3O1ksriTQ-6wpon0S82Ytovbh7gPvY9VGGxzAgXUWiTbl5QGYG92BM1Znn6HEH2ee4X47ZQi-xr6Z5aM7IRi8fPr5rzuGUs2sNA27Ubz43AnXU59xT2N4VBOhhHlHD4N7kOEcCcjjtSB-I Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:00:04.609018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:00:04.610240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_765e809e332e4a478e09be17e6b3c385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}] Jul 26 19:00:04.610240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.610240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:04.610240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.610240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:04.610240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:00:04.610240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:00:04.610240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 40f43a6429474c5e96db487ee85bbd84 Jul 26 19:00:04.610240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:04.610240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:00:04.610240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 19:00:04.610240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '2b8bb7af-2f89-4a8d-9a16-0e5a157af92d'} Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:00:04.610914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 19:00:04.612159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.613414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-91d3c46c-ff11-4d23-8b08-29ef4381bb8e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Returning 404 to user: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:00:04.613414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-91d3c46c-ff11-4d23-8b08-29ef4381bb8e tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 404 len: 111 microversion: 2.1 time: 0.027730 Jul 26 19:00:04.613414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2481/4486] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 19:00:04 2022] DELETE /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:00:04.618160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d7e6e786-483b-4910-87ec-4862170ed7f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:00:04.618749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d7e6e786-483b-4910-87ec-4862170ed7f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:00:04.624279 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d7e6e786-483b-4910-87ec-4862170ed7f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:04.624716 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d7e6e786-483b-4910-87ec-4862170ed7f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:04.625414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d7e6e786-483b-4910-87ec-4862170ed7f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:04.625872 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d7e6e786-483b-4910-87ec-4862170ed7f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:04.639091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-d7e6e786-483b-4910-87ec-4862170ed7f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] HTTP exception thrown: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d7e6e786-483b-4910-87ec-4862170ed7f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Request method failure captured: Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d HTTP/1.1 Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJoSQxtv8AwmMak-ApkBvAGOclo4VruA3O1ksriTQ-6wpon0S82Ytovbh7gPvY9VGGxzAgXUWiTbl5QGYG92BM1Znn6HEH2ee4X47ZQi-xr6Z5aM7IRi8fPr5rzuGUs2sNA27Ubz43AnXU59xT2N4VBOhhHlHD4N7kOEcCcjjtSB-I Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:00:04.640526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:00:04.641861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_765e809e332e4a478e09be17e6b3c385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}] Jul 26 19:00:04.641861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.641861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:04.641861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.641861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:04.641861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:00:04.641861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:00:04.641861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 40f43a6429474c5e96db487ee85bbd84 Jul 26 19:00:04.641861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:04.641861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:00:04.641861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 19:00:04.641861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '2b8bb7af-2f89-4a8d-9a16-0e5a157af92d'} Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:00:04.643287 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. Jul 26 19:00:04.644614 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.645672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d7e6e786-483b-4910-87ec-4862170ed7f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Returning 404 to user: Instance 2b8bb7af-2f89-4a8d-9a16-0e5a157af92d could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:00:04.645672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d7e6e786-483b-4910-87ec-4862170ed7f1 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d" status: 404 len: 111 microversion: 2.1 time: 0.027085 Jul 26 19:00:04.645672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2482/4487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:00:04 2022] GET /compute/v2.1/servers/2b8bb7af-2f89-4a8d-9a16-0e5a157af92d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:00:04.649911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7945dd55-c73f-42a7-a36d-621ac50413cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:00:04.650389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7945dd55-c73f-42a7-a36d-621ac50413cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:00:04.655903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7945dd55-c73f-42a7-a36d-621ac50413cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:04.656280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7945dd55-c73f-42a7-a36d-621ac50413cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:04.657027 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7945dd55-c73f-42a7-a36d-621ac50413cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:04.657451 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7945dd55-c73f-42a7-a36d-621ac50413cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:04.672018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-7945dd55-c73f-42a7-a36d-621ac50413cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] HTTP exception thrown: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7945dd55-c73f-42a7-a36d-621ac50413cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Request method failure captured: Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: DELETE /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 HTTP/1.1 Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJoSQxtv8AwmMak-ApkBvAGOclo4VruA3O1ksriTQ-6wpon0S82Ytovbh7gPvY9VGGxzAgXUWiTbl5QGYG92BM1Znn6HEH2ee4X47ZQi-xr6Z5aM7IRi8fPr5rzuGUs2sNA27Ubz43AnXU59xT2N4VBOhhHlHD4N7kOEcCcjjtSB-I Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:00:04.673504 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:00:04.674888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_765e809e332e4a478e09be17e6b3c385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}] Jul 26 19:00:04.674888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.674888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:04.674888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.674888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:04.674888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:00:04.674888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:00:04.674888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 40f43a6429474c5e96db487ee85bbd84 Jul 26 19:00:04.674888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:04.674888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:00:04.674888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 19:00:04.674888 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': 'd54c7ad3-e708-41db-ad30-52ed8fc45183'} Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:00:04.675652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 19:00:04.677001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.678262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7945dd55-c73f-42a7-a36d-621ac50413cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Returning 404 to user: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:00:04.678262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7945dd55-c73f-42a7-a36d-621ac50413cf tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 404 len: 111 microversion: 2.1 time: 0.028472 Jul 26 19:00:04.678262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2483/4488] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 19:00:04 2022] DELETE /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:00:04.686764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bb651a70-8abe-4f38-a3f2-e4120218ccf4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:00:04.687422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-bb651a70-8abe-4f38-a3f2-e4120218ccf4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: d54c7ad3-e708-41db-ad30-52ed8fc45183] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:00:04.696244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb651a70-8abe-4f38-a3f2-e4120218ccf4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:04.696681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb651a70-8abe-4f38-a3f2-e4120218ccf4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:04.697431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb651a70-8abe-4f38-a3f2-e4120218ccf4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:04.698098 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-bb651a70-8abe-4f38-a3f2-e4120218ccf4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:04.712473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-bb651a70-8abe-4f38-a3f2-e4120218ccf4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] HTTP exception thrown: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bb651a70-8abe-4f38-a3f2-e4120218ccf4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Request method failure captured: Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 HTTP/1.1 Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJoSQxtv8AwmMak-ApkBvAGOclo4VruA3O1ksriTQ-6wpon0S82Ytovbh7gPvY9VGGxzAgXUWiTbl5QGYG92BM1Znn6HEH2ee4X47ZQi-xr6Z5aM7IRi8fPr5rzuGUs2sNA27Ubz43AnXU59xT2N4VBOhhHlHD4N7kOEcCcjjtSB-I Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:00:04.714245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:00:04.715634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_765e809e332e4a478e09be17e6b3c385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}] Jul 26 19:00:04.715634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.715634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:00:04.715634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:00:04.715634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:04.715634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:00:04.715634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:00:04.715634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 40f43a6429474c5e96db487ee85bbd84 Jul 26 19:00:04.715634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:00:04.715634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:00:04.715634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 19:00:04.715634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': 'd54c7ad3-e708-41db-ad30-52ed8fc45183'} Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:00:04.716625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. Jul 26 19:00:04.717881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:00:04.719060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bb651a70-8abe-4f38-a3f2-e4120218ccf4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Returning 404 to user: Instance d54c7ad3-e708-41db-ad30-52ed8fc45183 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:00:04.719060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bb651a70-8abe-4f38-a3f2-e4120218ccf4 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183" status: 404 len: 111 microversion: 2.1 time: 0.034485 Jul 26 19:00:04.719060 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2484/4489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:00:04 2022] GET /compute/v2.1/servers/d54c7ad3-e708-41db-ad30-52ed8fc45183 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:00:34.395100 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:00:34.395931 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:00:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:00:36.499963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:00:36.501235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:00:36.607463 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-e5de38d3-3c08-4a42-bafa-b18d6e79b28c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:00:36.607963 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-e5de38d3-3c08-4a42-bafa-b18d6e79b28c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:00:36.614424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5de38d3-3c08-4a42-bafa-b18d6e79b28c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:36.614875 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5de38d3-3c08-4a42-bafa-b18d6e79b28c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:36.615669 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5de38d3-3c08-4a42-bafa-b18d6e79b28c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:00:36.616107 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-e5de38d3-3c08-4a42-bafa-b18d6e79b28c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:00:36.639974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-e5de38d3-3c08-4a42-bafa-b18d6e79b28c tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d/ips" status: 200 len: 145 microversion: 2.1 time: 0.148564 Jul 26 19:00:36.640530 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2485/4490] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Jul 26 19:00:36 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d/ips => generated 145 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:00:42.504099 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:00:42.504873 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:00:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:01:36.714549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:01:36.715801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=4 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:01:36.723672 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-327722d5-7365-4f16-9b16-7d2a751b2783 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:01:36.724481 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-327722d5-7365-4f16-9b16-7d2a751b2783 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:01:36.735336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-327722d5-7365-4f16-9b16-7d2a751b2783 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:36.735786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-327722d5-7365-4f16-9b16-7d2a751b2783 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:36.736542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-327722d5-7365-4f16-9b16-7d2a751b2783 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:36.736977 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-327722d5-7365-4f16-9b16-7d2a751b2783 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:36.762768 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-327722d5-7365-4f16-9b16-7d2a751b2783 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Going to try to terminate instance {{(pid=117996) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:01:36.841235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-327722d5-7365-4f16-9b16-7d2a751b2783 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 204 len: 0 microversion: 2.1 time: 0.129646 Jul 26 19:01:36.841989 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2486/4491] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 19:01:36 2022] DELETE /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:01:36.851737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7fb802c6-8978-435a-9d5b-de77ac849226 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:01:36.852445 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7fb802c6-8978-435a-9d5b-de77ac849226 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:01:36.858542 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7fb802c6-8978-435a-9d5b-de77ac849226 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:36.858981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7fb802c6-8978-435a-9d5b-de77ac849226 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:36.859801 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7fb802c6-8978-435a-9d5b-de77ac849226 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:36.860226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7fb802c6-8978-435a-9d5b-de77ac849226 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:36.999945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7fb802c6-8978-435a-9d5b-de77ac849226 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:01:37.007755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7fb802c6-8978-435a-9d5b-de77ac849226 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1673 microversion: 2.1 time: 0.160317 Jul 26 19:01:37.008312 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2487/4492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:01:36 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:01:38.033591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-39a5ff9f-8d04-492c-8889-3b0773915a2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:01:38.034628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-39a5ff9f-8d04-492c-8889-3b0773915a2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:01:38.045602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39a5ff9f-8d04-492c-8889-3b0773915a2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:38.046325 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39a5ff9f-8d04-492c-8889-3b0773915a2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:38.047537 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39a5ff9f-8d04-492c-8889-3b0773915a2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:38.047961 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-39a5ff9f-8d04-492c-8889-3b0773915a2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:38.181410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-39a5ff9f-8d04-492c-8889-3b0773915a2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:01:38.190749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-39a5ff9f-8d04-492c-8889-3b0773915a2b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1673 microversion: 2.1 time: 0.163473 Jul 26 19:01:38.191646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2488/4493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:01:38 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:01:39.212646 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-641c0ee5-0512-4fee-9c1c-d0f0e702c5a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:01:39.213289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-641c0ee5-0512-4fee-9c1c-d0f0e702c5a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:01:39.220128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-641c0ee5-0512-4fee-9c1c-d0f0e702c5a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:39.220573 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-641c0ee5-0512-4fee-9c1c-d0f0e702c5a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:39.221322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-641c0ee5-0512-4fee-9c1c-d0f0e702c5a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:39.221771 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-641c0ee5-0512-4fee-9c1c-d0f0e702c5a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:39.284091 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-641c0ee5-0512-4fee-9c1c-d0f0e702c5a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e3428cac482c8bf505107ad00e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd28d9e015838454a91f519b76b8ee3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:01:39.292156 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-641c0ee5-0512-4fee-9c1c-d0f0e702c5a7 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 200 len: 1606 microversion: 2.1 time: 0.083470 Jul 26 19:01:39.292724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2489/4494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:01:39 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 1606 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:01:39.481564 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-7b8a1fc0-4737-48ba-ba9a-f127dc1ed8ac req-4d0bd776-01d6-4681-888f-6032fd82acf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b204d62-a8cd-48f0-ac18-608dbbe30e4d", "name": "network-vif-deleted", "tag": "f8b3c256-726c-4aa5-b7b6-3d1687940164"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:01:39.491522 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-7b8a1fc0-4737-48ba-ba9a-f127dc1ed8ac req-4d0bd776-01d6-4681-888f-6032fd82acf0 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:39.491958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-7b8a1fc0-4737-48ba-ba9a-f127dc1ed8ac req-4d0bd776-01d6-4681-888f-6032fd82acf0 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:39.506021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-7b8a1fc0-4737-48ba-ba9a-f127dc1ed8ac req-4d0bd776-01d6-4681-888f-6032fd82acf0 service nova] Creating event network-vif-deleted:f8b3c256-726c-4aa5-b7b6-3d1687940164 for instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d on hv-cinder-82549 Jul 26 19:01:39.511227 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-7b8a1fc0-4737-48ba-ba9a-f127dc1ed8ac req-4d0bd776-01d6-4681-888f-6032fd82acf0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033625 Jul 26 19:01:39.512432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2490/4495] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 19:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:01:40.314799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a55c84c0-34d4-473d-8233-5614d7f28e34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:01:40.315523 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a55c84c0-34d4-473d-8233-5614d7f28e34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:01:40.322076 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a55c84c0-34d4-473d-8233-5614d7f28e34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:40.322528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a55c84c0-34d4-473d-8233-5614d7f28e34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:40.323315 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a55c84c0-34d4-473d-8233-5614d7f28e34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:40.323753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a55c84c0-34d4-473d-8233-5614d7f28e34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:40.338039 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-a55c84c0-34d4-473d-8233-5614d7f28e34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] HTTP exception thrown: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a55c84c0-34d4-473d-8233-5614d7f28e34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Request method failure captured: Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d HTTP/1.1 Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJlP_2OcoQmvy1ZxdLwpRZp6zsMSjQp10VzmV_rf_GqpTqO1hptrmi1n6Ilsx7dyY-yMR5vZ68Ec_FnI06Sy_HZG7_JbQz7Gto4DiSQcGDm4xYSdGH56aI7g9VWJBTAjyRvpHoJng_B-kGpesE8qT3KdGvUEtUBMT_meD8RqUjUjTc Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: d28d9e015838454a91f519b76b8ee3a7 Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:01:40.339626 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:01:40.340856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d28d9e015838454a91f519b76b8ee3a7"}]}] Jul 26 19:01:40.340856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:01:40.340856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: d28d9e015838454a91f519b76b8ee3a7 Jul 26 19:01:40.340856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:01:40.340856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeTestJSON-8354627-project Jul 26 19:01:40.340856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:01:40.340856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:01:40.340856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 2bc8e3428cac482c8bf505107ad00e00 Jul 26 19:01:40.340856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeTestJSON-8354627-project Jul 26 19:01:40.340856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:01:40.340856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:40.340856 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '6b204d62-a8cd-48f0-ac18-608dbbe30e4d'} Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:01:40.341996 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:40.343169 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:40.344165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a55c84c0-34d4-473d-8233-5614d7f28e34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Returning 404 to user: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:01:40.344165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a55c84c0-34d4-473d-8233-5614d7f28e34 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 404 len: 111 microversion: 2.1 time: 0.030993 Jul 26 19:01:40.344165 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2491/4496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:01:40 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:01:40.349749 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ca52cf93-09d5-4ef5-ace0-9c8733566903 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '.version_select at 0x7f390dface50>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:01:40.371966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ca52cf93-09d5-4ef5-ace0-9c8733566903 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2029423332" status: 202 len: 0 microversion: 2.1 time: 0.025787 Jul 26 19:01:40.372534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2492/4497] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Jul 26 19:01:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2029423332 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 19:01:41.000857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-999ea378-92df-406b-b2d6-920bb2a0406b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:01:41.001284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-999ea378-92df-406b-b2d6-920bb2a0406b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:01:41.008402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-999ea378-92df-406b-b2d6-920bb2a0406b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:41.008848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-999ea378-92df-406b-b2d6-920bb2a0406b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:41.009600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-999ea378-92df-406b-b2d6-920bb2a0406b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:41.010030 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-999ea378-92df-406b-b2d6-920bb2a0406b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:41.023858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-999ea378-92df-406b-b2d6-920bb2a0406b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] HTTP exception thrown: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-999ea378-92df-406b-b2d6-920bb2a0406b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Request method failure captured: Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: DELETE /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d HTTP/1.1 Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJlP_2OcoQmvy1ZxdLwpRZp6zsMSjQp10VzmV_rf_GqpTqO1hptrmi1n6Ilsx7dyY-yMR5vZ68Ec_FnI06Sy_HZG7_JbQz7Gto4DiSQcGDm4xYSdGH56aI7g9VWJBTAjyRvpHoJng_B-kGpesE8qT3KdGvUEtUBMT_meD8RqUjUjTc Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: d28d9e015838454a91f519b76b8ee3a7 Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:01:41.025450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:01:41.026898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d28d9e015838454a91f519b76b8ee3a7"}]}] Jul 26 19:01:41.026898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:01:41.026898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: d28d9e015838454a91f519b76b8ee3a7 Jul 26 19:01:41.026898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:01:41.026898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeTestJSON-8354627-project Jul 26 19:01:41.026898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:01:41.026898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:01:41.026898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 2bc8e3428cac482c8bf505107ad00e00 Jul 26 19:01:41.026898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeTestJSON-8354627-project Jul 26 19:01:41.026898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:01:41.026898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:41.026898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '6b204d62-a8cd-48f0-ac18-608dbbe30e4d'} Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:01:41.028029 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:41.029393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:41.030901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-999ea378-92df-406b-b2d6-920bb2a0406b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Returning 404 to user: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:01:41.030901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-999ea378-92df-406b-b2d6-920bb2a0406b tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 404 len: 111 microversion: 2.1 time: 0.030119 Jul 26 19:01:41.030901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2493/4498] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 19:01:40 2022] DELETE /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:01:41.034958 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-92b1c873-0621-4a44-a67f-f4166b0eaf70 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:01:41.035585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-92b1c873-0621-4a44-a67f-f4166b0eaf70 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 6b204d62-a8cd-48f0-ac18-608dbbe30e4d] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:01:41.041303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92b1c873-0621-4a44-a67f-f4166b0eaf70 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:41.041776 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92b1c873-0621-4a44-a67f-f4166b0eaf70 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:41.042526 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92b1c873-0621-4a44-a67f-f4166b0eaf70 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:01:41.042956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-92b1c873-0621-4a44-a67f-f4166b0eaf70 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:01:41.056243 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-92b1c873-0621-4a44-a67f-f4166b0eaf70 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] HTTP exception thrown: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-92b1c873-0621-4a44-a67f-f4166b0eaf70 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Request method failure captured: Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d HTTP/1.1 Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJlP_2OcoQmvy1ZxdLwpRZp6zsMSjQp10VzmV_rf_GqpTqO1hptrmi1n6Ilsx7dyY-yMR5vZ68Ec_FnI06Sy_HZG7_JbQz7Gto4DiSQcGDm4xYSdGH56aI7g9VWJBTAjyRvpHoJng_B-kGpesE8qT3KdGvUEtUBMT_meD8RqUjUjTc Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: d28d9e015838454a91f519b76b8ee3a7 Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:01:41.057767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:01:41.058994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d28d9e015838454a91f519b76b8ee3a7"}]}] Jul 26 19:01:41.058994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:01:41.058994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: d28d9e015838454a91f519b76b8ee3a7 Jul 26 19:01:41.058994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:01:41.058994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeTestJSON-8354627-project Jul 26 19:01:41.058994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:01:41.058994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:01:41.058994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 2bc8e3428cac482c8bf505107ad00e00 Jul 26 19:01:41.058994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeTestJSON-8354627-project Jul 26 19:01:41.058994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:01:41.058994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:41.058994 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '6b204d62-a8cd-48f0-ac18-608dbbe30e4d'} Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:01:41.059655 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. Jul 26 19:01:41.060723 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:01:41.061663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-92b1c873-0621-4a44-a67f-f4166b0eaf70 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Returning 404 to user: Instance 6b204d62-a8cd-48f0-ac18-608dbbe30e4d could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:01:41.061663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-92b1c873-0621-4a44-a67f-f4166b0eaf70 tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d" status: 404 len: 111 microversion: 2.1 time: 0.027722 Jul 26 19:01:41.061663 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2494/4499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:01:41 2022] GET /compute/v2.1/servers/6b204d62-a8cd-48f0-ac18-608dbbe30e4d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:02:10.598285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-33d4be18-b90f-4871-987d-61596fbecbe8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:02:10.598881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-33d4be18-b90f-4871-987d-61596fbecbe8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:02:10.601155 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:02:10.601810 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:02:10.608918 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33d4be18-b90f-4871-987d-61596fbecbe8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:02:10.609443 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33d4be18-b90f-4871-987d-61596fbecbe8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:02:10.610204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33d4be18-b90f-4871-987d-61596fbecbe8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:02:10.610658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-33d4be18-b90f-4871-987d-61596fbecbe8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:02:10.641375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-33d4be18-b90f-4871-987d-61596fbecbe8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Going to try to terminate instance {{(pid=117996) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:02:10.725553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-33d4be18-b90f-4871-987d-61596fbecbe8 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 204 len: 0 microversion: 2.20 time: 0.130902 Jul 26 19:02:10.726152 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2495/4500] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Jul 26 19:02:10 2022] DELETE /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:02:10.735044 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ec994e29-bbab-4a37-b77f-18b1deab363c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:02:10.735840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ec994e29-bbab-4a37-b77f-18b1deab363c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:02:10.742611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec994e29-bbab-4a37-b77f-18b1deab363c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:02:10.743093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec994e29-bbab-4a37-b77f-18b1deab363c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:02:10.743873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec994e29-bbab-4a37-b77f-18b1deab363c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:02:10.744311 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ec994e29-bbab-4a37-b77f-18b1deab363c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:02:10.882898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ec994e29-bbab-4a37-b77f-18b1deab363c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:02:10.892001 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ec994e29-bbab-4a37-b77f-18b1deab363c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:02:10.893453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ec994e29-bbab-4a37-b77f-18b1deab363c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:02:10.894619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ec994e29-bbab-4a37-b77f-18b1deab363c tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 200 len: 1722 microversion: 2.20 time: 0.163942 Jul 26 19:02:10.895172 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2496/4501] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 19:02:10 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:02:11.919184 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a8b3397d-cf2d-4f4e-ae3b-cd0087b1b04e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:02:11.920085 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a8b3397d-cf2d-4f4e-ae3b-cd0087b1b04e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:02:11.928267 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8b3397d-cf2d-4f4e-ae3b-cd0087b1b04e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:02:11.928714 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8b3397d-cf2d-4f4e-ae3b-cd0087b1b04e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:02:11.929478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8b3397d-cf2d-4f4e-ae3b-cd0087b1b04e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:02:11.930068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a8b3397d-cf2d-4f4e-ae3b-cd0087b1b04e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:02:12.066591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a8b3397d-cf2d-4f4e-ae3b-cd0087b1b04e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:02:12.074762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a8b3397d-cf2d-4f4e-ae3b-cd0087b1b04e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:02:12.076966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a8b3397d-cf2d-4f4e-ae3b-cd0087b1b04e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '319c8a4be56b4fc2a00937f2fa36bcba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3955f1bf0e348ea85252259acb1b902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:02:12.078120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a8b3397d-cf2d-4f4e-ae3b-cd0087b1b04e tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 200 len: 1722 microversion: 2.20 time: 0.163879 Jul 26 19:02:12.078708 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2497/4502] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 19:02:11 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 19:02:12.547939 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-08f63751-fd2c-4c04-bcb0-f6f85c544e76 req-42d1c0c1-c531-4ee3-b674-2cab49f405ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf4c176-65d7-4270-bed8-8f038aa47288", "name": "network-vif-deleted", "tag": "55c087d5-8838-4b6c-aa33-cdbad58cd768"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:02:12.558457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-08f63751-fd2c-4c04-bcb0-f6f85c544e76 req-42d1c0c1-c531-4ee3-b674-2cab49f405ea service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:02:12.558901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-08f63751-fd2c-4c04-bcb0-f6f85c544e76 req-42d1c0c1-c531-4ee3-b674-2cab49f405ea service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:02:12.572644 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-08f63751-fd2c-4c04-bcb0-f6f85c544e76 req-42d1c0c1-c531-4ee3-b674-2cab49f405ea service nova] Creating event network-vif-deleted:55c087d5-8838-4b6c-aa33-cdbad58cd768 for instance 0cf4c176-65d7-4270-bed8-8f038aa47288 on hv-cinder-82549 Jul 26 19:02:12.577981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-08f63751-fd2c-4c04-bcb0-f6f85c544e76 req-42d1c0c1-c531-4ee3-b674-2cab49f405ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033562 Jul 26 19:02:12.578673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2498/4503] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 19:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:02:13.102109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d4ac70f3-fa93-4c00-ae1d-aade7fa64859 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:02:13.102764 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d4ac70f3-fa93-4c00-ae1d-aade7fa64859 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:02:13.109159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4ac70f3-fa93-4c00-ae1d-aade7fa64859 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:02:13.109623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4ac70f3-fa93-4c00-ae1d-aade7fa64859 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:02:13.110390 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4ac70f3-fa93-4c00-ae1d-aade7fa64859 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:02:13.110788 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d4ac70f3-fa93-4c00-ae1d-aade7fa64859 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:02:13.125230 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-d4ac70f3-fa93-4c00-ae1d-aade7fa64859 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] HTTP exception thrown: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d4ac70f3-fa93-4c00-ae1d-aade7fa64859 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Request method failure captured: Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 HTTP/1.1 Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJsWS8A9HAyJSOVTJT17flGb4kpaWCMA85xUC-9zgYOdphF-MiXfRBd1LQnd9A0uPdlhXFTlinSO2Dj5DtNV3ZbMQEqYOL4YIPVzhEUtD1RS4fY8CxKc_YHfG0VuZMTcVDQLB_W5MwEqjpGdYEeUc_LRnzXuv-uaCZS4JU7mG5oER8 Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: b3955f1bf0e348ea85252259acb1b902 Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:02:13.127350 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:02:13.128997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3955f1bf0e348ea85252259acb1b902"}]}] Jul 26 19:02:13.128997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:02:13.128997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: b3955f1bf0e348ea85252259acb1b902 Jul 26 19:02:13.128997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:02:13.128997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeShelveTestJSON-774638063-project Jul 26 19:02:13.128997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:02:13.128997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:02:13.128997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 319c8a4be56b4fc2a00937f2fa36bcba Jul 26 19:02:13.128997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-774638063-project Jul 26 19:02:13.128997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:02:13.128997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:02:13.128997 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '0cf4c176-65d7-4270-bed8-8f038aa47288'} Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:02:13.129800 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:02:13.130885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:02:13.131936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d4ac70f3-fa93-4c00-ae1d-aade7fa64859 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Returning 404 to user: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:02:13.131936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d4ac70f3-fa93-4c00-ae1d-aade7fa64859 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 404 len: 111 microversion: 2.20 time: 0.031592 Jul 26 19:02:13.131936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2499/4504] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 19:02:13 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 19:02:13.137763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b738faf6-5f57-450e-9906-927810dc84de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '.version_select at 0x7f390e003160>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:02:13.157737 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b738faf6-5f57-450e-9906-927810dc84de tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-876120400" status: 204 len: 0 microversion: 2.20 time: 0.023636 Jul 26 19:02:13.158454 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2500/4505] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Jul 26 19:02:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-876120400 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 19:02:17.355831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:02:17.356610 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 19:02:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 19:02:46.526463 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:02:46.527338 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:02:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:03:54.406663 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:03:54.407803 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:03:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:04:02.517172 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:04:02.517992 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:04:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:05:37.367424 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:05:37.368360 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 19:05:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 19:06:06.540180 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:06:06.541239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:06:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:06:12.021917 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR oslo.messaging._drivers.impl_rabbit [-] [92383349-4637-4fd1-80e5-4998bd74f7ea] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 19:06:12.022478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:06:12.023252 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:06:12.028113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-0b25eb56-22bd-43ff-a5e7-a786a2fc43e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:12.028605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0b25eb56-22bd-43ff-a5e7-a786a2fc43e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:12.037236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b25eb56-22bd-43ff-a5e7-a786a2fc43e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:12.037691 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b25eb56-22bd-43ff-a5e7-a786a2fc43e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:12.038457 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b25eb56-22bd-43ff-a5e7-a786a2fc43e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:12.038894 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-0b25eb56-22bd-43ff-a5e7-a786a2fc43e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:12.087110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-0b25eb56-22bd-43ff-a5e7-a786a2fc43e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Going to try to terminate instance {{(pid=117996) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:06:12.154441 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-0b25eb56-22bd-43ff-a5e7-a786a2fc43e2 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 204 len: 0 microversion: 2.1 time: 0.135174 Jul 26 19:06:12.155159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2501/4506] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 19:06:12 2022] DELETE /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:06:12.163594 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c5f1c92a-220c-43e1-8ab9-123b656846c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:12.164282 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c5f1c92a-220c-43e1-8ab9-123b656846c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:12.171763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5f1c92a-220c-43e1-8ab9-123b656846c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:12.172386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5f1c92a-220c-43e1-8ab9-123b656846c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:12.173231 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5f1c92a-220c-43e1-8ab9-123b656846c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:12.173671 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-c5f1c92a-220c-43e1-8ab9-123b656846c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:12.466261 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c5f1c92a-220c-43e1-8ab9-123b656846c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:06:12.476833 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c5f1c92a-220c-43e1-8ab9-123b656846c3 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1507 microversion: 2.1 time: 0.317098 Jul 26 19:06:12.477623 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2502/4507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:06:12 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:06:13.156527 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dce6dedd-c5ba-4c58-8b66-b46478c8ff3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:13.157113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-dce6dedd-c5ba-4c58-8b66-b46478c8ff3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:13.164818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dce6dedd-c5ba-4c58-8b66-b46478c8ff3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:13.165248 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dce6dedd-c5ba-4c58-8b66-b46478c8ff3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:13.166012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dce6dedd-c5ba-4c58-8b66-b46478c8ff3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:13.166450 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-dce6dedd-c5ba-4c58-8b66-b46478c8ff3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:13.180314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] [92383349-4637-4fd1-80e5-4998bd74f7ea] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 36784. Jul 26 19:06:13.182200 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-dce6dedd-c5ba-4c58-8b66-b46478c8ff3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] HTTP exception thrown: Instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 could not be found. Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dce6dedd-c5ba-4c58-8b66-b46478c8ff3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Request method failure captured: Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: DELETE /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 HTTP/1.1 Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJlP_2OcoQmvy1ZxdLwpRZp6zsMSjQp10VzmV_rf_GqpTqO1hptrmi1n6Ilsx7dyY-yMR5vZ68Ec_FnI06Sy_HZG7_JbQz7Gto4DiSQcGDm4xYSdGH56aI7g9VWJBTAjyRvpHoJng_B-kGpesE8qT3KdGvUEtUBMT_meD8RqUjUjTc Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: d28d9e015838454a91f519b76b8ee3a7 Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:13.183949 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:13.185434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d28d9e015838454a91f519b76b8ee3a7"}]}] Jul 26 19:06:13.185434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:06:13.185434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: d28d9e015838454a91f519b76b8ee3a7 Jul 26 19:06:13.185434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:06:13.185434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeTestJSON-8354627-project Jul 26 19:06:13.185434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:13.185434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:13.185434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 2bc8e3428cac482c8bf505107ad00e00 Jul 26 19:06:13.185434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeTestJSON-8354627-project Jul 26 19:06:13.185434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:06:13.185434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 could not be found. Jul 26 19:06:13.185434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '99df3fd1-46e9-4842-9e60-b69d557d60c2'} Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 could not be found. Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:13.186301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 could not be found. Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 could not be found. Jul 26 19:06:13.187746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:13.189135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-dce6dedd-c5ba-4c58-8b66-b46478c8ff3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Returning 404 to user: Instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:13.189135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-dce6dedd-c5ba-4c58-8b66-b46478c8ff3d tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "DELETE /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 404 len: 111 microversion: 2.1 time: 0.032761 Jul 26 19:06:13.189135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2503/4508] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 19:06:13 2022] DELETE /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:06:13.193515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-76153a37-897e-4970-9cbf-b6b317fbef0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:13.194120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-76153a37-897e-4970-9cbf-b6b317fbef0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] [instance: 99df3fd1-46e9-4842-9e60-b69d557d60c2] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:13.200880 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76153a37-897e-4970-9cbf-b6b317fbef0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:13.201332 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76153a37-897e-4970-9cbf-b6b317fbef0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:13.202126 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76153a37-897e-4970-9cbf-b6b317fbef0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:13.202587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-76153a37-897e-4970-9cbf-b6b317fbef0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:13.216752 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-76153a37-897e-4970-9cbf-b6b317fbef0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] HTTP exception thrown: Instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 could not be found. Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-76153a37-897e-4970-9cbf-b6b317fbef0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Request method failure captured: Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 HTTP/1.1 Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJlP_2OcoQmvy1ZxdLwpRZp6zsMSjQp10VzmV_rf_GqpTqO1hptrmi1n6Ilsx7dyY-yMR5vZ68Ec_FnI06Sy_HZG7_JbQz7Gto4DiSQcGDm4xYSdGH56aI7g9VWJBTAjyRvpHoJng_B-kGpesE8qT3KdGvUEtUBMT_meD8RqUjUjTc Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: d28d9e015838454a91f519b76b8ee3a7 Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:13.218414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:13.219866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d28d9e015838454a91f519b76b8ee3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d28d9e015838454a91f519b76b8ee3a7"}]}] Jul 26 19:06:13.219866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:06:13.219866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: d28d9e015838454a91f519b76b8ee3a7 Jul 26 19:06:13.219866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeTestJSON-8354627 Jul 26 19:06:13.219866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeTestJSON-8354627-project Jul 26 19:06:13.219866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:13.219866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:13.219866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 2bc8e3428cac482c8bf505107ad00e00 Jul 26 19:06:13.219866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeTestJSON-8354627-project Jul 26 19:06:13.219866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:06:13.219866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 could not be found. Jul 26 19:06:13.219866 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '99df3fd1-46e9-4842-9e60-b69d557d60c2'} Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 could not be found. Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:13.225012 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 could not be found. Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 could not be found. Jul 26 19:06:13.226763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:13.227979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-76153a37-897e-4970-9cbf-b6b317fbef0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] Returning 404 to user: Instance 99df3fd1-46e9-4842-9e60-b69d557d60c2 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:13.227979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-76153a37-897e-4970-9cbf-b6b317fbef0a tempest-AttachVolumeTestJSON-8354627 tempest-AttachVolumeTestJSON-8354627-project] 10.222.0.27 "GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2" status: 404 len: 111 microversion: 2.1 time: 0.029910 Jul 26 19:06:13.227979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2504/4509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:06:13 2022] GET /compute/v2.1/servers/99df3fd1-46e9-4842-9e60-b69d557d60c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:06:13.499685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-da4305e4-a7ef-40a8-8c68-2172f3827507 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:13.500818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-da4305e4-a7ef-40a8-8c68-2172f3827507 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:13.507534 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da4305e4-a7ef-40a8-8c68-2172f3827507 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:13.508314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da4305e4-a7ef-40a8-8c68-2172f3827507 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:13.509178 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da4305e4-a7ef-40a8-8c68-2172f3827507 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:13.509621 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-da4305e4-a7ef-40a8-8c68-2172f3827507 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:13.645072 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-da4305e4-a7ef-40a8-8c68-2172f3827507 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:06:13.652992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-da4305e4-a7ef-40a8-8c68-2172f3827507 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1507 microversion: 2.1 time: 0.158115 Jul 26 19:06:13.653560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2505/4510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:06:13 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:06:14.406414 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-209658fa-02a3-4b53-9152-0d1e865c8e2e req-aed950a0-f6ff-4d2d-9122-e320bf11051b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240d5470-7916-48a4-b90f-910c88d68384", "name": "network-vif-deleted", "tag": "e225f24a-f0f4-4283-af60-d533e1dd5c9d"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:06:14.417161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-209658fa-02a3-4b53-9152-0d1e865c8e2e req-aed950a0-f6ff-4d2d-9122-e320bf11051b service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:14.417553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-209658fa-02a3-4b53-9152-0d1e865c8e2e req-aed950a0-f6ff-4d2d-9122-e320bf11051b service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:14.428843 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-209658fa-02a3-4b53-9152-0d1e865c8e2e req-aed950a0-f6ff-4d2d-9122-e320bf11051b service nova] Creating event network-vif-deleted:e225f24a-f0f4-4283-af60-d533e1dd5c9d for instance 240d5470-7916-48a4-b90f-910c88d68384 on hv-cinder-82549 Jul 26 19:06:14.434253 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-209658fa-02a3-4b53-9152-0d1e865c8e2e req-aed950a0-f6ff-4d2d-9122-e320bf11051b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097669 Jul 26 19:06:14.434841 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2506/4511] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 19:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:06:14.674831 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4949cf59-a618-4dd9-aae6-819beb946357 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:14.675837 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4949cf59-a618-4dd9-aae6-819beb946357 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:14.686945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4949cf59-a618-4dd9-aae6-819beb946357 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:14.687384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4949cf59-a618-4dd9-aae6-819beb946357 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:14.688171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4949cf59-a618-4dd9-aae6-819beb946357 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:14.688605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4949cf59-a618-4dd9-aae6-819beb946357 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:15.162786 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-4949cf59-a618-4dd9-aae6-819beb946357 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:06:15.172023 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4949cf59-a618-4dd9-aae6-819beb946357 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1507 microversion: 2.1 time: 0.501914 Jul 26 19:06:15.172955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2507/4512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:06:14 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1507 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:06:15.836167 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-7efcbd0e-8d88-4ce3-b92d-6101a00a8edd req-2e2ec4a7-e885-4a1b-bb31-ed069e718570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8422a278-bb13-476d-9fed-a2ea1b310a91", "name": "network-vif-deleted", "tag": "15966349-d3d2-4cea-88a5-c2fb5f9aafe2"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:06:15.847865 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-7efcbd0e-8d88-4ce3-b92d-6101a00a8edd req-2e2ec4a7-e885-4a1b-bb31-ed069e718570 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:15.848377 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-7efcbd0e-8d88-4ce3-b92d-6101a00a8edd req-2e2ec4a7-e885-4a1b-bb31-ed069e718570 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:15.861667 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-7efcbd0e-8d88-4ce3-b92d-6101a00a8edd req-2e2ec4a7-e885-4a1b-bb31-ed069e718570 service nova] Creating event network-vif-deleted:15966349-d3d2-4cea-88a5-c2fb5f9aafe2 for instance 8422a278-bb13-476d-9fed-a2ea1b310a91 on hv-cinder-82549 Jul 26 19:06:15.866427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-7efcbd0e-8d88-4ce3-b92d-6101a00a8edd req-2e2ec4a7-e885-4a1b-bb31-ed069e718570 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093038 Jul 26 19:06:15.867057 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2508/4513] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 19:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:06:16.200422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-694acd73-27e4-46db-b179-4a96ccca17b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:16.201386 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-694acd73-27e4-46db-b179-4a96ccca17b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:16.208884 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-694acd73-27e4-46db-b179-4a96ccca17b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:16.209585 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-694acd73-27e4-46db-b179-4a96ccca17b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:16.210659 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-694acd73-27e4-46db-b179-4a96ccca17b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:16.211270 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-694acd73-27e4-46db-b179-4a96ccca17b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:16.364867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-694acd73-27e4-46db-b179-4a96ccca17b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:06:16.374873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-694acd73-27e4-46db-b179-4a96ccca17b6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1465 microversion: 2.1 time: 0.183133 Jul 26 19:06:16.388301 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2509/4514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:06:16 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1465 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:06:17.418608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ba772ef8-aed0-4698-a126-6f7a97f9ef3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:17.423709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ba772ef8-aed0-4698-a126-6f7a97f9ef3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:17.431699 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba772ef8-aed0-4698-a126-6f7a97f9ef3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:17.432983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba772ef8-aed0-4698-a126-6f7a97f9ef3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:17.433911 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba772ef8-aed0-4698-a126-6f7a97f9ef3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:17.434814 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba772ef8-aed0-4698-a126-6f7a97f9ef3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:17.479755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba772ef8-aed0-4698-a126-6f7a97f9ef3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:17.480494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ba772ef8-aed0-4698-a126-6f7a97f9ef3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:17.481141 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.objects.instance [None req-ba772ef8-aed0-4698-a126-6f7a97f9ef3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lazy-loading 'fault' on Instance uuid 8422a278-bb13-476d-9fed-a2ea1b310a91 {{(pid=117996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:06:17.524018 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ba772ef8-aed0-4698-a126-6f7a97f9ef3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:06:17.532087 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ba772ef8-aed0-4698-a126-6f7a97f9ef3b tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 200 len: 1311 microversion: 2.1 time: 0.136172 Jul 26 19:06:17.532924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2510/4515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:06:17 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 1311 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:06:18.264934 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-acd4931a-1dfb-42cc-bd9e-3bc99f84a72d req-3d264b7d-6040-4a27-94fd-52c6ae6d3ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ada35c-e092-41a1-a9c4-2177b7e8ae31", "name": "network-vif-deleted", "tag": "249fd822-02ca-4f9a-bf6e-53fdc2629e85"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:06:18.274710 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-acd4931a-1dfb-42cc-bd9e-3bc99f84a72d req-3d264b7d-6040-4a27-94fd-52c6ae6d3ed5 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:18.275316 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-acd4931a-1dfb-42cc-bd9e-3bc99f84a72d req-3d264b7d-6040-4a27-94fd-52c6ae6d3ed5 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:18.286665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-acd4931a-1dfb-42cc-bd9e-3bc99f84a72d req-3d264b7d-6040-4a27-94fd-52c6ae6d3ed5 service nova] Creating event network-vif-deleted:249fd822-02ca-4f9a-bf6e-53fdc2629e85 for instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 on hv-cinder-82549 Jul 26 19:06:18.291840 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-acd4931a-1dfb-42cc-bd9e-3bc99f84a72d req-3d264b7d-6040-4a27-94fd-52c6ae6d3ed5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030767 Jul 26 19:06:18.293069 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2511/4516] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 19:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:06:18.559328 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6f22047b-6c69-498e-85b9-a800c7fbe7a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:18.560508 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-6f22047b-6c69-498e-85b9-a800c7fbe7a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: 8422a278-bb13-476d-9fed-a2ea1b310a91] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:18.567314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f22047b-6c69-498e-85b9-a800c7fbe7a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:18.568136 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f22047b-6c69-498e-85b9-a800c7fbe7a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:18.569110 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f22047b-6c69-498e-85b9-a800c7fbe7a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:18.569679 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-6f22047b-6c69-498e-85b9-a800c7fbe7a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:18.584562 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-6f22047b-6c69-498e-85b9-a800c7fbe7a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] HTTP exception thrown: Instance 8422a278-bb13-476d-9fed-a2ea1b310a91 could not be found. Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6f22047b-6c69-498e-85b9-a800c7fbe7a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Request method failure captured: Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 HTTP/1.1 Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJjI9s6qbx1uWj8Nh66RGFe9XimgHtp2LwzuRf32bwhuJGkOcImrFPHTXWz9VlFKeYvhELtnyHFrl8Fiy_hnmeqfO-iBWzE616j4e4cR9PoNFd2DwrMhNI8UyNEmjYxg5IbFeBWPPU2AsHoRn9xmyr-3O8gVOXj23V9PZ_Y1nWusfI Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: e9c0885f4de641028b1e194802620fbc Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593014913 Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:18.586240 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:18.587664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e9c0885f4de641028b1e194802620fbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e9c0885f4de641028b1e194802620fbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9c0885f4de641028b1e194802620fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9c0885f4de641028b1e194802620fbc"}]}] Jul 26 19:06:18.587664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593014913 Jul 26 19:06:18.587664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: e9c0885f4de641028b1e194802620fbc Jul 26 19:06:18.587664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593014913 Jul 26 19:06:18.587664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-ServerRescueNegativeTestJSON-593014913-project Jul 26 19:06:18.587664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:18.587664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:18.587664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 43205ac588bc432fb8c9628fba37d445 Jul 26 19:06:18.587664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593014913-project Jul 26 19:06:18.587664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:06:18.587664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 8422a278-bb13-476d-9fed-a2ea1b310a91 could not be found. Jul 26 19:06:18.587664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '8422a278-bb13-476d-9fed-a2ea1b310a91'} Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8422a278-bb13-476d-9fed-a2ea1b310a91 could not be found. Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:18.591393 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8422a278-bb13-476d-9fed-a2ea1b310a91 could not be found. Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8422a278-bb13-476d-9fed-a2ea1b310a91 could not be found. Jul 26 19:06:18.592720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.594128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-6f22047b-6c69-498e-85b9-a800c7fbe7a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Returning 404 to user: Instance 8422a278-bb13-476d-9fed-a2ea1b310a91 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:18.594128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-6f22047b-6c69-498e-85b9-a800c7fbe7a6 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91" status: 404 len: 111 microversion: 2.1 time: 0.035678 Jul 26 19:06:18.594128 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2512/4517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:06:18 2022] GET /compute/v2.1/servers/8422a278-bb13-476d-9fed-a2ea1b310a91 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:06:18.747208 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-730eb5cd-0f8d-4333-ba91-4b9bebaf576f tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Action: 'create', calling method: .version_select at 0x7f390a1169d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-58774403", "metadata": {"Type": "work"}}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-730eb5cd-0f8d-4333-ba91-4b9bebaf576f tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Request method failure captured: Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 120 Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DsqAMh9DYqv6xXiTSbN7AYiKTvK1OE4ferZ-74m4ympPDT9boFschqIHYluvf0bFbuMQgcB0sMx8kmgvGQrDaDykCZpc4lzstD4hzUW0ObGn3so8LQDCqvsj8kENJYcVqQ3s_UOoi2CogrLRkXb_lqQO0i75a9NQ8vBj6xkuBPtf5w Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 688835657ca148a1bf72402f1e5732c8 Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:18.771321 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:18.772759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/688835657ca148a1bf72402f1e5732c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_688835657ca148a1bf72402f1e5732c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/688835657ca148a1bf72402f1e5732c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/688835657ca148a1bf72402f1e5732c8"}]}] Jul 26 19:06:18.772759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:18.772759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 688835657ca148a1bf72402f1e5732c8 Jul 26 19:06:18.772759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:18.772759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesNegativeTest-1597520221-project Jul 26 19:06:18.772759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:18.772759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:18.772759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: b654a3335d164d63937e4ea6d33fd60f Jul 26 19:06:18.772759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesNegativeTest-1597520221-project Jul 26 19:06:18.772759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Jul 26 19:06:18.772759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-58774403", "metadata": {"Type": "work"}}} Jul 26 19:06:18.772759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: Jul 26 19:06:18.772759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-58774403', 'metadata': {'Type': 'work'}}}} Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi '#$%' Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:18.773611 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:06:18.775075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:06:18.776162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 19:06:18.776162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.776162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-730eb5cd-0f8d-4333-ba91-4b9bebaf576f tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:18.776162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-730eb5cd-0f8d-4333-ba91-4b9bebaf576f tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.184410 Jul 26 19:06:18.776162 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2513/4518] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Jul 26 19:06:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:06:18.780198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ae992809-6388-43b7-81c6-953d6ef9630e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:18.780678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ae992809-6388-43b7-81c6-953d6ef9630e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:18.795426 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae992809-6388-43b7-81c6-953d6ef9630e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:18.795992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae992809-6388-43b7-81c6-953d6ef9630e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:18.796770 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae992809-6388-43b7-81c6-953d6ef9630e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:18.797201 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ae992809-6388-43b7-81c6-953d6ef9630e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:18.827475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ae992809-6388-43b7-81c6-953d6ef9630e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Going to try to terminate instance {{(pid=117996) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:06:18.901493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ae992809-6388-43b7-81c6-953d6ef9630e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 204 len: 0 microversion: 2.1 time: 0.124723 Jul 26 19:06:18.902071 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2514/4519] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 19:06:18 2022] DELETE /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 19:06:18.907179 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fef2d22f-7560-4ddb-9f1e-0a315cd135ec tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Action: 'create', calling method: .version_select at 0x7f390a2ae3a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-23414609", "metadata": {"Type": "work"}}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fef2d22f-7560-4ddb-9f1e-0a315cd135ec tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Request method failure captured: Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 118 Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DsqAMh9DYqv6xXiTSbN7AYiKTvK1OE4ferZ-74m4ympPDT9boFschqIHYluvf0bFbuMQgcB0sMx8kmgvGQrDaDykCZpc4lzstD4hzUW0ObGn3so8LQDCqvsj8kENJYcVqQ3s_UOoi2CogrLRkXb_lqQO0i75a9NQ8vBj6xkuBPtf5w Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 688835657ca148a1bf72402f1e5732c8 Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:18.910851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:18.912410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/688835657ca148a1bf72402f1e5732c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_688835657ca148a1bf72402f1e5732c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/688835657ca148a1bf72402f1e5732c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/688835657ca148a1bf72402f1e5732c8"}]}] Jul 26 19:06:18.912410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:18.912410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 688835657ca148a1bf72402f1e5732c8 Jul 26 19:06:18.912410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:18.912410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesNegativeTest-1597520221-project Jul 26 19:06:18.912410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:18.912410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:18.912410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: b654a3335d164d63937e4ea6d33fd60f Jul 26 19:06:18.912410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesNegativeTest-1597520221-project Jul 26 19:06:18.912410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Jul 26 19:06:18.912410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-23414609", "metadata": {"Type": "work"}}} Jul 26 19:06:18.912410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: Jul 26 19:06:18.912410 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-23414609', 'metadata': {'Type': 'work'}}}} Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi '0' Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:18.913183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:06:18.914388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:06:18.916123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 19:06:18.916123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:18.916123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fef2d22f-7560-4ddb-9f1e-0a315cd135ec tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:18.916123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fef2d22f-7560-4ddb-9f1e-0a315cd135ec tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009074 Jul 26 19:06:18.916123 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2515/4520] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Jul 26 19:06:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:06:18.918943 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-433a1203-1ad3-480d-84ff-2cbbb37f7faf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:18.919720 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-433a1203-1ad3-480d-84ff-2cbbb37f7faf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:18.926647 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-433a1203-1ad3-480d-84ff-2cbbb37f7faf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:18.927116 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-433a1203-1ad3-480d-84ff-2cbbb37f7faf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:18.927858 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-433a1203-1ad3-480d-84ff-2cbbb37f7faf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:18.928327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-433a1203-1ad3-480d-84ff-2cbbb37f7faf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:19.064241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-433a1203-1ad3-480d-84ff-2cbbb37f7faf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:06:19.075649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-433a1203-1ad3-480d-84ff-2cbbb37f7faf tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.161751 Jul 26 19:06:19.076556 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2516/4521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:06:18 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:06:19.081384 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-38447024-e781-4020-b04b-076f05b0ef01 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Action: 'create', calling method: .version_select at 0x7f39096405e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-692990864", "metadata": {"Type": "work"}}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-38447024-e781-4020-b04b-076f05b0ef01 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Request method failure captured: Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 118 Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DsqAMh9DYqv6xXiTSbN7AYiKTvK1OE4ferZ-74m4ympPDT9boFschqIHYluvf0bFbuMQgcB0sMx8kmgvGQrDaDykCZpc4lzstD4hzUW0ObGn3so8LQDCqvsj8kENJYcVqQ3s_UOoi2CogrLRkXb_lqQO0i75a9NQ8vBj6xkuBPtf5w Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 688835657ca148a1bf72402f1e5732c8 Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:19.085150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:19.086305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/688835657ca148a1bf72402f1e5732c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_688835657ca148a1bf72402f1e5732c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/688835657ca148a1bf72402f1e5732c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/688835657ca148a1bf72402f1e5732c8"}]}] Jul 26 19:06:19.086305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:19.086305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 688835657ca148a1bf72402f1e5732c8 Jul 26 19:06:19.086305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:19.086305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesNegativeTest-1597520221-project Jul 26 19:06:19.086305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:19.086305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:19.086305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: b654a3335d164d63937e4ea6d33fd60f Jul 26 19:06:19.086305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesNegativeTest-1597520221-project Jul 26 19:06:19.086305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Jul 26 19:06:19.086305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-692990864", "metadata": {"Type": "work"}}} Jul 26 19:06:19.086305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: Jul 26 19:06:19.086305 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-692990864', 'metadata': {'Type': 'work'}}}} Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise error Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi '' Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:19.086985 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 19:06:19.088303 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 19:06:19.089425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 19:06:19.089425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.089425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-38447024-e781-4020-b04b-076f05b0ef01 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:19.089425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-38447024-e781-4020-b04b-076f05b0ef01 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008784 Jul 26 19:06:19.089425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2517/4522] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Jul 26 19:06:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:06:19.100619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-16ed6c46-032c-44bf-9698-7cd2d61aff62 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Calling method '.version_select at 0x7f39097a7430>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:19.129416 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-16ed6c46-032c-44bf-9698-7cd2d61aff62 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] HTTP exception thrown: Volume tempest-invalid-1350775184 could not be found. Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-16ed6c46-032c-44bf-9698-7cd2d61aff62 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Request method failure captured: Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1350775184 HTTP/1.1 Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DsqAMh9DYqv6xXiTSbN7AYiKTvK1OE4ferZ-74m4ympPDT9boFschqIHYluvf0bFbuMQgcB0sMx8kmgvGQrDaDykCZpc4lzstD4hzUW0ObGn3so8LQDCqvsj8kENJYcVqQ3s_UOoi2CogrLRkXb_lqQO0i75a9NQ8vBj6xkuBPtf5w Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 688835657ca148a1bf72402f1e5732c8 Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:19.132688 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:19.134109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/688835657ca148a1bf72402f1e5732c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_688835657ca148a1bf72402f1e5732c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/688835657ca148a1bf72402f1e5732c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/688835657ca148a1bf72402f1e5732c8"}]}] Jul 26 19:06:19.134109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:19.134109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 688835657ca148a1bf72402f1e5732c8 Jul 26 19:06:19.134109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:19.134109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesNegativeTest-1597520221-project Jul 26 19:06:19.134109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:19.134109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:19.134109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: b654a3335d164d63937e4ea6d33fd60f Jul 26 19:06:19.134109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesNegativeTest-1597520221-project Jul 26 19:06:19.134109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: Jul 26 19:06:19.134109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Volume tempest-invalid-1350775184 could not be found. Jul 26 19:06:19.134109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': 'tempest-invalid-1350775184'} Jul 26 19:06:19.134109 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1350775184 could not be found. (HTTP 404) (Request-ID: req-8ab03b1f-df51-4eb3-b488-ba40386df8fa) Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:19.135005 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 19:06:19.136336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1350775184 could not be found. Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:06:19.137576 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1350775184 could not be found. Jul 26 19:06:19.139223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.139223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:19.139223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.139223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.139223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:19.139223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:19.139223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:06:19.139223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:06:19.139223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1350775184 could not be found. Jul 26 19:06:19.139223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.139223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-16ed6c46-032c-44bf-9698-7cd2d61aff62 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Returning 404 to user: Volume tempest-invalid-1350775184 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:19.139223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-16ed6c46-032c-44bf-9698-7cd2d61aff62 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1350775184" status: 404 len: 99 microversion: 2.1 time: 0.037343 Jul 26 19:06:19.139223 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2518/4523] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Jul 26 19:06:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1350775184 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 19:06:19.143650 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7a8db5e9-589b-4108-bd40-f9f7e0f9b711 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003560 Jul 26 19:06:19.144135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2519/4524] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Jul 26 19:06:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 26 19:06:19.152217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-78d195ed-582f-495a-b2a8-8fce7df9649a tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003417 Jul 26 19:06:19.152698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2520/4525] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Jul 26 19:06:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 26 19:06:19.160317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-59478235-596b-4834-8963-7f8e37404067 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Calling method '.version_select at 0x7f39097d9550>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:19.197245 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-59478235-596b-4834-8963-7f8e37404067 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] HTTP exception thrown: Volume db0ae96a-7948-4a84-9533-b8f4b936a0ae could not be found. Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-59478235-596b-4834-8963-7f8e37404067 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Request method failure captured: Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: DELETE /compute/v2.1/os-volumes/db0ae96a-7948-4a84-9533-b8f4b936a0ae HTTP/1.1 Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DsqAMh9DYqv6xXiTSbN7AYiKTvK1OE4ferZ-74m4ympPDT9boFschqIHYluvf0bFbuMQgcB0sMx8kmgvGQrDaDykCZpc4lzstD4hzUW0ObGn3so8LQDCqvsj8kENJYcVqQ3s_UOoi2CogrLRkXb_lqQO0i75a9NQ8vBj6xkuBPtf5w Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 688835657ca148a1bf72402f1e5732c8 Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:19.199387 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:19.200790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/688835657ca148a1bf72402f1e5732c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_688835657ca148a1bf72402f1e5732c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/688835657ca148a1bf72402f1e5732c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/688835657ca148a1bf72402f1e5732c8"}]}] Jul 26 19:06:19.200790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:19.200790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 688835657ca148a1bf72402f1e5732c8 Jul 26 19:06:19.200790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:19.200790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesNegativeTest-1597520221-project Jul 26 19:06:19.200790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:19.200790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:19.200790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: b654a3335d164d63937e4ea6d33fd60f Jul 26 19:06:19.200790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesNegativeTest-1597520221-project Jul 26 19:06:19.200790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: Jul 26 19:06:19.200790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Volume db0ae96a-7948-4a84-9533-b8f4b936a0ae could not be found. Jul 26 19:06:19.200790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': 'db0ae96a-7948-4a84-9533-b8f4b936a0ae'} Jul 26 19:06:19.200790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume db0ae96a-7948-4a84-9533-b8f4b936a0ae could not be found. (HTTP 404) (Request-ID: req-dc9f0680-7647-4ccc-9439-f8f2c4040a76) Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:19.201745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 19:06:19.202982 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume db0ae96a-7948-4a84-9533-b8f4b936a0ae could not be found. Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 19:06:19.204852 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume db0ae96a-7948-4a84-9533-b8f4b936a0ae could not be found. Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume db0ae96a-7948-4a84-9533-b8f4b936a0ae could not be found. Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-59478235-596b-4834-8963-7f8e37404067 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Returning 404 to user: Volume db0ae96a-7948-4a84-9533-b8f4b936a0ae could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-59478235-596b-4834-8963-7f8e37404067 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/db0ae96a-7948-4a84-9533-b8f4b936a0ae" status: 404 len: 109 microversion: 2.1 time: 0.043753 Jul 26 19:06:19.206746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2521/4526] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Jul 26 19:06:19 2022] DELETE /compute/v2.1/os-volumes/db0ae96a-7948-4a84-9533-b8f4b936a0ae => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:06:19.210685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-be1f43ff-9838-46d5-a5f5-ef3dabea0d96 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Calling method '.version_select at 0x7f390a1eedc0>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:19.239405 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-be1f43ff-9838-46d5-a5f5-ef3dabea0d96 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] HTTP exception thrown: Volume 6278ec0b-b242-4454-9787-9e5d0ce3bd69 could not be found. Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-be1f43ff-9838-46d5-a5f5-ef3dabea0d96 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Request method failure captured: Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/os-volumes/6278ec0b-b242-4454-9787-9e5d0ce3bd69 HTTP/1.1 Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DsqAMh9DYqv6xXiTSbN7AYiKTvK1OE4ferZ-74m4ympPDT9boFschqIHYluvf0bFbuMQgcB0sMx8kmgvGQrDaDykCZpc4lzstD4hzUW0ObGn3so8LQDCqvsj8kENJYcVqQ3s_UOoi2CogrLRkXb_lqQO0i75a9NQ8vBj6xkuBPtf5w Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 688835657ca148a1bf72402f1e5732c8 Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:19.241432 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:19.242751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/688835657ca148a1bf72402f1e5732c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_688835657ca148a1bf72402f1e5732c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/688835657ca148a1bf72402f1e5732c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/688835657ca148a1bf72402f1e5732c8"}]}] Jul 26 19:06:19.242751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:19.242751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 688835657ca148a1bf72402f1e5732c8 Jul 26 19:06:19.242751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesNegativeTest-1597520221 Jul 26 19:06:19.242751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesNegativeTest-1597520221-project Jul 26 19:06:19.242751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:19.242751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:19.242751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: b654a3335d164d63937e4ea6d33fd60f Jul 26 19:06:19.242751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesNegativeTest-1597520221-project Jul 26 19:06:19.242751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: Jul 26 19:06:19.242751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Volume 6278ec0b-b242-4454-9787-9e5d0ce3bd69 could not be found. Jul 26 19:06:19.242751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '6278ec0b-b242-4454-9787-9e5d0ce3bd69'} Jul 26 19:06:19.242751 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6278ec0b-b242-4454-9787-9e5d0ce3bd69 could not be found. (HTTP 404) (Request-ID: req-14da70f4-0ac6-4b2a-9473-7b3a6af3dfaa) Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:19.243693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:06:19.244758 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6278ec0b-b242-4454-9787-9e5d0ce3bd69 could not be found. Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 19:06:19.245725 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6278ec0b-b242-4454-9787-9e5d0ce3bd69 could not be found. Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6278ec0b-b242-4454-9787-9e5d0ce3bd69 could not be found. Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-be1f43ff-9838-46d5-a5f5-ef3dabea0d96 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] Returning 404 to user: Volume 6278ec0b-b242-4454-9787-9e5d0ce3bd69 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-be1f43ff-9838-46d5-a5f5-ef3dabea0d96 tempest-VolumesNegativeTest-1597520221 tempest-VolumesNegativeTest-1597520221-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6278ec0b-b242-4454-9787-9e5d0ce3bd69" status: 404 len: 109 microversion: 2.1 time: 0.036069 Jul 26 19:06:19.246744 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2522/4527] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 19:06:19 2022] GET /compute/v2.1/os-volumes/6278ec0b-b242-4454-9787-9e5d0ce3bd69 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:06:20.105199 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d0866754-d391-4661-92a4-ae6f2daa0d61 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:20.105936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-d0866754-d391-4661-92a4-ae6f2daa0d61 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:20.112362 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0866754-d391-4661-92a4-ae6f2daa0d61 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:20.112883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0866754-d391-4661-92a4-ae6f2daa0d61 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:20.113762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0866754-d391-4661-92a4-ae6f2daa0d61 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:20.114260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-d0866754-d391-4661-92a4-ae6f2daa0d61 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:20.269409 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-d0866754-d391-4661-92a4-ae6f2daa0d61 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:06:20.277075 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d0866754-d391-4661-92a4-ae6f2daa0d61 tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1522 microversion: 2.1 time: 0.176883 Jul 26 19:06:20.277635 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2523/4528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:06:20 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:06:20.312431 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-e70e3a46-bed6-4fb9-8c3e-3f5c387cf654 req-8fa92d2b-1680-41ee-b120-704a596660fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26b67fc-cc0a-41a7-8568-17f2eed10fb2", "name": "network-vif-deleted", "tag": "b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:06:20.325308 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-e70e3a46-bed6-4fb9-8c3e-3f5c387cf654 req-8fa92d2b-1680-41ee-b120-704a596660fc service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:20.325936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-e70e3a46-bed6-4fb9-8c3e-3f5c387cf654 req-8fa92d2b-1680-41ee-b120-704a596660fc service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:20.337028 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-e70e3a46-bed6-4fb9-8c3e-3f5c387cf654 req-8fa92d2b-1680-41ee-b120-704a596660fc service nova] Creating event network-vif-deleted:b5ee0a7a-1fae-45fc-81b7-d8743a15c1c2 for instance e26b67fc-cc0a-41a7-8568-17f2eed10fb2 on hv-cinder-82549 Jul 26 19:06:20.343673 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-e70e3a46-bed6-4fb9-8c3e-3f5c387cf654 req-8fa92d2b-1680-41ee-b120-704a596660fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035087 Jul 26 19:06:20.344780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2524/4529] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 19:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:06:21.202874 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-1f6170ec-a55f-4e4c-b2cf-a29d01deac3c req-7ddb0263-db3d-4052-928b-aae98956fe86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf94d62-c20e-42ae-9403-03100f038397", "name": "network-vif-deleted", "tag": "73091f36-aac1-4e25-a6ce-1b43c6c16961"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:06:21.213974 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-1f6170ec-a55f-4e4c-b2cf-a29d01deac3c req-7ddb0263-db3d-4052-928b-aae98956fe86 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:21.214442 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-1f6170ec-a55f-4e4c-b2cf-a29d01deac3c req-7ddb0263-db3d-4052-928b-aae98956fe86 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:21.227680 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-1f6170ec-a55f-4e4c-b2cf-a29d01deac3c req-7ddb0263-db3d-4052-928b-aae98956fe86 service nova] Creating event network-vif-deleted:73091f36-aac1-4e25-a6ce-1b43c6c16961 for instance fbf94d62-c20e-42ae-9403-03100f038397 on hv-cinder-82549 Jul 26 19:06:21.232848 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-1f6170ec-a55f-4e4c-b2cf-a29d01deac3c req-7ddb0263-db3d-4052-928b-aae98956fe86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034575 Jul 26 19:06:21.233446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2525/4530] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 19:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:06:21.298904 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7e236d3b-e7c6-44ff-b947-a09a2dcb83ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:21.299625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7e236d3b-e7c6-44ff-b947-a09a2dcb83ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:21.306143 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e236d3b-e7c6-44ff-b947-a09a2dcb83ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:21.306587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e236d3b-e7c6-44ff-b947-a09a2dcb83ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:21.307465 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e236d3b-e7c6-44ff-b947-a09a2dcb83ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:21.307925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7e236d3b-e7c6-44ff-b947-a09a2dcb83ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:21.378933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7e236d3b-e7c6-44ff-b947-a09a2dcb83ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43205ac588bc432fb8c9628fba37d445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c0885f4de641028b1e194802620fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:06:21.387268 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7e236d3b-e7c6-44ff-b947-a09a2dcb83ed tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 200 len: 1307 microversion: 2.1 time: 0.092876 Jul 26 19:06:21.388171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2526/4531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:06:21 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:06:22.382921 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-8aab214c-5bc4-4f9c-8782-b5a77edf1717 req-47d80e41-3720-439e-afd3-62c97b11e8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc78286d-d3af-46ed-bc61-506e92fe4a32", "name": "network-vif-deleted", "tag": "1c5926b1-929a-4b2c-83f3-7af9008eb43c"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:06:22.394774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-8aab214c-5bc4-4f9c-8782-b5a77edf1717 req-47d80e41-3720-439e-afd3-62c97b11e8d9 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:22.395241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-8aab214c-5bc4-4f9c-8782-b5a77edf1717 req-47d80e41-3720-439e-afd3-62c97b11e8d9 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:22.398959 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:06:22.407533 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-8aab214c-5bc4-4f9c-8782-b5a77edf1717 req-47d80e41-3720-439e-afd3-62c97b11e8d9 service nova] Creating event network-vif-deleted:1c5926b1-929a-4b2c-83f3-7af9008eb43c for instance fc78286d-d3af-46ed-bc61-506e92fe4a32 on hv-cinder-82549 Jul 26 19:06:22.412435 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-8aab214c-5bc4-4f9c-8782-b5a77edf1717 req-47d80e41-3720-439e-afd3-62c97b11e8d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035698 Jul 26 19:06:22.412999 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2527/4532] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 19:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:06:22.418317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ea38e534-2191-4944-a634-747f593e372e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:22.418979 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ea38e534-2191-4944-a634-747f593e372e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] [instance: fbf94d62-c20e-42ae-9403-03100f038397] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:06:22.426793 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea38e534-2191-4944-a634-747f593e372e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:22.427446 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea38e534-2191-4944-a634-747f593e372e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:22.428190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea38e534-2191-4944-a634-747f593e372e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:06:22.428616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ea38e534-2191-4944-a634-747f593e372e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:06:22.442419 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-ea38e534-2191-4944-a634-747f593e372e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] HTTP exception thrown: Instance fbf94d62-c20e-42ae-9403-03100f038397 could not be found. Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ea38e534-2191-4944-a634-747f593e372e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Request method failure captured: Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 HTTP/1.1 Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJjI9s6qbx1uWj8Nh66RGFe9XimgHtp2LwzuRf32bwhuJGkOcImrFPHTXWz9VlFKeYvhELtnyHFrl8Fiy_hnmeqfO-iBWzE616j4e4cR9PoNFd2DwrMhNI8UyNEmjYxg5IbFeBWPPU2AsHoRn9xmyr-3O8gVOXj23V9PZ_Y1nWusfI Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: e9c0885f4de641028b1e194802620fbc Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593014913 Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:22.444050 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:22.445511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e9c0885f4de641028b1e194802620fbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e9c0885f4de641028b1e194802620fbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9c0885f4de641028b1e194802620fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e9c0885f4de641028b1e194802620fbc"}]}] Jul 26 19:06:22.445511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593014913 Jul 26 19:06:22.445511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: e9c0885f4de641028b1e194802620fbc Jul 26 19:06:22.445511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593014913 Jul 26 19:06:22.445511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-ServerRescueNegativeTestJSON-593014913-project Jul 26 19:06:22.445511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:22.445511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:22.445511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 43205ac588bc432fb8c9628fba37d445 Jul 26 19:06:22.445511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593014913-project Jul 26 19:06:22.445511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:06:22.445511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance fbf94d62-c20e-42ae-9403-03100f038397 could not be found. Jul 26 19:06:22.445511 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': 'fbf94d62-c20e-42ae-9403-03100f038397'} Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf94d62-c20e-42ae-9403-03100f038397 could not be found. Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:22.446455 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf94d62-c20e-42ae-9403-03100f038397 could not be found. Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf94d62-c20e-42ae-9403-03100f038397 could not be found. Jul 26 19:06:22.447528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:22.448738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ea38e534-2191-4944-a634-747f593e372e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] Returning 404 to user: Instance fbf94d62-c20e-42ae-9403-03100f038397 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:22.448738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ea38e534-2191-4944-a634-747f593e372e tempest-ServerRescueNegativeTestJSON-593014913 tempest-ServerRescueNegativeTestJSON-593014913-project] 10.222.0.27 "GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397" status: 404 len: 111 microversion: 2.1 time: 0.031305 Jul 26 19:06:22.448738 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2528/4533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:06:22 2022] GET /compute/v2.1/servers/fbf94d62-c20e-42ae-9403-03100f038397 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:06:27.426988 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cc1c8071-18c3-4f9f-a015-2d2067a35911 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Action: 'create', calling method: .version_select at 0x7f390a116040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-894918404"}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:06:27.739665 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cc1c8071-18c3-4f9f-a015-2d2067a35911 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.434690 Jul 26 19:06:27.740560 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2529/4534] 10.222.0.27 () {60 vars in 1155 bytes} [Tue Jul 26 19:06:27 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 437 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 26 19:06:27.754168 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1b0f4232-27eb-4963-b6e0-ff03136cf50c tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f39096fdca0>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:27.809551 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1b0f4232-27eb-4963-b6e0-ff03136cf50c tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97" status: 200 len: 344 microversion: 2.1 time: 0.059326 Jul 26 19:06:27.810125 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2530/4535] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 19:06:27 2022] GET /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:06:28.823927 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f9227359-2b70-45da-bd54-3ae12f9fd006 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f390a1ee430>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:28.874375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f9227359-2b70-45da-bd54-3ae12f9fd006 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97" status: 200 len: 345 microversion: 2.1 time: 0.055029 Jul 26 19:06:28.875479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2531/4536] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 19:06:28 2022] GET /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:06:28.888924 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-47e09555-0518-44f9-8251-1ccbf9e8ba01 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Action: 'create', calling method: .version_select at 0x7f390dfb8ee0>, body: {"snapshot": {"volume_id": "b8b5101e-a230-4fbf-a706-60cc74aeae97", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-256265575"}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:06:29.045730 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-47e09555-0518-44f9-8251-1ccbf9e8ba01 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.160930 Jul 26 19:06:29.046342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2532/4537] 10.222.0.27 () {60 vars in 1162 bytes} [Tue Jul 26 19:06:28 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:06:29.058342 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-8dfdf993-50b7-4558-bd3c-d4a32921f4d9 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f39095c9e50>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:29.104618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-8dfdf993-50b7-4558-bd3c-d4a32921f4d9 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b" status: 200 len: 286 microversion: 2.1 time: 0.049728 Jul 26 19:06:29.104618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2533/4538] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Jul 26 19:06:29 2022] GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:06:29.115531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3296fd56-771b-47de-9ff8-21fae1961f3b tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f390a26db80>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:29.156812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3296fd56-771b-47de-9ff8-21fae1961f3b tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.044920 Jul 26 19:06:29.157452 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2534/4539] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Jul 26 19:06:29 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:06:29.170493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a0d1516f-7063-496e-8f4e-7c2a05abb0ea tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f390a271700>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:29.203160 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a0d1516f-7063-496e-8f4e-7c2a05abb0ea tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b" status: 200 len: 286 microversion: 2.1 time: 0.036787 Jul 26 19:06:29.203767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2535/4540] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Jul 26 19:06:29 2022] GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:06:30.216256 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-533ebbcb-b083-4d19-a8ad-6958d8cfe7f5 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f39096fdc10>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:30.246992 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-533ebbcb-b083-4d19-a8ad-6958d8cfe7f5 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b" status: 200 len: 286 microversion: 2.1 time: 0.035042 Jul 26 19:06:30.247652 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2536/4541] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Jul 26 19:06:30 2022] GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:06:31.260762 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4090b168-890b-47c1-90aa-1896244c0de0 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f390dfb8a60>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:31.291079 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4090b168-890b-47c1-90aa-1896244c0de0 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b" status: 200 len: 286 microversion: 2.1 time: 0.034991 Jul 26 19:06:31.291746 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2537/4542] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Jul 26 19:06:31 2022] GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:06:32.304553 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c52c346a-0845-416f-a6a4-12949a216925 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f39096fd940>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:32.334226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c52c346a-0845-416f-a6a4-12949a216925 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b" status: 200 len: 286 microversion: 2.1 time: 0.033991 Jul 26 19:06:32.334778 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2538/4543] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Jul 26 19:06:32 2022] GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:06:33.344236 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:06:33.344983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:06:33.349826 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7abd3a68-e944-4fbd-bc64-0a8e244f5c30 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f39095c9b80>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:33.381239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7abd3a68-e944-4fbd-bc64-0a8e244f5c30 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b" status: 200 len: 286 microversion: 2.1 time: 0.037986 Jul 26 19:06:33.381862 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2539/4544] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Jul 26 19:06:33 2022] GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:06:34.395054 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4308dfb0-3be9-4b8e-a428-9a61c313b437 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f390a12a280>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:34.427645 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4308dfb0-3be9-4b8e-a428-9a61c313b437 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b" status: 200 len: 287 microversion: 2.1 time: 0.037215 Jul 26 19:06:34.428209 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2540/4545] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Jul 26 19:06:34 2022] GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:06:34.439045 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-615afa95-93ef-4e66-84fd-7447912a108b tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f390a12af70>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:34.499628 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-615afa95-93ef-4e66-84fd-7447912a108b tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b" status: 202 len: 0 microversion: 2.1 time: 0.063934 Jul 26 19:06:34.500497 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2541/4546] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Jul 26 19:06:34 2022] DELETE /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:06:34.508225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-50976d65-4f10-4078-9929-a25f6f341ff7 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f39095c9820>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:34.539745 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-50976d65-4f10-4078-9929-a25f6f341ff7 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b" status: 200 len: 286 microversion: 2.1 time: 0.035094 Jul 26 19:06:34.540314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2542/4547] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Jul 26 19:06:34 2022] GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:06:35.553619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-39a3809e-f7f8-454a-9fd4-2f22471511e5 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f39096fd040>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:35.584774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-39a3809e-f7f8-454a-9fd4-2f22471511e5 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] HTTP exception thrown: Snapshot ccfa44f4-64dd-416c-b68d-aec36d24ce6b could not be found. Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-39a3809e-f7f8-454a-9fd4-2f22471511e5 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Request method failure captured: Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b HTTP/1.1 Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4Dsz61ZJ5WADnz_6SWNutBmUEhzOBaMuA3-JF89N4wcwA0Ung667dhhtvl-ZnqMZO6waLDrktvUChRagwpI5jWRZmfioWCsrTw02ox6PcY5Dr3gyQxMYj1usvSEtjPwMatO4JwIO8UzzGbYp8__1nq1beZ9uevNeTht0ABikA4F-Xkg Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: ae44c679221d4fd399ddb45834d47524 Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1407194375 Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:35.587289 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:35.588847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae44c679221d4fd399ddb45834d47524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae44c679221d4fd399ddb45834d47524"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae44c679221d4fd399ddb45834d47524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae44c679221d4fd399ddb45834d47524"}]}] Jul 26 19:06:35.588847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1407194375 Jul 26 19:06:35.588847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: ae44c679221d4fd399ddb45834d47524 Jul 26 19:06:35.588847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1407194375 Jul 26 19:06:35.588847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesSnapshotsTestJSON-1407194375-project Jul 26 19:06:35.588847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:35.588847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:35.588847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: fd9addf4d2cb45b1b4815401226236df Jul 26 19:06:35.588847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1407194375-project Jul 26 19:06:35.588847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: Jul 26 19:06:35.588847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Snapshot ccfa44f4-64dd-416c-b68d-aec36d24ce6b could not be found. Jul 26 19:06:35.588847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': 'ccfa44f4-64dd-416c-b68d-aec36d24ce6b'} Jul 26 19:06:35.588847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ccfa44f4-64dd-416c-b68d-aec36d24ce6b could not be found. (HTTP 404) (Request-ID: req-dd25c1d2-ce6e-465d-96c5-655ac305b495) Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:35.589955 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:06:35.591404 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ccfa44f4-64dd-416c-b68d-aec36d24ce6b could not be found. Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 26 19:06:35.592984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:06:35.594695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ccfa44f4-64dd-416c-b68d-aec36d24ce6b could not be found. Jul 26 19:06:35.594695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:35.594695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:35.594695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:35.594695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:35.594695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:35.594695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:35.594695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:06:35.594695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:06:35.594695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ccfa44f4-64dd-416c-b68d-aec36d24ce6b could not be found. Jul 26 19:06:35.594695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:35.594695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-39a3809e-f7f8-454a-9fd4-2f22471511e5 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Returning 404 to user: Snapshot ccfa44f4-64dd-416c-b68d-aec36d24ce6b could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:35.594695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-39a3809e-f7f8-454a-9fd4-2f22471511e5 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b" status: 404 len: 111 microversion: 2.1 time: 0.040250 Jul 26 19:06:35.596021 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2543/4548] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Jul 26 19:06:35 2022] GET /compute/v2.1/os-snapshots/ccfa44f4-64dd-416c-b68d-aec36d24ce6b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:06:35.598960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-04b8e088-b92b-4d11-8d50-13e3533f2908 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f390e03a790>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:35.677548 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-04b8e088-b92b-4d11-8d50-13e3533f2908 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97" status: 202 len: 0 microversion: 2.1 time: 0.083682 Jul 26 19:06:35.678129 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2544/4549] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Jul 26 19:06:35 2022] DELETE /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:06:35.686681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-23c69d58-7727-41f7-9350-550bff6ed3aa tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f39096fd5e0>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:35.750608 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-23c69d58-7727-41f7-9350-550bff6ed3aa tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97" status: 200 len: 344 microversion: 2.1 time: 0.067591 Jul 26 19:06:35.758739 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2545/4550] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 19:06:35 2022] GET /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97 => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:06:36.771589 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d5816bf9-9670-4aa2-8663-07ab629ac03a tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f39096df820>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-d5816bf9-9670-4aa2-8663-07ab629ac03a tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] HTTP exception thrown: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d5816bf9-9670-4aa2-8663-07ab629ac03a tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Request method failure captured: Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97 HTTP/1.1 Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4Dsz61ZJ5WADnz_6SWNutBmUEhzOBaMuA3-JF89N4wcwA0Ung667dhhtvl-ZnqMZO6waLDrktvUChRagwpI5jWRZmfioWCsrTw02ox6PcY5Dr3gyQxMYj1usvSEtjPwMatO4JwIO8UzzGbYp8__1nq1beZ9uevNeTht0ABikA4F-Xkg Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: ae44c679221d4fd399ddb45834d47524 Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1407194375 Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:36.806501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:36.807883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae44c679221d4fd399ddb45834d47524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae44c679221d4fd399ddb45834d47524"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae44c679221d4fd399ddb45834d47524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae44c679221d4fd399ddb45834d47524"}]}] Jul 26 19:06:36.807883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1407194375 Jul 26 19:06:36.807883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: ae44c679221d4fd399ddb45834d47524 Jul 26 19:06:36.807883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1407194375 Jul 26 19:06:36.807883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesSnapshotsTestJSON-1407194375-project Jul 26 19:06:36.807883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:36.807883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:36.807883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: fd9addf4d2cb45b1b4815401226236df Jul 26 19:06:36.807883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1407194375-project Jul 26 19:06:36.807883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: Jul 26 19:06:36.807883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.807883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': 'b8b5101e-a230-4fbf-a706-60cc74aeae97'} Jul 26 19:06:36.807883 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. (HTTP 404) (Request-ID: req-78db0c74-c436-41c4-8360-65e5aad1d134) Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:36.808799 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:06:36.810064 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 19:06:36.811281 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-d5816bf9-9670-4aa2-8663-07ab629ac03a tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Returning 404 to user: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-d5816bf9-9670-4aa2-8663-07ab629ac03a tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97" status: 404 len: 109 microversion: 2.1 time: 0.042481 Jul 26 19:06:36.812470 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2546/4551] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 19:06:36 2022] GET /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:06:36.819818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c5965d83-e15f-45b8-8314-543644148c22 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f390a2ae040>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:36.847233 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-c5965d83-e15f-45b8-8314-543644148c22 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] HTTP exception thrown: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c5965d83-e15f-45b8-8314-543644148c22 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Request method failure captured: Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: DELETE /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97 HTTP/1.1 Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4Dsz61ZJ5WADnz_6SWNutBmUEhzOBaMuA3-JF89N4wcwA0Ung667dhhtvl-ZnqMZO6waLDrktvUChRagwpI5jWRZmfioWCsrTw02ox6PcY5Dr3gyQxMYj1usvSEtjPwMatO4JwIO8UzzGbYp8__1nq1beZ9uevNeTht0ABikA4F-Xkg Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: ae44c679221d4fd399ddb45834d47524 Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1407194375 Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:36.849171 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:36.850625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae44c679221d4fd399ddb45834d47524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae44c679221d4fd399ddb45834d47524"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae44c679221d4fd399ddb45834d47524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae44c679221d4fd399ddb45834d47524"}]}] Jul 26 19:06:36.850625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1407194375 Jul 26 19:06:36.850625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: ae44c679221d4fd399ddb45834d47524 Jul 26 19:06:36.850625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1407194375 Jul 26 19:06:36.850625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesSnapshotsTestJSON-1407194375-project Jul 26 19:06:36.850625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:36.850625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:36.850625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: fd9addf4d2cb45b1b4815401226236df Jul 26 19:06:36.850625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1407194375-project Jul 26 19:06:36.850625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: Jul 26 19:06:36.850625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.850625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': 'b8b5101e-a230-4fbf-a706-60cc74aeae97'} Jul 26 19:06:36.850625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. (HTTP 404) (Request-ID: req-32813ee4-6545-430c-9c37-a8a104f6993e) Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:36.851500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 19:06:36.852687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 19:06:36.854093 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:06:36.855371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.855371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.855371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:36.855371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.855371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:36.855371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:36.855371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:36.855371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:06:36.855371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:06:36.855371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.855371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.855371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c5965d83-e15f-45b8-8314-543644148c22 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Returning 404 to user: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:36.855371 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c5965d83-e15f-45b8-8314-543644148c22 tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97" status: 404 len: 109 microversion: 2.1 time: 0.034479 Jul 26 19:06:36.856232 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2547/4552] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Jul 26 19:06:36 2022] DELETE /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:06:36.859135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-00201157-1e99-4424-b094-d84456f0fe8e tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Calling method '.version_select at 0x7f390a2ae8b0>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:06:36.886159 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-00201157-1e99-4424-b094-d84456f0fe8e tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] HTTP exception thrown: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-00201157-1e99-4424-b094-d84456f0fe8e tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Request method failure captured: Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97 HTTP/1.1 Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4Dsz61ZJ5WADnz_6SWNutBmUEhzOBaMuA3-JF89N4wcwA0Ung667dhhtvl-ZnqMZO6waLDrktvUChRagwpI5jWRZmfioWCsrTw02ox6PcY5Dr3gyQxMYj1usvSEtjPwMatO4JwIO8UzzGbYp8__1nq1beZ9uevNeTht0ABikA4F-Xkg Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: ae44c679221d4fd399ddb45834d47524 Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1407194375 Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:06:36.888464 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:06:36.889703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae44c679221d4fd399ddb45834d47524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae44c679221d4fd399ddb45834d47524"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae44c679221d4fd399ddb45834d47524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae44c679221d4fd399ddb45834d47524"}]}] Jul 26 19:06:36.889703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1407194375 Jul 26 19:06:36.889703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: ae44c679221d4fd399ddb45834d47524 Jul 26 19:06:36.889703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1407194375 Jul 26 19:06:36.889703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesSnapshotsTestJSON-1407194375-project Jul 26 19:06:36.889703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:06:36.889703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:06:36.889703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: fd9addf4d2cb45b1b4815401226236df Jul 26 19:06:36.889703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1407194375-project Jul 26 19:06:36.889703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: Jul 26 19:06:36.889703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.889703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': 'b8b5101e-a230-4fbf-a706-60cc74aeae97'} Jul 26 19:06:36.889703 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. (HTTP 404) (Request-ID: req-e8b256a2-f043-4135-b483-826566cad6c3) Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:36.890415 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:06:36.891782 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 19:06:36.892798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-00201157-1e99-4424-b094-d84456f0fe8e tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] Returning 404 to user: Volume b8b5101e-a230-4fbf-a706-60cc74aeae97 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-00201157-1e99-4424-b094-d84456f0fe8e tempest-VolumesSnapshotsTestJSON-1407194375 tempest-VolumesSnapshotsTestJSON-1407194375-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97" status: 404 len: 109 microversion: 2.1 time: 0.034844 Jul 26 19:06:36.894353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2548/4553] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 19:06:36 2022] GET /compute/v2.1/os-volumes/b8b5101e-a230-4fbf-a706-60cc74aeae97 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:07:14.421190 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:07:14.421987 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:07:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:07:22.529753 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:07:22.530747 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:07:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:07:34.624965 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:07:34.625825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 19:07:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 19:08:57.380844 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:08:57.382857 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 19:08:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 19:09:17.777639 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:09:17.778502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 19:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 19:09:26.554239 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:09:26.555127 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:09:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:10:11.890825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR oslo.messaging._drivers.impl_rabbit [-] [92383349-4637-4fd1-80e5-4998bd74f7ea] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 19:10:11.894945 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7259f97a-1421-45ca-af32-a03bc7761386 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:10:11.895728 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7259f97a-1421-45ca-af32-a03bc7761386 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:10:11.902327 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7259f97a-1421-45ca-af32-a03bc7761386 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:10:11.902779 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7259f97a-1421-45ca-af32-a03bc7761386 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:10:11.903662 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7259f97a-1421-45ca-af32-a03bc7761386 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:10:11.904102 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7259f97a-1421-45ca-af32-a03bc7761386 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:10:11.917618 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-7259f97a-1421-45ca-af32-a03bc7761386 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] HTTP exception thrown: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7259f97a-1421-45ca-af32-a03bc7761386 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Request method failure captured: Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: DELETE /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 HTTP/1.1 Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJsWS8A9HAyJSOVTJT17flGb4kpaWCMA85xUC-9zgYOdphF-MiXfRBd1LQnd9A0uPdlhXFTlinSO2Dj5DtNV3ZbMQEqYOL4YIPVzhEUtD1RS4fY8CxKc_YHfG0VuZMTcVDQLB_W5MwEqjpGdYEeUc_LRnzXuv-uaCZS4JU7mG5oER8 Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: b3955f1bf0e348ea85252259acb1b902 Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:10:11.919203 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:10:11.920689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3955f1bf0e348ea85252259acb1b902"}]}] Jul 26 19:10:11.920689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:10:11.920689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: b3955f1bf0e348ea85252259acb1b902 Jul 26 19:10:11.920689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:10:11.920689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeShelveTestJSON-774638063-project Jul 26 19:10:11.920689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:10:11.920689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:10:11.920689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 319c8a4be56b4fc2a00937f2fa36bcba Jul 26 19:10:11.920689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-774638063-project Jul 26 19:10:11.920689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:10:11.920689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:10:11.920689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '0cf4c176-65d7-4270-bed8-8f038aa47288'} Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:10:11.921453 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:10:11.922622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:11.923846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7259f97a-1421-45ca-af32-a03bc7761386 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Returning 404 to user: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:10:11.923846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7259f97a-1421-45ca-af32-a03bc7761386 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 404 len: 111 microversion: 2.20 time: 0.032077 Jul 26 19:10:11.923846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2549/4554] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Jul 26 19:10:11 2022] DELETE /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:10:11.928925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fc4e557b-c774-4e9e-bd83-24396cc26fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:10:11.929524 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-fc4e557b-c774-4e9e-bd83-24396cc26fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 0cf4c176-65d7-4270-bed8-8f038aa47288] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:10:11.935586 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc4e557b-c774-4e9e-bd83-24396cc26fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:10:11.936033 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc4e557b-c774-4e9e-bd83-24396cc26fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:10:11.936791 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc4e557b-c774-4e9e-bd83-24396cc26fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:10:11.937225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-fc4e557b-c774-4e9e-bd83-24396cc26fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:10:11.950375 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-fc4e557b-c774-4e9e-bd83-24396cc26fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] HTTP exception thrown: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fc4e557b-c774-4e9e-bd83-24396cc26fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Request method failure captured: Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 HTTP/1.1 Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJsWS8A9HAyJSOVTJT17flGb4kpaWCMA85xUC-9zgYOdphF-MiXfRBd1LQnd9A0uPdlhXFTlinSO2Dj5DtNV3ZbMQEqYOL4YIPVzhEUtD1RS4fY8CxKc_YHfG0VuZMTcVDQLB_W5MwEqjpGdYEeUc_LRnzXuv-uaCZS4JU7mG5oER8 Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: b3955f1bf0e348ea85252259acb1b902 Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:10:11.951937 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:10:11.953458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3955f1bf0e348ea85252259acb1b902"}]}] Jul 26 19:10:11.953458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:10:11.953458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: b3955f1bf0e348ea85252259acb1b902 Jul 26 19:10:11.953458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:10:11.953458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeShelveTestJSON-774638063-project Jul 26 19:10:11.953458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:10:11.953458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:10:11.953458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 319c8a4be56b4fc2a00937f2fa36bcba Jul 26 19:10:11.953458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-774638063-project Jul 26 19:10:11.953458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:10:11.953458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:10:11.953458 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '0cf4c176-65d7-4270-bed8-8f038aa47288'} Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:10:11.954369 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. Jul 26 19:10:11.955736 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:11.957204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-fc4e557b-c774-4e9e-bd83-24396cc26fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Returning 404 to user: Instance 0cf4c176-65d7-4270-bed8-8f038aa47288 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:10:11.957204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-fc4e557b-c774-4e9e-bd83-24396cc26fa2 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288" status: 404 len: 111 microversion: 2.20 time: 0.028191 Jul 26 19:10:11.957204 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2550/4555] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 19:10:11 2022] GET /compute/v2.1/servers/0cf4c176-65d7-4270-bed8-8f038aa47288 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 19:10:13.118097 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b8f5d194-881d-451e-9787-55e281fde409 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:10:13.118701 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-b8f5d194-881d-451e-9787-55e281fde409 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:10:13.126183 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8f5d194-881d-451e-9787-55e281fde409 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:10:13.126619 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8f5d194-881d-451e-9787-55e281fde409 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:10:13.127397 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8f5d194-881d-451e-9787-55e281fde409 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:10:13.127821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-b8f5d194-881d-451e-9787-55e281fde409 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:10:13.133855 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] [92383349-4637-4fd1-80e5-4998bd74f7ea] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39706. Jul 26 19:10:13.143632 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-b8f5d194-881d-451e-9787-55e281fde409 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] HTTP exception thrown: Instance 240d5470-7916-48a4-b90f-910c88d68384 could not be found. Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b8f5d194-881d-451e-9787-55e281fde409 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Request method failure captured: Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: DELETE /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 HTTP/1.1 Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJsWS8A9HAyJSOVTJT17flGb4kpaWCMA85xUC-9zgYOdphF-MiXfRBd1LQnd9A0uPdlhXFTlinSO2Dj5DtNV3ZbMQEqYOL4YIPVzhEUtD1RS4fY8CxKc_YHfG0VuZMTcVDQLB_W5MwEqjpGdYEeUc_LRnzXuv-uaCZS4JU7mG5oER8 Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: b3955f1bf0e348ea85252259acb1b902 Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:10:13.145105 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:10:13.146819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3955f1bf0e348ea85252259acb1b902"}]}] Jul 26 19:10:13.146819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:10:13.146819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: b3955f1bf0e348ea85252259acb1b902 Jul 26 19:10:13.146819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:10:13.146819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeShelveTestJSON-774638063-project Jul 26 19:10:13.146819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:10:13.146819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:10:13.146819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 319c8a4be56b4fc2a00937f2fa36bcba Jul 26 19:10:13.146819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-774638063-project Jul 26 19:10:13.146819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:10:13.146819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 240d5470-7916-48a4-b90f-910c88d68384 could not be found. Jul 26 19:10:13.146819 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '240d5470-7916-48a4-b90f-910c88d68384'} Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 240d5470-7916-48a4-b90f-910c88d68384 could not be found. Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:10:13.147713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 240d5470-7916-48a4-b90f-910c88d68384 could not be found. Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 240d5470-7916-48a4-b90f-910c88d68384 could not be found. Jul 26 19:10:13.149161 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:13.150867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-b8f5d194-881d-451e-9787-55e281fde409 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Returning 404 to user: Instance 240d5470-7916-48a4-b90f-910c88d68384 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:10:13.150867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-b8f5d194-881d-451e-9787-55e281fde409 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 404 len: 111 microversion: 2.20 time: 0.032695 Jul 26 19:10:13.150867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2551/4556] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Jul 26 19:10:13 2022] DELETE /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:10:13.154591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-837a7f3c-810e-4dc1-bec4-94213e629675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:10:13.155217 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-837a7f3c-810e-4dc1-bec4-94213e629675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] [instance: 240d5470-7916-48a4-b90f-910c88d68384] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:10:13.160983 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-837a7f3c-810e-4dc1-bec4-94213e629675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:10:13.161427 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-837a7f3c-810e-4dc1-bec4-94213e629675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:10:13.162170 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-837a7f3c-810e-4dc1-bec4-94213e629675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:10:13.162602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-837a7f3c-810e-4dc1-bec4-94213e629675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:10:13.175899 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-837a7f3c-810e-4dc1-bec4-94213e629675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] HTTP exception thrown: Instance 240d5470-7916-48a4-b90f-910c88d68384 could not be found. Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-837a7f3c-810e-4dc1-bec4-94213e629675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Request method failure captured: Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 HTTP/1.1 Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJsWS8A9HAyJSOVTJT17flGb4kpaWCMA85xUC-9zgYOdphF-MiXfRBd1LQnd9A0uPdlhXFTlinSO2Dj5DtNV3ZbMQEqYOL4YIPVzhEUtD1RS4fY8CxKc_YHfG0VuZMTcVDQLB_W5MwEqjpGdYEeUc_LRnzXuv-uaCZS4JU7mG5oER8 Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: b3955f1bf0e348ea85252259acb1b902 Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:10:13.177583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:10:13.179241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3955f1bf0e348ea85252259acb1b902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3955f1bf0e348ea85252259acb1b902"}]}] Jul 26 19:10:13.179241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:10:13.179241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: b3955f1bf0e348ea85252259acb1b902 Jul 26 19:10:13.179241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-774638063 Jul 26 19:10:13.179241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeShelveTestJSON-774638063-project Jul 26 19:10:13.179241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:10:13.179241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:10:13.179241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 319c8a4be56b4fc2a00937f2fa36bcba Jul 26 19:10:13.179241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeShelveTestJSON-774638063-project Jul 26 19:10:13.179241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:10:13.179241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 240d5470-7916-48a4-b90f-910c88d68384 could not be found. Jul 26 19:10:13.179241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '240d5470-7916-48a4-b90f-910c88d68384'} Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 240d5470-7916-48a4-b90f-910c88d68384 could not be found. Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:10:13.180225 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 240d5470-7916-48a4-b90f-910c88d68384 could not be found. Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 240d5470-7916-48a4-b90f-910c88d68384 could not be found. Jul 26 19:10:13.181590 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:10:13.182790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-837a7f3c-810e-4dc1-bec4-94213e629675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] Returning 404 to user: Instance 240d5470-7916-48a4-b90f-910c88d68384 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:10:13.182790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-837a7f3c-810e-4dc1-bec4-94213e629675 tempest-AttachVolumeShelveTestJSON-774638063 tempest-AttachVolumeShelveTestJSON-774638063-project] 10.222.0.27 "GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384" status: 404 len: 111 microversion: 2.20 time: 0.027869 Jul 26 19:10:13.182790 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2552/4557] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Jul 26 19:10:13 2022] GET /compute/v2.1/servers/240d5470-7916-48a4-b90f-910c88d68384 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 19:10:34.430750 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:10:34.431286 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:10:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:10:42.542789 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:10:42.543825 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:10:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:10:54.638587 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:10:54.639571 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 19:10:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 19:12:10.270336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3ddaea72-3db9-4cb8-adf3-2101effaec28 tempest-TestVolumeBootPattern-376576048 tempest-TestVolumeBootPattern-376576048-project] Calling method '.version_select at 0x7f390a2aef70>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:10.284221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=8 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:12:10.285210 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=8 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:12:10.306995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3ddaea72-3db9-4cb8-adf3-2101effaec28 tempest-TestVolumeBootPattern-376576048 tempest-TestVolumeBootPattern-376576048-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-933572589" status: 202 len: 0 microversion: 2.1 time: 0.042198 Jul 26 19:12:10.307602 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2553/4558] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Jul 26 19:12:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-933572589 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 19:12:10.771323 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4443b254-ee80-40bf-9482-39a7fc79c0ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:10.771881 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-4443b254-ee80-40bf-9482-39a7fc79c0ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:10.778867 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4443b254-ee80-40bf-9482-39a7fc79c0ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:10.779434 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4443b254-ee80-40bf-9482-39a7fc79c0ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:10.780235 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4443b254-ee80-40bf-9482-39a7fc79c0ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:10.780658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-4443b254-ee80-40bf-9482-39a7fc79c0ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:10.796568 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-4443b254-ee80-40bf-9482-39a7fc79c0ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] HTTP exception thrown: Instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 could not be found. Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4443b254-ee80-40bf-9482-39a7fc79c0ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Request method failure captured: Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: DELETE /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 HTTP/1.1 Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJoSQxtv8AwmMak-ApkBvAGOclo4VruA3O1ksriTQ-6wpon0S82Ytovbh7gPvY9VGGxzAgXUWiTbl5QGYG92BM1Znn6HEH2ee4X47ZQi-xr6Z5aM7IRi8fPr5rzuGUs2sNA27Ubz43AnXU59xT2N4VBOhhHlHD4N7kOEcCcjjtSB-I Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:12:10.798122 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:12:10.799591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_765e809e332e4a478e09be17e6b3c385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}] Jul 26 19:12:10.799591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:12:10.799591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:12:10.799591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:12:10.799591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:12:10.799591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:12:10.799591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:12:10.799591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 40f43a6429474c5e96db487ee85bbd84 Jul 26 19:12:10.799591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:12:10.799591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:12:10.799591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 could not be found. Jul 26 19:12:10.799591 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '62ada35c-e092-41a1-a9c4-2177b7e8ae31'} Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 could not be found. Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:12:10.800695 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 could not be found. Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 could not be found. Jul 26 19:12:10.802221 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:10.803765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-4443b254-ee80-40bf-9482-39a7fc79c0ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Returning 404 to user: Instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:12:10.803765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-4443b254-ee80-40bf-9482-39a7fc79c0ae tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "DELETE /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 404 len: 111 microversion: 2.1 time: 0.032742 Jul 26 19:12:10.803765 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2554/4559] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 19:12:10 2022] DELETE /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:12:10.807709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-695c4482-187c-47fe-a1b9-8dfe2b22e325 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:10.808306 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-695c4482-187c-47fe-a1b9-8dfe2b22e325 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] [instance: 62ada35c-e092-41a1-a9c4-2177b7e8ae31] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:10.814198 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-695c4482-187c-47fe-a1b9-8dfe2b22e325 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:10.814638 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-695c4482-187c-47fe-a1b9-8dfe2b22e325 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:10.815422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-695c4482-187c-47fe-a1b9-8dfe2b22e325 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:10.815847 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-695c4482-187c-47fe-a1b9-8dfe2b22e325 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:10.829399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-695c4482-187c-47fe-a1b9-8dfe2b22e325 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] HTTP exception thrown: Instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 could not be found. Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-695c4482-187c-47fe-a1b9-8dfe2b22e325 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Request method failure captured: Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 HTTP/1.1 Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DJoSQxtv8AwmMak-ApkBvAGOclo4VruA3O1ksriTQ-6wpon0S82Ytovbh7gPvY9VGGxzAgXUWiTbl5QGYG92BM1Znn6HEH2ee4X47ZQi-xr6Z5aM7IRi8fPr5rzuGUs2sNA27Ubz43AnXU59xT2N4VBOhhHlHD4N7kOEcCcjjtSB-I Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:12:10.830995 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:12:10.832531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_765e809e332e4a478e09be17e6b3c385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/765e809e332e4a478e09be17e6b3c385"}]}] Jul 26 19:12:10.832531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:12:10.832531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 765e809e332e4a478e09be17e6b3c385 Jul 26 19:12:10.832531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-201653783 Jul 26 19:12:10.832531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:12:10.832531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:12:10.832531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:12:10.832531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: 40f43a6429474c5e96db487ee85bbd84 Jul 26 19:12:10.832531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-AttachVolumeNegativeTest-201653783-project Jul 26 19:12:10.832531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:12:10.832531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 could not be found. Jul 26 19:12:10.832531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '62ada35c-e092-41a1-a9c4-2177b7e8ae31'} Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 could not be found. Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:12:10.833314 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 could not be found. Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 could not be found. Jul 26 19:12:10.834781 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:10.836015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-695c4482-187c-47fe-a1b9-8dfe2b22e325 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] Returning 404 to user: Instance 62ada35c-e092-41a1-a9c4-2177b7e8ae31 could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:12:10.836015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-695c4482-187c-47fe-a1b9-8dfe2b22e325 tempest-AttachVolumeNegativeTest-201653783 tempest-AttachVolumeNegativeTest-201653783-project] 10.222.0.27 "GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31" status: 404 len: 111 microversion: 2.1 time: 0.028364 Jul 26 19:12:10.836015 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2555/4560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:10 2022] GET /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:12:15.715902 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-af471783-6ca8-4a03-bc7c-939a8feecd3f tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] Action: 'create', calling method: .version_select at 0x7f39096fdf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1879478172", "metadata": {"Type": "work"}}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:12:16.194131 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-af471783-6ca8-4a03-bc7c-939a8feecd3f tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.617639 Jul 26 19:12:16.195812 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2556/4561] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Jul 26 19:12:15 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 620 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 26 19:12:16.208043 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-bfcf27c8-a8a1-4582-ba99-b35102576a55 tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] Calling method '.version_select at 0x7f390e0339d0>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:16.258471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-bfcf27c8-a8a1-4582-ba99-b35102576a55 tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b" status: 200 len: 353 microversion: 2.1 time: 0.054173 Jul 26 19:12:16.259357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2557/4562] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 19:12:16 2022] GET /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:12:17.277907 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f97de242-f4d3-477d-acd9-6850abbd405d tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] Calling method '.version_select at 0x7f390a12a3a0>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:17.350120 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f97de242-f4d3-477d-acd9-6850abbd405d tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b" status: 200 len: 354 microversion: 2.1 time: 0.079993 Jul 26 19:12:17.350987 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2558/4563] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 19:12:17 2022] GET /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:12:17.364326 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3651c244-6509-464e-9e45-b3ccf63ff8bf tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] Calling method '.version_select at 0x7f39096fd8b0>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:17.396017 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:12:17.396389 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 19:12:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b (ip 10.222.0.27) !!! Jul 26 19:12:17.444657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3651c244-6509-464e-9e45-b3ccf63ff8bf tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b" status: 200 len: 354 microversion: 2.1 time: 0.085567 Jul 26 19:12:17.445774 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2559/4564] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 19:12:17 2022] GET /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:12:17.464285 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-cbc0a4c1-2194-45e6-a9d0-7eaeceaf3632 tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] Calling method '.version_select at 0x7f39097a7940>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:17.530931 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-cbc0a4c1-2194-45e6-a9d0-7eaeceaf3632 tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b" status: 202 len: 0 microversion: 2.1 time: 0.071223 Jul 26 19:12:17.531634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2560/4565] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Jul 26 19:12:17 2022] DELETE /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 19:12:17.539388 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-30b58f68-8c16-4660-8dd7-6ee4f8db8918 tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] Calling method '.version_select at 0x7f390a419a60>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:17.594759 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-30b58f68-8c16-4660-8dd7-6ee4f8db8918 tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b" status: 200 len: 353 microversion: 2.1 time: 0.058939 Jul 26 19:12:17.595709 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2561/4566] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 19:12:17 2022] GET /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:12:18.611056 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ee6494c8-ebb4-4bd0-b514-14605e469df3 tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] Calling method '.version_select at 0x7f39096df550>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-ee6494c8-ebb4-4bd0-b514-14605e469df3 tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] HTTP exception thrown: Volume 6a150908-fff3-4f9d-8acb-5ef90b4ec55b could not be found. Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ee6494c8-ebb4-4bd0-b514-14605e469df3 tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] Request method failure captured: Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b HTTP/1.1 Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DyPFqptge7RH7n3P-UdvioHGtkvVlKGJwM4gMH8LzFYE6liwSf-ant5-dtwO9OZmoL-lsDJj0_bwMV6562GQgSLc-br5mU-lp_5E926PjPSc_G2qzkgcFiDQpwpzDlra9uyB9iDT5XGmQjvc-Kpp8eIyU9ve9vd0yJIM7uWs__I-DE Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: d5e85d304fd84f4daeb9fce18d198490 Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesGetTestJSON-1902778835 Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:12:18.646821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:12:18.648353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d5e85d304fd84f4daeb9fce18d198490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d5e85d304fd84f4daeb9fce18d198490"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e85d304fd84f4daeb9fce18d198490"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d5e85d304fd84f4daeb9fce18d198490"}]}] Jul 26 19:12:18.648353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesGetTestJSON-1902778835 Jul 26 19:12:18.648353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: d5e85d304fd84f4daeb9fce18d198490 Jul 26 19:12:18.648353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesGetTestJSON-1902778835 Jul 26 19:12:18.648353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesGetTestJSON-1902778835-project Jul 26 19:12:18.648353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:12:18.648353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:12:18.648353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: fdee7a4039e34db6a82776cc5f2701c4 Jul 26 19:12:18.648353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesGetTestJSON-1902778835-project Jul 26 19:12:18.648353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: Jul 26 19:12:18.648353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Volume 6a150908-fff3-4f9d-8acb-5ef90b4ec55b could not be found. Jul 26 19:12:18.648353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': '6a150908-fff3-4f9d-8acb-5ef90b4ec55b'} Jul 26 19:12:18.648353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6a150908-fff3-4f9d-8acb-5ef90b4ec55b could not be found. (HTTP 404) (Request-ID: req-367d2a2b-360c-486b-aa06-d0624628b78f) Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:12:18.649336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 19:12:18.650664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6a150908-fff3-4f9d-8acb-5ef90b4ec55b could not be found. Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 19:12:18.652366 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6a150908-fff3-4f9d-8acb-5ef90b4ec55b could not be found. Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6a150908-fff3-4f9d-8acb-5ef90b4ec55b could not be found. Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ee6494c8-ebb4-4bd0-b514-14605e469df3 tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] Returning 404 to user: Volume 6a150908-fff3-4f9d-8acb-5ef90b4ec55b could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ee6494c8-ebb4-4bd0-b514-14605e469df3 tempest-VolumesGetTestJSON-1902778835 tempest-VolumesGetTestJSON-1902778835-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b" status: 404 len: 109 microversion: 2.1 time: 0.039247 Jul 26 19:12:18.653678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2562/4567] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Jul 26 19:12:18 2022] GET /compute/v2.1/os-volumes/6a150908-fff3-4f9d-8acb-5ef90b4ec55b => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 19:12:37.789262 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:12:37.789942 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 19:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 19:12:46.250685 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:12:46.251549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=4 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:12:46.256666 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2005379019", "imageRef": "1289389f-ca80-44ad-bc6f-821f9e33f7f8", "flavorRef": "452"}} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:12:46.309933 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.network.neutron [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] validate_networks() for None {{(pid=117996) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 19:12:46.567788 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:12:46.568344 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:12:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:12:46.585811 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Flavor limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 19:12:46.586226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Image limits 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 19:12:46.586687 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Flavor pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 19:12:46.587081 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Image pref 0:0:0 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 19:12:46.587488 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.virt.hardware [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 19:12:46.597025 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:46.597486 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:46.598402 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:46.598882 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:46.616491 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Getting quotas for project 1dd7de8c2ca542ba8e0b2946680b43f0. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 19:12:46.620864 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.quota [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Getting quotas for user c36cbfbcf1bc4b0abda1a78b05cf3511 and project 1dd7de8c2ca542ba8e0b2946680b43f0. Resources: {'instances', 'ram', 'cores'} {{(pid=117996) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 19:12:46.632634 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Going to run 1 instances... {{(pid=117996) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 19:12:46.634901 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1289389f-ca80-44ad-bc6f-821f9e33f7f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117996) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 19:12:46.691803 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-1a0025c0-8748-46d5-a37c-83c4b4a20def tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.442128 Jul 26 19:12:46.692657 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2563/4568] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Jul 26 19:12:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 19:12:46.705356 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-c1f04451-7eac-4399-ab7d-f88475c3005a tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:46.705966 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-c1f04451-7eac-4399-ab7d-f88475c3005a tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:46.767664 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-c1f04451-7eac-4399-ab7d-f88475c3005a tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:12:46.774501 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-c1f04451-7eac-4399-ab7d-f88475c3005a tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1215 microversion: 2.1 time: 0.072931 Jul 26 19:12:46.775135 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2564/4569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:46 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:12:47.795718 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-2e11a520-e547-453f-a447-9adcf2b72482 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:47.796422 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-2e11a520-e547-453f-a447-9adcf2b72482 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:47.803868 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e11a520-e547-453f-a447-9adcf2b72482 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:47.804317 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e11a520-e547-453f-a447-9adcf2b72482 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:47.805080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e11a520-e547-453f-a447-9adcf2b72482 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:47.805512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-2e11a520-e547-453f-a447-9adcf2b72482 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:47.885353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-2e11a520-e547-453f-a447-9adcf2b72482 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:12:47.893890 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-2e11a520-e547-453f-a447-9adcf2b72482 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1275 microversion: 2.1 time: 0.102127 Jul 26 19:12:47.894539 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2565/4570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:47 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1275 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:12:48.915823 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-151f076d-29c6-4e26-af99-6f545ef59a4f tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:48.917088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-151f076d-29c6-4e26-af99-6f545ef59a4f tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:48.924007 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-151f076d-29c6-4e26-af99-6f545ef59a4f tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:48.924484 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-151f076d-29c6-4e26-af99-6f545ef59a4f tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:48.925249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-151f076d-29c6-4e26-af99-6f545ef59a4f tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:48.925681 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-151f076d-29c6-4e26-af99-6f545ef59a4f tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:49.149698 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-151f076d-29c6-4e26-af99-6f545ef59a4f tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:12:49.157780 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-151f076d-29c6-4e26-af99-6f545ef59a4f tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1315 microversion: 2.1 time: 0.245933 Jul 26 19:12:49.158353 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2566/4571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:48 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:12:49.637373 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-e5a9efd6-facd-4737-b775-c80927950a0f req-7492b4be-9d6c-4fb8-85bd-b316562e2198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e2c995-adf1-4b30-8322-daeb1b15b6ff", "tag": "b7a52fce-46b8-4f84-983d-ceed3f05ae45"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:12:49.647625 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-e5a9efd6-facd-4737-b775-c80927950a0f req-7492b4be-9d6c-4fb8-85bd-b316562e2198 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:49.647953 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-e5a9efd6-facd-4737-b775-c80927950a0f req-7492b4be-9d6c-4fb8-85bd-b316562e2198 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:49.662177 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-e5a9efd6-facd-4737-b775-c80927950a0f req-7492b4be-9d6c-4fb8-85bd-b316562e2198 service nova] Creating event network-changed:b7a52fce-46b8-4f84-983d-ceed3f05ae45 for instance c6e2c995-adf1-4b30-8322-daeb1b15b6ff on hv-cinder-82549 Jul 26 19:12:49.668531 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-e5a9efd6-facd-4737-b775-c80927950a0f req-7492b4be-9d6c-4fb8-85bd-b316562e2198 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173025 Jul 26 19:12:49.669513 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2567/4572] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 19:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 19:12:50.186515 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f1997a16-f2c5-457d-bc26-6f4aff0624bd tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:50.188357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f1997a16-f2c5-457d-bc26-6f4aff0624bd tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:50.200807 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1997a16-f2c5-457d-bc26-6f4aff0624bd tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:50.201545 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1997a16-f2c5-457d-bc26-6f4aff0624bd tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:50.202798 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1997a16-f2c5-457d-bc26-6f4aff0624bd tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:50.203563 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f1997a16-f2c5-457d-bc26-6f4aff0624bd tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:50.340425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f1997a16-f2c5-457d-bc26-6f4aff0624bd tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:12:50.348544 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f1997a16-f2c5-457d-bc26-6f4aff0624bd tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1315 microversion: 2.1 time: 0.171582 Jul 26 19:12:50.349113 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2568/4573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:50 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:12:51.373914 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-7dc8a2ea-6817-4307-90a4-91674bf40093 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:51.375009 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-7dc8a2ea-6817-4307-90a4-91674bf40093 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:51.385956 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dc8a2ea-6817-4307-90a4-91674bf40093 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:51.386429 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dc8a2ea-6817-4307-90a4-91674bf40093 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:51.387226 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dc8a2ea-6817-4307-90a4-91674bf40093 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:51.387993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-7dc8a2ea-6817-4307-90a4-91674bf40093 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:51.530760 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-7dc8a2ea-6817-4307-90a4-91674bf40093 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:12:51.538368 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-7dc8a2ea-6817-4307-90a4-91674bf40093 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1315 microversion: 2.1 time: 0.171004 Jul 26 19:12:51.538960 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2569/4574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:51 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:12:52.559957 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ff0170eb-9b27-4379-8b0b-650b4f143fae tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:52.560592 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ff0170eb-9b27-4379-8b0b-650b4f143fae tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:52.567346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff0170eb-9b27-4379-8b0b-650b4f143fae tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:52.567851 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff0170eb-9b27-4379-8b0b-650b4f143fae tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:52.568600 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff0170eb-9b27-4379-8b0b-650b4f143fae tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:52.569026 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ff0170eb-9b27-4379-8b0b-650b4f143fae tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:52.704336 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ff0170eb-9b27-4379-8b0b-650b4f143fae tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:12:52.715295 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ff0170eb-9b27-4379-8b0b-650b4f143fae tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1315 microversion: 2.1 time: 0.159035 Jul 26 19:12:52.716037 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2570/4575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:52 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:12:53.742724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ab5f438a-69d2-4226-ba99-14a55f13ce7e tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:53.742724 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ab5f438a-69d2-4226-ba99-14a55f13ce7e tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:53.748583 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab5f438a-69d2-4226-ba99-14a55f13ce7e tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:53.748936 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab5f438a-69d2-4226-ba99-14a55f13ce7e tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:53.749818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab5f438a-69d2-4226-ba99-14a55f13ce7e tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:53.750260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ab5f438a-69d2-4226-ba99-14a55f13ce7e tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:53.881290 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ab5f438a-69d2-4226-ba99-14a55f13ce7e tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:12:53.889190 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ab5f438a-69d2-4226-ba99-14a55f13ce7e tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1315 microversion: 2.1 time: 0.151859 Jul 26 19:12:53.889755 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2571/4576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:53 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:12:54.910731 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-338263ae-ea9b-4c91-a965-4017ebec2290 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:54.911428 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-338263ae-ea9b-4c91-a965-4017ebec2290 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:54.919002 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-338263ae-ea9b-4c91-a965-4017ebec2290 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:54.919479 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-338263ae-ea9b-4c91-a965-4017ebec2290 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:54.920242 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-338263ae-ea9b-4c91-a965-4017ebec2290 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:54.920676 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-338263ae-ea9b-4c91-a965-4017ebec2290 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:55.064506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-338263ae-ea9b-4c91-a965-4017ebec2290 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:12:55.072302 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-338263ae-ea9b-4c91-a965-4017ebec2290 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1315 microversion: 2.1 time: 0.166048 Jul 26 19:12:55.072879 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2572/4577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:54 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:12:55.796444 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-8e36b3a5-c891-4fe9-a8ba-340dcb00949a req-ddfe881f-5896-4b46-9412-b7fca9748ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e2c995-adf1-4b30-8322-daeb1b15b6ff", "name": "network-vif-plugged", "status": "completed", "tag": "b7a52fce-46b8-4f84-983d-ceed3f05ae45"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:12:55.806068 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-8e36b3a5-c891-4fe9-a8ba-340dcb00949a req-ddfe881f-5896-4b46-9412-b7fca9748ba0 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:55.806506 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-8e36b3a5-c891-4fe9-a8ba-340dcb00949a req-ddfe881f-5896-4b46-9412-b7fca9748ba0 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:55.817528 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-8e36b3a5-c891-4fe9-a8ba-340dcb00949a req-ddfe881f-5896-4b46-9412-b7fca9748ba0 service nova] Creating event network-vif-plugged:b7a52fce-46b8-4f84-983d-ceed3f05ae45 for instance c6e2c995-adf1-4b30-8322-daeb1b15b6ff on hv-cinder-82549 Jul 26 19:12:55.822514 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-8e36b3a5-c891-4fe9-a8ba-340dcb00949a req-ddfe881f-5896-4b46-9412-b7fca9748ba0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089291 Jul 26 19:12:55.823088 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2573/4578] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 19:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:12:56.094721 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-a84ccc36-6e94-4d4a-b86d-0cfa3170df0c tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:56.095447 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-a84ccc36-6e94-4d4a-b86d-0cfa3170df0c tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:56.101827 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a84ccc36-6e94-4d4a-b86d-0cfa3170df0c tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:56.102284 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a84ccc36-6e94-4d4a-b86d-0cfa3170df0c tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:56.103055 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a84ccc36-6e94-4d4a-b86d-0cfa3170df0c tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:56.103495 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-a84ccc36-6e94-4d4a-b86d-0cfa3170df0c tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:56.239648 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-a84ccc36-6e94-4d4a-b86d-0cfa3170df0c tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:12:56.249249 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-a84ccc36-6e94-4d4a-b86d-0cfa3170df0c tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1315 microversion: 2.1 time: 0.159297 Jul 26 19:12:56.249821 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2574/4579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:56 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:12:57.273967 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-ccf34b45-5aa9-4c4b-a6e3-29cd13552892 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:57.274993 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-ccf34b45-5aa9-4c4b-a6e3-29cd13552892 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:57.278188 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=2 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:12:57.279357 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell0:SELECT=8 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:12:57.290494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccf34b45-5aa9-4c4b-a6e3-29cd13552892 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:57.291166 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccf34b45-5aa9-4c4b-a6e3-29cd13552892 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:57.292420 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccf34b45-5aa9-4c4b-a6e3-29cd13552892 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:57.293073 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-ccf34b45-5aa9-4c4b-a6e3-29cd13552892 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:57.429086 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-ccf34b45-5aa9-4c4b-a6e3-29cd13552892 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:12:57.437274 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-ccf34b45-5aa9-4c4b-a6e3-29cd13552892 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1315 microversion: 2.1 time: 0.169855 Jul 26 19:12:57.437846 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2575/4580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:57 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:12:58.469351 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-012684a2-4e0e-4dba-a8be-1275c188c086 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:58.470478 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-012684a2-4e0e-4dba-a8be-1275c188c086 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:58.481244 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-012684a2-4e0e-4dba-a8be-1275c188c086 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:58.481693 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-012684a2-4e0e-4dba-a8be-1275c188c086 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:58.482459 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-012684a2-4e0e-4dba-a8be-1275c188c086 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:58.482892 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-012684a2-4e0e-4dba-a8be-1275c188c086 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:58.629500 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-012684a2-4e0e-4dba-a8be-1275c188c086 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:12:58.640288 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-012684a2-4e0e-4dba-a8be-1275c188c086 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1464 microversion: 2.1 time: 0.177547 Jul 26 19:12:58.640898 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2576/4581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:58 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1464 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:12:58.688272 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-3af48dac-7606-44b1-9b7a-ebeee09a25fb tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:58.688763 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3af48dac-7606-44b1-9b7a-ebeee09a25fb tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:58.695265 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3af48dac-7606-44b1-9b7a-ebeee09a25fb tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:58.695713 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3af48dac-7606-44b1-9b7a-ebeee09a25fb tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:58.696475 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3af48dac-7606-44b1-9b7a-ebeee09a25fb tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:58.696906 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-3af48dac-7606-44b1-9b7a-ebeee09a25fb tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:58.721825 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-3af48dac-7606-44b1-9b7a-ebeee09a25fb tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Going to try to terminate instance {{(pid=117996) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 19:12:58.812216 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-3af48dac-7606-44b1-9b7a-ebeee09a25fb tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 204 len: 0 microversion: 2.1 time: 0.127550 Jul 26 19:12:58.812829 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2577/4582] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Jul 26 19:12:58 2022] DELETE /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 19:12:58.822616 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-82996d09-ced6-4cd9-aa65-f3229ad5a288 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:12:58.823346 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-82996d09-ced6-4cd9-aa65-f3229ad5a288 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:12:58.829903 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82996d09-ced6-4cd9-aa65-f3229ad5a288 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:58.830364 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82996d09-ced6-4cd9-aa65-f3229ad5a288 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:58.831150 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82996d09-ced6-4cd9-aa65-f3229ad5a288 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:12:58.831604 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-82996d09-ced6-4cd9-aa65-f3229ad5a288 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:12:58.965885 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-82996d09-ced6-4cd9-aa65-f3229ad5a288 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:12:58.973923 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-82996d09-ced6-4cd9-aa65-f3229ad5a288 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1470 microversion: 2.1 time: 0.156513 Jul 26 19:12:58.974425 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2578/4583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:58 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 19:13:00.005658 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-f55ac3a5-7d7f-463f-94a9-d043ee9603c4 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:13:00.006649 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-f55ac3a5-7d7f-463f-94a9-d043ee9603c4 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:13:00.016053 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f55ac3a5-7d7f-463f-94a9-d043ee9603c4 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:13:00.016502 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f55ac3a5-7d7f-463f-94a9-d043ee9603c4 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:13:00.017260 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f55ac3a5-7d7f-463f-94a9-d043ee9603c4 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:13:00.017689 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-f55ac3a5-7d7f-463f-94a9-d043ee9603c4 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:13:00.148984 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-f55ac3a5-7d7f-463f-94a9-d043ee9603c4 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:13:00.160861 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-f55ac3a5-7d7f-463f-94a9-d043ee9603c4 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1470 microversion: 2.1 time: 0.161442 Jul 26 19:13:00.161719 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2579/4584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:12:59 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:13:00.872063 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [req-0365a834-f612-4495-b30d-8e0167d662be req-417e8d25-1f22-4c31-86a9-de6a45f58851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e2c995-adf1-4b30-8322-daeb1b15b6ff", "name": "network-vif-deleted", "tag": "b7a52fce-46b8-4f84-983d-ceed3f05ae45"}]} {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 19:13:00.883925 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-0365a834-f612-4495-b30d-8e0167d662be req-417e8d25-1f22-4c31-86a9-de6a45f58851 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:13:00.884355 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [req-0365a834-f612-4495-b30d-8e0167d662be req-417e8d25-1f22-4c31-86a9-de6a45f58851 service nova] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:13:00.897622 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.compute.server_external_events [req-0365a834-f612-4495-b30d-8e0167d662be req-417e8d25-1f22-4c31-86a9-de6a45f58851 service nova] Creating event network-vif-deleted:b7a52fce-46b8-4f84-983d-ceed3f05ae45 for instance c6e2c995-adf1-4b30-8322-daeb1b15b6ff on hv-cinder-82549 Jul 26 19:13:00.902818 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [req-0365a834-f612-4495-b30d-8e0167d662be req-417e8d25-1f22-4c31-86a9-de6a45f58851 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034438 Jul 26 19:13:00.903549 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2580/4585] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Jul 26 19:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 19:13:01.190238 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-686edaae-38f7-4d96-b845-a370a36f17d0 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:13:01.191239 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-686edaae-38f7-4d96-b845-a370a36f17d0 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:13:01.202493 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-686edaae-38f7-4d96-b845-a370a36f17d0 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:13:01.203294 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-686edaae-38f7-4d96-b845-a370a36f17d0 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:13:01.204532 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-686edaae-38f7-4d96-b845-a370a36f17d0 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:13:01.205241 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-686edaae-38f7-4d96-b845-a370a36f17d0 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:13:01.229981 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG dbcounter [-] [117996] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117996) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 19:13:01.244876 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-686edaae-38f7-4d96-b845-a370a36f17d0 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:13:01.245322 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-686edaae-38f7-4d96-b845-a370a36f17d0 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:13:01.245753 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.objects.instance [None req-686edaae-38f7-4d96-b845-a370a36f17d0 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lazy-loading 'fault' on Instance uuid c6e2c995-adf1-4b30-8322-daeb1b15b6ff {{(pid=117996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 19:13:01.292873 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.policy [None req-686edaae-38f7-4d96-b845-a370a36f17d0 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c36cbfbcf1bc4b0abda1a78b05cf3511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd7de8c2ca542ba8e0b2946680b43f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117996) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 19:13:01.300503 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-686edaae-38f7-4d96-b845-a370a36f17d0 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 200 len: 1305 microversion: 2.1 time: 0.117647 Jul 26 19:13:01.301080 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2581/4586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:13:01 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 1305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 19:13:02.326767 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-34afcf83-dc1c-4cc9-a0bf-104582f66171 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Calling method '>' {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 19:13:02.327512 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.compute.api [None req-34afcf83-dc1c-4cc9-a0bf-104582f66171 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] [instance: c6e2c995-adf1-4b30-8322-daeb1b15b6ff] Fetching instance by UUID {{(pid=117996) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 19:13:02.334536 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34afcf83-dc1c-4cc9-a0bf-104582f66171 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:13:02.334973 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34afcf83-dc1c-4cc9-a0bf-104582f66171 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:13:02.335748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34afcf83-dc1c-4cc9-a0bf-104582f66171 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 19:13:02.336176 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG oslo_concurrency.lockutils [None req-34afcf83-dc1c-4cc9-a0bf-104582f66171 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Lock "ed53b5a3-56b8-4096-ad1b-6bf0519db1d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117996) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 19:13:02.352605 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.wsgi [None req-34afcf83-dc1c-4cc9-a0bf-104582f66171 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] HTTP exception thrown: Instance c6e2c995-adf1-4b30-8322-daeb1b15b6ff could not be found. Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-34afcf83-dc1c-4cc9-a0bf-104582f66171 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Request method failure captured: Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: request: GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff HTTP/1.1 Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept: application/json Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Accept-Encoding: identity Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Connection: close Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Length: 0 Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Content-Type: application/json Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Host: 10.222.0.27 Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Openstack-System-Scope: None Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: User-Agent: python-urllib3/1.26.10 Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Auth-Token: gAAAAABi4DysHYe2_nRFsSnDf8BeJEIemuieOZ3-bXlBvaFM-6CKrLlXE3Co_eEpIcvPUID6McSRowzeJB89MfM7_ALVp5Rt9ee2gDag0k_B7ouxenj6ilxIoxTBlX-bxus-Xs94OF5wBv3HSeGwpmh9eXYhgnymCkLQI7vWC8i4M94ZSWbdSL0 Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Id: None Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Domain-Name: None Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Identity-Status: Confirmed Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Is-Admin-Project: True Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Id: default Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Domain-Name: Default Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Id: 1dd7de8c2ca542ba8e0b2946680b43f0 Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Project-Name: tempest-VolumesNegativeTest-2049239353 Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Role: reader,member Jul 26 19:13:02.354280 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Roles: reader,member Jul 26 19:13:02.355748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1dd7de8c2ca542ba8e0b2946680b43f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1dd7de8c2ca542ba8e0b2946680b43f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1dd7de8c2ca542ba8e0b2946680b43f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1dd7de8c2ca542ba8e0b2946680b43f0"}]}] Jul 26 19:13:02.355748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant: tempest-VolumesNegativeTest-2049239353 Jul 26 19:13:02.355748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Id: 1dd7de8c2ca542ba8e0b2946680b43f0 Jul 26 19:13:02.355748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-Tenant-Name: tempest-VolumesNegativeTest-2049239353 Jul 26 19:13:02.355748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User: tempest-VolumesNegativeTest-2049239353-project Jul 26 19:13:02.355748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Id: default Jul 26 19:13:02.355748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Domain-Name: Default Jul 26 19:13:02.355748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Id: c36cbfbcf1bc4b0abda1a78b05cf3511 Jul 26 19:13:02.355748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: X-User-Name: tempest-VolumesNegativeTest-2049239353-project Jul 26 19:13:02.355748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: method: > Jul 26 19:13:02.355748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: exception: Instance c6e2c995-adf1-4b30-8322-daeb1b15b6ff could not be found. Jul 26 19:13:02.355748 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: action_args: {'id': 'c6e2c995-adf1-4b30-8322-daeb1b15b6ff'} Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: {{(pid=117996) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e2c995-adf1-4b30-8322-daeb1b15b6ff could not be found. Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 19:13:02.356637 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e2c995-adf1-4b30-8322-daeb1b15b6ff could not be found. Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e2c995-adf1-4b30-8322-daeb1b15b6ff could not be found. Jul 26 19:13:02.358180 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: ERROR nova.api.openstack.wsgi Jul 26 19:13:02.359734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: DEBUG nova.api.openstack.wsgi [None req-34afcf83-dc1c-4cc9-a0bf-104582f66171 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] Returning 404 to user: Instance c6e2c995-adf1-4b30-8322-daeb1b15b6ff could not be found. {{(pid=117996) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 19:13:02.359734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO nova.api.openstack.requestlog [None req-34afcf83-dc1c-4cc9-a0bf-104582f66171 tempest-VolumesNegativeTest-2049239353 tempest-VolumesNegativeTest-2049239353-project] 10.222.0.27 "GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff" status: 404 len: 111 microversion: 2.1 time: 0.034553 Jul 26 19:13:02.359734 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: [pid: 117996|app: 0|req: 2582/4587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Jul 26 19:13:02 2022] GET /compute/v2.1/servers/c6e2c995-adf1-4b30-8322-daeb1b15b6ff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 19:13:54.441134 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:13:54.442072 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:13:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:14:02.555558 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:14:02.556581 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:14:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:15:37.407471 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:15:37.408473 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 19:15:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 19:15:57.798675 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:15:57.799399 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 19:15:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 19:16:06.576995 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:16:06.577739 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:16:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:17:14.454920 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:17:14.456079 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:17:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:17:22.568247 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:17:22.568933 dv-cinder-825492-31-iscsi devstack@n-api.service[117997]: Tue Jul 26 19:17:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62ada35c-e092-41a1-a9c4-2177b7e8ae31 (ip 10.222.0.27) !!! Jul 26 19:17:34.656678 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:17:34.657494 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 19:17:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 19:18:57.420331 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 19:18:57.421049 dv-cinder-825492-31-iscsi devstack@n-api.service[117996]: Tue Jul 26 19:18:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!